Challenges and opportunities of evaluating and assessing connected learning
Some of the approaches used for measuring learning in a traditional classroom can be difficult or impossible to apply in connected learning settings. For example,
Without mandatory assessments that are possible in formal learning settings, collecting information about individual learners can be more difficult
While teachers can assess a student throughout a school year, before-and-after or longitudinal assessment of individuals can be virtually impossible—especially with drop-in experiences[2]</sup>
Rigorous experimental designs are difficult because learners’ motivations, prior knowledge, and experiences can vary even more than they do in schools where students are grouped by age
Connected learning encompasses a broader definition of “learning,” and there may not be an existing instrument that can assess the impact of the learning experiences that you are providing to your teens
By definition, connected learning occurs across multiple contexts, not just at the library
These challenges are not insurmountable! They’re just unfamiliar—for now. Fortunately, connected learning initiatives also present opportunities to be creative and flexible in the ways you evaluate and assess them. Your approach can be tailored for your library’s unique situation and context. Some of these opportunities include:
You have the ability to conduct assessments that are shorter, more flexible, and on-the-fly
Assessments don’t have to be broad and all-encompassing; you can assess the impact or value of single visits to the library
Assessing connected learning can be an excellent opportunity to learn about the social aspects of learning and group dynamics of your youth
An evaluation can highlight an initiative’s value to a wide range of people, not just the immediate participants
Creating your own instrument can help you evaluate the unique characteristics of your program
Participants are more likely to give authentic feedback when they feel like they are being listened to, not tested
You can learn how your library impacts the other “connected” aspects of participants’ lives
By the end of this module, you will feel confident about evaluating and assessing connected learning and connected learning initiatives at your library.
PROGRAM EVALUATIONS FOR CONNECTED LEARNING
In this short trailer for his free online Program Evaluations for Connected Learning course, Dr. William Penuel from the University of Colorado at Boulder describes the class as well as some of the challenges and opportunities of evaluating connected learning programs.
ADDITIONAL RESOURCES
The Community Toolbox provides a detailed Introduction to Evaluation from a community development perspective.
For a deeper dive into evaluating connected learning programs, Program Evaluations for Connected Learning (William Penuel & Carrie Allen, 2016) is a free online course consisting of eight modules covering topics like "measuring and using implementation evidence" and “developing a theory of change to guide evaluation.”
BetterEvaluation is an extensive collection of information for every stage and aspect of evaluation.
IMLS (2015) has collected a list of Evaluation Resources from a variety of sources.
Evaluating and Assessing Informal Learning
See Chapter 6 of Surrounded by Science (Marilyn Fenichel & Heidi A. Schweingruber, 2010) for a discussion of “Assessing Learning Outcomes.”
The Principal Investigator’s Guide: Managing Evaluation in Informal STEM Education Project (CAISE, 2011) was written for NSF-funded projects, but it contains extensive advice and examples that are useful for any informal learning context.
Chapter 5 of Putting Teens First in Library Services: A Roadmap, (Linda Braun & Shannon Peterson, eds., 2017), discusses “Assessments and Outcome-Based Evaluation in Formal and Informal Learning Spaces.” (Chicago, IL: YALSA).
Chapters 5 through 10 of Framework for Evaluating Impacts of Informal Science Education Projects, edited by Alan J. Friedman for the National Science Foundation, discuss the challenges of evaluating particular types of informal learning experiences like exhibits or media productions.
InformalScience.org has a set of evaluation resources specifically designed for informal STEM learning.
Last updated