Lori A. Wingate, Ayesha S. Boyce, Lyssa Wilson Becho, and Kelly N. Robertson
Introduction
Diverse Voices in Evaluation
Shining a Light on One Early Black Evaluation Scholar: Leander Boykin’s Commentary on the Nature of Evaluation
Leander L. Boykin
Introduction Classic Piece: Let’s Eliminate the Confusion: What is Evaluation?
What Evaluation Is and Should Be
Part I. Evaluation is a distinct form of inquiry that is oriented to reaching judgments of merit, worth, or significance.
Lyssa Wilson Becho
Part I Introduction
Valuing as a Core Evaluation Concept
The Classic Writing on Valuing
Evolution of Valuing in Evaluation
This Book’s Contemporary Commentary on the Core Concept
Michael Scriven
Part I Classic Piece: The Nature of Evaluation
The Paradoxical Status of Evaluation
From Practice to Methodology to Discipline
Criteria for a New Discipline
The Emerging Discipline of Evaluation
The Key Problem: The Validation of Evaluations
The State of Current Practice in Program Evaluation
Why Does All This Matter?
Bianca Montrosse-Moorhead and Khalil Bitar
Chapter 1: Amending the Architectural Blueprints for Evaluation
Scriven’s Definition and Its Enduring Impact on Evaluation Scholarship and Practice
Our Argument for Amending the Definition of Evaluation to Include Ethics
The Practical-Moral Obligations of the Evaluation Discipline
Renovating the Evaluation Building
An Amended Definition of Evaluation
Implications of the Amended Definition of Evaluation
Ghislain Arbour
Chapter 2: Lack of Discipline: Answering Scriven’s Call for Value in (Program) Evaluation
Scriven’s Call for Evaluation: About Value, Through Transdiscipline
Call Unanswered: The Case of Program Evaluation
Returning the Call: Program Evaluation as a Discipline
Conclusion: Toward (Common) Transdisciplinarity After All
Lyssa Wilson Becho
Part I Reflection Guide
Part II. Engagement enhances the usefulness and relevance of evaluation.
Kelly N. Robertson
Part II Introduction
Engagement as a Core Evaluation Concept
The Classic Writing on Evaluation Engagement
Evolution of Evaluation Engagement
This Book’s Contemporary Commentary on the Core Concept
Carol Weiss
Part II Classic Piece: The Stakeholder Approach to Evaluation: Origins and Promise
Critiques Point the Way to Something New
Development of the Stakeholder Model
Promise of the Stakeholder Approach
The Stakeholder Approach in Action
Tatiana E. Bustos, Oyesola Oluwafunmilayo Ayeni, and Jessica S. Saucedo
Chapter 3: Evaluation Engagement: Historical Perspectives and New Directions With Community-Based Participatory Research (CBPR) Principles
Persistent Evaluation Challenges
Community-Based Participatory Action Research (CBPR) Principles
Sharon Attipoe-Dorcoo and Norma Martínez-Rubin
Chapter 4: I.M.P.A.C.T.: A Manumission Mindset and Other Engagement Approaches for Evaluation
Weiss’s Classic Writing and Its Relation to Evaluation as an Engagement Approach
Evolution of Engagement in Evaluation Practice
The IMPACT Framework and Engagement
IMPACT Framework Components and How to Apply Them to Community Engagement
Future of Evaluation Engagement for Manumitted Communities
Kelly N. Robertson
Part II Reflection Guide
Part III. Evaluation is inherently political.
Lori A. Wingate
Part III Introduction
Politics as a Core Evaluation Concept
The Classic Writing on the Inherently Political Nature of Evaluation
Evolution of the Framing of Politics in Evaluation
This Book’s Contemporary Commentary on Politics and Evaluation
Eleanor Chelimsky
Part III Classic Piece: What Have We Learned About the Politics of Program Evaluation?
Part 1: The Development of the Policy Question
Part 2: The Translation of the Policy Question Into an Evaluation Question
Part 3: The Translation of the Evaluation Question Into the Evaluation Proper
Part 4: The Translation of the Evaluation Findings Into Policy Answers That Respond to the Original Policy Question
Part 5: Use of the Evaluation Findings and the Generation of New Policy Questions
Jennifer Billman and Bagele Chilisia
Chapter 5: The Power and Politics of Knowledge Production in Program Evaluation: Funder, Methodological, and Pedagogical Colonialism
A Path Forward: Decolonization Through Program Evaluation
Rakesh Mohan
Chapter 6: Walking the Tightrope Between Independence and Responsiveness: Falling Off Is Not an Option
Evaluations Are Inherently Political
Chelimsky’s Five-Step Framework, Plus One, Is Needed to Manage Evaluation Politics
What Do People Familiar With the Policy Process and Evaluation Say About Evaluation Use and Politics?
Lori A. Wingate
Part III Reflection Guide
Part IV. Culturally responsive evaluation practice can lead to a more just society.
Ayesha S. Boyce
Part IV Introduction
Cultural Responsiveness and Justice as Core Evaluation Concepts
The Classic Writing on Cultural Responsiveness
Evolution of the Framing of Culture in Evaluation
This Book’s Contemporary Commentary on the Core Concept
Stafford Hood
Part IV Classic Piece: Responsive Evaluation Amistad Style: Perspectives of One African American Evaluator
Grettel Arias Orozco
Chapter 7: En Busca de las Voces Latinas in CRE: Reflections From a Program Evaluation Latina
Rethinking the Language and Terminologies
Complexity and Diversity of Latino/a/e/x Cultures
Promoting Awareness and Representation of Latino/a/e/x Evaluators
Deja Taylor, Sojourner White, Superior Murphy, Radaya Ellis, and monique liston
Chapter 8: Black Methodologies for Black Evaluators
Evaluator Connection to Hood
Culturally Responsive Evaluation (CRE)
Equitable Evaluation Framework (EEF)
Afrofuturist Evaluation (AFE)
Ayesha S. Boyce
Part IV Reflection Guide
Part V. Evaluation’s value is realized through its use and influence.
Ayesha S. Boyce
Part V Introduction
Use as a Core Evaluation Concept
The Classic Writing on Use
Evolution of the Framing of Use in Evaluation
Michael Quinn Patton
Part V Classic Piece: Utilization-Focused Evaluation
This Book’s Contemporary Commentary on the Core Concept
Utilization-Focused Evaluation
Jeremy Acree and Jill Chouinard
Chapter 9: Aims, Aspirations, and Consequences: Problematization at the Intersection of Culture and Evaluation Use
Utilization in Practice: An Empirical Perspective
Institutional Ethnography and Problematics
Intersections of Use and Culture
Caitlin A. Blaser Mapitsa and Mine Pabari
Chapter 10: Beyond the Project: Using Evaluation to Reimagine the Future in Africa
Evaluation and Use in Africa
Shifting From Useful to Transformative
Ayesha S. Boyce
Part V Reflection Guide
Part VI. Evaluation is a reflexive practice: Evaluation can and should be evaluated.
Lori A. Wingate
Part VI Introduction
Metaevaluation as a Core Evaluation Concept
The Classic Writing on Metaevaluation
Evolution of the Concept and Practice of Metaevaluation
This Book’s Contemporary Commentary on the Core Concept
Daniel L. Stufflebeam
Part VI Classic Piece: Metaevaluation
A Conceptualization of Metaevaluation
Paidamoyo Chikate, Satlaj Dighe, Padma Kannan, and John M. LaVelle
Chapter 11: Revisiting Metaevaluation Through the Perspectives of the Global South
Metaevaluation’s Origin and Development
Sociopolitical Contexts of the Global South
Reimagining Metaevaluation in the Global South
Tiffany Tovey and Libby Smith
Chapter 12: A New Story for Metaevaluation
What Is Reflective Practice?
Reflective Practice and Reflexivity in Evaluation
Reconceptualizing Metaevaluation for the New Story
Conclusion and Call to Action
Lori A. Wingate
Part VI Reflection Guide
References
Author Index
Subject Index