​​Number of instances when target users report the application of knowledge captured through reflection to inform decisions or to take corrective action

Indicator Number: 
63

Category: 

Logic Model Component: 

Data Type(s): 
Count, proportion
Short Definition: 

Refers to the use of knowledge in decision making while taking corrective action, or attempting to improve a project, program, or initiative

Definition and Explanation (Long): 

This indicator refers to the use of tacit and explicit knowledge in decision making while taking corrective action or attempting to improve an activity, such as a project, program, or initiative. It measures the use of actions or outputs from reflective learning sessions in decision making or practice, which may include work planning, requests for technical assistance, modifications in project implementation or management activities, data review meetings, or identification of additional project or program needs. It can apply to work-related decisions and practice at the project, program, initiative, or individual level.

Data Requirements: 

Quantitative and qualitative data from key informant interviews or focus group discussions to determine when decisions were made based on knowledge, information, or insights captured during reflection

Data Sources: 

Key informant interviews, focus group discussions, after action reviews

Frequency of Data Collection: 
Semiannually or after specific activities
Purpose: 
The aim of this indicator is to measure actions taken to put reflection and knowledge into practice within the project, program, or initiative. By asking open-ended questions, the indicator captures not just the number of instances that knowledge was used to inform decisions or take corrective action, but also the way it was used, how it was adapted, and how it was useful.
Issues and Challenges: 
Finding time for discussion and analysis can be challenging for a project, program, or initiative. This indicator is mostly used to evaluate the adaptive practices selected, not the program itself, which can result in a low prioritization of this indicator. Measuring this indicator should be carefully considered as it could require considerable level of effort. Whether projects will want/need to measure this is debatable, but it still is an important measure of the preparation and reflection that resulted from previous subcategories. Users may want to limit the actions taken from one specific adaptive practice, such as an after-action review, in order to make this indicator manageable. Qualitative data is strongly recommended.
Related Indicators: 
Indicators related to action such as decision making, policy, and practice (indicators 40 to 42), and users’ knowledge needs and feedback used to inform design and implementation of products and services (indicator 4)

Published Year: 

  • 2017
Last Updated Date: 
Wednesday, December 13, 2017