The evaluation design is based on three levels of programs: evidence-based, promising, or emerging.
- For evidence-based programs, the evaluation objective is to assess the extent to which a program is on track to produce long-term effects demonstrated by previous research. Programs are evaluated by monitoring interim outcomes using field-tested, validated instruments. Fidelity to the model is measured with a fidelity diagnostic tool. If the program is implemented with fidelity to the model and the interim outcomes are being achieved, it is anticipated that the longer term outcomes will be achieved.
- For promising and emerging programs, the evaluation objective is to strengthen the level of evidence to better demonstrate program effectiveness. These programs are evaluated using existing data sources and field-tested, validated instruments or custom tools.
Another component of the evaluation plan is systems-level evaluation, which is defined as "changes in organizational culture, policies and procedures within and across organizations that enhance or streamline access, and reduce or eliminate barriers to needed services by target populations." The evaluation design is organized around the Strategic Plan goal areas in which the Commission is seeking to achieve systems change: Family Support, Health and Healthy Development, and Early Care and Education.
Systems-level evaluation will measure progress toward sustainable systems change in four core outcome areas:
- Improved quality of services
- Increased access to services
- Enhanced efficiency of services
- Increased consumer/community empowerment
Evaluation results will be shared through program evaluation briefs and more in-depth reports for promising and emerging programs. Aggregate data will be compiled into a document which will reflect the impact of the Commission’s investments.
Plan to Evaluate Impact of 2011-15 Strategic Plan (PDF)