Monitoring and Evaluation

Views:
 
Category: Education
     
 

Presentation Description

No description available.

Comments

Presentation Transcript

Introduction Monitoring and Evaluation :

Introduction Monitoring and Evaluation Dr. Ohan F. Yonan

PowerPoint Presentation:

Monitoring is the routine process of data collection and measurement of progress toward program objectives Evaluation is the use of specific study designs and special studies to measure the extent to which changes in desired outcomes are attributable to program’s intervention

Rational for M&E:

Rational for M&E M&E help to informed decisions regarding ongoing programs M&E ensure the most effective and efficient use of resources M&E determines exactly where a program is right on track and where changes need to be considered M&E helps stakeholders conclude whether the program is a success or otherwise M&E inform subsequent decisions about programs M&E preserves institutional memory

Monitoring :

Monitoring

Monitoring :

Monitoring Is an ongoing, continuous process; Requires the collection of data at multiple points throughout the program cycle, including at the beginning to provide a baseline; Can be used to determine if activities need adjustment during the intervention to improve desired outcomes.

Monitoring :

Monitoring Routine tracking of programs using input process and output data that are collected on a regular ongoing basis. Used to assess whether or not planned activities are carried out according to schedule Reveal the extent to which the program is progressing towards indentified targets and services are being utilized An abrupt or unexpected change in monitoring data may trigger the need for a more formal evaluation of the activities Sometimes called process evaluation when done periodically instead of routinely

Evaluation:

Evaluation

Evaluation:

Evaluation Evaluations require: Data collection at the start of a program (to provide a baseline) and again at the end, rather than at repeated intervals during program implementation; A control or comparison group in order to measure whether the changes in outcomes can be attributed to the program; A well-planned study design.

Training program components :

Training program components Inputs Processes Output Outcomes Impact Monitoring Evaluation Program level Population level Resources Staff , trainers , Space , Materials , equipment Activities Training Logistic Coordination Services % ministries offering training to staff % ministries with provincial training # trained staff Utilization # new staff enrolled # staff enrolled in advanced courses Intermediate % staff utilizing acquired skills # of ministry units with changes in system Long-term Improved ministry performance

Training program components :

Training program components Check to see if you know whether the following situations call for “monitoring” or “evaluation.” The National Council of Population and Development wants to know if the programs being carried out in province A are reducing unintended pregnancy among adolescents in that province. USAID wants to know how many sex workers have been reached by your program this year. A country director is interested in finding out if the post-abortion care provided in public clinics meets national standards of quality.

Monitoring and evaluation helps program implementers::

Monitoring and evaluation helps program implementers: make informed decisions regarding program operations and service delivery based on objective evidence; ensure the most effective and efficient use of resources; objectively assess the extent to which the program is having or has had the desired impact, in what areas it is effective, and where corrections need to be considered; and meet organizational reporting and other requirements, and convince donors that their investments have been worthwhile or that alternative approaches should be considered.

Level of effort required for M&E:

Level of effort required for M&E All Most Some Few MONITORING “ PROCESS EVALUATION ” EVALUATION “ EFFECTIVE EVALUATION ” Inputs Outputs Outcomes Impact Level of evaluation efforts Number of projects Resources Staff Funds Materials Facilities Supplies Training Materials availability Trained staff Quality of services Knowledge of best practice Short-term & intermediate effect Behavior changes Attitude changes Changes in units trend Increase in ministry support Long – term effect Changes in Training facility use Ministry systems of operation Increased service delivery

Why investment in M&V :

Why investment in M&V Strengthen program design and improve implementation Justify allocation of limited resources * improve use of allocated resources thereby increasing cost –effectiveness Generate knowledge * identify factors ( individual , community , programmatic ) that influence health outcomes Meet an organizational requirement

M&E:

M&E M&E is a continuous process that occurs throughout the life of a program, the budget should go toward M&E about 5-10% . To be most effective, M&E should be planned at the design stage of a program, with the time, money and personnel that will be required calculated and allocated in advance. Monitoring should be conducted at every stage of the program, with data collected, analyzed and used on a continuous basis. Evaluations are usually conducted at the end of programs. However, they should be planned for at the start because they rely on data collected throughout the program, with baseline data being especially important.

components of an M&E plan :

components of an M&E plan introduction program description and framework detailed description of the plan indicators data collection plan plan for monitoring plan for evaluation plan for the utilization of the information gained mechanism for updating the plan

introduction to the M&E plan :

introduction to the M&E plan information about the purpose of the program, the specific M&E activities that are needed and why they are important; and a development history that provides information about the motivations of the internal and external stakeholders and the extent of their interest, commitment and participation.

The program description :

The program description Problem statement The program goal ( broad statement ) The program objectives ( SMART ) The list of resources needed ( 5 type )

The program description :

The program description The Framework ( conceptual – result – logical – logic model ) Review program documents with stated goals and objectives Ensure that key factors that may influence program implementation and success are identified Achieve consensus among stakeholders

The program description :

The program description Indicators are clues, signs or markers that measure one aspect of a program and show how close a program is to its desired path and outcomes. SMART ( specific – measurable – achievable – relevant – time bounded ) Linked to M&E framework Useful for program decision-making Consistent with international standards and other reporting requirement ( as appropriate) Realistic to collect ( feasible )

The program description :

The program description Data sources are sources of information used to collect the data needed to calculate the indicators. The data collection plan should include diagrams depicting the systems used for data collection, processing, analysis and reporting. The strength of these systems determines the validity of the information obtained.

The program description :

The program description The monitoring plan describes: specific program components that will be monitored, such as provider performance or the utilization of resources; how this monitoring will be conducted; and the indicators that will be used to measure results.

The program description :

The program description The evaluation plan provides the specific research design and methodological approaches to be used to identify whether changes in outcomes can be attributed to the program.

PowerPoint Presentation:

Utility - ( الاداة ) serve practical information needs of intended users ماهي نوعية المعلومات المطلوبة او الخدمات وماذا تخدم ( what information need ) Feasibility – ( الجدوى ) be realistic , prudent , diplomatic and economical ( think about what we want to do and how we get the information واقعية قابلة للتطبيق وسهلة الحصول عليها اذن ماذا نحتاج ايضاً نحدد تكلفة المعلومات Standards for M&E plan

PowerPoint Presentation:

Propriety - ( النزاهة ) conducted legally , ethically and with regards to those involved in and affected by the evaluation Accuracy – ( الدقة ) reveal and convey technically accurate information المعلومات مفيدة اذا كانت دقيقة في بعض الاحيان نحتاج الى اكثر من مصدر لجمع المعلومات على ان لا يصبح Duplication Standards for M&E plan

PowerPoint Presentation:

Technical capacity for M&E M&E unit Strategically located individuals who are motivated , committed , competent and interested in M&E Scale of program funding and resources for M&E 5-10% of the resources devoted to M&E Cost related to data collection system and information dissemination Costs may be higher during the first year Other resources include indicator guides , manuals , communication tools Capacity and Resources for M&E

PowerPoint Presentation:

Remember that an M&E plan is a living document and needs to be adjusted when a program is modified

Group work:

Group work Inputs Processes Output Outcomes Impact Monitoring Evaluation Program level Population level Complete the framework above with concrete examples from your personal work areas

PowerPoint Presentation:

Thank you

authorStream Live Help