Slide 1: EVALUATION REPORT
Teaching & Learning Commons
Presentation Slide # 1 http://talc.ukzn.ac.za Slide 2: Purposes of Reporting
Type of Reports
Check list for an Evaluation Report Slide # 2 EVALUATION REPORT Major phases of an evaluation Outline of the Report
Presentation of conclusions and recommendations
Guidelines for report preparation http://talc.ukzn.ac.za Slide 3: PURPOSES OF REPORTING To Facilitate utilization of the findings of the Evaluation
To initiate making changes in the curriculum
To highlight the strengths and good (Exemplary) Aspects of the curriculum Slide # 3 http://talc.ukzn.ac.za Slide 4: TYPES OF REPORTS Oral report
Written report Slide # 4 (Permutation with AV Aids) http://talc.ukzn.ac.za Slide 5: ORAL REPORT Besides the written report, the evaluator should also present an oral report to those individuals responsible for decision marking
During such presentation the evaluator can also make use of a variety of Audio-visual aids
As the evaluator personally communicates the conclusions and recommendations to decision makers, (s)he can make necessary clarifications and provide supporting evidence to them. Slide # 5 http://talc.ukzn.ac.za Slide 6: (Format / outline / structure) Executive Summary: 2.1 Objectives of the curriculum
2.2 Description of Students
2.3 Description of programme staff
2.4 Description of the methods used for teaching and examining students
2.5 Review of evaluation of the programme, already conducted (if any) Contd. Slide # 6 1.1 Audiences of the report
1.2 Evaluation purposes / goals / objectives ORAL REPORT 1.0 Evaluation Objectives 2.0 Description of the Programme http://talc.ukzn.ac.za Slide 7: Slide # 7 (Format / outline / structure) ORAL REPORT 3.1 Sample
3.3 Data Analysis and Summarisation 3.0 Description of Evaluation Methodology 4.1 Results by activity
4.2 Results by issue
(Trend lines, indicators and comparisons) 4.0 Evaluation Outcomes or Results http://talc.ukzn.ac.za Slide 8: Slide # 8 APPENDICES (Format / outline / structure) ORAL REPORT 5.1 Conclusions
5.2 Recommendations from
5.3 Recommendations of the evaluator 5.0 Conclusions and Recommendations Programme participants
Programme staff http://talc.ukzn.ac.za Slide 9: EXECUTIVE SUMMARY: Evaluation objectives
Description of the Programme
Description of evaluation methodology
Evaluation outcomes or results
Conclusions and recommendations Slide # 9 EVALUATION REPORT http://talc.ukzn.ac.za Slide 10: PRESENTATION OF CONCLUSIONS AND RECOMMENDATIONS Conclusion is a statement of judgement, which has been based upon the systematic analysis of evaluative information / data.
The evaluator should also establish recommendations for those conclusions that indicate deficiencies. The recommendations must be explicit and give direction to the decision-makers for the remedy of identified deficiencies.
While citing evidences the identity of individuals who have provided the evaluative information should not be disclosed Slide # 10 http://talc.ukzn.ac.za Slide 11: ANNONYMITY The investigator does not know the respondent CONFIDENTIALITY The investigator knows the respondent but (s)he will not reveal that to others Slide # 11 http://talc.ukzn.ac.za Slide 12: EXAMPLE FORMAT FOR PRESENTING CONCLUSIONS AND RECOMMENDATIONS Slide # 12 http://talc.ukzn.ac.za Slide 13: GUIDELINES FOR PREPARATION OF EVALUATION REPORTS Contents, Length and nature / format of the report have to be negotiated between evaluators and clients
Style and language should be appropriate for the Intended Audience
Highlight the strengths as well as the weaknesses of the curriculum
Present your conclusions along with evidences and also Recommendations
Focus is Essential Contd. Slide # 13 http://talc.ukzn.ac.za Slide 14: Include “Quotations” which are significant
Maintain a balance between “Analysis” and “Description”
Include graphs, charts, diagrams, pictures and tables
Include in the appendix a copy of the Instruments used for data collection
Include an “Executive Summary” of the Report GUIDELINES FOR PREPARATION OF EVALUATION REPORTS Slide # 14 http://talc.ukzn.ac.za Slide 15: FOCUS Evaluators who try to include everything risk losing their readers in the sheer volume of the presentation. Hence focusing on important aspects is necessary.
Sufficient description and direct quotation should be included to allow the reader to enter into the situation and thoughts of the people represented in the report.
Description must be balanced by analysis and must lead into interpretation.
Include graphs, diagrams, pictures and tables in the report wherever possible. Slide # 15 http://talc.ukzn.ac.za Slide 16: CHECKLIST FOR AN EVALUATION REPORT Is the organisation and structure of the report clear, logical and inclusive?
Does contents of the report address the major purpose of the evaluation?
Are the evaluation methods and design adequately descried in the report?
Are the results clearly and objectively presented (too statistical, too terse, too much evaluator judgemental)?
Is the report appropriate for the intended audience?
Is the report written so that it is a guide for action? Slide # 16 http://talc.ukzn.ac.za Slide 17: MAJOR PHASES OF AN EVALUATION Negotiation and Translation from the “world of action” to the “world of scientific analysis”
Evaluation Design and Implementation
Translation into “World of Action” Slide # 17 http://talc.ukzn.ac.za Slide 18: Phase I: Negotiation and Translation from the “world of action” to the “world of scientific analysis” A. Who are the prominent and relevant audiences (public) in the “world of action” that are related to this programme?
B. Who is the client?
C. What are the client’s and audience’s expectations of the evaluation?
D. Do you have or can you obtain a description of the programme? Intents
outcomes Contd. Slide # 18 http://talc.ukzn.ac.za Slide 19: What are the major issues the clients and audiences wish to focus on?
Is your approach toward evaluation consistent with the client’s expectations?
Who will have ownership of the reports?
Will confidentiality of data be protected?
What resources (financial, administrative support, participant cooperation) are available and needed?
J. Are timelines and “deliverable dates” specified and understood?
K. What is to be the role of the evaluator? Slide # 19 Phase I: http://talc.ukzn.ac.za Slide 20: Phase II: Evaluation Design and Implementation What criteria are to be used to determine the value of the programme?
What types of evidence (information) will be collected (e.g., Judgements, descriptions)?
From whom will the evidence be collected, (e.g., multiple audiences, comparison groups)?
What instruments, methods, techniques will be used for collecting the information? Contd. Multiple Audiences
Comparison Groups Judgements
Descriptions Slide # 20 http://talc.ukzn.ac.za Slide 21: Phase II: What design for collecting the information will be used? (when will the data be collected?)
Who will collect the data?
How will the data be analyzed and synthesized?
Does the design allow for adjustments to allow for program changes and unanticipated effects? Slide # 21 Evaluation Design and Implementation http://talc.ukzn.ac.za Slide 22: Phase III: Translation into “World of Action” How will the information be summarized and portrayed?
What delivery modes (e.g. oral, written) will be used?
Who are the relevant audiences?
What will be included in the report?
What will be included in the report? Findings
Recommendations Slide # 22 http://talc.ukzn.ac.za Slide 23: Slide # 23 Thank you firstname.lastname@example.org http://talc.ukzn.ac.za