Advanced Auditing and Program Evaluation Methods

Purpose: The purpose of the training course is to introduce learners to evaluative methods and techniques that may be employed to inform decision makers about effectiveness, implementation, and improvement of program management for learning, research, and management systems. Duration: 2 Days. Scheduled class time is 8:00 to 5:00 PM. Training Overview: This course is intended for learners who have previously completed a course in internal auditing and have some experience performing audits. While auditing is about establishing conformity to requirements and agreed-upon criteria, evaluation is about making value judgements. Learners will be introduced to the methods for establishing evaluative conclusions about effectiveness, value, worth, level of improvement, and how good an evaluation object is. The concept of evaluation–specific logic and methodology as described by Michael Scriven, Jane Davidson, and others will be discussed and applied to program management with an emphasis on quality systems. An example discussion topic for the class will be clause 6.2.2 of the ISO 9001:2015 Standard in regard to competence, awareness, and training. Here the standard states that the organization will “evaluate the effectiveness of the actions taken.” During the course, learners will be engaged in a determination of how this might be accomplished and how an evaluative conclusion of “effective” might be established. Specific Key topics to be addressed: The purpose and importance of internal auditing and evaluation, How auditing and evaluation are alike and how they differ, Establishing evaluative criteria, Establishing standards of performance and sources of evidence, Data collection, synthesis and formation of value judgements, Using the results of evaluations (evaluation use), Scriven’s Key Evaluation Checklist, and Resources for additional study and application Hands-on training activities: Self-check and discussion sessions Group Activities involving tool and checklist development Training Objectives: Upon completion of the training the learner should be equipped to: o Define evaluation and specific evaluation terms o Explain the similarities and differences between an audit and an evaluation o Identify clauses in the ISO 9001:2015 standard that specifies a need for evaluation o List Scriven’s four steps in the logic of evaluation o Explain the purpose of an evaluation checklist o Explain the importance of evaluation utilization Resources: Textbook, class handouts and materials, and a certificate of completion will be included with the course.