Program Evaluation Plan - MDDE 617 in Profile view

Nurani Savitri's Journal / Nurani Savitri's Journal /
Program Evaluation Plan - MDDE 617

Evaluation is a crucial component in interdisciplinary fields, particularly in distance education. Throughout the semester, I gained valuable insights into program evaluation theories, methodologies, approaches, and applications. One of the key takeaways from this course was the critical importance of using flexible evaluation frameworks tailored to dynamic environments and capable of rapidly adapting to key audience needs. 

Throughout this course, we engaged in various assignments that allowed us to practice applying different evaluation methods and forms. By studying numerous evaluation models and techniques, I've gained a deeper understanding of how to apply and combine them effectively based on specific case requirements. This experience has undoubtedly reinforced the importance of extensive practice in evaluating educational programs.

For Assignment 3, I utilized Kirkpatrick's four-level model and participant-focused approaches. In the group assignment, we employed an interactive form with a specific emphasis on Responsive evaluation. This exercise proved invaluable for enhancing my understanding of program evaluation methodologies.

The final assignment of this course required creating an evaluation plan based on the provided case study, Ithika University's Instructional Design Diploma (IDD) Program.  This is a very comprehensive exercise as we had to include the evaluand, the purpose, the client and primary audiences, the evaluation resources, the focus, the model and/or form, the key questions, the preliminary standards and criteria, data management, dissemination plan, codes of behavior, and timeline. 

After careful consideration specifically the state of the program and the client's evaluation purposes, I selected the Context, Input, Process, and Product (CIPP) model approach for the case study of Ithika University's Instructional Design Diploma Program. This decision was based on the client's request to get a holistic view of their program, extending beyond mere impact assessment. 

The evaluation focused on four key areas:

  1. Program Viability: This will involve assessing the overall feasibility and sustainability of the IDD program, taking into account its long-term prospects and potential for continued operation.
  2. Academic Quality: The committee will evaluate the rigor of the curriculum, the effectiveness of the technologies and instructional methods used, and their alignment with industry standards and best practices. This evaluation aims to ensure that the program maintains high academic standards.
  3. Learner Relevance: The assessment will determine whether the program meets the needs of its target audience, ensuring it remains relevant and valuable to learners. This evaluation will help maintain the program's appeal and effectiveness in addressing learner needs.
  4. Cost Effectiveness: The committee will analyze the program's resource utilization, efficiency, and overall value in terms of return on investment. This evaluation will assist in optimizing resource allocation and ensuring the program's financial sustainability.

The IDD evaluation framework consists of the following four dimensions. The dimensions of this framework work together to create a comprehensive assessment, providing a holistic view of the IDD program.  

  • Context – In the IDD program, context refers to the foundational elements that shape its design and delivery. It encompasses the results of needs assessments, opportunities that influence program goals, and various factors that impact the educational experience such as learner demographics, organizational culture, and external environmental influences that affect the educational experience.
  • Input - Input involves the necessary resources, infrastructure, curriculum, and content needed to implement teaching-learning processes effectively. This includes materials, facilities, budget, technology, and other assets required for successful program delivery.
  • Process - The process includes all activities necessary for implementing different teaching methods, evaluations, and formative assessments. It covers how instructors deliver content, facilitate discussions, and assess student progress throughout the program.
  • Product - Product evaluation focuses on assessing skills, values, attitudes, and results achieved by learners. It examines whether the program has met its intended outcomes and contributed to learners' personal and professional development.

After that, I created a comprehensive list of evaluation questions for each dimension of the CIPP model.

IDD Dimension.jpg.1

After creating these questions, I created the preliminary standards and criteria. These criteria serve as indicators of compliance and identify areas needing improvement. Standards and criteria may evolve throughout evaluation as new issues emerge. 

Standard 1.jpg

I also drafted the questions for the assessment instruments by following the guidelines in the course guide. 

 

Appendix B.jpg

Reflection 

Program evaluation is crucial for validating the effectiveness of educational programs. It requires practices to effectively evaluate programs and utilize appropriate evaluation models and forms. Understanding the program evaluation process, including available approaches, is essential to provide comprehensive evaluation results for clients.

I learned about the significance of engaging stakeholders in the evaluation process to ensure diverse voices are heard and considered. This approach is particularly important for advancing social justice initiatives. Additionally, I discovered that multiple evaluation approaches can be utilized when evaluating programs.