Construct Validity and Reliability Analysis of a CIPP-Based Curriculum Evaluation Instrument for Outcome-Based Education (OBE)
DOI:
https://doi.org/10.56707/ijoerar.v4i3.187Keywords:
Curriculum, Outcome-Based Education, CIPP Model, Evaluation, Research dan DevelopmentAbstract
Objective: This study aims to develop and validate an instrument to evaluate the implementation of outcome-based education (OBE) curriculum in higher education by integrating the context, input, process, and product (CIPP) model. Method: The study used a research and development design that adapted the 4D model and was implemented until the development stage. The developed instrument consisted of 29 indicators distributed into four CIPP dimensions. Content validity was evaluated through expert judgment using Aiken's V, while empirical testing used partial least squares structural evaluation modeling (PLS-SEM). Evaluation of the measurement model included convergent validity, discriminant validity, and internal consistency reliability. Results: The four dimensions showed adequate content validity with an average Aiken's V above 0.80. Convergent validity was supported by the average variance extracted value of 0.631-0.756, while Cronbach's alpha of 0.900-0.946 and composite reliability of 0.926-0.956 indicated high internal consistency. The four dimensions have a strong and significant relationship with the evaluation construct, with the highest coefficient in the process dimension. Discriminant validity is met in most pairs of constructs, but empirical overlap is found between input and process, although all indicators have the highest cross loading on the measured construct. Novelty: This study produces a multidimensional instrument based on CIPP that expands the evaluation of the OBE curriculum from only measuring the achievement of learning outcomes to a diagnostic framework that integrates curriculum relevance, availability of supporting resources, implementation processes and achieved results to support the process of continuous quality improvement.
References
Afriadi, B., & Fitri, F. (2025). Curriculum evaluation model: Paradigm and implications in improving the quality of education. Jurnal Evaluasi Pendidikan, 16(1), 50–62.
Al-Shanawani, H. M. (2019). Evaluation of self-learning curriculum for kindergarten using Stufflebeam’s CIPP model. Sage Open, 9(1), 2158244018822380.
Aslan, M., & Uygun, N. (2019). Evaluation of preschool curriculum by stufflebeam’s context, input, process and product (CIPP) evaluation model. Egitim ve Bilim, 44 (200), 229–251.
Baartman, L., van Schilt-Mol, T., & van der Vleuten, C. (2022). Programmatic assessment design choices in nine programs in higher education. Frontiers in Education, 7, 931980.
Boateng, G. O., Neilands, T. B., Frongillo, E. A., Melgar-Quiñonez, H. R., & Young, S. L. (2018). Best practices for developing and validating scales for health, social, and behavioral research: A primer. Frontiers in Public Health, 6, 149.
Bohra, N. S., Johri, A., & Wasiq, M. (2024). Systematic approach of measuring program outcomes of management postgraduate program. Frontiers in Education, 9, 1404946.
Dau, M. P., & Kasiati, R. I. (2026). Evaluation of the Implementation of the Christian Religious Education Curriculum Using the CIPP Model: Alignment with the Indonesian Qualifications Framework and Outcome-Based Education. Jurnal Kependidikan: Jurnal Hasil Penelitian Dan Kajian Kepustakaan Di Bidang Pendidikan, Pengajaran, Dan Pembelajaran, 12(1), 238–250.
Derouich, M. (2025). Ensuring outcome-based curriculum coherence through systematic CLO–PLO alignment and feedback loops. Discover Education, 4(1), 486.
Derya, K., & Bulent, A. (2016). Application of context input process and product model in curriculum evaluation: Case study of a call centre. Educational Research and Reviews, 11(17), 1659–1669. https://doi.org/10.5897/err2016.2911
Dizon, A. G. (2023). Historical development of CIPP as a curriculum evaluation model. History of Education, 52(1), 109–128. https://doi.org/10.1080/0046760X.2022.2098390
Drakos, J. (2005). Ideas for developing a personal EFL teaching curriculum. The Internet TESL Journal, XI(3), 1–3.
Duan, P., Xiang, J., Niu, H., & Han, C. (2023). Construction of evaluation index for Chinese engineering undergraduates based on Cipp model. Sage Open, 13(1), 21582440221149416.
Elragal, A., & Habibipour, A. (2025). Operationalizing education 4.0: a structured method for course materials and assessment alignment. Frontiers in Education, 10, 1694545.
Grix, M., Todd, S., & Lawson, R. (2005). Towards a Measure of Individual Consumer Morality. In K. M. E. and H. Brembeck (Ed.), E - European Advances in Consumer Research (Vol. 7, pp. 616–622). Association for Consumer Research.
Gu, P. Y. (2021). An argument-based framework for validating formative assessment in the classroom. Frontiers in Education, 6, 605999.
Gurukkal, R. (2020). Outcome-based education: an open framework. In Higher Education for the Future (Vol. 7, Number 1, pp. 1–4). SAGE Publications Sage India: New Delhi, India.
Hair, J. F., Howard, M. C., & Nitzl, C. (2020). Assessing measurement model quality in PLS-SEM using confirmatory composite analysis. Journal of Business Research, 109, 101–110.
Hair, J. F., Hult, G. T. M., Ringle, C., & Sarstedt, M. (2017). A Primer on Partial Least Square Structural Equation Modelling (PLS-SEM) (Second). Sage Publication.
Jackson, D., & Bridgstock, R. (2021). What actually works to enhance graduate employability? The relative value of curricular, co-curricular, and extra-curricular learning and paid work. Higher Education, 81(4), 723–739.
Kushari, B., & Septiadi, L. (2022). A learning outcome assessment information system to facilitate Outcome-Based Education (OBE) implementation. Jurnal Pendidikan Teknologi Dan Kejuruan, 28(2), 238–250.
Mufanti, R., Carter, D., & England, N. (2024). Outcomes-based education in Indonesian higher education: Reporting on the understanding, challenges, and support available to teachers. Social Sciences & Humanities Open, 9, 100873.
Negara, G. A. J., Pitriani, N. R. V., & Fitriani, L. P. W. (2024). Kurikulum berbasis OBE (Outcome Based Education) dengan nilai-nilai karakter untuk meningkatkan kualitas mutu pendidikan perguruan tinggi. Jurnal Penelitian Dan Pengembangan Pendidikan, 8(1), 41–48.
Nouraey, P., Al-Badi, A., Riasati, M. J., & Maata, R. L. (2020). Educational Program and Curriculum Evaluation Models: A Mini Systematic Review of the Recent Trends. Universal Journal of Educational Research, 8(9), 4048–4055. https://doi.org/10.13189/ujer.2020.080930
Rao, N. J. (2020). Outcome-based education: An outline. Higher Education for the Future, 7(1), 5–21.
Retnawati, H. (2016). Reliabilitas, Validitas dan Karakteristik Butir Soal. Parama.
Rijal, A. H., Rajbanshi, R., Ghimire, P., Humagain, M., Dahal, N., Hasan, M. K., & Haque, M. N. (2026). Evaluating the bachelor of dental surgery curriculum of Kathmandu university using CIPP evaluation model: a mixed-methods study. Frontiers in Education, 11, 1746131.
Rosita, R., Susilana, R., Rusman, R., & Rosliana, L. (2025). Curriculum evaluation in tourism education: Assessing the fulfillment of OBE principles. Jurnal Penelitian Dan Evaluasi Pendidikan, 29(2), 240–255.
Soyka, C., & Schaper, N. (2024). Analyzing student response processes to refine and validate a competency model and competency-based assessment task types. Frontiers in Education, 9, 1397027.
Stufflebeam, D. L. (2003). The CIPP model for evaluation, in International handbook of educational evaluation. Springer.
Syeed, M. M. M., Shihavuddin, A. S. M., Uddin, M. F., Hasan, M., & Khan, R. H. (2022). Outcome based education (OBE): Defining the process and practice for engineering education. Ieee Access, 10, 119170–119192.
Terwee, C. B., Prinsen, C. A. C., Chiarotto, A., Westerman, M. J., Patrick, D. L., Alonso, J., Bouter, L. M., De Vet, H. C. W., & Mokkink, L. B. (2018). COSMIN methodology for evaluating the content validity of patient-reported outcome measures: a Delphi study. Quality of Life Research, 27(5), 1159–1170.
Thiagarajan, S., Semmel, D. S., & Semmel, M. I. (1974). Instructional Development for Training Teachers of Exceptional Children: A Sourcebook. University of Minnesota.
Tight, M. (2024). The curriculum in higher education research: A review of the research literature. Innovations in Education and Teaching International, 61(2), 315–328. https://doi.org/10.1080/14703297.2023.2166560
Toosi, M., Modarres, M., Amini, M., & Geranmayeh, M. (2021). Context, Input, Process, and Product Evaluation Model in medical education: A systematic review. Journal of Education and Health Promotion, 10(1), 199.
Ulfah, A. A., Kartono, K., & Susilaningsih, E. (2020). Validity of content and reliability of inter-rater instruments assessing ability of problem solving. Journal of Educational Research and Evaluation, 9(1), 1–7.
Vargas, H., Arredondo, E., Heradio, R., & Torre, L. de la. (2025). Standardizing course assessment in competency-based higher education: An experience report. Frontiers in Education, 10, 1579124.
Warju, W. (2016). Educational program evaluation using CIPP model. INVOTEC, 12(1).
Yuliarto, H. (2021). Analisis indeks aiken untuk mengukur validitas isi instrumen komitmen tugas bermain sepakbola. Jurnal Pendidikan Jasmani Indonesia, 17(1), 19–23.
Yusoff, M. S. B. (2019). ABC of response process validation and face validity index calculation. Educ Med J, 11(10.21315).
Zhang, S., Bai, L., & Yang, B. (2025). Mixed teaching quality evaluation of organizational behavior course based on CIPP model. Frontiers in Education, 10, 1538539.
Downloads
Published
How to Cite
Issue
Section
License
Copyright (c) 2026 International Journal of Emerging Research and Review
This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.
