DEVELOPMENT OF THE LIST OF MAJOR DRAWBACKS AS AN ELEMENT OF STUDY PROGRAMME EVALUATION IN LINE WITH THE ESG 2015 STANDARDS

Authors

DOI:

https://doi.org/10.28925/2412-0774.2025.3.1

Keywords:

evaluation criteria, expert panel report, List of Major Drawbacks, National Agency for Higher Education Quality Assurance (NAQA), sectoral expert council, study programme.

Abstract

The article explores the initial stage in forming a model for establishing the correspondence of study programme evaluation criteria to the key parameters of the Standards and Guidelines for Quality Assurance in the European Higher Education Area (ESG 2015) and Ukrainian legislation – namely, the development of the List of Major Drawbacks as an element of study programme evaluation. The period of formation of a new paradigm in the national higher education quality assurance system, together with the evidence accumulated as a result of analysing the functioning of the external quality assurance system of higher education, has highlighted the need for a clearly structured, unambiguous, and standardised list of drawback formulations that are comprehensible to all participants in the accreditation process. In particular, it was deemed necessary to identify typical manifestations of drawbacks for each criterion, to develop detailed clarifications on describing levels of compliance with the criteria and providing appropriate justifications, and to prepare methodological recommendations ensuring the proper substantiation of identified drawbacks in expert panel reports and sectoral expert council conclusions. The purpose of this article is therefore to examine the development of the List of Major Drawbacks as an element of study programme evaluation in line with ESG 2015 standards. It has been established that the List of Major Drawbacks enables participants in both external and internal quality assurance processes to identify areas for further improvement. The List is not designed to function as a checklist for detecting drawbacks but serves as a tool for precise formulation of expert conclusions. An expert first conducts a comprehensive analysis of the programme’s compliance with established requirements, identifying the essence of the problem, its causes, and potential consequences. Only after confirming the fact of non-compliance does the expert select the appropriate formulation from the List for recording. Furthermore, the article highlights the potential application of the List in internal evaluations of study programmes and in assessing the effectiveness of institutional quality assurance systems, presenting it as a clearly structured tool with a proven and tested methodology.

References

Butenko, A., Denyskina, G., & Yeremenko, O. (2021). [Formation of a study program in the context of conformity with the ESG (on the material of the analysis of study programs in Ukraine)]. Education Sciences, 11, 670. https://doi.org/10.3390/educsci11110670

Yeremenko, O. V., Butenko, A. P., & Stukalo, N. V. (2024). Formuvannja

terminosystemy novoji paradyghmy zabezpechennja jakosti vyshhoji osvity: jevrointeghracijnyj aspekt. [Formation of the terminological system of the new paradigm of quality assurance in higher education: The European integration aspect]. Nova filologhija, (95), 21–29. https://doi.org/10.26661/2414-1135-2024-95-3

Helesh, A., Eremenko, O., & Kryshtanovych, M. (2021). Monitoring the quality of the work of experts when they conduct accreditation examinations of educational programs. Revista Tempos e Espaços em Educação, 14(33). e16535. https://doi.org/10.20952/revtee.v14i33.16535

National Agency for Higher Education Quality Assurance (NAQA). (2019). Metodychni rekomendaciji dlja ekspertiv Nacionaljnogho aghentstva shhodo zastosuvannja Kryterijiv ocinjuvannja jakosti osvitnjoji proghramy. [Methodological Recommendations for Experts of the National Agency for Higher Education Quality Assurance on the Application of the Criteria for Evaluating the Quality of a Study Programme].

Nazarov, I. V. (2024). Zakonodavchi zminy v systemi zabezpechennja jakosti vyshhoji osvity v umovakh vojennogho stanu. [Legislative changes in the system of quality assurance in higher education under martial law]. Nove ukrajinsjke pravo, 2, 102–108. https://doi.org/10.51989/NUL.2024.2.13

Stukalo, N. (2023). Digitalization of quality assurance in Ukraine. In Proceedings of the workshop “People and culture in QA agencies” (CEENQA, June 2, 2023) (p. 35). CEENQA. https://www.ceenqa.org/wp-content/uploads/2023-CEENQA-People-and-Culture-in-QA-Agencies.pdf

Volk, I., Ivanov, O., Artyukhov, A., Dluhopolskyi, O., & Artyukhova, N. (2024). Comparative study of pre-attentive visual attention analysis instruments: 3M VAS and iMotions as AI-based vs human-based experiments. In E. Faure et al. (Eds.), Information Technology for Education, Science, and Technics (ITEST-2024) (Lecture Notes on Data Engineering and Communications Technologies, Vol. 221, pp. 14–26). Springer. https://doi.org/10.1007/978-3-031-71801-4_2 (Scopus-indexed monograph).

Ministry of Education and Science of Ukraine. (2024). Polozhennja pro akredytaciju osvitnikh proghram, za jakymy zdijsnjujetjsja pidghotovka zdobuvachiv vyshhoji osvity: Zatverdzheno nakazom Ministerstva osvity i nauky Ukrajiny vid 15 travnja 2024 r. # 686. [Regulation on the accreditation of study programmes leading to higher education degrees, approved by the Order of the Ministry of Education and Science of Ukraine dated May 15, 2024, No. 686] https://zakon.rada.gov.ua/laws/show/z1013-24#Text

National Agency for Higher Education Quality Assurance (NAQA). (2020). Richnyj zvit Nacionaljnogho aghentstva iz zabezpechennja jakosti vyshhoji osvity za 2019 rik. [Annual report of the National Agency for Higher Education Quality Assurance for 2019]. [244 с.] / za zagh. red. S. Kvita. Kyiv: National Agency for Higher Education Quality Assurance. https://naqa.gov.ua/wp-content/uploads/2020/02/Звіт-2020.pdf

National Agency for Higher Education Quality Assurance (NAQA). (2021). Richnyj zvit Nacionaljnogho aghentstva iz zabezpechennja jakosti vyshhoji osvity za 2020 rik. [Annual report of the National Agency for Higher Education Quality Assurance for 2020]. [364 с.] / za zagh. red. S. Kvita ta O. Yeremenko. Kyiv: National Agency for Higher Education Quality Assurance. https://naqa.gov.ua/wp-content/uploads/2021/02/Річний-звіт-2020.pdf

National Agency for Higher Education Quality Assurance (NAQA). (2022). Richnyj zvit Nacionaljnogho aghentstva iz zabezpechennja jakosti vyshhoji osvity za 2021 rik. [Annual report of the National Agency for Higher Education Quality Assurance for 2021]. [232 с.] / za zagh. red. S. Kvita. Kyiv: National Agency for Higher Education Quality Assurance. https://naqa.gov.ua/wp-content/uploads/2022/02/Звіт-2021.pdf

National Agency for Higher Education Quality Assurance (NAQA). (2023). Richnyj zvit Nacionaljnogho aghentstva iz zabezpechennja jakosti vyshhoji osvity za 2022 rik. [Annual report of the National Agency for Higher Education Quality Assurance for 2022]. [111 с.] / za zagh. red. A. Butenka, О. Yeremenko. Kyiv: National Agency for Higher Education Quality Assurance. https://naqa.gov.ua/wp-content/uploads/2023/04/Річний-звіт-за-2022-рік.pdf

National Agency for Higher Education Quality Assurance (NAQA). (2024). Richnyj zvit Nacionaljnogho aghentstva iz zabezpechennja jakosti vyshhoji osvity za 2023 rik [Annual report of the National Agency for Higher Education Quality Assurance for 2023]. [108 с.] / za zagh. red. A. Butenka, О. Yeremenko, N. Stukalo. Kyiv: National Agency for Higher Education Quality Assurance. https://naqa.gov.ua/wp-content/uploads/2024/05/Звіт-2023.pdf

National Agency for Higher Education Quality Assurance (NAQA). (2025). Richnyj zvit Nacionaljnogho aghentstva iz zabezpechennja jakosti vyshhoji osvity za 2024 rik. [Annual report of the National Agency for Higher Education Quality Assurance for 2024]. [154 с.] / za zagh. red. A. Butenka, О. Yeremenko, N. Stukalo. Kyiv: National Agency for Higher Education Quality Assurance. https://naqa.gov.ua/wp-content/uploads/2025/03/Річний-звіт-НА-за-2024.pdf

Butenko, A., Denyskina, G., Yeremenko, O., Knysh, O., Simshah, I., & Trebenko, O. (2024). Roz'jasnennja shhodo zastosuvannja Kryterijiv ocinjuvannja jakosti osvitnjoji proghramy: metodychnyj posibnyk. [Clarifications on the application of the criteria for assessing the quality of study programmes: methodological guidelines]. [Elektronne vydannja, 127 s.]. Kyiv: National Agency for Higher Education Quality Assurance. https://naqa.gov.ua/wp-content/uploads/2024/12/Розяснення-щодо-застосування-Критеріїв-оцінювання-якості-освітньої-програми.pdf

Standards and guidelines for quality assurance in the European Higher Education Area (ESG) (2015). [32 p.]. Brussels, Belgium. https://www.enqa.eu/wp-content/uploads/2015/11/ESG_2015.pdf

National Agency for Higher Education Quality Assurance (NAQA). (2020-2025) Informacijno-komunikacijna systema : Akredytacijni spravy [Information and communication system: Accreditation cases] [Elektronnyj resurs]. URL: https://public.naqa.gov.ua

Rekomendaciji shhodo zastosuvannja kryterijiv ocinjuvannja jakosti osvitnjoji proghramy [Recommendations on the application of criteria for assessing the quality of study programs] / za red. A. P. Butenka, O. V. Yeremenko, S. M. Kvita. Kyiv: TOV «Ukrajinsjkyj osvitjansjkyj vydavnychyj centr «Orion»», 2020. 66 с.

Butenko, A., Yeremenko, O., & Stukalo, N. (Eds.). (2023). Dopovidj pro jakistj vyshhoji osvity v Ukrajini, jiji vidpovidnistj zavdannjam stalogho innovacijnogho rozvytku suspiljstva u 2022 roci [Review on the quality of higher education in Ukraine]. Kyiv: National Agency for Higher Education Quality Assurance. https://naqa.gov.ua/wp-content/uploads/2023/04/Доповідь-про-якість-вищої-освіти-в-Україні.pdf

Butenko, A., Yeremenko, O., & Stukalo, N. (Eds.). (2024). Dopovidj pro jakistj vyshhoji osvity v Ukrajini, jiji vidpovidnistj zavdannjam stalogho innovacijnogho rozvytku suspiljstva u 2023 roci [Review on the quality of higher education in Ukraine]. Kyiv: National Agency for Higher Education Quality Assurance. https://naqa.gov.ua/wp-content/uploads/2024/05/Доповідь-2023-року.pdf

Butenko, A., Yeremenko, O., & Stukalo, N. (Eds.). (2025). Dopovidj pro jakistj vyshhoji osvity v Ukrajini, jiji vidpovidnistj zavdannjam stalogho innovacijnogho rozvytku suspiljstva u 2024 roci [Review on the quality of higher education in Ukraine]. Kyiv: National Agency for Higher Education Quality Assurance. https://naqa.gov.ua/wp-content/uploads/2025/06/Доповідь-про-якість-вищої-освіти-2024.pdf

Published

2025-10-31

How to Cite

Butenko, A. ., Yeremenko, O. ., & Trebenko, O. . (2025). DEVELOPMENT OF THE LIST OF MAJOR DRAWBACKS AS AN ELEMENT OF STUDY PROGRAMME EVALUATION IN LINE WITH THE ESG 2015 STANDARDS. Continuing Professional Education: Theory and Practice, 84(3), 7–19. https://doi.org/10.28925/2412-0774.2025.3.1

Issue

Section

THEORY AND METHODOLOGY OF CONTINUING PROFESSIONAL EDUCATION