Evolution of quality assurance in higher education from INQAAHE GGP to ISGs − Are quality assurance agencies in Asia ready to the emerging modules?

Angela Yung Chi Hou (Department of Education, National Chengchi University, Taipei City, Taiwan)
Christopher Hong-Yi Tao (Department of Education, National Chengchi University, Taipei City, Taiwan) (Lingnan University, Hong Kong, China)
Kyle Zi-Wei Zhou (Department of Education, National Chengchi University, Taipei City, Taiwan) (Lingnan University, Hong Kong, China)
Arianna Fang Yu Lin (Department of Education, National Chengchi University, Taipei City, Taiwan) (Higher Education Evaluation and Accreditation Council of Taiwan, Taipei City, Taiwan)
Edward Hung Cheng Su (Department of Education, National Chengchi University, Taipei City, Taiwan)
Ying Chen (Minjiang University, Fuzhou, China)

Journal of International Cooperation in Education

ISSN: 2755-029X

Article publication date: 6 March 2024

Issue publication date: 4 June 2024

860

Abstract

Purpose

In 2022, the International Network for Quality Assurance (QA) Agencies in Higher Education (INQAAHE) published the new guidelines by adding three QA modules in response to the changing higher education landscape. The paper aims to investigate the transformative focus of quality assurance in higher education globally as well as Asian response to three new QA modules according to the INQAAHE ISGs.

Design/methodology/approach

The research conducted a quantitative approach for data collection. An on-line survey was conducted to perceive QA practices, perceptions toward new emerging QA modules and challenges encountered. In total, there were 26 responses from 18 territories with 22 QA agencies. A total of 13 out of them have a national qualifications framework in place.

Findings

Three are three major findings in the study. First, national policy and criteria and standards in distance education have been developed in the majority of Asian nations. Second, non-signatories of the Tokyo Convention had a higher proportion of having related policies, regulations and criteria in CBHE and distance education. Third, national policies and regulations; and lack of professional staff are two common challenges implementing QA in new types of providers.

Originality/value

The findings are of value for policymakers, QA agencies and universities to advocate the new QA model as a systematic approach in response to changing higher education landscape in the post pandemic era.

Keywords

Citation

Hou, A.Y.C., Tao, C.H.-Y., Zhou, K.Z.-W., Lin, A.F.Y., Su, E.H.C. and Chen, Y. (2024), "Evolution of quality assurance in higher education from INQAAHE GGP to ISGs − Are quality assurance agencies in Asia ready to the emerging modules?", Journal of International Cooperation in Education, Vol. 26 No. 1, pp. 85-100. https://doi.org/10.1108/JICE-09-2023-0022

Publisher

:

Emerald Publishing Limited

Copyright © 2024, Angela Yung Chi Hou, Christopher Hong-Yi Tao, Kyle Zi-Wei Zhou, Arianna Fang Yu Lin, Edward Hung Cheng Su and Ying Chen

License

Published in Journal of International Cooperation in Education. Published by Emerald Publishing Limited. This article is published under the Creative Commons Attribution (CC BY 4.0) licence. Anyone may reproduce, distribute, translate and create derivative works of this article (for both commercial and non-commercial purposes), subject to full attribution to the original publication and authors. The full terms of this licence may be seen at http://creativecommons.org/licences/by/4.0/legalcode


1. Introduction

Due to severe global competition for talent and resources in the era of higher education massification, higher education institutions are expected to respond to these “new” challenges. Nevertheless, the attention on how the quality is redefined and what standards and criteria should be developed, has been intensified, particularly during outbreak of the pandemic. Concurrently, diversification, relevance and sustainability have been regarded as three core elements of quality assurance (QA) measures and arrangements in higher education (INQAAHE, 2022; Harvey & Stensaker, 2022). Quality assurance agencies (EQAA) and accreditors, in most nations, cannot stop evolving in order to “meet both the changing expectations of universities, governments, and students” (Matear, 2018, p. 1). As a quality regulator as well as a future thinker for higher education development, EQAAs and accreditors are often expected to embrace diversity of higher education system, seek for institutional efficiency, empower universities in this transformative age (Hou, Hill, Guo, Tsai, & Justiniano Castillo, 2020).

In 2022, the International Network for Quality Assurance Agencies in Higher Education (INQAAHE), the largest global QA network, published the new guidelines titled International Standards and Guidelines for Quality Assurance in Tertiary Education (ISGs) with three new QA modules in cross border education, short learning program and distance education, in response to the changing higher education landscape in the post pandemic era (INQAAHE, 2022). Given that there is a growing number of students choosing to study abroad after the 2000s, another key aspect for quality assurance practices is its convergence with the recognition of qualifications and linkages with national qualifications framework (Knight, 2004; Hou, Lu, Grace, Chen, & Guo, 2023).

Higher education in Asia, and its quality assurance (QA) mechanisms have undergone several phases of reforms. It is imperative to explore the effective QA methods to renovate higher education and to engage varying stakeholders in the development of new quality standards in the post COVID-19 era. Thus, the paper aims to investigate the transformative focus of QA in higher education globally and in Asia. Through an international online survey targeting Tokyo Convention signatories and active full members of INQAAHE and Asia Pacific Quality Network (APQN), Asian accreditors' responses to three emerging QA modules and new initiatives addressed in the INQAAHE ISGs are discovered. Barriers and challenges are discussed at the end of the paper. Based on above, three research questions are addressed as follows,

RQ1.

What are the common characteristics of QA in higher education globally and in Asia after 2000?

RQ2.

How do EQAAs and accreditors in Asia respond to three QA modules of the INQAAHE ISGs and other emerging initiatives?

RQ3.

How would three QA modules be integrated into qualifications recognition system from an Asian QA perspective? And what challenges are national QA systems in Asia confronting?

2. Literature review

2.1 An overview of QA development, qualification recognition and regional conventions

QA has existed for more than a century, since it first appeared in the USA. Global QA development can be generally categorized into the three main stages, prior to 2000. As an outset of the first wave, beginning around the 1900s, EQAAs in the USA as self-directed organizations “emerged from efforts to standardize a diverse system” due to economic concern and consumer protection (Kinser, 2021, p. 2). The second wave came after Second World War and European countries, such as UK and Ireland started to establish national external quality assurance mechanism in order to “help guide the development of a rapidly growing and diversifying sector” during the 1960s. In this stage, two conflicting QA rationales aiming at both state control and quality enhancement often intertwined with each other (Harvey, 2018; Harvey & Stensaker, 2022). It was not until the 1990s that the third wave of external QA started with an explosion of the establishment of varying EQAAs, professional accreditors, and self-funded agencies. During the period, INQAAHE was formed in 1991 in Hong Kong by 18 EQAAs.

Moving into the 21st century, an evolution of QA has gone faster with a focus of “accountability” in response to several global manifestations in higher education, including massification, internationalization, and marketization, privatization as well as domination of global rankings (Harvey, 2018; King, 2018). When the pandemic outbroke, global QA systems started to experience such a disruption over their traditional external review modes and standards, “which led to the need to reimagine, re-invent and redesign the diverse aspects of higher education to enhance relevance, trust and credibility in performance” (INQAAHE, 2021, p. 1). Hence, in addition to student learning outcomes and educational efficiency, the pandemic crisis of 2020 has caused national QA systems to pay more attention to stakeholders' engagement, social impacts and innovation, as well as how to integrate third mission into the standards and indicators (Kaiser, Melo, & Hou, 2022; Hou et al., 2021b, 2022).

In general, evidence-based, enhancement-led and an emphasis of institutional self -review are adopted principles in most quality assurance systems (Martin & Stella, 2007; Harvey & Stensaker, 2022). Audit, accreditation, assessment/inspection and external examination/national examination are considered as four popular ways of quality assurance practices worldwide (Harvey, 2018; Harvey & Stensaker, 2022). There are some common characteristics for these quality assurance arrangements. First, given the fact that EQAAs with their legitimate status often adopt “the approach of fitness for purposes”, standards and indicators developed by EQAAs are provided for institutional self-regulation according to their mission and vision (Martin & Stella, 2007). Second, self-assessment reports, peer review, and onsite visits are core components of quality assurance exercises (Harvey & Newton, 2007). Universities should undertake a self-assessment procedure in compliance with the standards and indicators developed by EQAAs prior to an onsite visit (INQAAHE, 2016). Third, university performance and accountability are measured by both quantitative and qualitative approaches (Martin & Stella, 2007). Concurrently, internal quality assurance has gained more and more attention, vice versa likely reflecting the issues of state controls and EQA domination over decades (Stensaker et al., 2011; INQAAHE, 2016). As Harvey (2018) argued, “the greater effectiveness over external process is another perspective that endured for more than a decade” (p. 19), QA needs to be more diverse, relevant and transformative in order to empower higher education institutions (INQAAHE, 2022).

QA is commissioned to align with qualification recognition systems owing to global talent mobility in some regions in the early 2010s (Knight, 2004; OECD, 2005). Although QA and qualification recognition schemes are part of national regulatory frameworks in most contexts, a divergence of qualification recognition and external quality assurance exists due to being operated by different authorized bodies (Hou, Morse, & Wang, 2017). To facilitate overseas qualification recognition globally and regionally, cooperation between quality assurance and recognition bodies has been highlighted in the UNESCO organized six Regional Conventions and Global Convention (Hou, Hill, Chan, Chen, & Tang, 2021). There are two major aims at these regional and global conventions while quality assurance is considered as a prerequisite: one is to promote international cooperation in higher education; and the other is to reduce obstacles to the recognition of degrees and qualifications (UNESCO Bangkok, 2013; Hou et al., 2021).

2.2 Development and transformation of QA in Asian context after 2000

To respond to the growing social demand, system expansion and privatization, the establishment of QA systems became a national agenda concern in Asian nations (Martin & Stella, 2007; Hou et al., 2023). After 2000, the development of EQA systems in Asia can be categorized into three phases.

  1. As a policy instrument under neo-liberalism (2000 ∼ 2013)

In the first phase of QA development in Asia, quality assurance was regarded as a policy instrument for reforming higher education systems, assessing higher education providers' accountability (Harvey & Newton, 2007; Hou et al., 2020) as well as the pursuit of academic excellence under neo liberalism (Jarvis, 2014; Hou et al., 2023). In this phase, EQAAs and higher education institutions in Asia also found themselves grappling with the challenge of aligning with international educational standards and started to borrow quality policy, accreditation modes, and standards from advanced systems. Notably, several international organizations provided quality guidelines, principles for accountability and recognition of quality assurance agencies and accreditors, including INQAAHE, APQN. In the phase, QA professionalism is optimized while “the fitness for purpose” approach is implicated in the region (Karakhanyan & Stensaker, 2020). Yet, there were several critical voices arguing that QA associated with national authority is “bureaucratic, formalistic, centralized, and time consuming” (Harvey & Stensaker, 2022, p. 85). Besides, it was challenged by lacking evidence on the improvement of teaching and learning (Bloch, Degn, Nygaard, & Haase, 2021). As Westerheijden, Stensaker, Rosa, and Corbett (2014) highlighted “the adoption of quality assurance schemes becomes a process of copying instruments and policies that exist elsewhere, or to legitimate political action regardless of its actual effect” (p. 3).

  1. Linking to qualification recognition and regional Convention due to a rapid growth of international student mobility (2011 ∼ 2019)

In the second phase from 2011 to 2019, the inclusion of new quality assurance modules in national qualifications framework and overseas qualifications recognition system has gained greater attention regionally owing to a growing number of Asian students pursuing international education (ANICCW, 2019). According to the “Education at a Glance” students from Asia are the largest group of international students enrolled in tertiary education programmes at all levels, contributing to 58% of all mobile students (OECD, 2022, p. 218). Moreover, the UNESCO 17 Sustainable Development Goals (SDGs) in 2015 has triggered the integration of QA and qualifications framework and necessitated a compatible recognition system cross border (United Nations, 2023; Chakroun, 2017). Given that a national qualifications framework acts as a quick reference guide on the recognition of foreign qualifications and facilitates the mobility of students, workers, and professionals across the regions, Asian governments are pressured to build a flexible pathway for different types of learning outcome to be recognized, to connect the educational institution and the labor market, and finally to make the qualifications system sustainable (Hou et al., 2023).

Revised in 2011, the Tokyo Convention launched first in 1983, has become a legal framework providing general guidelines to facilitate the implementation of regional co-operation regarding the recognition of higher education qualifications in the region. Emphasis of on students' learning outcomes and employability started to drive Asian EQAAs to be aligned with international standards and engage the development of national qualifications framework and recognition system. In 2019, 12 member states ratifying the Tokyo Convention established National Information Centers under the umbrella of the Asia-Pacific Network of National Information Centers (APNNIC) (APNNIC, 2023). Related quality and qualification information should be published on the APNNIC website, such as educational system, quality assurance review outcomes, list of recognized higher education institutions as well as related quality policy and regulations (Noda & Hotta, 2023).

  1. A shift of multi-facet QA roles during the pandemic (2020 to present)

In the third phase, a call for “the build-up of new systems for external quality assurance” is getting stronger and stronger. INQAAHE and APQN have taken a proactive approach in support with those agencies interested in system changes, including developing a virtual mode for site visits; forming new standards for non-traditional providers (Salmi, 2020; Hou et al., 2022; INQAAHE, 2022). As Lamie and Hill (2023) indicated that “governance methods of new providers need to be in place and these will need to be agreed at a sector level to provide quality assurance and mutual recognition” (p. 167). Therefore, it could be observed that QA in this period will likely adeptly integrate pressing global themes such as diversity, digitalization, relevance and sustainability into a new comprehensive QA scheme. To summarize, QA in Asian higher education is learning to transform itself from a focus of quality of traditional and local providers to diversification and relevance of educational system that would ensure student outcomes, respond social demand and address global concerns.

2.3 Transition of INQAAHE QA guidelines and emergence of three new modules

As the INQAAHE aims to be a platform for information-sharing on good practices and for quality improvement in higher education between EQAAs, it has developed good principles and practices, entitled the Guidelines of Good Practice in Quality Assurance in 2003 and revised in 2006. In 2016, INQAAHE amended the Guidelines, with focuses on QA of cross-border higher education, integrity of EQAAs and the links to the QA community (INQAAHE, 2016). By 2023, 16 national EQAAs have been recognized as the GGP aligned agencies in compliance with the INQAAHE GGP (INQAAHE, 2023).

As indicated above, “a ‘one-size-fits-all’ approach to QA in tertiary education no longer serves the needs of diverse stakeholders and societies” (INQAAHE, 2022, p. 2). The 2022 INQAAHE ISGs are expected to “embrace the ever-increasing diversity in tertiary education (formal and non-formal) and empower the enhancement capacity of QA providers in their quest for diversification, efficiency, relevance, and transformative power” (INQAAHE, 2023, p. 1). One of the manifestations is to recognize the high level of maturity of quality assurance agencies and facilitate them to moving from “efficiency (fitness for purpose) to relevance and transformative capacity” (INQAAHE, 2022, p. 12). In addition to the Baseline Standards module, which originated from the 2016 edition, three new sets of QA modules were built, including cross-border QA/QA of cross-border education; QA of short learning programs, and QA of distance education.

  1. Cross-border QA/QA of cross-border education

There are two sub-dimensions in these modules, including cross-border QA and QA of cross-border education. The former means that EQAAs provide QA services over the institutions outside the country; such as international accreditation; the latter refers to EQAAs that conduct QA/accreditation of domestic education units that operate across the borders of their legal incorporation, such as branch campuses (INQAAHE, 2022). In the cross -border module, EQAAs should demonstrate their mandates, have policy and review procedures in place, develop appropriate and relevant standards, and ensure a fair recognition system of review outcomes in cross-border education. In particular, EQAAs should be aware of the importance in alignment with international guidelines and regulations, understanding cultural and contextual differences, and ensuring review outcomes and status recognized in both domestic and international contexts.

  1. Short learning program (Micro-credentials)

INQAAHE defined a short learning program as “a set of activities shorter than a full degree that culminates in learner assessment and the award of a credential, which should be designed in line with UNESCO ISCED levels 4–8” (INQAAHE, 2022, p. 44). Micro-credentials are one of the examples. Micro-credentials recognize a skill or competency that has been acquired through an organized learning process and validated through an assessment (OECD, 2021). With characteristics of flexibility, relevance to industry and shorter learning periods, micro-credentials became popular and spread rapidly during the pandemic (Hunt, 2020). The ISGs put an emphasis on scope of external review standards in flexibility, employability, assessment and recognition in the module. Most importantly, Standard 3.3. highlighted that “academic integrity should be at the core of related policies, activities and practice” (INQAAHE, 2022, p. 33).

  1. Distance Education

Distance education in the module is defined as “education imparted at a distance through the use of information/communication technology” (INQAAHE, 2022, p. 42) in both modes of online and blended. With its accessibility, affordability, flexibility, learning pedagogy, life-long learning policy, distance education becomes attractive for higher education institutions (Dhawan, 2020). Concurrently, the pedagogy, technology, infrastructure development, student support, and learning outcomes that accompany the teaching and learning process have become the focus of new attention in distance education (Hassan, 2021). The Module 4 of the ISGs presented a set of standards and measures for QA of online and blended modalities of distance education. More specifically, EQAAs should have clear policies to ensure that online or blended programs are authorized for their operations and the qualifications awarded are recognized.

All in all, the ambition of the INQAAHE ISGs is to act as one of significant references to reflect higher education diversification, to empower EQAAs, as well as to fulfill the need of varying stakeholders in the post pandemic era. By examining the content of the INQAAHE ISGs, QA is encouraged to transform itself gradually from a limited focus on a local context to an international scenario; from one-fit-all to diversity mode, and from recognition to relevance and engagement as shown in Figure 1.

3. Methodology

The research conducted a quantitative approach for data collection. Due to the lack of transnational data in the current situation of EQAAs in Asian context during and after the pandemic, an on-line survey was conducted to perceive current QA practices, perceptions toward new emerging QA modules and challenges encountered. Purposive sampling was applied to select participating EQAAs from that are judged to better capable to share useful information with the researchers (Neyman, 1992). According to the research questions and theoretical framework, the study targeted on 24 EQAAs at 22 territories, including 15 EQAA from 12 signatories of Tokyo Conventions and 11 active EQAAs at INQAAHE and APQN. Each EQAA was invited to recommend 1–2 senior administrator, staff or researcher to fill in the survey. In order to distribute the survey efficiently, the research team searched the liaison information of selected EQAAs from multiple sources, including the INQAAHE website, APQN website, and official websites of the selected agencies.

The online survey took place from July, 2023 to Sept, 2023 by three rounds of questionnaire distribution. The consent form was signed by all participants, who were invited to complete in the survey voluntarily. In total, there were 26 responses collected from 18 territories with 22 EQAAs. A total of 13 out of them have a national qualifications framework in place (Table 1).

The study took advantage of cross-national comparisons approach to analyze survey results. First, the collected responses were simply analyzed by mean and standard deviation. Second, four common indicators, including Pillai's Trace, Wilk's Lambda, Hotelling's Trace and Roy's Largest Root were applied to test differences between QA respondents with NQF and the ones without in terms of level of difficulties in the implementation of new QA modules by MANOVA (Hair, Black, Babin, & Anderson, 2019).

4. Major findings

4.1 National regulatory framework and QA policy for new QA modules by the INQAAHE ISGs

4.1.1 High level of awareness of INQAAHE guidelines

First of all, the study found that more than 90% of the QA respondents were aware of the INQAAHE's two guidelines, including GGP and ISGs. Moreover, 23 out of 26 respondents knew the content of the two guidelines, approximately 88%. Half of the respondents indicated that their agencies were the INQAAHE GGP aligned members (See Table 2).

4.1.2 National policy and criteria and standards in distance education had been developed in the majority of Asian nations

When it came to national regulatory and QA criteria and indicators development in three modules, it was found that more than 77% of the respondents replied that they had the national policy for distance education in place and 50% developed the quality criteria and indicators for distance education. 42% of the respondents integrated distance education into national qualifications system, followed by CBHE with 38% and micro-credentials 19%. Subsequently, more than 62% of QA respondents said that there were no criteria and indicators for micro-credentials, and 46% for CBHE. (Figure 2).

The respondents were requested to share whether there were national policy, framework or guidelines for inclusion of “university social impact” into QA system. 52% indicated that they have had national policy in place, but did not develop criteria and indicators yet. In other words, university social impact has gained recognition by national higher education policy, but not by EQAAs.

When it came to level of importance, there is a consistency that the respondents agreed highly on inclusion of distance education integrated into qualification framework with a ratio of 4.23, following by CBHE and micro-credentials and social impacts, like their positive responses in national policy and regulatory framework above (Table 3). To our surprise, the level of difficulty was not as higher as the level of importance. Examining the correlation of two items, it was found that there is no significance between level of importance and level of difficulty (Table 4).

4.2 Comparison between QA agencies of Tokyo Convention member and non-Tokyo Convention members

Comparing QA respondents of signatories of the Tokyo Convention and of non-signatories, it was found that non-signatories had a higher proportion of having related policies, regulations and criteria in CBHE and distance education. One of the possible causes could be that 9 out of 10 are active INQAAHE and APQN members with national qualifications framework and their QA systems are more mature, such as Malaysia, Thailand, Hong Kong (Table 5).

Regarding a convergence between QA and QF, QA respondents of Tokyo Convention signatories tended to consider both CBHE and distance education more important with a highest score of 4.08, in contrast, non-signatories preferred distance education with a score 4.38 (Table 6). When it comes to the level of difficulty, both considered micro-credentials quite challenging.

4.2.1 All QA respondents considered that CBHE should be integrated into standards framework, vice versa, those non-signatories started to pay more attention to sustainability

Regarding the first priority for EQAAs which should respond first and integrate into current standards framework, it was found that CBHE was the first selection by most QA respondents. In comparison, QA respondents of the Tokyo Convention signatories considered distance education as the top; vice versa, non-signatories considered measuring “sustainability” as significant and urgent (Figure 3).

Comparing the difficulty of a convergence between QA and QF in CBHE, micro-credentials, and distance education modules, the study found there was no significant difference between the Tokyo Convention signatories or non-signatories; or those having qualification framework or without it by applying MANOVA test (Hair et al., 2019) (Table 7). Yet, with the urgent need of recognition of cross-border qualifications and other types of providers, developing national qualifications framework can be regarded a stepping stone to diversity and relevance of QA, but it will take time to achieve the ultimate goal in Asia.

4.3 National policies and regulations, and lacking professional staff are two common challenges implementing QA in new types of providers

The study found that different factors would affect the external review process and outcomes of CBHE, micro-credentials and distance education immensely (Figure 4). In general, national policies and regulations, and lacking professional staff are two common challenges implementing QA in the respective modules. Top three challenges in CBHE are “Differences in regulations and laws across countries,Differences in qualification system across countries, and “Lack of professional staff who are familiar with CBHE among QA agencies”. In addition to two common items lacking professional staff and national regulations and policies, diversity was considered as a contributing factor affecting QA of micro-credentials most. Besides, limited value for micro-credentials was another concern of most QA respondents. What concerned participants most in QA development of distance education were “no transparent and reliable information,national policy and regulationandprofessional staff”. Nevertheless, diversity and internal quality assurance in the module also impacted whether the value of distance education will be recognized by the employer or not (Figure 4).

Given that social impact and sustainability have gained greater attention in recent years, the respondents were invited to share their perception toward the challenges if EQAAs would like to measure university performances in this manner. It was found that “lack of transparency and reliability of information” and “limited value and recognized by the employers” were identified as top concerns from their perspectives.

5. Discussion- moving forward

5.1 Is quality assurance ready to respond to new emerging issues?

The study shows that most Asian quality assurance agencies are evolving to the third diverse stage of “policy formulation” in order to address the quality issues, such as stakeholder engagement, relevant to social impact, responses to SDGs. Obviously, the pandemic is one of potential triggers for this transformative power (Hou et al., 2022). Although the transformative power and capacity building of QA differed from context to context, distance education and CBHE have drawn the greater attention among all QA participants. This aligns with the viewpoint of Hou et al. (2022), “under the disruptive era, digitalization not only provides an alternative for higher education and QA practices but overwhelmingly drives innovation” (p. 587). More specifically, whether Asian nations would like to respond to INQAAHE ISGs, they still need to characterize new QA schemes for micro-credentials, social impact or SDGS in order to underline the relevance of external review (INQAAHE, 2022). As it would be an important issue to pursue, more evidence is needed in the future studies.

Diversification, relevance and transformative capacity are three aspects that the INQAAHE ISGs would like to elicit responses from EQAAs in the post pandemic period. With a focus shift from “one-fit-all” module to a variety of QA dimensions, the INQAAHE ISGs has revealed that EQAAs should be more proactive to reflect upon diversification of higher education. When institutional differentiation and diversity continues to challenge QA, one of possible solutions is to “induce regulatory competitions to match such developments” (King, 2018, p. 39). Nevertheless, EQAAs are encouraged to adopt a new compliance theory to reflect varying stakeholders' need by developing “better regulations programs”, such as a risk-based approach.

5.2 Would the INQAAHE ISGs decrease the barriers of convergence of QA and qualification recognitions?

Prior to the pandemic, Hou et al. has found that (2017) several factors continued to obstruct a convergence between QA and qualification recognition in Asia, such as limited engagement of higher education stakeholders, lack of confidence in the system, lack of integration into the local context, limited transparency, etc. In the study, it was acknowledged that there were more complexities surrounding integrating QA of CBHE, micro-credentials, and distance education into “on-fit all module” either within contexts or cross contexts due to their diverse characteristics. Thus, it remains challenging for recognizing qualifications awarded by distance education, micro credentials and CBHE while QA in Asia is evolving into the new phase with a focus of relevance and engagement. On one hand, there is a widespread concern that the lack of comparability in QA and qualifications system in the region hindered the convergence of QA and qualification recognition. On the other hand, this has sparked a vigorous debate about whether a built-up regional regulatory framework would lead to an isomorphism phenomenon in global higher education system (Liu & Liu, 2017; Hou et al., 2023). This issue has long been a “persistent bottleneck” for EQAAs in Asia (Hou et al., 2020).

Notably, the convergence of QA and qualification recognition depends on engagement of various HE stakeholders, which will result in quality, efficiency, relevance, greater impact and sustainable development of higher education (UNESCO Bangkok, 2020). Under Tokyo Convention, APNNIC, a collaboratively regional information portal, began to provide transparent reliable information in higher education, QA, and national qualifications framework within region. It is believed that “appropriate, reliable, accessible and up-to-date information on higher-education systems, institutions, programmes and quality assurance mechanisms” (UNESCO, 2020, p. 8) should be provided by national competent authorities. While most QA respondents in the study have high expectations toward a convergence between QA and qualifications framework, the INQAAHE ISGs can suggest that “the procedures, standards and activities carried out by EQAAs are relevant to higher education system within which it operates and equip the TEIs, and overall, the system, with the necessary capacity to yield relevant outcomes” (INQAAHE, 2022, p. 39).

6. Conclusion

It has been more than two decades since national quality assurance systems have been established in the early 2000 in Asia. Under neoliberalism, QA was initially doomed to be an extended arm of government to regulate higher education institutions in the massified era. Although it was regarded as a policy instrument in Asian nations, the changing needs of varying higher education stakeholders has facilitated an evolution of QA in purposes, methods, and governance models (Matear, 2018; Hou et al., 2020). The study found that EQAAs in Asia have begun to consider new emerging QA modules as a part of their existing system to fulfill their new obligations as well as to prove their accountability in a flexible manner. Cross-border education and distance education have drawn more attention comparing to micro-credentials. Moreover, most of QA respondents agreed that it was imperative to integrate new QA modules into national qualifications framework and recognition systems, in spite of several existing barriers, such as national policies and regulations, and lacking professional staff.

Over past two decades, a “one-fit-all” QA mode might have created some harm in quality, relevance and efficiency of the higher education system, as a result of an isomorphism in Asian context. However, outbreak of the pandemic 2020 which has brought a lot of negative impacts over higher education quality pressured EQAAs to build their capacity and to address emerging issues after the global crisis. To reflect upon diversity, relevance and efficiency in a changing higher education landscape, the 2022 INQAAHE ISGs, as a global benchmark for QA self-enhancement, is determined to provide a new methodology to future challenges in academic quality. Using the new guidelines, INQAAHE would like to engage regional QA networks as well as to bridge all quality assurance agencies and accreditors together in response to new challenges in the post pandemic era. Thus, the Asian QA practices in the study are paving the way into a new policy formation, which can be implicated into other regions. Although it will take time to measure the actual impact of the new guidelines, evolution of QA cannot be stopped. As King (2018) indicated,

Regulators are increasingly being called upon to demonstrate that they can regulate for innovation rather than acing as conservative breaks on progress, quality assurance agencies shall have transformative power to retain the confidence of a myriad of stakeholders (p, 39).

Figures

Conceptual framework for QA evolution according to INQAAHE guidelines

Figure 1

Conceptual framework for QA evolution according to INQAAHE guidelines

Percentage of responses by three QA dimensions

Figure 2

Percentage of responses by three QA dimensions

Priority of QA development and integration with QF

Figure 3

Priority of QA development and integration with QF

Factors affect the external review process and outcomes (CBHE, micro-credentials, distance education)

Figure 4

Factors affect the external review process and outcomes (CBHE, micro-credentials, distance education)

Distribution of respondents by signatory status of the Tokyo Convention

TerritoryNumber of respondentsNumber of agencies
Signatories to the Tokyo ConventionArmenia (v)* 811
China (x)11
Japan (x)32
Mongolia (x)21
New Zealand (v)1022
Russia (x)22
South Korea (v) 811
Turkey (v) 811
Subtotal81311
Non-signatories to the Tokyo ConventionCroatia (v)811
Hong Kong (v) 711
Indonesia (v) 911
Kazakhstan (v) 811
Malaysia (v) 811
Romania (v) 811
Spain (v) 811
Taiwan (x)42
Thailand (v) 611
Vietnam (v) 811
Subtotal101311
Total182622

Note(s): “v” means having national qualification framework and level

Source(s): Table developed by authors

The percentage of respondents' perception toward the INQAAHE guidelines

ItemsPositive (yes)Negative (no)
Heard of GGP96% (25)4% (1)
Know GGP content88% (23)12% (3)
GGP alignment54% (14)46% (12)
Heard of ISGs92% (24)8% (2)
Know ISG content88% (23)12% (3)

Source(s): Table developed by authors

Average score of importance and difficulties for integrating QA into QF

All samples (N = 26)
MeanStandard deviationConfident interval
LowerUpper
CBHE importance4.041.003.634.44
CBHE difficulty3.350.892.993.71
MC importance4.000.893.644.36
MC difficulty3.690.843.354.03
DE importance4.231.613.584.88
DE difficult3.500.913.133.87
SI importance3.920.703.634.21
SI difficulty3.601.003.194.01

Source(s): Table developed by authors

Significance between level of importance and difficulty

All samples (N = 26)
CBHE importanceMC importanceDE importanceSI importance
CBHE difficulty0.070.20−0.370.11
MC difficulty−0.030.11−0.180.24
DE difficult0.020.15−0.280.26
SI difficulty−0.170.22−0.310.19

Source(s): Table developed by authors

Comparison between quality assurance at signatories of Tokyo Convention and non-signatories

Cross-border higher education (CBHE)Micro-credentials (MC)Distance education (DE)
National policyReview criteriaNational policyReview criteriaNational policyReview criteria
Signatories to the Tokyo Convention42%34%54%16%75%25%
Non-signatories to the Tokyo Convention62%62%50%39%85%77%

Source(s): Table developed by authors

Average score of importance and difficulties for integrating QA into QF by signatories and non-signatories

MeanStandard deviationConfident interval
LowerUpper
Signatories to the Tokyo Convention (N = 13)
CBHE importance4.080.953.504.65
CBHE difficulty3.310.952.743.88
MC importance3.921.043.304.55
MC difficulty3.460.882.933.99
DE importance4.081.753.025.14
DE difficult3.310.852.793.82
SI importance3.920.673.494.34
SI difficulty3.331.072.654.02
Non-signatories to the Tokyo Convention (N = 13)
CBHE importance4.001.083.354.65
CBHE difficulty3.380.872.863.91
MC importance4.080.763.624.54
MC difficulty3.920.763.464.38
DE importance4.381.503.485.29
DE difficult3.690.953.124.26
SI importance3.920.763.464.38
SI difficulty3.850.903.304.39

Source(s): Table developed by authors

MANOVA test of NQF QA respondents

ValueFHypothesis dfError dfSigPartial eta squared
NQFPillai's trace0.170.428160.890.17
Wilk's lambda0.830.428160.890.17
Hotelling's trace0.210.428160.890.17
Roy's largest root0.210.428160.890.17

Source(s): Table developed by authors

Disclosure statement: No potential conflict of interest was reported by the author(s).

References

APNNIC (2023). Vision and objectives. Available from: https://apnnic.net/vision-objectives/ (accessed 25 July 2023).

Asian National Information Centres Coordinating Website (ANICCW) (2019). About ANICCW. Available from: https://www.aniccw.net/ (accessed 30 May 2023).

Bloch, C., Degn, L., Nygaard, S., & Haase, S. (2021). Does quality work work? A systematic review of academic literature on quality initiatives in higher education. Assessment and Evaluation in Higher Education, 46(5), 701718. doi: 10.1080/02602938.2020.1813250.

Chakroun, B. (2017). Qualification frameworks in a sustainable development context: Reflections and perspectives. In Global Inventory of Regional and National Qualifications Frameworks, 11.

Dhawan, S. (2020). Online learning: A panacea in the time of COVID-19 crisis. Journal of Educational Technology Systems, 49(1), 522. doi: 10.1177/0047239520934018.

Hair, J. F. Jr., Black, W. C., Babin, B. J., & Anderson, R. E. (2019). Multivariate data analysis (8th ed.). EMEA: Cengage Learning.

Harvey, L. (2018). Challenges for quality assurance in higher education: Regulatory turn. In E. Hazelkorn, H. Coates, & A. C. McCormick (Eds.), Research Handbook on Quality, Performance and Accountability in Higher Education (pp. 1529). Cheltenham: Edward Elgar.

Harvey, L., & Newton, J. (2007). Transforming quality evaluation: Moving on. In D. F. Westerheijden, B. Stensaker, & M. J. Rosa (Eds.), Quality assurance in higher education: Trends in regulation, translation and transformation (pp. 225245). Dordrecht: Springer Netherlands.

Harvey, L. & Stensaker, B. (2022). Researching quality assurance: Accomplishments and future agendas. In J. Huisman & M. van der Wende (Eds.) (pp. 8195), A Research Agenda for Global Higher Education, Cheltenham: Edward Elgar.

Hassan, M. (2021). Online teaching challenges during COVID-19 pandemic. International Journal of Information and Education Technology, 11(1), 4146. doi: 10.18178/ijiet.2021.11.1.1487.

Hou, A. Y. C., Morse, B., & Wang, W. (2017). Recognition of academic qualifications in transnational higher education and challenges for recognizing a joint degree in Europe and Asia. Studies in Higher Education, 42(7), 12111228. doi: 10.1080/03075079.2015.1085010.

Hou, A. Y. C., Hill, C., Guo, C. Y., Tsai, S., & Justiniano Castillo, D. R. (2020). A comparative study of relationship between the government and national quality assurance agencies in Australia, Japan, Malaysia and Taiwan: Policy change, governance models, emerging roles. Quality in Higher Education, 26(3), 284306. doi: 10.1080/13538322.2020.1778613.

Hou, A. Y. C., Hill, C., Chan, S. J., Chen, D. I. R., & Tang, M. (2021). Is quality assurance relevant to overseas qualification recognition in Asia? Examining regulatory framework and the roles of quality assurance agencies and professional accreditors. Journal of Education and Work, 34(3), 373387. doi: 10.1080/13639080.2021.1922618.

Hou, A. Y. C., Hill, C., Ince, M., Lin, F. Y., & Chen, E. (2021). A preliminary exploration of crisis management approach on higher education and quality assurance in Taiwan under COVID-19 pandemic: Relevance to other contexts? Journal of Asian Public Policy, 15(3), 120. doi: 10.1080/17516234.2021.1919390.

Hou, A. Y. C., Lu, I. J. G., & Hill, C. (2022). What has been the impact of COVID-19 on driving digitalization, innovation and crisis management of higher education and quality assurance? -a Taiwan case study in alignment with the INQAAHE virtual review. Higher Education Policy, 35(3), 568590. doi: 10.1057/s41307-022-00267-z.

Hou, A. Y. C., Lu, I., Grace, J., Chen, K. H. J., & Guo, C. Y. (2023). Quality regulation in higher education in Asia-Pacific: Roles of quality assurance and national qualification frameworks. In D. Kapur, L. Kong, F. Lo, & D. M. Malone (Eds.), The Oxford Handbook of Higher Education in the Asia-Pacific Region (pp. 249267). Oxford University Press.

Hunt, T., Carter, R., Zhang, L., & Yang, S. (2020). Micro-credentials: The potential of personalized professional development. Development and Learning in Organizations: An International Journal, 34(2), 3335. doi: 10.1108/dlo-09-2019-0215.

International Network for Quality Assurance in Higher Education (INQAAHE) (2016). INQAAHE guidelines of good practice. Barcelona: INQAAHE.

International Network for Quality Assurance in Higher Education (INQAAHE) (2021). Inqaahe: The history of the first quality assurance network in tertiary education (1991-2021). Barcelona: INQAAHE.

International Network for Quality Assurance in Higher Education (INQAAHE) (2022). International standards and guidelines for quality assurance in tertiary education. Barcelona: INQAAHE. Available from: https://www.inqaahe.org/sites/default/files/INQAAHE-International-Standards-and-Guidelines-ISG.pdf

International Network for Quality Assurance in Higher Education (INQAAHE) (2023). GGP aligned agencies, Available from: https://www.inqaahe.org/ggp-aligned-agencies

Jarvis, D. S. (2014). Regulating higher education: Quality assurance and neo-liberal managerialism in higher education—a critical introduction. Policy and Society, 33(3), 155166. doi: 10.1016/j.polsoc.2014.09.005.

Kaiser, F., Melo, A. I., & Hou, A. Y. C. (2022). Are quality assurance and rankings useful tools to measure ‘new’ policy issues in higher education? The practices in Europe and Asia. European Journal of Higher Education, 12(sup1), 391415. doi: 10.1080/21568235.2022.2094816.

Karakhanyan, S., & Stensaker, B. (2020). The landscape, the players and developmental trends. In S. Karakhanyan, & B. Stensaker (Eds.), Global Trends in Higher Education Quality Assurance: Challenges and Opportunities in Internal and External Quality Assurance (pp. 1136). Amsterdam: Brill.

King, R. (2018). Challenges for quality assurance in higher education: Regulatory turn. In E. Hazelkorn, H. Coates, & A. C. McCormick (Eds.), Research Handbook on Quality, Performance and Accountability in Higher Education (pp. 3041). Cheltenham: Edward Elgar.

Kinser, K. (2021). Confusion about quality: US accreditation and options for reform. In NCCU International Seminar 2021, Taipei, Taiwan, [Conference presentation].

Knight, J. (2004). Quality assurance and recognition of qualification in post-secondary education in Canada. In Quality and Recognition in Higher Education: The Cross-Border Challenges (pp. 4362). Paris: OECD.

Lamie, J., & Hill, C. (2023). Key trends in international higher education post-COVID: Cruising along the open road, speeding down the super-highway or driving full pelt into a cul-de-sac? In J. Lamie, & C. Hill (Eds.), The Evolving Nature of Universities: What Shapes and Influences Identity in International Higher Education (pp. 153170). Taylor & Francis.

Liu, S., & Liu, J. (2017). Quality assurance in Chinese higher education. In M. Shah, & Q. T. N. Do (Eds.), The Rise of Quality Assurance in Asian Higher Education (pp. 1533). Oxfordshire: Chandos Publishing.

Martin, M., & Stella, A. (2007). External quality assurance in higher education: Making choices. Paris: UNESCO.

Matear, S. (2018). Evolving quality. In presented in the 10th higher education Conference on Innovation and developments in Teaching and learning quality assurance. Macao, China: Macao Polytechnic Institute.

Neyman, J. (1992). On the two different aspects of the representative method: The method of stratified sampling and the method of purposive selection. In S. Kotz, & N. L. Johnson (Eds.), Breakthroughs in Statistics: Methodology and Distribution (pp. 123150). New York, NY: Springer.

Noda, A., & Hotta, T. (2023). Can the national information Centers (NICs) promote transnational higher education in Asia and the Pacific with the Tokyo convention? A case of the NIC-Japan. In A. Y. C. Hou, J. Smith, K. H. Mok, & C. Y. Guo (Eds.), Crafting the Future of International Higher Education in Asia via Systems Change and Innovation. Higher Education in Asia: Quality, Excellence and Governance (pp. 85100). Singapore: Springer.

Organization for Economic Cooperation and Development (OECD) (2005). Guidelines for quality provision in cross-border higher education. Available from: http://www.oecd.org/dataoecd/27/51/35779480.pdf.2022

Organization for Economic Cooperation and Development (OECD) (2021). Micro-credential innovations in higher education: Who, what and why? (Vol. 39). Paris: OECD.

Organization for Economic Cooperation and Development (OECD) (2022). Education at a glance 2022. Paris: OECD Indicators. doi: 10.1787/3197152b-en.

Salmi, J. (2020). Learning from the past, coping with the present, readying for the future: Impact of covid-19 on higher education from an equity perspective. Washington, DC: Lumina Foundation.

Stensaker, B., Langfeldt, L., Harvey, L., Huisman, J., & Westerheijden, D. (2011). An in‐depth study on the impact of external quality assurance. Assessment and Evaluation in Higher Education, 36(4), 465478. doi: 10.1080/02602930903432074.

UNESCO (2020). A practical guide to recognition: Implementing the global convention on the recognition of qualifications concerning higher education. Available from: https://unesdoc.unesco.org/ark:/48223/pf0000374905 (accessed 25 August 2023).

UNESCO Bangkok (2013). A tool for the recognition of foreign qualifications: A reference for asia-pacific practitioners. Bangkok: UNESCO Bangkok.

UNESCO Bangkok (2020). Confronting COVID-19 by strengthening cooperation in qualifications recognition in the Asia-Pacific and beyond. Bangkok: UNESCO Bangkok.

United Nations (2023). Sustainable Development Goals (SDGs). Retrieved from: https://www.un.org/en/common-agenda/sustainable-development-goals (accessed 30 August 2023).

Westerheijden, D. F., Stensaker, B., Rosa, M. J., & Corbett, A. (2014). Next generations, catwalks, random walks and arms races: Conceptualizing the development of quality assurance schemes. European Journal of Education, 49(3), 42134. doi: 10.1111/ejed.12071.

Further reading

Mok, K. H., Xiong, W., Ke, G., & Cheung, J. O. W. (2021). Impact of COVID-19 pandemic on international higher education and student mobility: Student perspectives from mainland China and Hong Kong. International Journal of Educational Research, 105, 111. doi: 10.1016/j.ijer.2020.101718.

Stensaker, B. R. (2003). Trance, transparency and transformation: The impact of external quality monitoring on higher education. Quality in Higher Education, 9(2), 151159. doi: 10.1080/13538320308158.

Acknowledgements

The paper is part of the research project funded by the National Science and Technology Council, Taiwan (Project No: MOST 111-2410-H-004 -125 -MY2).

Corresponding author

Angela Yung Chi Hou can be contacted at: yungchi@nccu.edu.tw

Related articles