ISSN 0798 1015

logo

Vol. 40 (Number 2) Year 2019. Page 12

Assessing the Quality and Effectiveness of Additional Vocational Education

Evaluación de la calidad y efectividad de la educación vocacional adicional

Artemy G. VARZHAPETYAN 1; Elena G. SEMENOVA 2; Alena V. FOMINA 3; Viktor M. BALASHOV 4; Karina v. BALASHOVA 5

Received: 04/08/2018 • Approved: 28/11/2018 • Published 21/01/2019


Contents

1. Introduction

2. Literature review

3. Methods

4. Results

5. Discussion

6. Conclusion

Bibliographic references


ABSTRACT:

Modern requirements bring to the forefront the concept of continuing education throughout the whole life including such important component as corporate education. The article deals with the aspects related to additional vocational education in technology and management that contribute to improving one of every company’s main values – organizational knowledge of processes, phenomena, and mechanisms of functioning. Such education is significant for improving a company’s innovative activity. The authors propose an algorithm aimed at identifying and minimizing educational risks, as well as criteria for assessing the effectiveness of corporate education within the system of additional vocational education. The article addresses the external and internal spheres of education quality assessment, educational programs, and education process management methods.
Keywords: additional vocational education, corporate education, education quality assessment

RESUMEN:

Los requisitos modernos ponen en primer plano el concepto de educación continua a lo largo de toda la vida, incluido un componente tan importante como la educación corporativa. El artículo trata sobre los aspectos relacionados con la educación profesional adicional en tecnología y gestión que contribuyen a mejorar uno de los valores principales de cada empresa: el conocimiento organizativo de los procesos, los fenómenos y los mecanismos de funcionamiento. Dicha educación es importante para mejorar la actividad innovadora de una empresa. Los autores proponen un algoritmo destinado a identificar y minimizar los riesgos educativos, así como criterios para evaluar la efectividad de la educación corporativa dentro del sistema de educación vocacional adicional. El artículo aborda los ámbitos externo e interno de la evaluación de la calidad de la educación, los programas educativos y los métodos de gestión del proceso educativo.
Palabras clave: educación vocacional adicional, educación corporativa, evaluación de la calidad de la educación.

PDF version

1. Introduction

High rates of scientific and technological progress and revolutionary changes in production technology have led to a peculiar situation that is characteristic for the whole world – that university graduates’ level of competence fails to correspond to industry and business companies’ requirements. In light of this, corporate education that contributes to acquiring new competencies is taking on greater importance (Gackstatter et al., 2014; Ponchek, 2016; Thune, & Børing, 2015). Continuing vocational education is instrumental in improving one of every company’s main values – organizational knowledge of processes, phenomena, and mechanisms of functioning.

Additional vocational education based completely on the Education → Research → Innovations triangle is becoming sought-after (Cervantes, 2017; Hartl et al., 2014; Pascoe, & Vonortas, 2014; Unger, & Polt, 2017). Corporate education within the additional vocational education system is aimed at improving existing competencies or acquiring new ones, and all this contributes to the innovational development of a company and increasing the consumer value of products or services that such company produces.

Empirical analysis to assess the relationship between the knowledge management capabilities, processes and performance of the company has indicated the existence of conditioning factors (Luhn et al., 2017). Similar trends are traced when studying the relationship between the adapted measurements of services quality and students’ satisfaction (Dalati, & Al Hamwi, 2016). Thus, the research focuses on studying additional vocational education (AVE) from the perspective of possibilities to develop the innovation potential. Within the research, the following tasks were set:

 

2. Literature review

Corporate education in AVE is implemented in compliance with the ISO 9001 standard (ISO 9001:2015. Quality Management Systems – Requirements, 2015), according to which in managing a company its strategic, tactic, and operative goals must be taken into account. The detailed analysis of various AVE models is performed in reports and articles (Diner, & Sturova, 2016; Savina, 2016; Mendoza, 2015; UNESCO, 2014; Wilson et al., 2014); here the authors aim at describing the main aspects only. Among European AVE models, the Swedish model taken as a basis at several Russian universities is highlighted (Mozhaeva, & Mozaheva-Renha, 2014; Rashidi, 2013). The model is based on the principle of continuing education, its forward-looking nature and close interaction with employers with financial support from the state and adapting the AVE system to the needs of the job market.

In recent years, the method aimed at developing students’ creative skills, the ability to construct one’s knowledge independently, acquire necessary competencies, orientate oneself in the informational space, as well as critical thinking, has been actively implemented at all levels of education. General ideas and algorithms of the project work method in a higher education institution are detailed in the paper by Yakovleva et al. (2013). Knowles (1980) identifies three main models of using a project approach in the educational process: a project as an exercise; a project as an element of the educational process; and a project as the educational method.

In Canada and the US (Wilson et al., 2014), such form of additional vocational education as "experience-based education" has been developing actively in close connection with students’ practical professional activity. The American AVE system means developing own educational techniques. The main task of all the forms and types of training and professional development is "to make knowledge productive". In the US, this system involves about 20 million people, each of whom takes a professional development course during 500 days in 10 years of work (approximately 10-15% of the work time). By comparison, in Russia this parameter amounts to approximately 30 days in 10 years (Primshits, 2016).

The Japanese model (Savina, 2016) of professional education in firms is based on the "flexible employee" concept – an employee is trained not in one but in two or three fields with further professional development throughout his/her whole life. It should be noted that the Japanese model of AVE pays less attention to graduates’ level of competence; the focus is mostly on various aspects of AVE that allow taking into account the specific features of a company. Personnel rotation is a significant element of improving managers’ qualification. Lately, these mechanisms have been also developing in Russian companies in the form of on-the-job training or appointment ad interim, especially as regards training of top managers.

3. Methods

In order to develop the algorithm of managing additional vocational education, the authors have used the experience of interacting with various departments of OOO Toyota Motor factory (Saint Petersburg). Upon stating the aim of the training, the algorithm of the AVE process can be presented as a consequence of the following stages: 1. Planning → 2. Implementation → 3. Monitoring → 4. Evaluation of the results.

The content of the stages is briefly presented below.

1. Planning:

2. Implementation:

Within the implementation of an educational program, all possible training activities may be included (seminars, laboratory practicals, practices, business games, trainings, etc.).

3. Monitoring. The effectiveness of training stages is evaluated by a teacher leading the educational program (and a representative of a branch that sent a student, if necessary). Following each stage, participants of project groups discuss the results and directions for further work and identify areas of concern.

4. Evaluation of results. This stage includes the analysis of achieving the planned values of the educational process parameters. In order to do this, a quantitative assessment method is used that includes two groups of parameters: achieving the targets of the educational program and quality assessment shown in Fig. 2. The set of parameters can be expanded based on the specific features of a certain educational program.

Figure 1
Educational program effectiveness evaluation parameters

The list of parameters and their significance coefficients are determined by expert evaluation methods (Durham College, 2016; Antokhina et al., 2017). If the parameters are evaluated within the 0.1 range, the effectiveness E of executing the plan of educational program implementation work plan can be evaluated according to the following formula:

where xk – the value of the critical parameter taken on the basis of the current company’s technical education systems: n – the number of target parameters; wi – the significance coefficient of the i-th target parameter; xi – the planned value of the i-th target parameter; xfi – actual quantitative assessment of the i-th target parameter.

One of the possible grades of educational program effectiveness evaluation is presented in Table 1.

Table 1
Levels of educational program effectiveness evaluation.

Category

Target function value

Managerial decision

Effective

At least 0.75

To declare effective

Effective with comments

At least 0.5 but less than 0.75

Additional consideration is required to take a final decision

Ineffective

Less than 0.5

To declare ineffective

 

In some cases, the effectiveness is not evaluated as the company’s management may be interested in evaluating the aggregate of local target parameters that allows having a more detailed evaluation of the results of the performed training activity.

4. Results

Training results should be presented as a measurable and differentiated level of grasping competencies required for performing job functions within the professional activity. Applying widely used systems of knowledge control and assessment systems (for example, Moodle) allows evaluating the quality of an educational program quite correctly.

Three components of the education quality are generally indicated: (1) the quality of education results (knowledge, skills, competencies); (2) the quality of educational programs of AVE, the criterion of a program’s quality being its ability to ensure the expected results; and (3) the quality of managing a company performing corporate education. As an example, the results of self-checking the quality of the educational program "Quantum Electronics Devices. Magnetometers" implemented by the Institute of Additional Education of the Peter the Great St. Petersburg Polytechnic University and the R&D company "Radar MMS", JSC.

The scope of the educational program was 72 hours including 36 lecture hours, 18 hours of seminars and laboratory practicals, and 18 hours of a student’s independent work. The program was focused on creating the following competencies of students:

The examination took place from April 12, 2017 to June 29, 2017 for a group of students consisting of 15 persons (Table 2). In order to self-check the quality of the educational project, a method of evaluating under a 10-point scale according to seven proposed criteria was used; the criteria allowed comprehending the level of implementation and usefulness for students.

Table 2
Assessing the quality of the educational program

Assessment parameter

Average point acc.
to a 10-point scale

  • Informational value (receiving new information)

7.33

  • Attractiveness

6.93

  • Applicability, the possibility of practical use of the received knowledge

6.73

  • Comprehensibility of presenting the material

6.27

  • Novelty, modern tendencies

6.93

  • The possibility to share the experience with colleagues

7.27

  • Qualification of teaching staff

8.36

The high grade of teaching staff qualification is caused by quite high requirements that the university set for selecting lecturers, arranging a required laboratory and production facility, preparing educational materials and sets of test cases.

The analysis of the obtained results confirmed the advisability of combining theoretical classes and practical sessions in the educational project. Students noted the informational value and novelty of the presented material, as well as its applicability and the possibility of practical use. During sessions, additional opportunities for contacting and sharing experience with colleagues from related business units were provided.

5. Discussion

Any company providing corporate education should include the issues of managing corporate education processes in its management system. The way to do that most effectively should be selected by each company independently. Creation and constant improvement of the system of assessing the quality of corporate education within additional vocational education is an objective necessity preconditioned by satisfying the need in competent specialists that exists in society.

Within the AVE system, selecting this or that model of independent assessment and quality recognition is defined by the subtype of a program and the target consumer group to a much larger extent than within the system of secondary vocational or higher education. The following parameters can be proposed to characterize the quality of corporate education:

The strategic aim of inter-corporate education is to ensure the process of improving the competence level that corresponds to the innovative type of development. This includes three areas of education: first, necessary education that includes the minimal amount of knowledge required to carry out effective professional activity within the performed competencies; second, focused education of a strategic nature aimed at a limited number of personnel, in order to create reserve for future advancement; and third, developing education that allows obtaining additional knowledge and developing skills that are not necessary for one’s current professional activity.

The general presentation of the goals, levels, and forms of AVE and companies organizing the process is shown in Fig. 2.

Figure 2
The system of additional vocational education

6. Conclusion

The article deals with the aspects of additional vocation education performed as corporate education. The carried out research allows making the following conclusions – as compared to basic education, the AVE system reacts to changes in the job market in a more operative manner. Advanced training and retraining programs are implemented within shorter periods, are oriented at a specific customer, and react to changes in the market in a more mobile manner. The proposed algorithm of corporate education is invariant to applied models due to taking into account the process related to identification and minimization of educational risks and the criteria for evaluating the effectiveness of the AVE process.

Bibliographic references

Antokhina, Yu.A., Varzhapetyan, A.G., Ivanov, N.N., Semenova, E.G., & Fomina, A.V. (2017). Managing Innovative Activity Risks in the Electronics Industry. St. Petersburg: Politekhnika.

Cervantes, M. (2017). Higher Education Institutions in the Knowledge Triangle. Foresight and STI Governance, 11(2), 27-42.

Dalati, S., & Al Hamwi, S. (2016). Sustainable development in higher education through service quality and price fairness: empirical evidence from private universities in Syria. Entrepreneurship and Sustainability Issues, 4(1), 25-38.

Diner, A.A., & Sturova, I.S. (2016). Review of the Foreign Experience in the Sphere of the Additional Vocational Education of Adults and Senior Citizens. Economics. Profession. Business, 1, 80-89.

Durham College, Canada. (2016). Global Class. Additional Education and Professional Development. Retrieved February 1, 2017, from http://www.global-class.org/edu/5

Gackstatter, S., Kotsemir, M., & Meissner, D. (2014). Building an Innovation-Driven Economy – The Case of BRIC and GCC Countries. Foresight, 16(4), 293-308.

Hartl, J., Lassnigg, L., & Unger, M. (2014). Higher Education Institutions and the Knowledge Triangle: Improving the Interaction between Education, Research and Innovation. Vienna: Institute for Advanced Studies.

ISO 9001:2015. Quality Management Systems – Requirements. (2015). Retrieved December 12, 2017, from https://www.iso.org/obp/ui/#iso:std:iso:9001:ed-5:v1:en

Knowles, M. (1980). The Modern Practice of Adult Education: From Pedagogy to Andragogy. Wilton, Connecticut: Association Press.

Luhn, A., Aslanyan, S., Leopoldseder, C., & Priess, P. (2017). An evaluation of knowledge management system's components and its financial and non-financial implications. Entrepreneurship and Sustainability Issues, 5(2), 315-329. https://doi.org/10.9770/jesi.2017.5.2(11).

Mendoza, P. (2015). Industry-Academia Linkages: Lessons from Empirical Studies and Recommendations for Future Inquiry. In Higher Education: Handbook of Theory and Research (pp. 469-523). Heidelberg: Springer International Publishing.

Mozhaeva, G.V., & Mozaheva-Renha, P.N. (2014). Swedish Model of Additional professional Education and Its Implementation in Russia. Proceedings of Moscow Institute of Physics and Technology, 6(4),182-193.

Pascoe, C., & Vonortas, N.S. (2014). University Entrepreneurship: A Survey of US Experience. In N.S. Vonortas, C. Phoebe, & A. Aridi (Eds.), Innovation Policy: A Practical Introduction (pp. 27-46). Heidelberg; New York; Dordrecht; London: Springer.

Ponchek, T.J. (2016). To Collaborate or Not to Collaborate? A Study of the Value of Innovation from a Sectoral Perspective. Journal of the Knowledge Economy, 7(1), 43-79.

Primshits, V.V. (2016). Development of the Competence Approach in the Personnel Continuing Education System. In Modern Tendencies in Adults’ Additional Education: Proceedings of the 3rd Scientific and Methodical Conference, Minsk, October 21, 2016: In Two Parts (Part 2, pp. 64-66). Minsk, RIVSH.

Rashidi, A.M. (2013). The Swedish model of Additional Vocational Training. Continuing Professional Education in the Country and the World, 3(3), 34-37.

Savina, N.N. (2016). Additional Education Models in the Modern World. Professional Education in the Modern World, 6(2), 324-332.

Thune, T., & Børing, P. (2015). Industry PhD Schemes: Developing Innovation Competencies in Firms. Journal of the Knowledge Economy, 6(2), 385-401.

U.S. Department of Education. (2016). Adult Education and Family Literacy Act of 1998. Retrieved November 10, 2016, from at www.ed.gov/policy/adulted/leg/legis.html

UNESCO. (2014). Report by the Director General on a Draft Strategy for Technique and Vocational Education and Training (TVET). Paris: UNESCO Paris. Retrieved September 21, 2017, from unesdoc.unesco.org/images/./180869e.pdf

Unger, M., & Polt, W. (2017). The Knowledge Triangle between Research, Education and Innovation – A Conceptual Discussion. Foresight and STI Governance, 11(2), 10-26.

Wilson, B., Osborne, M., Devereux, S., & Godling, B. (2014). Lifelong Learning PoliciesEurope, Australia and the Place of Education in the Post-2015 Sustainable Development Goals: Report of a Policy Briefing Conducted by the European Union Centre at RMIT. RMIT University. European Union Centre.

Yakovleva, N.F., Belova, E.N., Savolaynen, G.S., & Falaleyev, A.N. (2013). Models of Educators’ Professional Competence Development: A Joint Monograph (2nd ed.). Krasnoyarsk: Krasnoyarsk State Pedagogical University named after V.P. Astafyev.


1. Dr. Sci. (Engineering), Professor, Saint Petersburg State University of Aerospace Instrumentation (GUAP). Email: vаgbnм@gmаil.com

2. Dr. Sci. (Engineering), Professor, Saint Petersburg State University of Aerospace Instrumentation (GUAP). Email: еgsеmеnоvа@mail.ru

3. Dr. Sci. (Economics), Assistant professor, JSC “Central Research Institute of Economy Management and Information Systems “Electronics”. Email: fоminа_а@instеl.ru

4. Dr. Sci. (Engineering), Professor, JSC Research and Production Enterprise ‘Radar mms’. Email:  bаlаshоv_viktоr@mаil.ru

5. Deputy General Director for Strategic Development, Scientific-research institute “Mashtab”. Email: karina.balashova.87@inbox.ru


Revista ESPACIOS. ISSN 0798 1015
Vol. 40 (Nº 2) Year 2019

[Index]

[In case you find any errors on this site, please send e-mail to webmaster]

revistaESPACIOS.com