An Analysis of the Effectiveness of Psychology Education in Higher Education Institutions Based on the ARCS Model

Figure 1.

Average scores for the three levels of indicators

Three-level index	Index score	Three-level index	Index score
A11	3.98	B32	3.85
A12	3.58	C11	3.57
A21	3.25	C12	3.34
A22	4.55	C21	3.22
A23	4.79	C22	4.29
A31	3.42	C23	3.71
A32	3.16	D11	3.59
A41	4.32	D12	3.49
A42	3.95	D21	3.47
B11	3.36	D22	3.78
B12	3.97	E11	3.36
B21	3.45	E12	3.81
B22	3.19	E21	3.41
B23	3.54	E31	3.62
B31	3.23

Index system content

Primary index	Secondary index	Three-level index
(A) background evaluations	(A1) Institutional setup and system construction	(A11) Has a psychology course teaching research group
		(A12) To develop the school psychology education system
	(A2) Construction of campus culture	(A21) Students study and live in a beautiful environment
		(A22) Hold psychological and cultural festivals to popularize mental health ideas
		(A23) Actively carry out extracurricular psychological education activities
	(A3) Curriculum Provision	(A31) Courses in psychology were offered
		(A32) Optional courses such as success psychology are offered
	(A4) Input of teaching	(A41) Provide pre-job training for new teachers
		(A42) Teaching required hardware and software equipment is complete
(B) Teacher evaluation	(B1) Teaching qualification	(B11) Bachelor degree or above in psycology
		(B12) Psychology professional
	(B2) Teaching level	(B21) In the course evaluation system can be praised by students
		(B22) Teaching supervision gave a good evaluation
	(B3) Teaching attitude	(B31) Make high quality course PPT
		(B32) Carefully assign and check students’ homework
(C) Materials evaluation	(C1) Technical feature	(C11) Standard and scientific use of language, text and graphics
		(C12) Illustrations are used wisely
	(C2) content characteristics	(C21) The theoretical knowledge of psychology is comprehensive
		(C22) Psychological theories are explained by examples
		(C23) Reasonable structure arrangement
(D) Process evaluation	(D1) The execution of the teaching plan	(D11) Classroom teaching shall be carried out according to the teaching plan
		(D12) Teaching can effectively achieve the purpose of teaching
	(D2) The use of teaching means	(D21) Reasonable use of psychological tests, psychodrama and other psychological means in class
		(D22) Reasonable use of projectors and other teaching equipment
(E) Academic achievement assessment	(E1) Student benefit	(E11) Excellent results in the final test
		(E12) Form a healthy and harmonious psychological and cultural atmosphere
	(E2) Sustainability of curriculum construction	(E21) Curriculum construction is operable
	(E3) Extensibility of curriculum construction	(E31) The curriculum construction experience is easy to be transplanted and can be extended to other schools

Index weight of student training quality evaluation index

Primary index	weight	Secondary index	weight	Three-level index	weight
A	0.112	A1	0.199	A11	0.396
				A12	0.504
		A2	0.284	A21	0.480
				A22	0.443
				A23	0.177
		A3	0.193	A31	0.412
				A32	0.588
		A4	0.324	A41	0.481
				A42	0.519
B	0.301	B1	0.252	B11	0.243
				B12	0.757
		B2	0.555	B21	0.738
				B22	0.128
				B23	0.134
		B3	0.193	B31	0.597
				B32	0.403
C	0.125	C1	0.421	C11	0.528
				C12	0.472
		C2	0.579	C21	0.216
				C22	0.274
				C23	0.510
D	0.351	D1	0.654	D11	0.496
				D12	0.504
		D2	0.346	D21	0.742
				D22	0.258
E	0.111	E1	0.502	E11	0.468
				E12	0.532
		E2	0.498	E21	0.632
				E31	0.368

Secondary indicator score

Secondary index	Index score	Secondary index	Index score
A1	3.91	C1	3.45
A2	3.17	C2	3.58
A3	3.31	D1	3.25
A4	3.21	D2	4.15
B1	3.21	E1	4.19
B2	3.52	E2	3.42
B3	3.09	E3	3.16

Statistical analysis of index measurements

Three level index measurement items	Mean value	Standard deviation	Variable coefficient	Result
A11	4.93	0.5179	0.1553	retain
A12	4.41	0.8293	0.1463	retain
A21	4.48	0.5123	0.1275	retain
A22	4.29	0.7756	0.157	retain
A23	4.97	0.458	0.1011	retain
A31	4.01	0.5478	0.1775	retain
A32	4.21	0.4392	0.144	retain
A41	4.31	0.4704	0.1656	retain
A42	4.82	0.6627	0.165	retain
B11	4.75	0.6179	0.0902	retain
B12	4.91	0.699	0.1207	retain
B21	4.34	0.6709	0.1597	retain
B22	4.45	0.7862	0.1634	retain
B23	4.19	0.699	0.1786	retain
B31	4.19	0.5443	0.1515	retain
B32	4.94	0.3995	0.1569	retain
C11	5.00	0.00	0.0000	retain
C12	5.00	0.00	0.0000	retain
C21	5.00	0.00	0.0000	retain
C22	5.00	0.00	0.0000	retain
C23	5.00	0.00	0.0000	retain
D11	4.91	0.3263	0.0905	retain
D12	4.84	0.6811	0.1017	retain
D21	4.93	0.3745	0.1668	retain
D22	4.14	0.706	0.1442	retain
E11	4.03	0.4537	0.097	retain
E12	4.46	0.7	0.1097	retain
E21	4.52	0.6002	0.1354	retain
E31	4.67	0.4375	0.1791	retain

Primary index score

Primary index	Index score	Secondary index	Index score
A	3.54	D	3.62
B	3.91	E	3.82
C	3.71

Results of the AHP hierarchy analysi

Item	Eigenvector	Weighted value	Max-eigen value	CI value	RI value	CR value	Consistent result
A	0.301	10.000%	3.000	0.000	0.521	0.000	pass
B	0.900	30.000%
C	0.100	10.000%
D	1.802	30.000%
E	0.201	20.000%

Statistical analysis of first-level indicators

Primary index	Mean value	Standard deviation	Variable coefficient	Result
A	4.15	0.375	0.0942	retain
B	4.82	0.294	0.0563	retain
C	5.00	0.000	0.000	retain
D	4.85	0.385	0.801	retain
E	4.65	0.456	0.951	retain

Judgment matrix of first-level indicators

	A	B	C	D	E
A	1	1/7	1/3	1/6	1/4
B	7	1	1/4	1/5	1/2
C	3	4	1	1/2	1/3
D	6	5	2	1	1/5
E	4	2	3	5	1

Results of the consistency testing were performed

Specialist	Max-eigen value	CI value	RI value	CR value	Consistent result
1	3.000	0.000	0.521	0.000	pass
2	3.000	0.000	0.521	0.000	pass
3	3.000	0.000	0.521	0.000	pass
4	3.000	0.000	0.521	0.000	pass
5	3.000	0.000	0.521	0.000	pass
6	3.000	0.000	0.521	0.000	pass
7	3.000	0.000	0.521	0.000	pass
8	3.000	0.000	0.521	0.000	pass
9	3.000	0.000	0.521	0.000	pass
10	3.007	0.003	0.521	0.024	pass
11	3.003	0.001	0.521	0.035	pass
12	3.003	0.001	0.521	0.037	pass
13	3.006	0.003	0.521	0.26	pass
14	3.000	0.000	0.521	0.000	pass
15	3.000	0.000	0.521	0.000	pass
16	3.000	0.000	0.521	0.000	pass
17	3.002	0.001	0.521	0.018	pass
18	3.000	0.000	0.521	0.000	pass
19	3.000	0.000	0.521	0.000	pass
20	3.000	0.000	0.521	0.000	pass
21	3.000	0.000	0.521	0.000	pass
22	3.005	0.002	0.521	0.041	pass
23	3.008	0.004	0.521	0.063	pass
24	3.002	0.001	0.521	0.052	pass
25	3.000	0.000	0.521	0.000	pass

Statistical analysis of secondary indicators

Secondary indicators	Mean value	Standard deviation	Variable coefficient	Result
A1	4.91	0.287	0.0687	retain
A2	4.15	0.289	0.0932	retain
A3	4.23	0.385	0.1165	retain
A4	4.85	0.246	0.0835	retain
B1	4.90	0.186	0.0645	retain
B2	4.17	0.364	0.0987	retain
B3	4.89	0.259	0.0654	retain
C1	5.00	0.000	0.000	retain
C2	5.00	0.000	0.000	retain
D1	4.58	0.365	0.1346	retain
D2	5.00	0.000	0.000	retain
E1	4.41	0.247	0.0723	retain
E2	4.13	0.475	0.0526	retain
E3	4.96	0.311	0.0761	retain