Acceso abierto

Research on the construction of virtual playing environment and its human-computer interaction performance improvement in piano teaching

  
21 mar 2025

Cite
Descargar portada

Figure 1.

Diagram structure of HMM
Diagram structure of HMM

Figure 2.

Kinect bone tracks 25 binders
Kinect bone tracks 25 binders

Figure 3.

HMM topology structure
HMM topology structure

Figure 4.

Descriptive analysis results of each level of experience score
Descriptive analysis results of each level of experience score

Figure 5.

Interactive gesture current frequency and expected score
Interactive gesture current frequency and expected score

Figure 6.

User reviews at the interface level
User reviews at the interface level

Figure 7.

User ratings of emotional resonance
User ratings of emotional resonance

The average curvature of the fingers under each gesture

Curvature Gesture
Finger one two three X
Index finger 12 96 15 5 8
Middle finger 14 12 76 6 5
The fourth finger 8 8 40 76 57
Little finger 20 3 4 8 104

The result of gesture recognition

Gesture Correct frequency Number of errors Total degree The accuracy rate
Spread your fingers 294 6 300 98.00%
Half-closed fist 293 7 300 97.67%

Relationship between hand z value and piano ratio

Hand z value Piano ratio Hand z value Piano ratio Hand z value Piano ratio
600 0.6 850 0.48 1100 0.45
650 0.6 900 0.45 1150 0.48
700 0.6 950 0.43 1200 0.3
750 0.53 1000 0.4 1250 0.3
800 0.50 1050 0.43 1300 0.3

Single sample t test analysis results

Name Sample size Minimum value Maximum value Mean value Standard deviation t p
Functional experience 124 1.00 7.00 4.721 1.579 3.517 0.002**
Content experience 124 1.00 7.00 4.602 1.591 3.251 0.001**
Interface experience 124 1.00 7.00 4.685 1.684 3.243 0.000**
Emotional experience 124 1.00 7.00 4.806 1.607 4.019 0.001**
Value experience 124 1.00 7.00 4.643 1.825 2.858 0.016*

Dynamic gesture classification

Gesture 1 2 3 4 5
Figure