Weiya You, Shaohuan Zhou, Shiyin Kang, Yuren You, Jiankun Hu, Deyi Tuo, Zhiyong Wu
ABSTRACT
The acciaccatura is a kind of ornaments which is very commonly used in playing or singing. The flexible use of the acciaccatura can make the singing more expressive. However, as far as we observe, there is no research on the analysis of the acciaccatura and its prediction. In this paper, we analyze a Chinese music score dataset with acciaccatura annotations. Base on the analysis results, we obtain the factors affecting the acciaccatura: duration and pitch, and use them as features, after being encoded by embedding, they are feed into BiLSTM-CRF models which have good performance in named entity recognition (NER) to predict the acciaccatura position and pitch. Finally, the ABX tests is used to verify that the music score containing the model’s predicted acciaccatura allowed the singing voice synthesis model to synthesize a more beautiful song.
ACCIACCATURA PREDICTION
Our goal is to predict the acciaccatura position and acciaccatura pitch from the original score. Finally, the acciaccatura score is used to synthesize a more beautiful song.
PREDICTION ACCIACCATURA POSITION IS THE SAME AS LABELING
The percentage of sentences with the exact same predicted acciaccatura position and labeling was 69.61%.
| No | Labeled music score | Audio | Without acciaccatura | Audio | Predicted music score | Audio |
|---|---|---|---|---|---|---|
| 1 |  |
 |
 |
|||
| 2 |  |
 |
 |
|||
| 3 |  |
 |
 |
|||
| 4 |  |
 |
 |
|||
| 5 |  |
 |
 |
|||
| 6 |  |
 |
 |
|||
| 7 |  |
 |
 |
LESS PREDICTION ACCIACCATURA POSITION THAN LABELING
The percentage of sentences with only partial acciaccatura labels missing was 16.99%.
| No | Labeled music score | Audio | Without acciaccatura | Audio | Predicted music score | Audio |
|---|---|---|---|---|---|---|
| 1 |  |
 |
 |
|||
| 2 |  |
 |
 |
|||
| 3 |  |
 |
 |
|||
| 4 |  |
 |
 |
|||
| 5 |  |
 |
 |
MORE PREDICTION ACCIACCATURA POSITION THAN LABELING
The percentage of sentences with more partial acciaccatura labels was 10.01%.
| No | Labeled music score | Audio | Without acciaccatura | Audio | Predicted music score | Audio |
|---|---|---|---|---|---|---|
| 1 |  |
 |
 |
|||
| 2 |  |
 |
 |
|||
| 3 |  |
 |
 |
|||
| 4 |  |
 |
 |
SAME NUMBER, PREDICTION ACCIACCATURA POSITION OFFSET
The percentage of predicted sentences with the same number of acciaccatura but with acciaccatura position shifts was 2.42%.
| No | Labeled music score | Audio | Without acciaccatura | Audio | Predicted music score | Audio |
|---|---|---|---|---|---|---|
| 1 |  |
 |
 |
|||
| 2 |  |
 |
 |
|||
| 3 |  |
 |
 |
OTHER SITUATIONS
The percentage of sentences with other cases was 0.957%.
| No | Labeled music score | Audio | Without acciaccatura | Audio | Predicted music score | Audio |
|---|---|---|---|---|---|---|
| 1 |  |
 |
 |