Automatic Lyrics Transcription On Jam Alt 4
평가 지표
Case Error Rate
Line break F-1
Punctuation F-1
Word Error Rate (WER)
평가 결과
이 벤치마크에서 각 모델의 성능 결과
비교 표
| 모델 이름 | Case Error Rate | Line break F-1 | Punctuation F-1 | Word Error Rate (WER) |
|---|---|---|---|---|
| jam-alt-a-formatting-aware-lyrics | 3.2 | 66.1 | 34.9 | 43.3 |
| lyrics-transcription-for-humans-a-readability | - | 73.4 | 45.9 | 27.7 |
| lyrics-transcription-for-humans-a-readability | - | 73.7 | 45.3 | 27.1 |
| jam-alt-a-formatting-aware-lyrics | 2.0 | 84.9 | 45.8 | 34.9 |
| jam-alt-a-formatting-aware-lyrics | 3.2 | 69.4 | 30.9 | 44.9 |
| jam-alt-a-formatting-aware-lyrics | 3.2 | 73.4 | 45.8 | 27.7 |
| lyrics-transcription-for-humans-a-readability | - | 65.6 | 36.1 | 38.2 |
| jam-alt-a-formatting-aware-lyrics | 3.3 | 77.8 | 42.4 | 34.7 |
| lyrics-transcription-for-humans-a-readability | - | 77.9 | 42.3 | 34.7 |
| lyrics-transcription-for-humans-a-readability | - | 69.3 | 32.0 | 44.9 |
| lyrics-transcription-for-humans-a-readability | - | 77.9 | 42.5 | 34.7 |
| lyrics-transcription-for-humans-a-readability | - | 36.0 | 30.6 | 71.6 |
| lyrics-transcription-for-humans-a-readability | - | 40.9 | 22.3 | 78.5 |
| lyrics-transcription-for-humans-a-readability | - | 69.3 | 32.0 | 44.9 |
| lyrics-transcription-for-humans-a-readability | - | 66.0 | 38.0 | 43.3 |
| lyrics-transcription-for-humans-a-readability | - | 88.6 | 46.1 | 20.8 |