Apply to become a certified provider
TC-STAR 2005 Evaluation Package - ASR English
TC-STAR is a European integrated project focusing on Speech-to-Speech Translation (SST). To encourage significant breakthrough in all SST technologies, annual open competitive evaluations are organized. Automatic Speech Recognition (ASR), Spoken Language Translation (SLT) and Text-To-Speech (TTS) are evaluated independently and within an end-to-end system. The first TC-STAR evaluation campaign took place in March 2005. Two core technologies were evaluated during the campaign: • Automatic Speech Recognition (ASR), • Spoken Language Translation (SLT). Each evaluation package includes resources, protocols, scoring tools, results of the official campaign, etc., that were used or produced during the first evaluation campaign. The aim of these evaluation packages is to enable external players to evaluate their own system and compare their results with those obtained during the campaign itself. The speech databases made within the TC-STAR project were validated by SPEX, in the Netherlands, to assess their compliance with the TC-STAR format and content specifications. This package includes the material used for the TC-STAR 2005 Automatic Speech Recognition (ASR) first evaluation campaign for the English language. The same packages are available for both Spanish (ELRA-E0003) and Mandarin (ELRA-E0004) for ASR and for SLT in 3 directions, English-to-Spanish (ELRA-E0005), Spanish-to-English (ELRA-E0006), Chinese-to-English (ELRA-E0007). To be able to chain the components, ASR and SLT evaluation tasks were designed to use common sets of raw data and conditions. Two evaluation tasks, common to ASR and SLT, were selected: EPPS (European Parliament Plenary Sessions) task and VOA (Voice of America) task. This package was used within the EPPS task and consists of 2 data sets: - Development data set: consists of audio recordings of Parliament’s sessions from 25 to 28 October 2004, manually transcribed. Approximately 3.5 hours of recordings were selected and transcribed, corresponding to approximately 35,000 running words in English. - Test data set: consists of audio recordings of Parliament’s sessions from 15 to 18 November 2004. As for the development set, the test data set is made of 3.5 hours (35,000 running words).
ELRA