Center for the Evaluation of Language and Communication Technologies

The Center for the Evaluation of Language and Communication Technologies (CELCT) was an organisation devoted to the evaluation of language technologies, located in Povo, Trento (Italy).

CELCT was established in 2003 by FBK (Fondazione Bruno Kessler) and DFKI (Deutsches Forschungszentrum für Künstliche Intelligenz), and was funded by the Autonomous Province of Trento. The goals of CELCT were "to set up infrastructures and develop skills in order to operate successfully in the field of the evaluation of language and communication technologies, becoming a reference point in the field at the national and European levels."^[1] CELCT interpreted its mission by carrying out several activities in the field of HLT evaluation, mainly focusing on the organization of national and international evaluation campaigns and on the creation of speech and text corpora in different languages and at different linguistic annotation levels.^[1]

CELCT's activities were closed on December 31, 2013. The staff working at CELCT at the time of its closure is continuing their research activities within FBK.^[2]

European Projects

• TOSCA-MP:^[3][4][5] Task-oriented search and content annotation for media production
• EXCITEMENT:^[6] EXploring Customer Interactions through Textual EntailMENT
• PROMISE:^[7][8] Participative Research labOratory for Multimedia and Multilingual Information Systems Evaluation
• TrebleCLEF: Evaluation, Best Practice & Collaboration for Multilingual Information Access
• EuroMatrix:^[9] Statistical and Hybrid Machine Translation Between All European Languages

Other Projects

• LiveMemories:^[10] Active Digital Memories of Collective Life - Project funded by the Autonomous Province of Trento
• OntoText:^[11] From Text to Knowledge for the Semantic Web - Project funded by the Autonomous Province of Trento
• Law Making Environment^[12] - Project in collaboration with Consiglio Nazionale delle Ricerche

Evaluation Campaigns

CELCT was involved in the following initiatives devoted to the evaluation of Natural Language Processing tools, collaborating with various organizations and networks of excellence both at the national and international level:

• Document Understanding Conference: DUC 2005^[13]
• Multilingual Question Answering Track at CLEF^[14] (from 2005 to 2013)
• Recognizing Textual Entailment (RTE) Challenges^[15] (from 2005 to 2013)
• International Workshop on Spoken Language Translation: IWSLT 2006,^[16][17] IWSLT 2007,^[18][19] IWSLT 2011,^[20][21] and IWSLT 2012^[22][23]
• Evalita:^[24] Evaluation of NLP and Speech Tools for Italian (2007, 2009, 2011)
• Cross-Lingual Textual Entailment task at Semeval (2012^[25] and 2013^[26])

Publications

CELCT produced a number of scientific publications in all its activity fields.^[27][28][29]

References

1. "CELCT web site". Retrieved 10 January 2014.
2. "Fondazione Bruno Kessler website". Retrieved 10 January 2014.
3. "TOSCA-MP European project website". Retrieved 18 January 2014.
4. "Deliverable D2.1 of TOSCA-MP project" (PDF). Retrieved 10 January 2014.
5. "Deliverable D2.2 of TOSCA-MP project" (PDF). Retrieved 10 January 2014.
6. "EXCITEMENT European project website". Retrieved 18 January 2014.
7. "PROMISE website". Retrieved 18 January 2014.
8. "Partners of PROMISE". Retrieved 13 January 2014.
9. "Euromatrix European project website".
10. "LiveMemories website". Retrieved 26 February 2014.
11. "Ontotext project website". Retrieved 18 January 2014.
12. "Law Making Environment project website". Retrieved 18 January 2014.
13. "DUC 2005 website".
14. "CLEF web site". Retrieved 10 January 2014.
15. "RTE challenges website". Retrieved 18 January 2014.
16. "IWSLT2006 website". Retrieved 18 January 2014.
17. "Organizers of IWSLT 2006". Retrieved 10 January 2014.
18. "IWSLT2007 website". Retrieved 18 January 2014.
19. "Organizers of IWSLT 2007". Retrieved 10 January 2014.
20. "IWSLT2011 website". Retrieved 18 January 2014.
21. "Organizers of IWSLT 2011 evaluation campaign". Retrieved 10 January 2014.
22. "IWSLT2012 website". Retrieved 18 January 2014.
23. "MT Track organizers of IWSLT 2012". Retrieved 10 January 2014.
24. "Evalita website". Retrieved 18 January 2014.
25. "CLTE@Semeval-2012 website". Retrieved 18 January 2014.
26. "CLTE@Semeval-2013 website". Retrieved 22 January 2014.
27. "Complete list of CELCT publications". Retrieved 18 January 2014.
28. "List of CELCT publications in the ACL Anthology Network". Retrieved 18 January 2014.
29. "List of CELCT publications in the ACL Anthology Searchbench". Retrieved 18 January 2014.