Activities

CELCT has been actively involved in the following events:

2012

• Coordinator of the subjective evaluation of the IWSLT 2012 Evaluation Campaign. Results presented at IWSLT 2012 (Hong Kong, December 6-7, 2012)
• Third party with respect to FBK in the European Project called TOSCA-MP: Task-oriented search and content annotation for media production. CELCT is in charge of manual annotation, transcription and translation tasks of audio data.
• Third party with respect to FBK in the European Project called EXCITEMENT - EXploring Customer Interactions through Textual EntailMENT. CELCT is in charge of the production of the design and the annotation guidelines for the domain datasets.
• Co-Organizer of the Cross-lingual Textual Entailment (CLTE) for Content Synchronization task at Semeval 2012 workshop, collocated with NAACL-HLT Montreal, Canada (June 7-8, 2012)
• “UniUtrecht: Textual Entailment Dataset”: job commissioned by the University of Utrecht to create a dataset of 1,000 textual entailment pairs involving numerical and temporal reasoning phenomena
• Organization Chair of CLEF 2012: running of the labs, management and preparation of the publications related to the event (both conference and labs), and development and update of the event Web site. CLEF 2012 will be held in Rome 17-20 September, 2012
• Technical Co-Coordination of the QA4MRE 2012 Question Answering for Machine Reading Evaluation Evaluation lab. Results presented at CLEF 2012 (17-20 September, 2012)

2011

• Organization Chair of CLEF 2011: running of the labs, management and preparation of the publications related to the event (both conference and labs), and development and update of the event Web site. CLEF 2011 was held in Amsterdam 19-22 September, 2011
• Coordinator of the subjective evaluation of the IWSLT 2011 Evaluation Campaign. Results presented at IWSLT 2011 (San Francisco, USA, December 8-9, 2011)
• Technical Co-Coordination of the QA4MRE 2011 Question Answering for Machine Reading Evaluation Evaluation lab. Results presented at CLEF 2011 (19-22 September, 2011)
• Coordinator of RTE7 - Seventh Recognising Textual Entailment Challenge. Results presented at TAC2011 (NIST, Gaithersburg, MD, USA, November 14-15, 2011)
• Scientific Coordinator, web site and proceedings management of EVALITA 2011 - Evaluation of NLP Tools for Italian (Roma, Italy, January 24-25,2012)
• Organizer of Named Entity Recognition on Transcribed Broadcast News and Cross-document Coreference Resolution of Named Person Entities tasks at EVALITA 2011 (Roma, Italy, January 24-25, 2012)

2010

• Organization Chair of CLEF 2010 : running of the labs, management and preparation of the publications related to the event (both conference and labs), and development and update of the event Web site. CLEF 2012 was held in Padua 20-23 September, 2010
• Co-coordinator of ResPubliQA. Results presented at CLEF 2010 (20-23 September, 2010)
• Coordinator of RTE6 - Sixth Recognising Textual Entailment Challenge. Results presented at TAC2010 (NIST,Gaithersburg, MD,USA, November 15-16, 2010)

2009

• a Multilingual Information Access ( MLIA ) Technology Transfer Day was organized at the World Business Alliance Center in Berlin, December 8, 2009
• Coordinator of EVALITA 2009 - Evaluation of NLP Tools for Italian (Reggio Emilia, Italy, December 12, 2009)
• Co-Organizer of the EVALITA 2009 workshop organized in Reggio Emilia in conjunction with AI*IA 2009 (December 12, 2009)
• Organizer of the Local Entity Detection and Recognition task at EVALITA 2009 (Reggio Emilia, Italy, December 12, 2009)
• Coordinator of RTE5 - Fifth Recognising Textual Entailment Challenge. Results presented at TAC 2009 (NIST, Gaithersburg, MD, USA, November 16-17, 2009).
• Coordinator of the ResPubliQA 2009 track. Results presented at CLEF 2009 (Corfu, Greece, September 30 - October 2, 2009).
• Co-Organizer of the GIkiCLEF 2009 track. Results presented at CLEF 2009 (Corfu, Greece, September 30 - October 2, 2009).
• Co-Organizer of the TrebleCLEF Panel on Evaluation in Information Retrieval at ESSIR 2009 (Padua, Italy, August 31 - September 4, 2009).
• Co-Organizer of the TrebleCLEF Summer School on Multilingual Information Access (Pisa, Italy, June 15-19, 2009).
• Co-Organizer of the TrebleCLEF Workshop on Query Log Analysis: From Research to Best Practice (London, UK, May 27-28, 2009).

2008

• Coordinator of RTE4 - Fourth Recognising Textual Entailment Challenge. Results presented at TAC 2008 (NIST, Gaithersburg, MD, USA, November 17-19 2008)
• Co-Organizer of the TrebleCLEF Workshop on Best Practices for System Developers: Bringing Multilingual Information Access to Operational Systems (Winterthus, Switzerland, October 2-3, 2008)
• Coordinator of the QA@CLEF2008 track. Results presented at CLEF 2008 (Aarhus, Danmark, September 17- 19, 2008)
• Co-Organizer of the TrebleCLEF Workshop on Best Practices for the Development of Multilingual Information Access Systems: The User Perspective (Segovia, Spain, June 24-25, 2008)
• Co-Organizer of Euromatrix Third Workshop On Statistical Machine Translation at ACL 2008 (Columbus, OH, USA, June 19, 2008)
• Co-Organizer of TrebleCLEF Workshop on Novel Methodologies for Evaluation in Information Retrieval at ECIR '08 - European Conference for Information Retrieval (Glasgow, Scotland, 30 March 2008)

2007

• Co-Organizer of IWSLT 2007 - International Worshop on Spoken Language Translation (Trento, Italy, October 15-16, 2007)
• Coordinator of the QA@CLEF2007 track. Results presented at CLEF 2007 (Budapest, Hungary, September 19-21, 2007)
• Co-Organizer of EVALITA 2007 - Evaluation of NLP Tools for Italian (Rome, Italy, September 10, 20077)
• Coordinator of RTE3. Results presented at the Workshop on Textual Entailment and Paraphrasing at ACL 2007 (Prague, Czech Republic, June 28-29, 2007)
• Co-Organizer of Euromatrix Second Workshop On Statistical Machine Translation at ACL 2007 (Prague, Czech Republic, June 23, 2007)
• Organizer of "COME MIGLIORARE LA QUALITÁ DELLA COMUNICAZIONE SUL WEB" (Trento, Italy, April 18, 2007)
• Invited speaker at ACE 2007 - Automatic Content Extraction (Gaithersburg, MD, USA, March 28-30, 2007)
• Invited speaker at VVC2 - Visual & Vocal Comunication (Rome, Italy, March 19-20, 2007)
• Invited speaker at SSML 2007 - "Qual è la parola? Traduzione tra Immagine e Linguaggio" - Scuola Superiore per Mediatori Linguistici (Pisa, Italy, March 1-2, 2007)

2006

• Co-Organizer of AISV 2006 (Trento, Italy, November 29 - December 1, 2006)
• Co-Organizer of IWSLT 2006 (Kyoto, Japan, November 27-28, 2006)
• Coordinator of the QA@CLEF 2006 track. Results presented at CLEF 2006 (Alicante, Spain, September 20-22, 2006 )
• Co-organizer of RTE2 - Second PASCAL Recognising Textual Entailment Challenge. Results presented at the RTE2 Pascal Workshop (Venice, Italy, April 10, 2006)
• Sponsor of EACL 2006 (Trento, Italy, April 3-7, 2006)
• Sponsor of TAL 2006 (Rome, Italy, March 9-10, 2006)

2005

• Organizer of Algorithmic Techniques to search web, xml and text documents, a seminar by Prof. Ferragina (ITC-irst, Trento, Italy, December 5, 2005) – See also the Documentation section to download presentations
• Co-Organizer of 2� Convegno Nazionale AISV - Associazione Italiana di Scienze della Voce: "ANALISI PROSODICA" teorie, modelli e sistemi di annotazione (Salerno, Italy, November 30 - December 2, 2005)
• Organizer of "Eye tracking tutorial", Kerstin Kl�ckner (Trento, Italy, November 8-12, 2005)
• Invited speaker at "Scienze umane, Storia e Informatica" (Pisa, Italy, September 28-29, 2005)
• Coordinator of the QA@CLEF 2005 track. Results presented at CLEF 2005 (Vienna, Austria, September 21-23, 2005)