WP9 User requirements and evaluation - M30

Summary of progress

To improve the communication between work packages, we have set up a bug tracking system in http://tfs.cc/trac, and assigned the flagship leaders to be in charge of their component. Everyone using the tools is encouraged to leave their comments and requests in trac.

Maarit Koponen's work in evaluating semantical aspects of machine translation quality is progressing. We have started recruiting people for translation quality evaluation, and got response from the University of Pisa, with Italian-English and Italian-German as possible language pairs.

Targeting towards D9.2, we have started gathering evaluations from the grammar writers. Individual use cases can be measured in terms of translation quality, but good grammar design principles will make any grammar easier to write and maintain. We evaluate the grammars in terms of D2.3, a best practices document.

Highlights

Maarit Koponen's article Comparing human perceptions of post-editing effort with post-editing operations was accepted in Seventh Workshop on Statistical Machine Translation (Montreal) and published in the proceedings.

Deviations from Annex I

No major deviations reported. Minor actions include the addition of grammar quality evaluation.