warning: Creating default object from empty value in /home/local/www/molto-project.eu/sites/all/modules/i18n/i18ntaxonomy/i18ntaxonomy.pages.inc on line 34.

     

WP9

WP9 User requirements and evaluation - M39

Summary of progress

Due to the progress of other work packages, the actual evaluation work was started at Spring 2013. Some of the evaluations were made within work packages, for instance the patent cases (WP7) were evaluated with automatic evaluation metrics, and the semantic multilingual wiki (WP11) was evaluated internally for usability.

WP9 User requirements and evaluation - M30

Summary of progress

To improve the communication between work packages, we have set up a bug tracking system in http://tfs.cc/trac, and assigned the flagship leaders to be in charge of their component. Everyone using the tools is encouraged to leave their comments and requests in trac.

Maarit Koponen's work in evaluating semantical aspects of machine translation quality is progressing.

WP9 User requirements and evaluation - M24

Summary of progress

This WP is working on collecting evaluation plans from each site.

An extended D9.1E Evaluation plan has been written.

Highlights and planned evaluation methods

Progress evaluation has mainly been carried out by each site during development. This would be a good idea to collect this more systematically.

For the SMT/hybrid patent case, automatic measures (BLEU but also others - maybe check Cristina/UPC slides for examples) are probably mainly used.

Syndicate content