WP9 User requirements and evaluation - M18

Summary of progress

The work done during the months 12-18 the results are targeting for the preliminary work for D9.2 - the final evaluation.

Highlights

We have gained much input from Maarit Koponen's review on post-editing analysis and quality measurement in MT evaluation, also presented during the Open Day at the Third Project Meeting in Helsinki.

For designing the evaluation of translator's tools, we have studied different translation management systems, that are common in the translation industry. We have selected GlobalSight, an open-source platform, for a closer study.

We also have set up a MOLTO Content Factory server, which provides collaborative term voting and term validation. These features will be used in evaluation of terminology work. The MOLTO server has an URL already - but currently, UHEL security measures make it http-accessible only via UHEL's VPN. UHEL is working to find a solution for opening up the server to the MOLTO Consortium compatible with the university security policies. The server base URL is "http://tfs.cc/" and the mediawiki content is hosted at "http://tfs.cc/wiki", as demonstrated during the MOLTO Open Day.

There is an ongoing discussion about collaboration with local entrepreneurs who are researching pre-editing and pre-validation of machine translatable documents. The research is focused in MT quality and its evaluation metrics.

Deviations from Annex I

This work package is tightly related to other work packages, likewise to the dissemination work package. Due to the changes in the Patents Case Study (WP7) we are reviewing the related material for evaluation purposes. We are going to announce updates to the earlier evaluation plan (D9.1) as needed.

Use of resources

The use of resources follows the earlier plans.