User choice as an evaluation metric for cross language IM

A method for evaluating MT performance embedded in Cross-Language Instant Messaging (CLIM) systems is presented. A web interface that provided concurrent real- time translation for instant messaging from multiple MT services was developed and used by paid participants to collaborate on a photo identification task. The method showed a task performance benefit due to the availability of multiple translation alternatives.

Ogden, William, Ron Zacharski, Sieun An and Yuki Ishikawa. 2009. User choice as an evaluation metric for web translation services in cross language instant messaging applications. Proceedings of the Machine Translation Summit XII. Ottawa, Canada. (pdf)

No Comments

Categories Machine Translation, Publications | Tags:

Social Networks: Facebook, Twitter, Google Bookmarks, del.icio.us, StumbleUpon, Digg, Reddit, Posterous.

You can follow any follow up comments to this entry through the RSS 2.0 feed.

Leave a Reply

You can use these tags: <a href="" title=""> <abbr title=""> <acronym title=""> <b> <blockquote cite=""> <cite> <code> <del datetime=""> <em> <i> <q cite=""> <strike> <strong>

By submitting a comment here you grant Ron Zacharski a perpetual license to reproduce your words and name/web site in attribution. Inappropriate or irrelevant comments will be removed at an admin's discretion.