Summary
The harmonised metric will consist of a union of the MQM error type hierarchy and the DQF analytic metric The harmonisation will involve the addition of necessary categories from DQF to MQM and the adoption of shared terminology TAUS will determine which categories if any to add to DQF from the MQM master hierarchy The result will be a joint publication of the results and use of the harmonised terminology for error types in both MQM and DQF The harmonised metric will be tested on a set of approximately 300 segments of ENDE data taken from T31 with triple annotation to ensure that annotators are able to deploy the metric correctly and to suggest improvements to training materials Testing will be conducted in cooperation with GALA The result will be a report on agreement and suggestion for any needed changes to the metric profile chosen to be used in subsequent tasks
