Job Edit Distance

Edit distance tells you how much a translation changed during a job: the share of the job's text that was inserted, deleted, or modified. It gives project managers a quick read on how much editing effort a job actually involved, without opening every segment.

• Where to find it: read the percentage in the Edit effort row of a completed job's word-count popup.

• How to read it: a low percentage means little of the job's text changed, a high percentage means heavy editing.

• How it is measured: understand what the figure counts and what it leaves out.

Viewing edit distance for a job

Edit distance is available for completed Standard and Codyt jobs.

Follow these steps to view a job's edit distance:

1. Open the Jobs page of your project.

2. Select the word-count icon on the job to open its word-count popup.

3. Read the Edit effort row, shown as a percentage directly below the No match row.

A figure of 0% means the job's text was not changed. A dash (–) means the figure is not available yet: it appears within about an hour of the job being completed, and jobs completed before this feature was enabled keep the dash, because the figure is recorded going forward and is not calculated retroactively. In Codyt projects, open the popup from the job, not from the document view, which does not show the figure.

How edit distance is measured

Edit distance answers one question: how much did the linguist change the text, compared with what they started from?

For each segment, Wordbee compares the linguist's final translation against the version they began with: a machine-translation or memory match if the segment was pre-filled, or nothing if it was empty. It counts the characters inserted, deleted, or changed, adds these up across the whole job, and divides by the combined length of all the segments in the job (not only the ones that were changed). The result is shown as a percentage.

The figure reflects the changes made by the job's assigned linguist, for this job only. A separate revision job over the same segments has its own, independent figure. It measures how much the text changed, not the quality of the result. For example, a document is first translated in a translation job and then checked in a separate revision job: the translation job's figure shows how much the translator changed the starting text, while the revision job's figure shows only what the reviewer changed afterward. The two are independent and are never added together.

Pretranslation or machine translation applied before the linguist starts is the starting point, not counted as their editing.

Reading the percentage:

A pure translation-from-scratch job reads close to 100%, because every character is new. That is expected: a high figure means a lot of editing, not a problem.

A worked example

A job contains two segments, both pretranslated by machine translation. The linguist post-edits them:

• Segment 1: color becomes colour (one character added). Final length: 6 characters.

• Segment 2: The meeting is at 3pm becomes The meeting is at 4pm (one character changed). Final length: 21 characters.

Two characters changed across 27 characters of text, so the job's edit distance is about 7%: a light post-editing pass.

What the figure counts

• Text only: the measurement looks at the words. Moving or changing formatting tags without changing the text counts as no edit (0%).

• Very long changes are skipped: changes to very long segments (roughly 500 characters or more on either side) are excluded by design, so the figure reflects typical segment editing.

• One of several edit-distance figures: this is calculated independently from other edit-distance numbers you may see in Wordbee (such as the MT-evaluation edit distance from a quality-assessment integration), so the values are not directly comparable.

When the figure can go above 100%

For a standard job handled by one linguist, edit distance normally stays between 0% and about 100%. Two less common situations can push it higher, because the figure counts editing effort and divides by the final text length.

Large deletions

When a linguist removes most of a segment, the change is large but it is measured against the small amount of text that remains.

Example: a segment is pretranslated with a 200-character machine translation, and the linguist keeps only a 20-character sentence. About 180 characters are removed, but that change is divided by the 20 characters that remain, so this segment alone counts as roughly 900%. If much of a job is trimmed this way, the job's overall figure can rise above 100%.

A segment revised more than once

Edit distance counts the editing that was done, not the net before-and-after difference. If a segment is changed, then reverted or changed by someone else, and then changed again, each round of changes is added up, while the segment's length is counted only once.

Example: a linguist translates a segment, a reviewer changes it, and the linguist then edits it again. Both of the linguist's rounds of changes are counted, so the total can exceed the segment's length. This is uncommon in a standard job assigned to a single linguist, where consecutive edits by the same person are treated as one change.

Learn More

• Create and Assign Jobs: How jobs are created, assigned, and completed.

• Revision History Panel: View the revisions a segment went through in the Editor.