AnnotationPrep

Localization, Tone & Writing Constraints practice questions

40 questions from the Bilingual RLHF & writing constraints practice test.

Start practising

Localization, Tone & Writing Constraints practice drill

10 scenarios, graded as you go, with the exact grading principle for every answer. Start free, no sign-up.

Sample scenarios

PROMPT

Translate "Break a leg at your audition tonight!" into natural Spanish for a friend.

MODEL A

¡Rómpete una pierna en tu audición esta noche!

MODEL B

'¡Mucha suerte en tu audición de esta noche!' (or '¡Mucha mierda!' in theater slang, if appropriate).

Why does Model A fail?

  1. Literal idiom translation: translating 'break a leg' word-for-word into Spanish sounds like wishing physical injury rather than good luck.
  2. Spanish does not have a word for 'audition'.
  3. It used exclamation marks.
  4. Model A is better because literal translations are always preferred.
Show the answer

A. Literal idiom translation: translating 'break a leg' word-for-word into Spanish sounds like wishing physical injury rather than good luck.

Bilingual RLHF evaluations penalize 'translationese'—translating idioms literally when the target language does not share the idiom.

Principle: Localization QA: Idiomatic Equivalence

A prompt asks for a polite customer-support apology in Japanese (日本語) to an enterprise client.
Model A uses casual plain form (だ・である / 〜だよ).
Model B uses appropriate business honorifics (敬語 / 丁寧語, e.g., 申し訳ございません).

Which passes?

  1. Model A, because casual Japanese is shorter.
  2. Model B, because business customer support in Japanese requires polite/honorific register (keigo), and casual forms are inappropriate.
  3. Tie.
  4. Neither, because apologies cannot be written in Japanese.
Show the answer

B. Model B, because business customer support in Japanese requires polite/honorific register (keigo), and casual forms are inappropriate.

Register mismatch (informal vs. formal/honorific) is one of the top criteria on bilingual AI tutor and OneForma linguistic assessments.

Principle: Localization QA: Register & Honorifics

PROMPT

Rewrite this paragraph in active voice: "The quarterly report was reviewed by the finance team, and three errors were found by the lead auditor."

Select the best evaluation:

  1. 'The quarterly report had been reviewed by the finance team, and three errors were discovered.'
  2. 'The finance team reviewed the quarterly report, and the lead auditor found three errors.'
  3. 'Three errors were found in the quarterly report by the finance team.'
  4. 'The finance team was reviewing the report while errors were being found.'
Show the answer

B. 'The finance team reviewed the quarterly report, and the lead auditor found three errors.'

Option B converts both passive clauses ('was reviewed by...', 'were found by...') into crisp active voice where the subjects perform the actions.

Principle: Writing QA: Active vs. Passive Voice