Skip to content
/ sumo Public

MT revert translated UI elements back to English #2605

@kelimuttu

Description

@kelimuttu
Collaborator

Describe the bug
We've got a report from the French community that SUMO bot revert the already translated UI elements back to English in some articles:

Preconditions

Steps to reproduce
Steps to reproduce the behavior:

  1. Go to SUMO Bot translation that has prior translation
  2. Compare it to the previous approved translation

Expected behavior
Machine translation or SUMO Bot preserve the already translated UI elements in target language using the prior translation

Actual behavior
Machine translation or SUMO Bot revert UI elements back to English. Looks like it happen sporadically.

Screenshots/Screencasts
Image

Activity

moved this from โ“ triage to ๐Ÿ—„ backlog in Mozilla Supporton Oct 27, 2025
janbrasna

janbrasna commented on Nov 3, 2025

@janbrasna
emilghittasv

emilghittasv commented on Nov 4, 2025

@emilghittasv
Collaborator

Bug fix candidate for the current sprint.

kelimuttu

kelimuttu commented on Nov 6, 2025

@kelimuttu
CollaboratorAuthor

@janbrasna Are there any other articles in German impacted by this? I wonder if this bug is more severe than we thought.

janbrasna

janbrasna commented on Nov 6, 2025

@janbrasna

Haven't seen more, but definitely check with :Artist who has the gist of what all needed correcting after SumoBot โ€” I generally mostly saw surprisingly good results, and only the additions were being touched in general, but the cases where it, perhaps for more complex formatting, went wild and touched also already-localized things, and just plowed over them, were concerning โ€” basically MT is just translation, whereas the preexisting content was already localized by the teams, so the self-approvals overriding that human effort come across as very rude.

The only thing I'm aware of, only parallel to this issue, but a distinct problem in itself perhaps, is folks fighting with updates being constantly reverted back with regards to the actual wording in their language, e.g. in fr :YD wrestling with the same change repeatedly: 399:409 and again 446:550 โ€” this would get exhausting soon.

janbrasna

janbrasna commented on Nov 6, 2025

@janbrasna

That said, I do see the instructions clearly being there: https://github.com/mozilla/kitsune/blob/c17259f/kitsune/llm/l10n/prompt.py#L80-L83
so I'm wondering where and when it wants to touch things outside of the diff being tackled.

Maybe someone will have a few extra instructions how to stop messing with the excluded syntax, that also already differs being localized in the target content.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    bugSomething isn't working

    Type

    No type

    Projects

    Status

    ๐Ÿ—„ backlog

    Milestone

    No milestone

    Relationships

    None yet

      Development

      No branches or pull requests

        Participants

        @janbrasna@kelimuttu@emilghittasv

        Issue actions

          MT revert translated UI elements back to English ยท Issue #2605 ยท mozilla/sumo