-
Notifications
You must be signed in to change notification settings - Fork 9
Open
Labels
bugSomething isn't workingSomething isn't working
Description
Describe the bug
We've got a report from the French community that SUMO bot revert the already translated UI elements back to English in some articles:
- https://support.mozilla.org/fr/kb/marque-pages-firefox/compare?locale=fr&to=309488&from=291238
- https://support.mozilla.org/fr/kb/modifier-date-ou-heure-%C3%A9v%C3%A9nement/compare?locale=fr&to=309001&from=139780
Preconditions
Steps to reproduce
Steps to reproduce the behavior:
- Go to SUMO Bot translation that has prior translation
- Compare it to the previous approved translation
Expected behavior
Machine translation or SUMO Bot preserve the already translated UI elements in target language using the prior translation
Actual behavior
Machine translation or SUMO Bot revert UI elements back to English. Looks like it happen sporadically.
samutich
Metadata
Metadata
Assignees
Labels
bugSomething isn't workingSomething isn't working
Type
Projects
Status
๐ backlog
Milestone
Relationships
Development
Select code repository
Activity
janbrasna commentedon Nov 3, 2025
Similar in German:
https://support.mozilla.org/de/kb/pdf-dateien-in-firefox-oder-anderem-viewer-ansehen/compare?locale=de&to=312143&from=296056 incl. more formatting and even content bits reverted to EN.
emilghittasv commentedon Nov 4, 2025
Bug fix candidate for the current sprint.
kelimuttu commentedon Nov 6, 2025
@janbrasna Are there any other articles in German impacted by this? I wonder if this bug is more severe than we thought.
janbrasna commentedon Nov 6, 2025
Haven't seen more, but definitely check with :Artist who has the gist of what all needed correcting after SumoBot โ I generally mostly saw surprisingly good results, and only the additions were being touched in general, but the cases where it, perhaps for more complex formatting, went wild and touched also already-localized things, and just plowed over them, were concerning โ basically MT is just translation, whereas the preexisting content was already localized by the teams, so the self-approvals overriding that human effort come across as very rude.
The only thing I'm aware of, only parallel to this issue, but a distinct problem in itself perhaps, is folks fighting with updates being constantly reverted back with regards to the actual wording in their language, e.g. in fr :YD wrestling with the same change repeatedly: 399:409 and again 446:550 โ this would get exhausting soon.
janbrasna commentedon Nov 6, 2025
That said, I do see the instructions clearly being there: https://github.com/mozilla/kitsune/blob/c17259f/kitsune/llm/l10n/prompt.py#L80-L83
so I'm wondering where and when it wants to touch things outside of the diff being tackled.
Maybe someone will have a few extra instructions how to stop messing with the excluded syntax, that also already differs being localized in the target content.