Is the AI Job Replacement Hype Overblown? Top Translation Firm Finds AI Is Not Yet Ready to Replace Human Translators
Despite Google Translate recently discontinuing its human feedback tool called Contribute, HR leaders may want to hesitate before replacing their human translators. as a new study by a leading human-powered translation company reveals that AI-powered translations still fall short in accuracy and sophistication compared to their human counterparts
The Spanish Group, which counts U.S. government agencies among its clients, analyzed the official translations of some of this year’s Eurovision song lyrics and compared them to translations done by ChatGPT and Google Translate. The findings showed that AI often misinterpreted the original lyrics, altering the tone and overall meaning of the songs.
Internally, The Spanish Group also compared AI-powered tools to human translators for client projects. The conclusion was clear: artificial intelligence cannot match human precision, nor can it capture nuances and local language differences effectively.
The significance of accurate translations is highlighted by Croatia’s entry “Rim Tim Tagi Dim” by Baby Lasagna, the favorite to win this year’s Eurovision. A serious song about a young person leaving Croatia turns into an amusing tale with AI translations. The lyric “I won’t go far and I’ve sold my pride” becomes “I don’t go far and sold my cow” in AI translations. Similarly, Google Translate’s version of “everything is very beautiful and very perfected” turned into “the jail is very nice and very sophisticated.”
Spain’s Eurovision song “Zorra,” described as an anti-female slur which includes steamy lyrics like “I’m just a vixen to you,” was translated by ChatGPT as “I’m just a fox” and by Google Translate as “I’m just a bitch.”
Estonia’s entry “nendest narkootikumidest ei tea me (küll) midagi,” which means “We (really) don’t know anything about (these) drugs,” produced notable errors. ChatGPT translated “uniformed men visiting” from the original “a visit from men in uniform,” while Google Translate went further, interpreting it as “I’m fine with fit men in the village.”
Georgia’s entry “Firefighter” further underscored AI translation inconsistencies, with AI tools translating “I’m running like tigers” to “I’m flying like a hawk” and mistaking “dove” for “firefighter.”
Salvador Ordorica, founder of The Spanish Group, emphasized the pitfalls of relying on free AI tools. “AI-powered translation tools are useful for informal tasks like understanding menus or learning simple phrases. However, they are unsuitable for complex tasks requiring accuracy and nuance. I’ve heard of visa applications being rejected due to mistranslations.”
Commenting on the Eurovision translations, he said: “These discrepancies highlight the limitations of AI translation tools. While they have made progress, they often miss subtle nuances and cultural contexts that human translators grasp effortlessly. This analysis underscores the unique value humans bring to translation, ensuring accuracy and preserving intended meanings. In a globalized world, human translators remain essential for effective cross-cultural communication.”
As anticipation builds for the 2024 Eurovision Song Contest, the importance of accurate translations becomes clear. A recent study by WordFinderX showed that Taylor Swift is the most translated artist in the world, with fans translating 365 of her songs into 57 languages, totaling nearly 5,000 translations.
So, if you and your friends are having your Adele Carpool Karaoke moment, make sure you’re all singing from the same translation sheet.
