ChatGPT Vs. Machine Translation

A Study of the potential uses and pitfalls of using Large Language Models for translation and linguistic evaluation.

Your subscription could not be saved. Please try again.
Your subscription has been successful.

Access the Paper

By submitting this form, you agree that the personal data you provided will be under Bureau Works Privacy Policy.


Language is a tricky business.

While everyone is blown away by the prowess and potential of language models like ChatGPT, we decided to take a deeper look to understand how they compare to neural machine translation when it comes to idiomatic translations.

So, we compared ChatGPT's translation capabilities with systems like Google, Microsoft, and Amazon.

We selected 10 common idiomatic expressions in English. Then, we provided them to Amazon, Google, and Microsoft for nontuned machine translation.

We compared the results with the results of the same expressions translated by ChatGPT (GPT-3). Sign up to receive our paper and get the results!