ChatGPT Vs. Machine Translation

A Study of the potential uses and pitfalls of using Large Language Models for translation and linguistic evaluation.

‍
‍
Language is a tricky business.

While everyone is blown away by the prowess and potential of language models like ChatGPT, we decided to take a deeper look to understand how they compare to neural machine translation when it comes to idiomatic translations.

So, we compared ChatGPT's translation capabilities with systems like Google, Microsoft, and Amazon.

‍

We selected 10 common idiomatic expressions in English. Then, we provided them to Amazon, Google, and Microsoft for nontuned machine translation.

‍

We compared the results with the results of the same expressions translated by ChatGPT (GPT-3). Sign up to receive our paper and get the results!