Anthropic "forgot" to mention in the Claude 3 announcement that it compared the model to the "old" GPT-4, not the GPT-4 Turbo

A company founded by former OpenAI employees promoted their language model as "surpassing ChatGPT", but there is a catch.

The thing is, Claude 3 only surpasses the very first GPT-4 model released by OpenAI a year ago, not the more powerful GPT-4 Turbo, which in Promptbase's comparative analysis actually outperforms the competitor in every test.

Somewhat interesting advertising choice from Anthropic, comparing their newly released Claude 3 to GPT-4 on release (March 2023).

According to Promptbase's benchmarking, GPT-4-turbo scores better than Claude 3 on every benchmark where we can make a direct comparison. https://t.co/k3tQEpTxScpic.twitter.com/W3sRcOud4f

— Tolga Bilge (@TolgaBilge_) March 4, 2024

Anthropic marketers instead decided that it was better not to mention this in the announcement, focusing only on comparative data regarding the "old" GPT-4 (after all, they placed this "inconvenient" detail in the footnotes of the announcement).

This somewhat inconvenient detail is briefly acknowledged in the footnotes of Anthropic's announcement:https://t.co/R7PJIcb6Gxpic.twitter.com/Jsxp60qYNk

— Tolga Bilge (@TolgaBilge_) March 4, 2024

In general, AI developers are not new to using advertising tricks to promote their creations - Google previously admitted that a demonstration video of Gemini AI was staged.