In the blog post announcing them, Meta did what every AI company now does with a major release.
Metas announcement was no different.
But plenty of AI obsessives immediately noticed one shocking benchmark result Meta highlighted in its post.
© Meta
The whole AI ecosystem rumbled with surprise at the results.
The company had programmed this model to be more chatty than usual.
Effectively it charmed the benchmark into submission.
It doesnt seem like LMArena was pleased with the charm offensive.
Now AI models are getting more chatty to juice their scores too.
Thats still 2.46% faster than everyone else.
As these AIs continue to mature into actual consumer-facing products well start seeing more benchmark bragging.
Hopefully, well see the other stuff too.
Not when a chatty bot can game the system so easily.
News from the future, delivered to your present.
Meta Pissed Off Everyone With Poorly Redacted Docs
Meta is being very transparent on accident.
Elon Musk and Jack Dorsey, too.
