The questions asked by researchers required the LLM to take a number of steps to ascertain information for answer.
The LLMs didnt do very well.
In the meantime, the average success rate for human respondents is 92%.
Yann LeCun, Vice President and Chief AI Scientist for Meta Platforms, testifies before the U.S. Senate Intelligence Committee at the Hart Senate Office Building on September 19, 2023 in Washington, DCPhoto: Kevin Dietsch (Getty Images)
News from the future, delivered to your present.
Why the Hell Is OpenAI Building an X Clone?
OpenAI is reportedly planning on making a social media platform because content to train on ain’t cheap.