What kinds of AI are susceptible to model collapse?
Model collapse shows up when an artificial intelligence model is excessively trained on AI-generated data.
LLMs generally are built to both comprehend and produce text, making them useful as chatbots and AI assistants.
The MareNostrum 5 supercomputer in Barcelona.© Photo by Adria Puig/Anadolu via Getty Images
In the late stage of model collapse, [the] model breaks down fully.
In case youre unaware, a moderately large modelproduces twice the CO2 emissionsof an average Americans lifetime.
The team input text into the model on the topic of designing 14th century church towers.
We should note that most of these are not actual species of jackrabbits.
Model collapse grows more critical as AI content saturates the web
A cluttered internet is nothing new.
But AI-generated text can be produced faster than human gibberish, raising concerns on a larger scale.
Among other things, model collapse poses challenges for fairness in generative AI.
This presents a risk that minority groups or viewpoints will be less represented, or potentially erased.
O brave new world, with such AI in it!
News from the future, delivered to your present.
Two banks say Amazon has paused negotiations on some international data centers.
