Lightning-fast demos from Groq went viral this weekend, making current versions ofChatGPT,Geminiand even Grok look sluggish.
While ChatGPT, Gemini, and other chatbots are impressive, Groq could make them lightning-fast.
Fast enough to have practical use cases in the real world.
Photo: Groq Inc./Amanda Dalton/Handout (Reuters)
Groq is an inference engine, not a chatbot like ChatGPT, Gemini, or Grok.
It helps these chatbots run incredibly fast but does not replace them altogether.
Groq produces 247 tokens/second compared to Microsofts 18 tokens/second, according to athird-party test from Artificial Analysispublished last week.
That means ChatGPT could run more than 13x as fast if it was running on Groqs chips.
AI chatbots like ChatGPT, Gemini, and Grok could be significantly more useful if they were faster.
But with Groks increased speeds, that video could be a reality.
Before Groq, Ross co-founded Googles AI chip division, which produced cutting-edge chips to train AI models.
The name Grok comes from Stranger in a Strange Land, a 1961 science fiction book by Robert Heinlein.
The word means to understand profoundly and intuitively.
Thats the reason so many AI companies are using it to describe their AI products.
Not only is there Rosss Groq and Elon Musks Grok, but theres also anAI-enabled IT company named Grok.
Grimes also has anAI-powered toy, Grok,supposedly named after the way she and Musks children say Grocket.
However, Ross claims his Groq was first in 2016.
Groqs increased chip speeds could jumpstart the AI world, creating new possibilities for real-time communication with AI chatbots.
News from the future, delivered to your present.
