Groq API – 500+ Tokens/s – First Impression and Tests – WOW!
👊 Become a member and get access to GitHub:
📧 Join the newsletter:
🌐 My website:
Groq:
www.groq.com
In this video I give my first impression and to multiple test on the Groq API. Like real time speech to speech and comparing Groq to ChatGPT. A new chip design for running inference on AI apps like LLMs. Thanks to Groq for giving me early access!
00:00 Groq API Intro
00:45 Groq LPU
01:45 Groq Real Time Speech to Speech Test
06:07 Groq vs ChatGPT Test
09:33 Groq Chain Prompting Test
11:15 Conclusion
source
