How Can We Improve Determinism in the AI Tech Stack (LLMs): Temperature, Seeds, and Tools
HUBSPOT Free E-book:
👊 Become a member and get access to GitHub and Code:
🤖 Great AI Engineer Course:
🔥 Open GitHub Repos:
📧 Join the newsletter:
🌐 My website:
Today we are looking if and how we can improve deterministic outputs in LLMs. We do some experiments with open source model like phi3 and bigger modles like gpt4o
3Blue1Brown:
00:00 AI Determinism Intro
00:24 AI Tech Stack vs Software Tech Stack
02:17 How to Improve Determinism in LLMs?
04:13 Hubspot
05:28 Improving Determinism Tests
08:29 What is Temperature in a LLM?
12:43 Improving Determinism Tests
17:12 OpenAI Seeds
20:52 Conclusion
This Video was sponsored by Hubspot
source
