Autonomous Open Source LLM Evaluator (Ollama) – Full Guide
👊 Become a member and get access to GitHub and Code:
🤖 Great AI Engineer Course:
🔥 Open GitHub Repos:
📧 Join the newsletter:
🌐 My website:
Today I take a look at my Autonomous Open Source LLM Evaluator using Ollama and GPT-4. This is a neet tool to test open source LLMs on different tasks like problems and code
00:00 Ollama LLM Eval Intro
00:21 Ollama LLM Eval Flowchart
01:28 LLM Evaluator Code 1
06:24 Test 1
08:30 LLM Evaluator Code 2
09:13 Test 2
10:53 Conclusion
source
