Hey everyone! In this tutorial, I’m showing you how to run large language models (LLMs) on your local machine using Docker. We’ll talk about the benefits, including saving on inference costs and having total control over your models. I’ll guide you step-by-step on installing Docker Desktop, enabling necessary features, and downloading models. I’ll also demonstrate how to set up a basic app that interacts with Docker just like an API from OpenAI or Google. This is perfect for anyone looking to develop AI-powered apps locally. Big thanks to Docker for sponsoring this video! Don’t forget to check out the demo app available for download in the description. Have any questions? Drop them in the comments below!
▼ Link(s) From Today’s Video:
Docker:
Demo App:
► MattVidPro Discord:
► Follow Me on Twitter:
► Buy me a Coffee!
————————————————-
▼ Extra Links of Interest:
General AI Playlist:
AI I use to edit videos:
Instagram: instagram.com/mattvidpro
Tiktok: tiktok.com/@mattvidpro
Gaming & Extras Channel:
Let’s work together!
– For brand & sponsorship inquiries:
– For all other business inquiries: [email protected]
Thanks for watching Matt Video Productions! I make all sorts of videos here on Youtube! Technology, Tutorials, and Reviews! Enjoy Your stay here, and subscribe!
All Suggestions, Thoughts And Comments Are Greatly Appreciated… Because I Actually Read Them.
00:00 Introduction to Local AI Models
01:23 Setting Up Docker Desktop
02:10 Configuring Docker for AI Models
03:38 Downloading and Running AI Models
07:26 Developing AI-Powered Apps
10:05 Advanced Tips and Troubleshooting
13:42 Conclusion and Final Thoughts
source
