Ultra Fast LocalGPT inference with Groq API

Описание

In this video we will learn how to use the Groq API with localgpt to buiild a RAG pipline. This will enable you to chat with your documents using the Fast LPU inference that Groq has to offer.

🦾 Discord: https://discord.com/invite/t4eYQRUcXB
☕ Buy me a Coffee: https://ko-fi.com/promptengineering
|🔴 Patreon: https://www.patreon.com/PromptEngineering
💼Consulting: https://calendly.com/engineerprompt/consulting-call
📧 Business Contact: engineerprompt@gmail.com
Become Member: http://tinyurl.com/y5h28s6h

💻 Pre-configured localGPT VM: https://bit.ly/localGPT (use Code: PromptEngineering for 50% off).

LINKS:
LocalGPT: https://tinyurl.com/26sk3puj
Groq: https://youtu.be/S53BanCP14c

Signup for Advanced RAG:
https://tally.so/r/3y9bb0


TIMESTAMPS:
[00:00] Groq with LocalGPT
[00:29] Sneak Peek: Upcoming UI for Local GPT
[01:20] Setting Up the Environment
[06:55] Setting up Groq API in localgpt
[05:35] Comparing Performance: Grok API vs. Hugging Face Models



All Interesting Videos:
Everything LangChain: https://www.youtube.com/playlist?list=PLVEEucA9MYhOu89CX8H3MBZqayTbcCTMr

Everything LLM: https://youtube.com/playlist?list=PLVEEucA9MYhNF5-zeb4Iw2Nl1OKTH-Txw

Everything Midjourney: https://youtube.com/playlist?list=PLVEEucA9MYhMdrdHZtFeEebl20LPkaSmw

AI Image Generation: https://youtube.com/playlist?list=PLVEEucA9MYhPVgYazU5hx6emMXtargd4z