Mistral 7B

Описание

Resources:
*LLM comparison notebook* https://github.com/TrelisResearch/install-guides
*Runpod affiliate link* https://tinyurl.com/yjxbdc9w
*Supervised Fine-tuning Tutorial* https://youtu.be/DMcxxg5iEZQ

0:00 Intro
0:08 Video Overview
0:34 Mistral 7B architecture and design
3:33 Runpod setup
4:24 Mistral 7B Evaluation
6:18 Test 1: Random sequence reversal
7:24 Test 2: Code generation
9:03 Test 3: Passkey retrieval
10:26 Test 4: Fine-tuning
13:06 Evaluation Summary
14:30 EXTRA: Grouped Query Attention
15:31 EXTRA: Sliding Window Attention