Blog Paper of the Week Series Courses Store Pricing

← On-Device LLMs Model Preparation

Section 0 · Lecture 1 · 1:12

welcome and course overview

section 1 intro →

0. Welcome

Free

welcome and course overview1:12

1. On-Device AI and Mobile Hardware

Free

section 1 intro0:12
ondevice ai and mobile soc9:00
bandwidth roofline runtimes10:24

2. Model Compression Theory

quantization formula and ptq10:00
qat ste pruning distillation9:36
llm quantization and decision tree9:12

3. Small Language Models

section 3 intro0:12
slm definition and lineup9:30
kv cache and tokenizer efficiency9:12
language benchmarks and selection framework9:36

4. llama.cpp and GGUF

environment token and cmake build9:30
download convert quantize and bench8:30
size vs speed quality and tuning8:30

5. MLC LLM

mlc difference install convert11:54
mlc compile artifacts test port8:36

6. ONNX Runtime Conversion

why onnx optimum export8:54
int4 woq inference execution providers9:12
ep benchmark graph speculative app tips9:24

Exploring the frontiers of AI, LLMs, and Diffusion models. Building the future, one line of code at a time.

Explore

Blog
Series
Store
Pricing
Courses

Products

DrillCheck - AI Interview
VibeCheck - Mobile Vibe Coding
Nestoz Inc.

© 2026 SOTAAZ Lab All rights reserved.

welcome and course overview — On-Device LLMs Model Preparation | SOTAAZ Blog