Overview
Llama-3.2-3B-Instruct is a 3.2-billion-parameter instruction-tuned model from Meta.
- License: Llama3.2
- Context length: 128K tokens
- Languages: Multilingual
- Minimum hardware: ~8 GB VRAM
- Strengths: lightweight on-device chat and summarization
Highlights
- 3.2B-parameter model sized for local hardware.
- Runs on ~8 GB VRAM.
- Handles long inputs with a 128K-token context window.
- Strong at tool calling tasks.
- Also handles reasoning and summarization out of the box.
What it is good at
Meta tuned Llama-3.2-3B-Instruct for multilingual dialogue, summarization, and agentic retrieval. The capabilities reported for it map to a few practical jobs:
- Tool calling — it can emit structured function calls, so you can wire it to local scripts or a retrieval step and have it decide when to call them.
- Reasoning and summarization — it condenses long reports or threads inside the 128K context and answers questions grounded in the text you give it.
- Code — it drafts and explains short functions, shell commands, and config snippets for quick local coding help.
- Multilingual chat — it handles dialogue across several languages, useful for translation drafts and answering in the user's language.
Running it locally
At 3.2B parameters the model is light. In full FP16 precision it needs roughly 7 GB of VRAM; a 4-bit quantized build drops that to about 1.8-2 GB, which fits on a 6 GB consumer GPU or runs on a modern laptop. The 128K context costs extra memory, so long inputs raise the requirement.
huggingface-cli download meta-llama/Llama-3.2-3B-Instruct
You can load the weights with Hugging Face Transformers or serve them with vLLM, or skip the setup and open the model in Atomic Chat with one click for a fully on-device chat.
License
Llama-3.2-3B-Instruct is released under the Llama 3.2 Community License. It permits commercial and research use, with redistribution and fine-tuning allowed under Meta's acceptable-use terms; very large products (over 700 million monthly active users) need a separate license from Meta. Check the license text before shipping a commercial product on top of it.