Host Llama 3.2 3B Instruct on AWS
Llama 3.2 3B Instruct needs 1x 12GB+ GPU, and AWS's current cheapest qualifying row is T4 at $0.98/hr.
AWS rows that can host Llama 3.2 3B Instruct
The cheapest tracked way to host Llama 3.2 3B Instruct on AWS is T4 at $0.98/hr. The overall tracked market floor is $0.39/hr on RunPod, so AWS is $0.59/hr above the current floor.
| GPU | VRAM | Per GPU | Estimated hourly | Estimated monthly | Offers | Updated |
|---|---|---|---|---|---|---|
| T4 | 16GB | $0.98/hr | $0.98/hr | $714/mo | 14 |
Jul 9, 2026
AWS public EC2 pricing data
14 offers · Jul 9, 2026
global aggregate
|
| L4 | 24GB | $1.50/hr | $1.50/hr | $1,092/mo | 16 |
Jul 9, 2026
AWS public EC2 pricing data
16 offers · Jul 9, 2026
global aggregate
|
| A10G | 24GB | $1.83/hr | $1.83/hr | $1,336/mo | 16 |
Jul 9, 2026
AWS public EC2 pricing data
16 offers · Jul 9, 2026
global aggregate
|
| V100 | 16GB | $3.06/hr | $3.06/hr | $2,234/mo | 8 |
Jul 9, 2026
AWS public EC2 pricing data
8 offers · Jul 9, 2026
global aggregate
|
| A100 SXM4 | 80GB | $3.09/hr | $3.09/hr | $2,254/mo | 4 |
Jul 9, 2026
AWS public EC2 pricing data
4 offers · Jul 9, 2026
global aggregate
|
| L40 | 48GB | $3.39/hr | $3.39/hr | $2,471/mo | 16 |
Jul 9, 2026
AWS public EC2 pricing data
16 offers · Jul 9, 2026
global aggregate
|
| H100 SXM | 80GB | $6.88/hr | $6.88/hr | $5,022/mo | 2 |
Jul 9, 2026
AWS public EC2 pricing data
2 offers · Jul 9, 2026
global aggregate
|
| H200 | 141GB | $7.91/hr | $7.91/hr | $5,776/mo | 2 |
Jul 9, 2026
AWS public EC2 pricing data
2 offers · Jul 9, 2026
global aggregate
|
Why this setup does or does not fit
1x 12GB+ GPU
1x 24GB GPU for comfortable headroom. Long prompts, batching, and KV cache can require extra headroom.
Entry-level quality
Cheap and responsive, but noticeably weaker on nuanced reasoning, coding, and edge cases than 8B+ models.
Meta 3B
Good first self-hosted model when you want something inexpensive and easy to operate.
Llama 3.2 3B Instruct on AWS FAQ
Can I host Llama 3.2 3B Instruct on AWS?
The cheapest tracked way to host Llama 3.2 3B Instruct on AWS is T4 at $0.98/hr.
What GPU memory does Llama 3.2 3B Instruct need?
Our baseline for Llama 3.2 3B Instruct is 1x 12GB+ GPU. The practical recommendation is 1x 24GB GPU for comfortable headroom.
Is AWS the cheapest provider for Llama 3.2 3B Instruct?
The overall tracked market floor is $0.39/hr on RunPod, so AWS is $0.59/hr above the current floor.
How fresh is this AWS Llama 3.2 3B Instruct cost page?
This page recalculates from the latest tracked on-demand rows. The freshest qualifying AWS row shown here is from Jul 9, 2026.