Model provider cost

Host Mistral Nemo Instruct 12B on AWS

Mistral Nemo Instruct 12B needs 1x 24GB+ GPU, and AWS's current cheapest qualifying row is L4 at $1.50/hr.

1x 24GB+ GPU 12B params Strong long-context Apache 2.0
All LLM costs All AWS GPUs
Cheapest on this provider
$1.50/hr
L4
Monthly estimate
$1,092/mo
730 hours at the current median
VRAM baseline
24GB
1x 24GB+ GPU
Qualifying rows
6
Updated Jul 9, 2026
Live hosting options

AWS rows that can host Mistral Nemo Instruct 12B

The cheapest tracked way to host Mistral Nemo Instruct 12B on AWS is L4 at $1.50/hr. The overall tracked market floor is $0.39/hr on RunPod, so AWS is $1.11/hr above the current floor.

Price source AWS public EC2 pricing data Published list pricing; private discounts and capacity terms are not reflected.
Methodology Freshness
GPU VRAM Per GPU Estimated hourly Estimated monthly Offers Updated
L4 24GB $1.50/hr $1.50/hr $1,092/mo 16 Jul 9, 2026
AWS public EC2 pricing data 16 offers · Jul 9, 2026 global aggregate
A10G 24GB $1.83/hr $1.83/hr $1,336/mo 16 Jul 9, 2026
AWS public EC2 pricing data 16 offers · Jul 9, 2026 global aggregate
A100 SXM4 80GB $3.09/hr $3.09/hr $2,254/mo 4 Jul 9, 2026
AWS public EC2 pricing data 4 offers · Jul 9, 2026 global aggregate
L40 48GB $3.39/hr $3.39/hr $2,471/mo 16 Jul 9, 2026
AWS public EC2 pricing data 16 offers · Jul 9, 2026 global aggregate
H100 SXM 80GB $6.88/hr $6.88/hr $5,022/mo 2 Jul 9, 2026
AWS public EC2 pricing data 2 offers · Jul 9, 2026 global aggregate
H200 141GB $7.91/hr $7.91/hr $5,776/mo 2 Jul 9, 2026
AWS public EC2 pricing data 2 offers · Jul 9, 2026 global aggregate
Model fit

Why this setup does or does not fit

VRAM floor

1x 24GB+ GPU

1x 24GB to 48GB GPU. Long prompts, batching, and KV cache can require extra headroom.

Model quality

Strong long-context

Good for summarization and retrieval-heavy work, though it is not a frontier reasoning model.

Operational note

Mistral 12B

Useful when long prompts matter more than absolute frontier reasoning quality.

FAQ

Mistral Nemo Instruct 12B on AWS FAQ

Can I host Mistral Nemo Instruct 12B on AWS?

The cheapest tracked way to host Mistral Nemo Instruct 12B on AWS is L4 at $1.50/hr.

What GPU memory does Mistral Nemo Instruct 12B need?

Our baseline for Mistral Nemo Instruct 12B is 1x 24GB+ GPU. The practical recommendation is 1x 24GB to 48GB GPU.

Is AWS the cheapest provider for Mistral Nemo Instruct 12B?

The overall tracked market floor is $0.39/hr on RunPod, so AWS is $1.11/hr above the current floor.

How fresh is this AWS Mistral Nemo Instruct 12B cost page?

This page recalculates from the latest tracked on-demand rows. The freshest qualifying AWS row shown here is from Jul 9, 2026.

Next research paths

Compare this setup

All self-hostable LLM costs Compare the full model catalog against live GPU prices. All AWS GPU prices Open the provider catalog behind these model hosting options. AWS vLLM hosting prices Compare this model-specific estimate with the broader vLLM workload slice. Cheapest market setup: RunPod L4 Compare against the current $0.39/hr tracked floor.