Skip to content

Cost reference

What it costs to fine-tune Qwen3 30B-A3B

The cheapest setup we compared is LoRA on 2 × L40S: about $0.028 per million training tokens, so $0.28 for 10 million and $2.76 for 100 million. Full fine-tuning costs about $0.49 per 10 million tokens on 4 × B200. As a mixture of experts it computes like a 3.3B model, so it is cheap per token for its size.

By Will Schulz · Checked 15 November 2026 · Prices as of November 2026

GPU-hours and cost by GPU and method

Per epoch over the token count shown; multiply by your number of epochs. GPU-hours are the same however many GPUs the job is split over.

GPU · methodGPUs for memoryTokens/s per GPUGPU-hours per 1M1.0M tokens10M tokens100M tokens
H100 SXM · LoRA$4.39/hr129,9700.01$0.041$0.41$4.07
H100 SXM · QLoRA$4.39/hr123,3760.01$0.052$0.52$5.22
H100 SXM · Full fine-tuning$4.39/hr719,9800.01$0.061$0.61$6.10
B200 · LoRA$7.99/hr168,1820.00$0.033$0.33$3.26
B200 · QLoRA$7.99/hr153,1820.01$0.042$0.42$4.17
B200 · Full fine-tuning$7.99/hr445,4550.01$0.049$0.49$4.88
L40S · LoRA$1.09/hr210,9700.03$0.028$0.28$2.76
L40S · QLoRA$1.09/hr18,5560.03$0.035$0.35$3.54
L40S · Full fine-tuning$1.09/hr12 (over 8)7,3130.04———
RTX 5090 · LoRA$1.39/hrDoesn't fit6,3480.04———
RTX 5090 · QLoRA$1.39/hr14,9520.06$0.078$0.78$7.80
RTX 5090 · Full fine-tuning$1.39/hrDoesn't fit4,2320.07———

Compared with fine-tuning APIs

OptionPer 1M tokens10M tokens100M tokens
Rented GPU: LoRA on L40S (our estimate)$0.028$0.28$2.76
Together AIQwen3 30B-A3B not listed——
OpenAI gpt-4.1-mini fine-tuning (closed model; closed to new users)$5.00$50.00$500

API prices are per training token processed (dataset tokens × epochs), seen on 15 November 2026. Together AI charges a minimum per job. OpenAI's pricing page says fine-tuning is closed to new users. Rented GPU estimates leave out setup, failed runs and idle time, which an API absorbs.

Your run

Pre-filled for Qwen3 30B-A3B: 10M tokens, 3 epochs, LoRA on an H100.

Estimated cost

$1.22

H100 SXM-hours

0.28

Time on 1 GPU

17 minutes

Tokens per second per GPU

29,970

30M tokens processed. Fits on one H100 SXM at 2,048-token sequences. GPU-hours assume perfect scaling across GPUs.

Assumptions

  • Compute per token: 6 FLOPs per active parameter for full fine-tuning (forward plus backward) and about 4 for LoRA and QLoRA, which skip the frozen weights' gradients. Qwen3 30B-A3B uses 3.3B parameters per token.
  • Utilisation: 40% of each GPU's dense BF16 peak. torchtune measured 3,083 tokens a second for Llama 3.1 8B LoRA on one RTX 4090, about 60% on the same accounting, so well-tuned code can beat these figures.
  • QLoRA runs at 78% of LoRA's speed, the ratio torchtune measured (2,413 vs 3,083 tokens a second), because the 4-bit weights are dequantised on the fly.
  • Memory decides the GPU count, from our Qwen3 30B-A3B VRAM estimates at 2,048-token sequences. Consumer cards are counted as single GPUs only.
  • Prices: on-demand Runpod Secure Cloud rates (page dated 12 November 2026). Community Cloud and spot capacity cost less.

Frequently asked questions

How much does it cost to fine-tune Qwen3 30B-A3B?
About $0.028 per million training tokens at the cheapest setting we compared (LoRA on 2 × L40S, $1.09/hour per GPU), so about $0.28 for 10M tokens and $2.76 for 100M. Budget for several runs: the first rarely wins.
How long does it take to fine-tune Qwen3 30B-A3B on an H100?
LoRA processes about 29,970 tokens a second on one H100 at 40% utilisation, so 10M tokens take about 6 minutes. Full fine-tuning needs 7 H100s for memory and about 1.5× the compute.
Is it cheaper to fine-tune Qwen3 30B-A3B through an API?
Together AI's November 2026 price list doesn't include Qwen3 30B-A3B, so the choice is rented GPUs or a hosted model. Rented GPU time costs about $0.28 per 10M tokens by our estimate, plus setup and idle time.
Should I use LoRA or full fine-tuning for Qwen3 30B-A3B?
Start with LoRA or QLoRA. Full fine-tuning Qwen3 30B-A3B needs about 492 GB, so 7 × 80 GB GPUs with sharded optimiser state, and about 1.5× the compute per token. LoRA usually gets close for format, style and task adaptation; move to full fine-tuning only when evaluation shows LoRA has plateaued.

Sources

  1. [1]Hugging Face. Qwen/Qwen3-30B-A3B config.json
  2. [2]Alibaba Qwen. Qwen/Qwen3-30B-A3B model card
  3. [3]Alibaba Qwen. Qwen3 Technical Report (arXiv:2505.09388)
  4. [4]Hu et al., 2021. LoRA: Low-Rank Adaptation of Large Language Models (arXiv:2106.09685)
  5. [5]Dettmers et al., 2023. QLoRA: Efficient Finetuning of Quantized LLMs (arXiv:2305.14314)
  6. [6]Kaplan et al., 2020. Scaling Laws for Neural Language Models (arXiv:2001.08361)
  7. [7]PyTorch. torchtune: memory and throughput benchmarks (Llama 3.1 8B on RTX 4090)
  8. [8]Together AI. Fine-tuning pricing (seen 15 November 2026)
  9. [9]OpenAI. API pricing: fine-tuning (seen 15 November 2026)
  10. [10]Runpod. GPU pricing (updated 12 November 2026)

Try the cheaper levers first.

Prompt tuning and model search in Kojen cost API calls, not GPU-hours, and often close the gap before any fine-tuning.

Start training free