Docs / Guides / Edge AI

GPU Selection for Edge AI Inference: TGP, TDP and Enclosure Thermal Limits

Choosing a GPU for a fanless edge AI box PC is a thermal decision before it is a compute decision: TGP must fit the chassis cooling budget and the DC power budget. This guide walks through the numbers that actually gate the choice.

Quick answer

For a fanless box PC, pick the GPU by TGP (total graphics power) first: the chassis cooling design caps what can be passively dissipated (practically up to ~50–75 W), and the DC input budget caps total system draw. Compute classes (TOPS, VRAM) come second. A model that cannot dump its heat into the fins at 50°C ambient will throttle no matter how good its benchmarks are.

The three budgets to check

BudgetWhat it limitsTypical fanless ceiling
Chassis thermal (passive)GPU TGP + CPU TDP the fins can dissipate~50–75 W GPU class
DC inputTotal system power on 9–36 V inputSize PSU for CPU+GPU+peripherals +30%
VRAM / workloadModel size at batch size you actually run6–16 GB workstation class fits most vision inference

GPU classes that fit fanless designs

Design notes

Frequently Asked Questions

How much GPU power can a fanless box PC dissipate?

Practically, passive cooling supports GPUs in the 50-75 W TGP range with a well-designed finned chassis at moderate ambient temperatures, sometimes more with hybrid cooling that adds a small temperature-controlled fan. Beyond that, heat cannot leave the enclosure fast enough and the GPU throttles.

Should I use a Jetson module or a workstation GPU for edge AI?

Jetson modules win on power efficiency (10-60 W, high TOPS-per-watt) and are the default for strict fanless and battery-powered designs. Workstation GPUs (A2000/A4000 class) win on raw throughput and the full CUDA ecosystem for larger models, but need more thermal headroom.

Why does my GPU inference slow down after a few minutes?

That is thermal throttling: the GPU reduced clocks because junction temperature hit its limit. In a fanless enclosure it means the sustained TGP exceeds what the chassis can dissipate at your ambient temperature — the fix is hardware selection (lower-TGP GPU or better thermal design), not software tuning.

Need hardware for this application? Explore Yikway industrial PCs or email our engineers for a free selection review.

Maintained by the Yikway Engineering Team · Last updated: 2026-11-20 · All documentation