Yotta NM1 Navi Mumbai
- Uptime Institute Tier IV certified
- Dual utility feeds from separate substations
CDNA 3 · OAM
AMD MI300X servers, bought and hosted in India.
The MI300X carries 192 GB of memory per GPU, 2.4 times an H100. Large models fit on fewer GPUs, and PyTorch and vLLM run on AMD’s ROCm stack.
- GPU memory
- 192 GB HBM3 per GPU
- GPU power
- Up to 750 W per GPU
- Server power
- 6 kW of GPU power for 8 GPUs, plus CPUs and fans
- Rack space · cooling
- 8U typical · Air
Shipping Lead time, October 2026: Quoted per order · All GPU lead times
Good fit for
Who buys AMD MI300X.
- Serving very large models from GPU memory
- Teams on ROCm, PyTorch or vLLM
- A second source alongside NVIDIA
The hardware
What an AMD MI300X server looks like.
8-GPU OAM platform, 1.5 TB of GPU memory. 192 GB HBM3 per GPU, up to 750 W per GPU, 8u typical of rack space.
- Server power: 6 kW of GPU power for 8 GPUs, plus CPUs and fans
- Cooling: Air
Hosting
Where an AMD MI300X server runs.
An 8-GPU MI300X server is in the same power class as an HGX H100 system. We place it against its full rated draw.
How managed hosting worksYotta D1 Greater Noida
- Dual 220 kV feeds with an on-site substation
- 48 hours of on-site backup power
AMD MI300X questions
Is MI300X a good alternative to H100?
For memory-bound inference, often yes: 192 GB per GPU versus 80 GB. Check that your stack runs on ROCm before you buy.
Does PyTorch run on AMD GPUs?
Yes, through ROCm. vLLM and most major inference frameworks support MI300X.
How much memory does an 8-GPU MI300X server have?
1.5 TB of HBM3 across eight GPUs.
Other GPU servers
H200141 GB HBM3e per GPU · Up to ~10.2 kW per serverH10080 GB HBM3 per GPU · Up to ~10.2 kW per serverB200180 GB HBM3e per GPU · Up to ~14.3 kW per serverB300288 GB HBM3e per GPU · Up to ~14 kW per serverGB300 NVL7220 TB HBM3e across 72 GPUs · ~132–140 kW per rackL40S48 GB GDDR6 per GPU · 2.8 kW of GPU power for 8 cards, plus CPUs and fansRTX PRO 6000 Blackwell96 GB GDDR7 per GPU · Up to 4.8 kW of GPU power for 8 cards, plus CPUs and fans
Owning one
Managed GPU hosting
Rack, power, cooling, network and remote hands for servers you own.
Learn more →
Finance the purchase
Lender-ready quotes and asset records for your bank or NBFC.
Learn more →
Power and cooling guide
kW, amps and tons of cooling for every GPU class.
Learn more →
Sell or swap
Tested, valued and sold, or traded up for newer GPUs.
Learn more →