LLM Inference Benchmark
Maximizing GPU Efficiency: NVIDIA MPS vs Dedicated GPU Allocation for LLM Inference
50% GPU cost reduction with only 7.5% throughput loss when sharing via MPS — a benchmark on Qwen3-4B-FP8 across NVIDIA A100-80GB GPUs.
Healthcare AI
IOTAIRx slashes AI Training Costs and Carbon Footprint by 48% with Pebble's EcoAgent
40% infrastructure cost reduction and 48% energy & carbon cut on long-running DeepSeek fine-tuning jobs running on NVIDIA A100s in GKE.