Invest Like the Best

Background agents will eat 90% of compute, so inference should trade latency for throughput

The next wave of AI inference is not chat but background agents, and they will eat 90% of compute. Sale Research therefore optimizes for throughput rather than latency, and will even accept 80% availability, in exchange for prices that fall by orders of magnitude — and it argues Nvidia's performance-per-watt advantage is overrated.