OpenAI's upcoming Jalapeño AI chip outperforms NVIDIA GB300 in inference tests

OpenAI has developed the Jalapeño AI chip through a rapid nine-month cycle, co-designing it with its own models. In inference tests, Jalapeño outperformed the NVIDIA GB300, delivering higher throughput per watt and lower latency. According to the Broadcom CEO, the chip matches NVIDIA Blackwell performance while providing a 50% cost advantage. This custom hardware aims to disrupt the AI market, intensifying competition and reducing the industry's overall reliance on NVIDIA GPUs for high-performance computing tasks.