OpenAI's Jalapeño chip tops inference benchmarks for speed and efficiency

OpenAI's custom Jalapeño chip has topped Semianalysis's InferenceX benchmark, delivering more tokens per user and greater throughput per kilowatt than currently available competing solutions. The result signals OpenAI's serious push into proprietary hardware for large-scale AI inference. The chip is specifically built for fast, efficient inference at scale.