ByteDance RL Agent Writes CUDA Kernels 2x Faster Than torch.compile

A new ByteDance paper shows a reinforcement-learning-trained AI agent generating GPU kernels that are 2.11x faster than those produced by NVIDIA's own torch.compile, with the dataset open-sourced.

ByteDance has published a paper demonstrating an RL-trained AI agent that writes CUDA kernels outperforming torch.compile by a factor of 2.11x, according to @socialwithaayan. The agent was trained to optimize GPU kernel code directly, bypassing the heuristics and template-based approaches that conventional compilers rely on. ByteDance has open-sourced the dataset used for training.

Unlock the full briefing

Get every story in today's briefing, the full archive, and the daily AI intelligence brief.

All stories today

Full archive

Daily brief

Cancel anytime. Payments powered by Stripe.