Together AI’s Together Compiler uses AI agents to beat megakernels

Together AI reports that its Together Compiler uses AI agents to rewrite and fuse GPU kernels in model forward passes, and that this approach outperforms its previous hand-written megakernels on B200.

Who it affects This matters to teams working on GPU kernels and AI inference engines.

Source: together.ai ·