Articles by Hugo Belmar

Top-k routing has become a default. It shouldn't be. A look at the tradeoffs nobody's measuring and the experiments that change my mind.

The choice used to be obvious. It isn't anymore. A side-by-side on training a 30B model across three clusters and four hardware generations.