Release writeups and engineering notes from the lab — recipes, evaluation methodology, and the walls we hit along the way. The same rigor that goes into the model cards, in long form.
We quantized Tencent's Hy3 (295B MoE) to 4-bit weights while keeping its MTP draft layer in BF16. It matches the FP8 release on quality at 57% of the footprint, runs +40% faster single-stream than the same-scheme quant that shipped without MTP, and takes the high-concurrency throughput crown among 4-bit Hy3 quants.
We quantized GLM-5.2 (744B MoE) to 4-bit weights while keeping its MTP draft head in BF16. It matches the FP8 release on quality, fits on four H200s instead of eight, and is the fastest popular 4-bit GLM-5.2 quant in the interactive serving regime.