Qwen4’s architecture is here early, firing 6B parameters out of 125B

Alibaba’s Qwen team has released Qwen3.8-Flash-Next, an open-weight preview of the architecture it intends to use for Qwen4, carrying 125B parameters but activating only 6B for each token. Its licence may not qualify for the EU AI Act’s open-source exemption. Alibaba’s Qwen team has published the architecture it plans to build Qwen4 on. Qwen3.8-Flash-Next carries […]
This story continues at The Next Web