知情人士透露，OpenAI对他展开了长达数月的挖角。尽管庞若鸣曾向同事表示自己在Meta工作愉快、基础设施团队状态良好，但最终还是选择了离开。
Abstract:Autoregressive decoding is bottlenecked by its sequential nature. Speculative decoding has become a standard way to accelerate inference by using a fast draft model to predict upcoming tokens from a slower target model, and then verifying them in parallel with a single target model forward pass. However, speculative decoding itself relies on a sequential dependence between speculation and verification. We introduce speculative speculative decoding (SSD) to parallelize these operations. While a verification is ongoing, the draft model predicts likely verification outcomes and prepares speculations pre-emptively for them. If the actual verification outcome is then in the predicted set, a speculation can be returned immediately, eliminating drafting overhead entirely. We identify three key challenges presented by speculative speculative decoding, and suggest principled methods to solve each. The result is Saguaro, an optimized SSD algorithm. Our implementation is up to 2x faster than optimized speculative decoding baselines and up to 5x faster than autoregressive decoding with open source inference engines.
，推荐阅读51吃瓜获取更多信息
07:00, 3 марта 2026Из жизни
据大河报消息，在郑州市日前召开的全市推动新一年良好开局动员部署会上，蜜雪冰城雪王城市主题乐园被明确列为重点支持项目，拟落地蜜雪冰城旗舰总部片区。
华为发布新一代 AI 超算集群