当Transformer学会"绕圈"跑:也许真能省下堆层数
原创
你有没有想过,Transformer为什么非得一层层往上堆?最近一个Recurrent Looped Transformer的方案给出了另一种答案:不堆层,让同一组参数循环跑。把Transformer的输出喂回去继续算,像RNN那样"绕圈"处理输入,理论上能在参数量和计算量之间找到更优的平衡。思路算不上新奇,但把loop嵌进Transformer主干架构这个点值得琢磨——如果效果真能接近深层Transformer,那"堆层数等于涨性能"的默认信念就该动摇。我比较看好这个方向。
原文:Recurrent Looped Transformer · 来源:Hacker News
版权声明
所有资源都来源于爬虫采集,如有侵权请联系我们,我们将立即删除
相关文章
- Stabyourself.net Games
- 【IT 早报】2026年11月19日 - 本周要闻与趋势
- 从均匀平铺到自适应路由:RINs 如何让扩散生成提速 10 倍?
- Claude Code makes a finished subagent send its report twice (70-second repro)
- Becerra faces a $2B budget deficit as potential AI bust looms
- Show HN: Agent Hive – cute Grokbot like agentic teams with queen and many bees
- Show HN: Lazycow Studio – turns footage you never edited into reels, locally
- Experiments in Weight-Space Programming
- Lindy Effect
- Meet Your Neighbors – A new type of political compass
最新文章
- Stabyourself.net Games 40分钟前
- 【IT 早报】2026年11月19日 - 本周要闻与趋势 43分钟前
- 从均匀平铺到自适应路由:RINs 如何让扩散生成提速 10 倍? 2小时前
- Claude Code makes a finished subagent send its report twice (70-second repro) 2小时前
- Becerra faces a $2B budget deficit as potential AI bust looms 2小时前
- Show HN: Agent Hive – cute Grokbot like agentic teams with queen and many bees 3小时前
- Show HN: Lazycow Studio – turns footage you never edited into reels, locally 3小时前
- Experiments in Weight-Space Programming 3小时前
- Lindy Effect 3小时前
- Meet Your Neighbors – A new type of political compass 5小时前
itfan123





