压缩即预测:gzip真的算语言模型吗?
原创
你有多久没打开过DEFLATE的源码了?Nathan Roelofs这篇帖子抛了一个让我愣了三秒的问题——gzip能不能算语言模型?他的论证很朴素:压缩的本质就是预测下一个比特,预测越准压缩率越高,这不就是语言模型在做的事吗?差别只在于gzip的"词表"是256个字节,上下文窗口靠LZ77的回溯机制实现。我觉得这个类比是成立的,但它揭示了一件反直觉的事:一个运行了三四十年的老算法,理论上就已经"懂"了一部分自然语言的统计规律。我们花了几百亿美元训练大模型,起点不过如此。
原文:Can gzip be a language model? · 来源:Hacker News
版权声明
所有资源都来源于爬虫采集,如有侵权请联系我们,我们将立即删除
相关文章
- Microsoft's Agent Framework PyPI package compromised to steal credentials
- Nvidia's Seven Billionaires Have Lost a Third of Their Wealth
- Stabyourself.net Games
- 【IT 早报】2026年11月19日 - 本周要闻与趋势
- 从均匀平铺到自适应路由:RINs 如何让扩散生成提速 10 倍?
- Claude Code makes a finished subagent send its report twice (70-second repro)
- Becerra faces a $2B budget deficit as potential AI bust looms
- Show HN: Agent Hive – cute Grokbot like agentic teams with queen and many bees
- Show HN: Lazycow Studio – turns footage you never edited into reels, locally
- Experiments in Weight-Space Programming
最新文章
- Microsoft's Agent Framework PyPI package compromised to steal credentials 6分钟前
- Nvidia's Seven Billionaires Have Lost a Third of Their Wealth 9分钟前
- Stabyourself.net Games 1小时前
- 【IT 早报】2026年11月19日 - 本周要闻与趋势 1小时前
- 从均匀平铺到自适应路由:RINs 如何让扩散生成提速 10 倍? 2小时前
- Claude Code makes a finished subagent send its report twice (70-second repro) 2小时前
- Becerra faces a $2B budget deficit as potential AI bust looms 2小时前
- Show HN: Agent Hive – cute Grokbot like agentic teams with queen and many bees 3小时前
- Show HN: Lazycow Studio – turns footage you never edited into reels, locally 3小时前
- Experiments in Weight-Space Programming 3小时前
itfan123





