ADP 前沿学习

← 板块一 · 研究前沿

The Shannon Lower Bound is Asymptotically Tight

Koch · cs.IT,math.IT · 2016-02-22 · 原文

The Shannon lower bound is one of the few lower bounds on the rate-distortion function that holds for a large class of sources. In this paper, it is demonstrated that its gap to the rate-distortion function vanishes as the allowed distortion tends to zero for all sources having a finite differential entropy and whose integer part is finite. Conversely, it is demonstrated that if the integer part of the source has an infinite entropy, then its rate-distortion function is infinite for every finite distortion. Consequently, the Shannon lower bound provides an asymptotically tight bound on the rate-distortion function if, and only if, the integer part of the source has a finite entropy.

🔮 让 ChatGPT 全网深度追问

讲义

讲义·推断 依据「原文」自动生成的结构化摘要(推断),非原文表述;以原文为准。

1. 人话版

The Shannon lower bound is one of the few lower bounds on the rate-distortion function that holds for a large class of sources.

In this paper, it is demonstrated that its gap to the rate-distortion function vanishes as the allowed distortion tends to zero for all sources having a finite differential entropy and whose integer part is finite.

2. 领域脉络

本文类目:cs.IT、math.IT,属于其所在研究脉络的最新进展。

3. 机制拆解

Conversely, it is demonstrated that if the integer part of the source has an infinite entropy, then its rate-distortion function is infinite for every finite distortion.

4. 证据与数字

摘要未给出量化结果——留意原文的实验与数据。

5. 反例与边界

Consequently, the Shannon lower bound provides an asymptotically tight bound on the rate-distortion function if, and only if, the integer part of the source has a finite entropy.

6. 跨领域连接与意外收获

横跨 2 个类目(cs.IT、math.IT),关注其在你兴趣板块间的迁移面。

7. 可复用方法

把本文机制与你手头项目对照,找一个两周内能验证的最小实验。

8. 术语表

精读时把不熟的术语记入此处,作为下次回忆的锚点。