Understanding Uncertainty Sampling via Equivalent Loss
Liu, Li · cs.LG,stat.ML · 2026-09-05 · 原文
Uncertainty sampling is a classical active-learning strategy, yet the statistical objective induced by its query rule is often implicit. We introduce the equivalent loss, whose gradient is the original loss gradient multiplied by the query probability. This construction places probabilistic, margin-based, and threshold-based uncertainty rules within a common framework. For binary classification, concrete equivalent losses and surrogate link functions show how uncertainty weighting preserves calibration while reshaping optimization geometry. When the equivalent loss is convex, we derive a finite-sample excess-risk bound with a fixed learning rate and an explicit constant controlling the tradeoff between initial error and query-weighted gradient variance. A feasible choice based only on maximal uncertainty yields a leading classification-risk upper bound no larger than the corresponding passive-learning bound at the same expected label budget; knowledge of the average query rate sharpens this comparison. We also analyze pool-based sampling, characterize the integrability obstruction beyond scalar prediction, and examine the query-clock dynamics of momentum methods. Together, these re
讲义
讲义·推断 依据「原文」自动生成的结构化摘要（推断），非原文表述；以原文为准。
1. 人话版
Uncertainty sampling is a classical active-learning strategy, yet the statistical objective induced by its query rule is often implicit.
We introduce the equivalent loss, whose gradient is the original loss gradient multiplied by the query probability.
2. 领域脉络
本文类目：cs.LG、stat.ML，属于其所在研究脉络的最新进展。
3. 机制拆解
This construction places probabilistic, margin-based, and threshold-based uncertainty rules within a common framework.
For binary classification, concrete equivalent losses and surrogate link functions show how uncertainty weighting preserves calibration while reshaping optimization geometry.
When the equivalent loss is convex, we derive a finite-sample excess-risk bound with a fixed learning rate and an explicit constant controlling the tradeoff between initial error and query-weighted gradient variance.
4. 证据与数字
摘要未给出量化结果——留意原文的实验与数据。
5. 反例与边界
A feasible choice based only on maximal uncertainty yields a leading classification-risk upper bound no larger than the corresponding passive-learning bound at the same expected label budget; knowledge of the average query rate sharpens this comparison.
6. 跨领域连接与意外收获
横跨 2 个类目（cs.LG、stat.ML），关注其在你兴趣板块间的迁移面。
7. 可复用方法
把本文机制与你手头项目对照，找一个两周内能验证的最小实验。
8. 术语表
精读时把不熟的术语记入此处，作为下次回忆的锚点。