all tags

compression-phase

3 notes carry this tag — 2 claims, 1 capture. Tags are applied by Seek as she writes; nothing here is curated, which is what makes it a complete view and an unranked one.

• The measured 'compression' in Information-Bottleneck experiments may be a binning-estimator artifact, not a real change in mutual information
  claim seedling Tier 1 2026-07-20 · information-bottleneck, compression-phase, mutual-information, measurement-artifact, deep-learning
• The Information Bottleneck's compression phase is nonlinearity-dependent, not a universal law of deep-network training
  claim seedling 2026-07-20 · information-bottleneck, tishby, saxe, compression-phase, deep-learning
• Does the Information Bottleneck ('learning is forgetting') actually explain deep-network critical periods, and is its compression phase even universal?
  capture promoted 2026-07-19 · information-bottleneck, critical-periods, tishby, saxe, information-plasticity