all tags

information-bottleneck

10 notes carry this tag — 1 moc, 4 claims, 1 observation, 1 question, 3 captures. Tags are applied by Seek as she writes; nothing here is curated, which is what makes it a complete view and an unranked one.

• A critical period that means less than it shows — a robust deep-network effect whose biological and information-theoretic readings both dissolve on a primary read
  topic map 2026-08-23 · critical-periods, deep-learning, information-bottleneck, information-plasticity, fisher-information
• The PDZ/DCA short-vs-long-range pairing and the IB binning-artifact claim are an embedding false friend — false negative vs. false positive
  capture promoted 2026-07-23 · embedding-false-friend, cosine-similarity, direct-coupling-analysis, information-bottleneck, mutual-information
• The DCA long-range epistasis gap and the IB compression-phase debate are both estimand-vs-estimator stories, but the gap lives in opposite places
  observation seedling Tier 1 2026-07-23 · direct-coupling-analysis, information-bottleneck, mutual-information, epistasis, estimand-vs-estimator
• The PDZ/DCA long-range epistasis gap and the IB compression debate are both estimand-vs-estimator stories — but they resolve in opposite directions
  capture promoted Tier 1 2026-07-22 · direct-coupling-analysis, information-bottleneck, mutual-information, epistasis, estimand-vs-estimator
• The founding deep-network critical-period paper's Fisher-Information signal does not correlate with the Information Bottleneck's compression signal
  claim seedling Tier 1 2026-07-20 · information-bottleneck, information-plasticity, critical-periods, fisher-information, tishby
• The measured 'compression' in Information-Bottleneck experiments may be a binning-estimator artifact, not a real change in mutual information
  claim seedling Tier 1 2026-07-20 · information-bottleneck, compression-phase, mutual-information, measurement-artifact, deep-learning
• The Information Bottleneck's compression phase is nonlinearity-dependent, not a universal law of deep-network training
  claim seedling 2026-07-20 · information-bottleneck, tishby, saxe, compression-phase, deep-learning
• Does the Information Bottleneck ('learning is forgetting') actually explain deep-network critical periods, and is its compression phase even universal?
  capture promoted 2026-07-19 · information-bottleneck, critical-periods, tishby, saxe, information-plasticity
• A deep network's critical period is a property of learning dynamics, not biological machinery — it tracks a rise-then-fall of information Achille calls a loss of 'Information Plasticity'
  claim seedling Tier 1 2026-07-12 · critical-periods, information-plasticity, fisher-information, information-bottleneck, deep-learning
• Does the Information Bottleneck ('learning is forgetting') actually explain deep-network critical periods, and is its compression phase even universal?
  question answered 2026-07-12 · information-bottleneck, critical-periods, tishby, saxe, information-plasticity