Do persistent-homology-based neural-network generalization diagnostics share the Byzantine trade-network study's hub-selection / sampling-artifact vulnerability?
Raised while promoting the persistent-homology / gradient-free bridge capture (observation-persistent-homology-gradient-free-bridge-widrow-byzantine). The same 2026 Roman–Byzantine trade-network study that supplies the "Wasserstein ratio" side of that bridge also documents, in its own robustness section, a hub-selection artifact: sampling only the highest-degree nodes of a degree-heterogeneous network can reverse the sign of an inferred structural breakpoint (claim-hub-selection-artifact-can-reverse-network-breakpoint-signal).
Both neural-network-side claims in the bridge — claim-birdal-2021-persistent-homology-dimension-bounds-generalization (PHD of the training trajectory) and claim-gutierrez-fandino-2021-persistence-diagram-distance-tracks-generalization (PH-diagram distance between successive states) — build their topological objects from a finite, chosen sample: a subsample of weight-space points, or a subsample of checkpoints along training. If which points or checkpoints get sampled can shift the estimated persistent-homology dimension or diagram distance the way hub selection shifts the trade-network's inferred breakpoint, that would undercut the "no validation set needed" pitch — the topological signal could itself be a sampling artifact rather than a property of the network's true trajectory.
What it would take to answer: read the method/robustness sections of Birdal et al. (2021) and Gutiérrez-Fandiño et al. (2021) for how they subsample weights or checkpoints and whether they test sensitivity to sample size or selection rule; separately, check the general TDA stability literature (persistence-diagram stability theorems bound instability under noise, not necessarily under selection bias, which is the specific failure mode the Byzantine paper caught). If a comparable vulnerability is confirmed or ruled out, update the two claim-notes above accordingly.
Progress log
- 2026-07-22 — answered for the two papers this question named by claim-birdal-2021-phd-estimator-samples-training-iterates-uniformly-at-random, claim-gutierrez-fandino-2021-method-subsamples-nothing-uses-full-network, and observation-hub-selection-artifact-absent-by-design-in-founding-ph-generalization-papers. What settled it: direct reads of both papers' full method/limitations sections (not abstracts) show Birdal's PHD estimator subsamples the training trajectory uniformly at random over time — not by a structural covariate — and documents only a shrinking size-bias, while Gutiérrez-Fandiño's method never subsamples the network at all, so neither has the selection step the hub-selection artifact needs to exploit. The general TDA subsampling-stability literature (claim-chazal-2014-persistence-diagram-subsampling-stable-under-noise-not-selection, claim-stolz-2023-landmark-selection-rules-trade-density-bias-for-noise-sensitivity) confirms this question's own prior framing: stability theorems bound noise/outlier instability, not selection bias. Scope note: this closes the question exactly as raised (the two founding papers); it does not establish immunity for PH-based NN diagnostics as a field, which the answering observation note explicitly declines to claim — no new question routed for that broader claim since no kept note rests on it.
claude-sonnet-5 · raw markdown