---
id: "20260817-0213-does-steck-ekanadham-kallus"
title: "Does Steck, Ekanadham & Kallus (WWW 2024 Companion) count as \"refereed\" for the single-source-concentration cap, and has the vault's embedding-false-friend genre already reached it?"
type: "capture"
status: "promoted"
origin: "batch"
writer_model: "claude-sonnet-5"
date_created: "2026-08-17T00:00:00.000Z"
provenance: "Batch research run, 2026-08-17, direct response to 50-questions/question-corroborate-steck-2024-cosine-arbitrariness-single-source-cap.md"
derived_from: []
tags: ["sources-floor","single-source-concentration","cosine-similarity","embedding-false-friend","steck","www2024","peer-review"]
source_tier: 1
promoted_to: ["30-notes/claim-steck-2024-www-short-paper-cleared-committee-peer-review.md"]
not_promoted: ["Vault self-count claim (exactly three notes cite Steck's source_url directly) — not promoted as its own claim-note: it's vault-internal bookkeeping, not a world-fact, and is already reproducible by grep. Folded into the new claim-note's body/commentary and into entity-harald-steck.md's Updates log instead of given a permanent 30-notes/ file of its own.","Synthesis/ruling on whether the WWW Short Papers track clears the cap's 'refereed' bar — this IS the claim promoted (see claim-steck-2024-www-short-paper-cleared-committee-peer-review.md), not a separate leftover.","Further lead: arXiv:2406.10984 ('Revisiting Cosine Similarity via Normalized ICA-transformed Embeddings') and arXiv:2504.16318 ('Semantics at an Angle') as potential independent corroborators of Steck's specific result — neither read past abstract this session ([unverified-mechanism]). Not routed to 50-questions/: no kept claim in this promotion rests on whether they corroborate Steck (the cap ruling above doesn't need corroboration at all now that Steck is ruled refereed), so this is a nice-to-verify lead, not a load-bearing doubt. Left as a lead for a future session that wants to chase it, not a formal question.","The open question's sub-question 2 (does Ethayarajh 2019 discharge the cap independently of Steck's refereed status) — not promoted as a new claim or question. The question this capture answers is ruled 'answered' (see question-corroborate-steck-2024-cosine-arbitrariness-single-source-cap.md's answered_log): sub-question 2 was conditioned on Steck counting as unrefereed, which this promotion rules false, so it's moot to that question. Whether Ethayarajh corroborates Steck's *specific* result independent of the cap question remains genuinely interesting but is a different question than the one this capture was answering, and no kept claim here rests on it — so it was not spun into a new open question, per the intake discipline against promising work nothing here needs.","ACM Digital Library's own record (403 to the archive tool this session) as a second primary corroborator of track/review type — not promoted; the two conference-site pages already quoted are sufficient primary grounding for the claim made, and this is a tooling/access note, not a claim.","Entity candidates declined: Chaitanya Ekanadham and Nathan Kallus (co-authors with no independently-argued significance beyond co-authorship on this one paper — stay folded into entity-harald-steck.md, not promoted to their own hubs); WWW / The Web Conference (ACM) (fails the stricter org-hub bar — single-cluster relevance, acts here only as a publication venue, not as a funding/building/deciding actor); the single-source-concentration cap (a vault-governance concept documented in 00-meta/specs/sources.md, not a domain concept the entity-page spec's hub test is meant to cover — declined as a category mismatch, not a quality judgment). Ethayarajh (EMNLP 2019) — real, foundational to the general anisotropy mechanism this whole genre cites, but named directly in only one existing claim-note so far; deferred rather than built, logged to 00-meta/seek-flags.md as [watch] pending a second independent direct citation."]
seek_code_commit: "17d9798"
---


This capture answers the two-part question opened in [[question-corroborate-steck-2024-cosine-arbitrariness-single-source-cap]] (raised 2026-08-16, itself citing [[entity-harald-steck]]). It researches part 1 directly (is a WWW Companion short paper "refereed" in the cap's sense) with primary conference-site sources, and confirms part 2's vault-state premise (has the genre reached three direct citations) by re-counting the vault.

## Claim: WWW 2024's Short Papers track — where Steck, Ekanadham & Kallus's paper appeared — required committee-based single-blind peer review, not merely submission

The Web Conference 2024's official Call for Short Papers states the submission and reviewing process directly: "Submissions will be peer-reviewed by members of the Short Papers Committee based on originality, significance, quality, and clarity. The review process will be single-blind." This is a formal peer-review gate — a program committee evaluates each submission against explicit criteria before acceptance — not an open-submission or organizer-curated abstract slot.

> [!info] Provenance
> source_url: https://www2024.thewebconf.org/calls/short-papers/
> source_sha: 010e70808154ba2a7fcea484e4e26b242f6344d8a333596bedc669cd3e021af1
> source_title: "International World Wide Web Conference 2024 ( WWW2024 | The Web Conf 2024 ) | Call for Short Papers"
> source_author: The Web Conference 2024 Organizing Committee (Short Papers Co-Chairs: Alexandros Ntoulas, Sinno Pan)
> source_date: 2024 (page reflects the 2024 CFP cycle; archived 2026-08-17)
> source_venue: thewebconf.org (official WWW 2024 conference site)
> source_quote: "Submissions will be peer-reviewed by members of the Short Papers Committee based on originality, significance, quality, and clarity. The review process will be single-blind."
> source_tier: 1 (primary conference-organizer statement of its own review policy)
> claim_kind: technical-mechanism (how the review process actually worked) — clears the Tier 1-2 floor directly.

## Claim: Steck, Ekanadham & Kallus's paper is officially listed among WWW 2024's peer-reviewed, accepted Short Papers — it did not merely appear in the Companion volume by a lighter route

The conference's own "Accepted Papers – Short Papers" page lists "Is Cosine-Similarity of Embeddings Really About Similarity?" by "Harald Steck, Chaitanya Ekanadham and Nathan Kallus" among the accepted Short Papers track submissions. This ties the paper to the specific track whose review process is described above, rather than to one of the Companion Proceedings' other, non-research sub-tracks (workshops, demos, PhD symposium, etc., which are not all reviewed identically). The arXiv listing corroborates the same venue attribution: "Journal reference: ACM Web Conference 2024 (WWW 2024 Companion)," with a Related DOI pointing to the ACM Digital Library Companion Proceedings record (10.1145/3589335.3651526).

> [!info] Provenance
> source_url: https://www2024.thewebconf.org/accepted/short-papers/
> source_sha: b9d22d42d7a44322e13f512df363207f049685e5967e7a579a73f5c7b804b225
> source_title: "International World Wide Web Conference 2024 ( WWW2024 | The Web Conf 2024 ) | Accepted Papers - Short Papers"
> source_author: The Web Conference 2024 Organizing Committee
> source_date: 2024 (archived 2026-08-17)
> source_venue: thewebconf.org (official WWW 2024 conference site)
> source_quote: "Is Cosine-Similarity of Embeddings Really About Similarity?\nHarald Steck, Chaitanya Ekanadham and Nathan Kallus"
> source_tier: 1
> claim_kind: historical/definitional (which track a specific paper was accepted through) — Tier 3-4 would suffice by the floor, but this rests on Tier 1 anyway.
>
> Corroborating source (not separately quote-checked as load-bearing, supporting only):
> source_url: https://arxiv.org/abs/2403.05440
> source_sha: c838fa8fa3754966bb7e2531531fd8d017820ea2a76ebb2a737955c51a40d6c0
> source_title: "[2403.05440] Is Cosine-Similarity of Embeddings Really About Similarity?"
> source_author: arXiv (hosting Steck, Ekanadham, Kallus)
> source_date: "Submitted 8 Mar 2024"
> source_venue: arXiv.org, cs.IR
> source_quote: "Journal reference:ACM Web Conference 2024 (WWW 2024 Companion)"
> source_tier: 1

## Claim: exactly three of the vault's claim-notes currently cite the Steck paper directly via `source_url` — the cap's ceiling for an unrefereed primary, not yet exceeded

A direct grep of `30-notes/` for `source_url: https://arxiv.org/abs/2403.05440` returns exactly three files: [[claim-cosine-similarity-of-embeddings-can-be-arbitrary]], [[observation-hawks-jeffress-cosine-pairing-is-embedding-false-friend]], and [[observation-gates-jevons-cosine-pairing-is-embedding-false-friend]]. Three further notes — [[observation-falcon-helmholtz-inference-embedding-false-friend]], [[observation-ml-ad-en-gedi-cosine-pairing-is-embedding-false-friend]], and [[observation-ml-ad-en-gedi-and-gates-jevons-false-friend-notes-are-a-confirmed-bridge]] — rely on the same result only by wikilink to [[claim-cosine-similarity-of-embeddings-can-be-arbitrary]], not by direct `source_url` citation of the paper itself. This re-confirms the count [[entity-harald-steck]] and the open question already stated: the vault sits exactly at, not past, `sources.md`'s "no more than three" ceiling for an unrefereed primary.

> [!info] Provenance
> source_url: "vault:30-notes/ (grep of source_url field, 2026-08-17)"
> source_title: "Vault self-count — direct-citation grep against 30-notes/"
> source_author: Seek (vault-internal count, not an external source)
> source_date: 2026-08-17
> source_venue: SeekVault (this vault)
> source_tier: 1 (direct, reproducible read of the vault's own frontmatter)
> claim_kind: quantitative (a count) — but of vault-internal state, not a world-fact; reproducible by rerunning the same grep, so treated as directly verified rather than `[unverified-quant]`.

## Synthesis toward the open question

Taken together, the first two claims weigh against classifying Steck, Ekanadham & Kallus as an "unrefereed primary" in the cap's sense. The cap's own definition names "a preprint, a working paper, a self-published report, a conference abstract" as the unrefereed category (`sources.md`, single-source-concentration cap section) — categories characterized by the *absence* of a committee gate. WWW 2024's Short Papers track has that gate: a named committee, stated criteria (originality, significance, quality, clarity), and single-blind reviewing, confirmed as the actual track this specific paper passed through. That the track is lighter-weight than WWW's main Research Track (a 4-page limit, poster rather than oral presentation by default) argues for weighting the paper cautiously, not for calling it unrefereed outright — "refereed" and "as rigorously refereed as a full research-track paper" are different questions, and the cap's text asks only the first.

Whether "peer-reviewed short paper" clears the specific bar the cap's authors intended is ultimately an editorial call for Cali/Seek at promotion, not something a source can settle by itself — this capture supplies the primary-source facts the open question named as needed ("a direct check of WWW 2024's companion-track review/acceptance process"), not the ruling itself.

> [!note] Seek's commentary:
> The open question asked for exactly one thing — go read WWW 2024's own review policy instead of guessing — and the conference's own site answers it cleanly: this was not a drive-by companion-track slot, it went through a named committee under stated criteria. That doesn't resolve the *second* half of the original question (does Ethayarajh 2019 discharge the cap on the general mechanism even if Steck alone doesn't), which I've left as a lead below rather than force here — it needs a careful read of two papers side by side, and this capture is already doing one job well rather than two jobs partially.

## Further leads
- Two 2024-2025 papers cite and extend Steck et al.'s specific regularization-arbitrariness result rather than only the general anisotropy point Ethayarajh covers — worth checking as potential independent corroborators for the cap: "Revisiting Cosine Similarity via Normalized ICA-transformed Embeddings" (arXiv:2406.10984) and "Semantics at an Angle: When Cosine Similarity Works Until It Doesn't" (arXiv:2504.16318). Neither was read past its abstract in this session — [unverified-mechanism — needs direct read] on whether either actually corroborates Steck's specific claim (as opposed to the general "cosine can mislead" theme).
- The original open question's second sub-question — whether Ethayarajh (EMNLP 2019, already cited in [[claim-cosine-similarity-of-embeddings-can-be-arbitrary]]) corroborates the *general mechanism* but not Steck's *specific* analytic result, per the cap's "different author group and different venue" test — is unresolved and belongs in a follow-up capture, not force-fit here.
- ACM Digital Library's own record (https://dl.acm.org/doi/10.1145/3589335.3651526) returned HTTP 403 to the archive tool this session; a future session with different access could pull ACM's own metadata (review type, track) as a second primary corroborating the conference-site pages used here.

## Entity candidates
- Ethayarajh (EMNLP 2019, "How Contextual are Contextualized Word Representations?") — person/paper — the FOUNDATIONAL earlier figure the vault's own claim-note already measures Steck's result against (anisotropy as the general mechanism vs. Steck's specific regularization-arbitrariness result); flagged first per the blind-spot warning, since he is the ancestry the corroboration question in [[question-corroborate-steck-2024-cosine-arbitrariness-single-source-cap]] actually turns on, not a co-author of the paper under review.
- Chaitanya Ekanadham — person — co-author of the paper under review; not yet an entity page, currently folded entirely into [[entity-harald-steck]].
- Nathan Kallus — person — co-author of the paper under review; same gap as Ekanadham.
- WWW / The Web Conference (ACM) — concept/institution — the conference and its Short Papers Committee whose review policy is now the load-bearing fact for this question; no vault entity page currently tracks conference-level peer-review policy as its own concept.
- single-source-concentration cap — concept — the vault's own governance rule this capture is testing against a real case; currently documented only in `00-meta/specs/sources.md`, not as its own entity/concept note.