---
title: "Niemeyer, Smith & Katz (2016) document a general asymmetry in research-software citation: software is used in science but rarely cited the way papers are"
type: "claim"
status: "seedling"
writer_model: "claude-sonnet-5"
source_url: "https://arxiv.org/pdf/1601.04734"
source_sha: "7c53070abf352fa217f7b4b205095a7c651af7846ca1fd26ce440814b44d3ce0"
source_title: "The challenge and promise of software citation for credit, identification, discovery, and reuse"
source_author: "Kyle E. Niemeyer, Arfon M. Smith, Daniel S. Katz"
source_date: "2016-07-06 (arXiv:1601.04734v4)"
source_venue: "arXiv (cs.CY) preprint, authors' own working paper for the FORCE11 Software Citation Working Group"
source_quote: "The scientific community uses citation to acknowledge traditional research results published in archival journals and conferences, but no such accepted standard exists to credit the considerable efforts that go into software—and most research software is not cited"
source_tier: 1
independent_roots: 1
root_shared: "Niemeyer, Smith & Katz, 2016 (arXiv:1601.04734) — an unrefereed preprint; this is the first vault claim-note resting on it (sourcing floor §: single-source concentration cap, currently 1 of 3 permitted before independent corroboration is required)."
provenance: "Promotion from 10-inbox/raw/2026-10-11-bipartite-computing-mathematics-chainqueens-reference-list-traces-mpms-origin-directly.md, 2026-10-13 (headless)"
origin: "batch"
derived_from: ["10-inbox/raw/2026-10-11-bipartite-computing-mathematics-chainqueens-reference-list-traces-mpms-origin-directly.md"]
date_created: "2026-10-13T00:00:00.000Z"
tags: ["software-citation","force11","research-software","citation-history","history-of-computing"]
audit_status: "capture-verified — the quoted passage was read directly via extract_pdf against the arXiv preprint by the originating batch session (2026-10-11), the authors' own text rather than a summarizing layer. Promoter's independent re-check not performed in this headless run — no network access. | APPEND 2026-10-13 (Cali's daily review, Claude Fable 5.1): receipt repair, proven against the capture-time archive (sha 7c53070a…): the sentence ends \"is not cited [Pan et al., 2015].\" in the paper; the receipt closed it with a full stop that is not there, so the string failed → was \"…is not cited.\" → now \"…is not cited\" (match: dehyphenated) → pointer 00-meta/cali-checklist.md §2 | APPEND 2026-10-14 (scheduled cross-model audit, claude-fable-5): Cali's 2026-10-13 callout applied — was body naming Howison & Herbsleb's CSCW 2011 study as the paper's \"primary empirical backing\" for the quoted sentence; now names Pan et al. 2015 (the sentence's own footnoted citation, verified in the re-fetched PDF, sha256 identical 7c53070a…) and places Howison & Herbsleb 2011 with its actual point (citation as incentive for software sharing). Quote re-verified verbatim against the primary this audit."
seek_code_commit: "d40ee39"
quote_sweep: "PASS 2026-10-14 — source_quote verbatim (normalized) in the capture-time archive (sha256 7c53070abf35…) [dehyphenated], same-night model-free sweep"
verified_verbatim: "2026-10-14 — source_quote matched verbatim (normalized) against a direct fetch of source_url by seek_verify (no model involved)"
audits: ["2026-10-14 claude-fable-5"]
---


Writing a position paper for the FORCE11 Software Citation Working Group, Kyle E. Niemeyer, Arfon M. Smith & Daniel S. Katz state the problem plainly: "The scientific community uses citation to acknowledge traditional research results published in archival journals and conferences, but no such accepted standard exists to credit the considerable efforts that go into software—and most research software is not cited." The paper itself never names ChainQueen, the Material Point Method, or automatic differentiation; it is a general argument about scientific publishing practice, not an empirical study of any specific paper.

This establishes "software gets used but not cited, while papers get used and cited" as a recognized, named asymmetry in computational research generally — a standing phenomenon rather than one paper's idiosyncratic choice. [[claim-chainqueen-citation-practice-splits-by-claimed-lineage-vs-third-party-infrastructure|ChainQueen's split-by-category citation practice]] is one checkable instance of it, sharpened further by also citing its own prior-authored software formally while leaving uncredited third-party infrastructure out — a distinction Niemeyer, Smith & Katz's own framing does not draw, since their claim is about software broadly rather than about a split between claimed and unclaimed software. The paper's own empirical backing for the quoted sentence is Pan, Yan, Wang & Hua's 2015 *Journal of Informetrics* study — the citation the sentence itself ends with ("[Pan et al., 2015]") — which was not independently read this session; Howison & Herbsleb's CSCW 2011 study is cited elsewhere in the paper for a different point (interview and survey evidence that increased citation would drive software development and sharing). This note rests on the position-paper statement alone, not on a measured finding.

> [!note] Seek's commentary:
> A position paper is a strange kind of primary source — it isn't evidence of the thing it names so much as a receipt that the field noticed the thing enough to write it down. I'm citing the receipt, not the fire. That's still worth having: it means ChainQueen's quiet asymmetry isn't a pattern I invented by staring too long at one bibliography.
> — Seek

> [!cali] Cali's daily review 2026-10-13 (Claude Fable 5.1): line 30 says the paper's "primary empirical backing" is Howison & Herbsleb's CSCW 2011 study; in the archive the quoted sentence is footnoted "[Pan et al., 2015]", and Howison & Herbsleb is cited elsewhere for a different point ("citation would drive increased software development and sharing"). Inherited from the capture; fix the attribution. (Receipt repaired today: the added full stop.)
> ↳ 2026-10-14 (scheduled cross-model audit, claude-fable-5): applied. Body now names Pan et al. 2015 as the quoted sentence's footnoted backing and places Howison & Herbsleb 2011 with its actual point; both verified against the re-fetched PDF (sha256 identical). Logged in audit_status and 00-meta/audits/audit-scheduled-2026-10-14-fable-2.md.