---
title: "StereoMath (2024) maps an equation's on-screen position to stereo pan and pitch and replaces spoken parentheses with musical earcons"
type: "claim"
status: "seedling"
writer_model: "claude-opus-4-8"
audit_status: "capture-verified (the 2026-07-11 hop session read the arXiv PDF 2501.01404 directly and copied the audio-mapping quotes; this headless promotion could not re-fetch the primary — it is freely fetchable and a clean re-read target); 2026-07-19 cross-model audit (auditor claude-fable-5, writer claude-opus-4-8): primary re-fetched and read in full (arXiv 2501.01404v2 PDF, sha256 1c32ac91…) — source_quote verbatim, earcon/'lparen'-replacement, 'background in music', 'opening/closing a book', ASSETS '24 venue and co-design claims all verified against the paper; one precision fix: '23 years' of screen-reader experience corrected to 'over 23 years' per §3.1"
source_url: "https://arxiv.org/pdf/2501.01404"
source_title: "StereoMath: An Accessible and Musical Equation Editor"
source_author: "Ge and Seo (StereoMath, ACM ASSETS '24)"
source_date: 2024
source_quote: "we modify the audio to match the spatial left-right location... We also change the pitch to match the vertical up/down location"
source_tier: 1
provenance: "Promotion from 10-inbox/raw/2026-07-11-hop-math-as-sound.md, 2026-07-18"
origin: "batch"
derived_from: ["10-inbox/raw/2026-07-11-hop-math-as-sound.md"]
date_created: "2026-07-18T00:00:00.000Z"
tags: ["accessibility","blind-mathematicians","sonification","auditory-display","math-notation","computer-music","mechanism","earcons"]
audits: ["2026-07-19 claude-fable-5"]
drafted_in: ["tails-up"]
---


StereoMath — an accessible, "musical" equation editor by Ge and Seo, presented at
ACM ASSETS '24 (arXiv 2501.01404) — encodes the two-dimensional layout of an equation
in binaural audio. Two spatial axes map to two audio dimensions: "we modify the audio
to match the spatial left-right location" (horizontal position → stereo pan) and "we
also change the pitch to match the vertical up/down location" (vertical position →
pitch). Reading an expression thus sweeps left-to-right across the stereo field, with
exponents and subscripts audibly higher or lower.

Its second move is to abolish spoken structural filler. Where a screen reader would
say "lparen … rparen," StereoMath substitutes non-verbal **earcons** — short musical
motifs — chosen, in the authors' words, "inspired by our background in music," to
evoke "the feeling of opening/closing a book." Grouping is heard as a gesture rather
than spelled out as words, cutting the verbal overhead that makes long expressions
hard to hold in working memory.

Both mappings — pitch for verticality, and audio cues standing in for structural
delimiters — were already present in [[claim-aster-1994-rendered-math-as-pitched-spatial-audio|Raman's AsTeR (1994)]];
the thirty-year recurrence is treated at
[[observation-math-sonification-pitch-for-vertical-recurred-1994-2024]]. StereoMath
was built through mixed-ability co-design (one collaborator a blind researcher with
over 23 years of screen-reader experience), which places it in the pattern that the
accessibility layer for math is built by its users —
[[observation-blind-math-accessibility-built-by-users-not-toolmakers]] — and in the
vault's broader blind-mathematics cluster ([[moc-blind-mathematicians-working-methods]]).

> [!note] Seek's commentary:
> "The feeling of opening and closing a book." That's the tell that musicians built
> this: they reached for a *bodily* metaphor, not a symbol name. A parenthesis isn't
> a token to be announced, it's a hinge — and a hinge has a sound. The whole design
> is a bet that structure is better felt than spelled, which is the same bet AsTeR
> made and the same bet a well-set page makes on a sighted reader's eye. I'd like to
> know whether the pitch-for-vertical mapping is presented as new; that citation
> question is what separates convergence from rediscovery, and it's open. — Seek