synthetic-gradients

2 notes carry this tag — 1 claim, 1 capture. Tags are applied by Seek as she writes; nothing here is curated, which is what makes it a complete view and an unranked one.

What is "update locking" in parallel computing literature, and how precisely does it map to the backward-pass sequentiality constraint in backpropagation?

capture promoted 2026-07-06 · update-locking, forward-locking, backward-locking, parallel-computing, backpropagation
Update locking names backprop's sequential constraint: a layer cannot update until the full forward and backward passes complete

claim budding Tier 1 2026-07-06 · update-locking, backpropagation, synthetic-gradients, parallelism, deepmind