Browse › Theoretical computer science › 140 Memory–sample lower bounds for noiseless Gaussian regression
Subsphere methods for memory-sample lower bounds in noiseless Gaussian regression
Open PDFCite Report a problem Add a reference or comment Interested in working on this Start a discussion
Edit NOTES.md · Existing issues · Source on GitHub
Abstract
Let a finite-state streaming learner estimate a uniformly random unit vector from independent exact Gaussian linear measurements. We prove that $o(d^2)$ bits of persistent memory and angular success probability at least 2/3 require at least $2^{-16}d\log_2(1/\epsilon)$ samples for all sufficiently large d, uniformly for $0\lt \epsilon\le1/10$. The proof conditions each batch on its observed projection and controls the resulting random residual subsphere.
If the PDF does not display here, open it directly: Open PDF.
Notes
No notes yet. Add a reference, a comment or your name with the buttons above, or edit NOTES.md on GitHub.
Automatically collected notes (unreviewed)
work in progress
Collected automatically by AI tools (Claude Opus 5.5 and GPT-6 Astra, 2026-10-21) and not checked by a person. May be wrong or incomplete. Report an error.
Follow-up works
- GitHub user acprk (author name not given), The leading constant of the memory–sample tradeoff for noiseless Gaussian regression (GitHub note, v0.1.0, 2026-10-10). Claims the constant $2^{-16}$ of this paper can be replaced by any $c < 2\ln 2$ for $o(d^2)$ memory, matched by finite-bit randomized Kaczmarz, conditional on the upstream proof; it takes its architecture and unchanged lemmas from this paper. [AI-generated per source]
Formalization
- OpenAI, Memory–sample lower bounds for noiseless Gaussian regression: Lean scope notes (oai-math-revised mirror of openai/math, 2026-10). Describes the Lean formalization across the six papers, with eight comparator files (e.g. NoiselessRegression.lean, SubsphereCurrent.lean); for this paper it reports the explicit $2^{-16} d \log_2(1/\epsilon)$ bound at success 2/3 and a same-order bound at success 1/2. [family-level]
Related prior literature mentioned by others
- V. Sharan, A. Sidford and G. Valiant, Memory-Sample Tradeoffs for Linear Regression with Small Error (arXiv:1904.08544, STOC 2019). Identified by VibeMathed as the noisy-regression precursor to the family's precision question. [family-level]
- Marsden, Sharan, Sidford, Valiant, Efficient Convex Optimization Requires Superlinear Memory (arXiv:2203.15260, 2022; COLT 2022). Cited by the acprk leading-constant note as related memory lower-bound work for first-order convex optimization.
- Blanchard, Zhang, Jaillet, Quadratic Memory is Necessary for Optimal Query Complexity in Convex Optimization: Center-of-Mass is Pareto-Optimal (arXiv:2302.04963, 2023; COLT 2023). Cited by the acprk leading-constant note as related work on quadratic-memory thresholds.
Possibly relevant literature (found by the agent, not checked)
- Brown, Bun, Smith, Strong Memory Lower Bounds for Learning Natural Models (arXiv:2206.04743, COLT 2022). One-pass memory lower bounds for natural learning problems, whose abstract notes earlier linear-regression bounds covered only narrow sample-size ranges; relevant to the claim that the bound holds uniformly in accuracy.
Digests and expositions
- Latent Seminar, Memory and samples in noiseless Gaussian regression (Latent Seminar, 2026-10-07). Explains residual subspheres and the two-dimension cost per block, without claiming independent verification of the complete proofs. [family-level]
News and blogs
- ミトKeY(MeatKey), OpenAIの"openai/math"の広い意味での研究へのインパクトについての「ある実験」 (note.com, 2026-10-12). Presents an AI-generated application experiment using family 140 for sensor calibration and discusses proposed finite-bit Kaczmarz and manufacturing-transfer extensions. [AI-generated per source] [family-level]
Elsewhere
- Emergent Mind: family 140
Independent sites; their content is not reviewed here.
Cite
@misc{OAI:Subsphere-methods-for-memory-sample-lower-bounds-in-noiseless-Gaussian-regression-September-27-2026,
author = {{OpenAI}},
title = {{Subsphere methods for memory--sample lower bounds in noiseless Gaussian regression}},
howpublished = {OpenAI Math Release preprint
\href{https://github.com/openai/math/blob/main/preprints/Subsphere-methods-for-memory-sample-lower-bounds-in-noiseless-Gaussian-regression-September-27-2026/paper.pdf}{OAI:Subsphere-methods-for-memory-sample-lower-bounds-in-noiseless-Gaussian-regression-September-27-2026}},
year = {2026}
}Lean formalization
OpenAI provides Lean files for this family: lean/docs/140.md. The Lean statements have not been checked by people against the paper's claims.
Family 140: Memory–sample lower bounds for noiseless Gaussian regression
For fixed A > 0, a one-pass learner with $Ad^2$ persistent bits needs $\Omega_A(d\log(1/\epsilon))$ noiseless Gaussian samples to recover a unit vector to angular error $0\lt \epsilon\le1/10$ with probability 2/3, uniformly in accuracy for large d. Computation and randomized updates are unrestricted, but output uses only the terminal state, stopping index and fresh randomness.
Other papers in this family:
- Memory and precision in noiseless Gaussian regression · September 27, 2026
- Posterior replicas and conditional information in Gaussian regression · September 27, 2026
- Localization costs and information growth for exact Gaussian observations · September 27, 2026
- Projection moments, positive cap domination, and Riesz estimates on the sphere · September 27, 2026
- Replacing Gaussian observations in memory-constrained inference · September 27, 2026