Memory Sample Tradeoff: Why Perfect Gaussian Measurements Still Demand More Samples
A stack of exact Gaussian equations can pin down an unknown vector after just as many measurements as it has coordinates. Put those same equations through a learner that can read each pair only once and retain at most a fixed multiple of the dimension squared in bits, and the precision changes what it needs. … Read more