The Patch Gap Is the Problem