Rehearsal in the Deep