2 Heads Are Better Than 1 4