Memorization is Not Enough