The Building Blocks of Deep Learning