[D] The Bitter Lesson of Optimization: Why training Neural Networks to update themselves is mathematically brutal (but probably inevitable)
Are we still stuck in the "feature engineering" era of optimization? We trust neural networks to learn unimaginably complex patterns from...