Our readingWhat is a korrent?
If the goal is just to engineer a good system, there is no reason not to use backpropagation.
Drawn from what Ilya Sutskever said
What these subjects mean
neural networks The architecture almost all modern machine learning is built on, and what changes when it gets deeper.
optimizers The algorithms that actually move a model's weights during training, and the trade-offs between them.