deep_learning.html

Somewhat counterintuitively, the fitting procedures used in deep learning do not seek a global minima across the observation set. Indeed, the concept of "overfitting" is one of the first principles discussed in introductory material about the topic.

This is contrast to what scientists have historically been instructed to do