Machine Leaning

Overfitting occurs when a model learns the training data too closely, including random noise and unnecessary details.

As a result:

1. Excellent performance on training data
2. Poor performance on new data

Analogy

A student memorizes answers to previous exams but struggles when asked different questions.

The student hasn't learned the concepts—only the examples.