Question 26
Domain 2 — AI Operations, Lifecycle, and Control EnvironmentAn IS auditor notes that an AI model achieved significantly better results on training data than on test dat a. Which of the following problems with the model has the IS auditor identified?
Correct answer: B
Explanation
Overfitting occurs when a model learns the training data too closely and performs much better on training data than on unseen test data. The large gap between training and test results shows the model has memorized patterns in the training set rather than generalizing well.
Why each option is right or wrong
A. Underfitting
B. Overfitting
A model that performs markedly better on the data it was trained on than on held-out test data is exhibiting poor generalization, which is the classic definition of overfitting in machine learning. The training set is used to fit the model, while the test set is intended to measure performance on unseen data; a large performance gap indicates the model has learned noise or idiosyncrasies from the training set rather than stable patterns.
C. Generalization
D. High variance