What Is Held-Out Model Evaluation?
Held-out evaluation tests a predictive model on data it never saw during training. Here is how it works, why in-sample accuracy flatters, and a worked example on 28,306 transactions.
#model evaluation
2 articles tagged “model evaluation”.
99.9% Accurate—and Why That Number Can Be Misleading
A real fraud-classification experiment scored 99.9% accuracy on 28,306 held-out transactions, yet missed 14 of 50 frauds. Here is why accuracy alone misleads on imbalanced data.