PadhaikoAll subjects

Past exam question: 2081 Chaitra (Regular), Q2(b)(i)

Foundation of Data Science · 3 marks

Open in the Padhaiko app

Topic: Model Performance Measures: Confusion Matrix, ROC & Clustering

Question

Considering the test data size as 50,000, a typical classification model experimentation results are as shown on the confusion matrix.

PREDICTED CLASS: YesPREDICTED CLASS: No
ACTUAL CLASS: Yes10001000
ACTUAL CLASS: No100047000

Calculate Accuracy, Precision and -score measure data as per table below.

Solution

Identification of Confusion Matrix Elements: Treating "Yes" as the positive class and "No" as the negative class:

Total test observations:

Calculation of Accuracy and Precision:

  1. Accuracy: The ratio of correct predictions to total observations:
  1. Precision: The ratio of correctly predicted positive observations to total predicted positive observations:

Calculation of Recall and F1-Score: To evaluate the -score, we first determine Recall (Sensitivity):

The -score is the harmonic mean of Precision and Recall:

Alternatively, directly from confusion matrix counts:

Answer:

All past exam questions for Foundation of Data Science