Confusion Matrix
Confusion Matrix is one of the statistical analyses applied automatically in MerQur. This page illustrates — on a Education Sciences sample dataset — how the analysis is run, what the MerQur output looks like, and how the result is reported in APA 7 format.
🎯 What is it for?
Confusion Matrix automatically applies in the background all the assumption checks required for the relevant data type (normality, homogeneity of variance, etc.) and presents the results with a clear table + chart. Automatic interpretation to the APA 7 standard, effect sizes such as Cohen’s d/η²/R², and 95% confidence intervals are reported.
📌 When is it used?
- Statistical analysis of measurements in the Education Sciences domain
- To produce APA 7-compatible result tables for academic publications
- Hypothesis testing and decision-making processes
- Undergraduate / master’s / PhD theses after the appropriate method has been selected
📐 Assumptions
- Appropriate scale — Variables must be at the measurement level required by the analysis (nominal/ordinal/interval/ratio)
- Independent observations — Observations must come from individuals independent of one another
- Sufficient sample size — The minimum n requirement for the analysis must be met
- Outlier check — Outliers must be detected and evaluated
If assumptions are violated, MerQur automatically suggests a non-parametric or robust alternative.
🛠 How to do it in MerQur
Load the data. Select the sample file from File → Open. MerQur auto-detects column types.
Select the analysis. From the left side select Confusion Matrix.
Panel assignments (form fields in the program):
- target_col:
gercek_etiket - prediction_col:
tahmin_etiket - positive_class:
1
Optional settings. Effect size ✓ · 95% confidence interval ✓ · Assumption checks (automatic).
▶ Run — click the button. Results are produced automatically as a table + chart.
📄 Export to Word. APA 7-formatted report with italic statistical symbols.
📊 Sample Dataset — Education Sciences
ℹ Note: The scenario, MerQur output and interpretation below were produced by actually running the real example dataset in MerQur. Numeric results on your own data will differ; the goal is to show how the analysis is set up and interpreted end-to-end.
🎬 Example File
This analysis is demonstrated on the following example dataset for Education Sciences:
Egitim_Bilimleri/62_complexity_achievement_3sinif.xlsx
🎬 Scenario
Suppose an automated grading system assigns each student a predicted achievement label, and we want to check how accurate it is against the true labels. For 200 assessment units we have the actual_label, the model’s prediction_label, and a continuous prediction_score behind each decision. Confusion Matrix Metrics let us compute accuracy, precision, recall, and F1 from the cross-tabulation of predicted versus actual classes. This is the natural choice when we have a categorical classifier and want a full breakdown of where it gets things right and where it confuses one class for another.
⚙️ Variable Selection
- Actual class: actual_label
- Predicted class: prediction_label
- Predicted probability/score: prediction_score
Data Preview (First 5 Rows)
| unit_id | actual_label | prediction_label | prediction_score |
|---|---|---|---|
| 1.0 | 0.0 | 0.0 | 0.249 |
| 2.0 | 0.0 | 0.0 | 0.279 |
| 3.0 | 0.0 | 0.0 | 0.392 |
| 4.0 | 0.0 | 0.0 | 0.04 |
| 5.0 | 0.0 | 0.0 | 0.325 |
n = 200 · Columns: unit_id, actual_label, prediction_label, prediction_score
📈 MerQur Output
💬 Interpretation
We broke down a classifier’s achievement-class predictions with a confusion matrix. With accuracy 93% and F1 = 0.92 the model is very successful — both the overall correct rate is high and the precision/recall balance (F1) is good. The confusion matrix reveals what the “accuracy” number hides — where each class is misclassified, which classes are confused. The F1 score is more informative than accuracy especially with imbalanced classes. It is the indispensable tool for evaluating the real performance of automated grading/classification models in education.
⚠ Common Mistakes
- Misidentifying the data type (e.g., loading a categorical variable as numeric)
- Skipping assumption checks and going straight to the p-value
- Failing to report effect size — APA 7 requires both p and effect size
- Failing to apply a Type I error correction (Bonferroni/Tukey) in multiple comparisons
- Not switching to a non-parametric alternative when n is insufficient
📹 Video Walkthrough
Watch the video below for an end-to-end walkthrough of this analysis on a Education Sciences file.
▶ Confusion Matrix — video walkthrough
This section is part of the Sınıflandırma video (7 analyses in one video). The link below jumps straight to 3:39, where this analysis begins. Narration is in Turkish.
🧪 Natural Sciences & Mathematics · 🏛 Architecture, Planning & Design · ⚙ Engineering · 🏥 Health Sciences · 📊 Social, Humanities & Admin Sciences · 🏃 Sport Sciences · 🌾 Agriculture, Forestry & Aquatic
📚 If You Used This Analysis, Cite MerQur
If you performed this analysis using MerQur in a scientific study, please use the citation below as part of your academic citation obligations (APA 7):
Örücü, Ö. K. (2026). MerQur: Integrated Academic Data Analysis & Reporting Platform [Computer software] (Version 1.0.0). https://doi.org/10.53463/merqur.2026001
For BibTeX, RIS, EndNote and the English citation form: all citation formats →
- American Psychological Association. (2020). Publication manual of the American Psychological Association (7th ed.).
- Field, A. (2018). Discovering statistics using IBM SPSS Statistics (5th ed.). Sage.
- Cohen, J. (1988). Statistical power analysis for the behavioral sciences (2nd ed.). Lawrence Erlbaum.