ROC Analysis
ROC Analysis is one of the statistical analyses applied automatically in MerQur. This page illustrates — on a Education Sciences sample dataset — how the analysis is run, what the MerQur output looks like, and how the result is reported in APA 7 format.
🎯 What is it for?
ROC Analysis automatically applies in the background all the assumption checks required for the relevant data type (normality, homogeneity of variance, etc.) and presents the results with a clear table + chart. Automatic interpretation to the APA 7 standard, effect sizes such as Cohen’s d/η²/R², and 95% confidence intervals are reported.
📌 When is it used?
- Statistical analysis of measurements in the Education Sciences domain
- To produce APA 7-compatible result tables for academic publications
- Hypothesis testing and decision-making processes
- Undergraduate / master’s / PhD theses after the appropriate method has been selected
📐 Assumptions
- Appropriate scale — Variables must be at the measurement level required by the analysis (nominal/ordinal/interval/ratio)
- Independent observations — Observations must come from individuals independent of one another
- Sufficient sample size — The minimum n requirement for the analysis must be met
- Outlier check — Outliers must be detected and evaluated
If assumptions are violated, MerQur automatically suggests a non-parametric or robust alternative.
🛠 How to do it in MerQur
Load the data. Select the sample file from File → Open. MerQur auto-detects column types.
Select the analysis. From the left side select ROC Analysis.
Panel assignments (form fields in the program):
- Target Column:
uni_basaril - Predictors:
['kompozit_basari_skor']
Optional settings. Effect size ✓ · 95% confidence interval ✓ · Assumption checks (automatic).
▶ Run — click the button. Results are produced automatically as a table + chart.
📄 Export to Word. APA 7-formatted report with italic statistical symbols.
📊 Sample Dataset — Education Sciences
ℹ Note: The scenario, MerQur output and interpretation below were produced by actually running the real example dataset in MerQur. Numeric results on your own data will differ; the goal is to show how the analysis is set up and interpreted end-to-end.
🎬 Example File
This analysis is demonstrated on the following example dataset for Education Sciences:
Egitim_Bilimleri/60_roc_composite_university_achievement.xlsx
🎬 Scenario
Suppose we built a composite_achievement_score for 250 students and want to know how well it predicts whether a student is later university_successful, a binary outcome coded 0/1. We need to evaluate the score’s discriminative ability across all possible cut-off thresholds rather than picking one arbitrarily. ROC curve analysis is exactly suited to this: it plots sensitivity against one-minus-specificity over every threshold and summarizes overall accuracy with the area under the curve, while also helping us identify an optimal cut-off for classifying students.
⚙️ Variable Selection
- Classifier / test score: composite_achievement_score
- Binary outcome (event): university_successful
Data Preview (First 5 Rows)
| student_id | composite_achievement_score | university_successful |
|---|---|---|
| 1.0 | 59.5 | 1.0 |
| 2.0 | 36.8 | 0.0 |
| 3.0 | 61.2 | 1.0 |
| 4.0 | 80.5 | 1.0 |
| 5.0 | 62.7 | 0.0 |
n = 250 · Columns: student_id, composite_achievement_score, university_successful
📈 MerQur Output
💬 Interpretation
We measured how well a composite achievement score predicts university success with the ROC curve. AUC = 0.93 is “excellent”: the score largely separates admitted from non-admitted students correctly. The Youden index gives the best cut-off (threshold), optimising sensitivity and specificity; here sensitivity is 0.90 at a 0.54 threshold. ROC/AUC is the standard for reporting a diagnostic/classification model’s discriminating power; in education it is ideal for evaluating selection exams, risk-screening tools and prediction models.
⚠ Common Mistakes
- Misidentifying the data type (e.g., loading a categorical variable as numeric)
- Skipping assumption checks and going straight to the p-value
- Failing to report effect size — APA 7 requires both p and effect size
- Failing to apply a Type I error correction (Bonferroni/Tukey) in multiple comparisons
- Not switching to a non-parametric alternative when n is insufficient
📹 Video Walkthrough
Watch the video below for an end-to-end walkthrough of this analysis on a Education Sciences file.
▶ ROC Analysis — video walkthrough
This section is part of the Sınıflandırma video (7 analyses in one video). The link below jumps straight to 0:00, where this analysis begins. Narration is in Turkish.
🧪 Natural Sciences & Mathematics · 🏛 Architecture, Planning & Design · ⚙ Engineering · 🏥 Health Sciences · 📊 Social, Humanities & Admin Sciences · 🏃 Sport Sciences · 🌾 Agriculture, Forestry & Aquatic
📚 If You Used This Analysis, Cite MerQur
If you performed this analysis using MerQur in a scientific study, please use the citation below as part of your academic citation obligations (APA 7):
Örücü, Ö. K. (2026). MerQur: Integrated Academic Data Analysis & Reporting Platform [Computer software] (Version 1.0.0). https://doi.org/10.53463/merqur.2026001
For BibTeX, RIS, EndNote and the English citation form: all citation formats →
- American Psychological Association. (2020). Publication manual of the American Psychological Association (7th ed.).
- Field, A. (2018). Discovering statistics using IBM SPSS Statistics (5th ed.). Sage.
- Cohen, J. (1988). Statistical power analysis for the behavioral sciences (2nd ed.). Lawrence Erlbaum.