| Title: | Addressing overfitting bias due to sample overlap in polygenic risk scoring |
| Journal: | Alzheimer's & Dementia |
| Published: | 6 Apr 2025 |
| Pubmed: | https://pubmed.ncbi.nlm.nih.gov/40189831/ |
| DOI: | https://doi.org/10.1002/alz.70109 |
Publication 14744
WARNING: the interactive features of this website use CSS3, which your browser does not support. To use the full features of this website, please update your browser.
Abstract
INTRODUCTION: Numerous studies on Alzheimer's disease polygenic risk scores (PRSs) overlook sample overlap between International Genomics of Alzheimer's Project (IGAP) and target datasets like Alzheimer's Disease Neuroimaging Initiative (ADNI).</p>
METHODS: To address this, we developed overlap-adjusted PRS (OA PRS) and tested it on simulated data to assess biases from different scenarios by varying training, testing, and overlap proportions. OA PRS was used to adjust for sample bias in simulations; then, we applied OA PRS to IGAP and ADNI datasets and validated through visual diagnosis.</p>
RESULTS: OA PRS effectively adjusted for sample overlap in all simulation scenarios, as well as for IGAP and ADNI. The original IGAP PRS showed an inflated area under the receiver operating characteristic (AUROC: 0.915) on overlapping samples. OA PRS reduced the AUROC to 0.726, closely aligning with the AUROC of non-overlapping samples (0.712). Further, visual diagnostics confirmed the effectiveness of our adjustments.</p>
DISCUSSION: With OA PRS, we were able to adjust the IGAP summary-based PRS for the overlapped ADNI samples, allowing the dataset to be fully used without the risk of overfitting.</p>
HIGHLIGHTS: Sample overlap between large Alzheimer's disease (AD) cohorts poses overfitting bias when using AD polygenic risk scores (PRSs). This study highlighted the effectiveness of overlap-adjusted PRS (OA -PRS) in mitigating overfitting and improving the accuracy of PRS estimations. New PRSs based on adjusted effect sizes showed increased power in association with clinical features.</p>
12 Keywords
- Aged
- Alzheimer Disease
- Bias
- Computer Simulation
- Female
- Genetic Predisposition to Disease
- Genome-Wide Association Study
- Humans
- Male
- Multifactorial Inheritance
- Neuroimaging
- Risk Factors
14 Authors
- Seokho Jeong
- Manu Shivakumar
- Sang-Hyuk Jung
- Hong-Hee Won
- Kwangsik Nho
- Heng Huang
- Christos Davatzikos
- Andrew J. Saykin
- Paul M. Thompson
- Li Shen
- Young Jin Kim
- Bong-Jo Kim
- Seunggeun Lee
- Dokyoon Kim
Enabling scientific discoveries that improve human health