| Title: | From YouTube to the brain: Transfer learning can improve brain-imaging predictions with deep learning |
| Journal: | Neural Networks |
| Published: | 18 Jun 2022 |
| Pubmed: | https://pubmed.ncbi.nlm.nih.gov/35777174/ |
| DOI: | https://doi.org/10.1016/j.neunet.2022.06.014 |
| URL: | https://www.sciencedirect.com/science/article/am/pii/S0893608022002295 |
Publication 14017
WARNING: the interactive features of this website use CSS3, which your browser does not support. To use the full features of this website, please update your browser.
Abstract
Deep learning has recently achieved best-in-class performance in several fields, including biomedical domains such as X-ray images. Yet, data scarcity poses a strict limit on training successful deep learning systems in many, if not most, biomedical applications, including those involving brain images. In this study, we translate state-of-the-art transfer learning techniques for single-subject prediction of simpler (sex and age) and more complex phenotypes (number of people in household, household income, fluid intelligence and smoking behavior). We fine-tuned 2D and 3D ResNet-18 convolutional neural networks for target phenotype predictions from brain images of ∼40,000 UK Biobank participants, after pretraining on YouTube videos from the Kinetics dataset and natural images from the ImageNet dataset. Transfer learning was effective on several phenotypes, especially sex and age classification. Additionally, transfer learning in particular outperformed deep learning models trained from scratch especially on smaller sample sizes. The out-of-sample performance using transfer learning from previously learned knowledge based on real-world images and videos could unlock the potential in many areas of imaging neuroscience where deep learning solutions are currently infeasible.</p>
6 Keywords
- Brain
- Deep Learning
- Humans
- Intelligence
- Neural Networks, Computer
- Social Media
2 Authors
- Nahiyan Malik
- Danilo Bzdok
1 Application
| Application ID | Title |
|---|---|
| 25163 | Structural genetic contributions brain function and behavior |
Enabling scientific discoveries that improve human health