| Title: | Efficient Search Algorithms for Identifying Synergistic Associations in High-Dimensional Datasets |
| Journal: | Entropy |
| Published: | 11 Nov 2024 |
| Pubmed: | https://pubmed.ncbi.nlm.nih.gov/39593912/ |
| DOI: | https://doi.org/10.3390/e26110968 |
Publication 14155
WARNING: the interactive features of this website use CSS3, which your browser does not support. To use the full features of this website, please update your browser.
Abstract
In recent years, there has been a notably increased interest in the study of multivariate interactions and emergent higher-order dependencies. This is particularly evident in the context of identifying synergistic sets, which are defined as combinations of elements whose joint interactions result in the emergence of information that is not present in any individual subset of those elements. The scalability of frameworks such as partial information decomposition (PID) and those based on multivariate extensions of mutual information, such as O-information, is limited by combinational explosion in the number of sets that must be assessed. In order to address these challenges, we propose a novel approach that utilises stochastic search strategies in order to identify synergistic triplets within datasets. Furthermore, the methodology is extensible to larger sets and various synergy measures. By employing stochastic search, our approach circumvents the constraints of exhaustive enumeration, offering a scalable and efficient means to uncover intricate dependencies. The flexibility of our method is illustrated through its application to two epidemiological datasets: The Young Finns Study and the UK Biobank Nuclear Magnetic Resonance (NMR) data. Additionally, we present a heuristic for reducing the number of synergistic sets to analyse in large datasets by excluding sets with overlapping information. We also illustrate the risks of performing a feature selection before assessing synergistic information in the system.</p>
11 Authors
- Cillian Hourican
- Jie Li
- Pashupati P. Mishra
- Terho Lehtimäki
- Binisha H. Mishra
- Mika Kähönen
- Olli T. Raitakari
- Reijo Laaksonen
- Liisa Keltikangas-Järvinen
- Markus Juonala
- Rick Quax
1 Application
| Application ID | Title |
|---|---|
| 68746 | Assessing the influence of genetic- and non-genetic risk factors on subclinical and clinical cardiovascular disease. |
Enabling scientific discoveries that improve human health