Estimation and Inference for High-Dimensional Generalized Linear Models with Knowledge Transfer

Sai Li, Linjun Zhang, T. Tony Cai, Hongzhe Li

Research output: Contribution to journalArticlepeer-review

4 Scopus citations

Abstract

Transfer learning provides a powerful tool for incorporating data from related studies into a target study of interest. In epidemiology and medical studies, the classification of a target disease could borrow information across other related diseases and populations. In this work, we consider transfer learning for high-dimensional Generalized Linear Models (GLMs). A novel algorithm, TransHDGLM, that integrates data from the target study and the source studies is proposed. Minimax rate of convergence for estimation is established and the proposed estimator is shown to be rate-optimal. Statistical inference for the target regression coefficients is also studied. Asymptotic normality for a debiased estimator is established, which can be used for constructing coordinate-wise confidence intervals of the regression coefficients. Numerical studies show significant improvement in estimation and inference accuracy over GLMs that only use the target data. The proposed methods are applied to a real data study concerning the classification of colorectal cancer using gut microbiomes, and are shown to enhance the classification accuracy in comparison to methods that only use the target data. Supplementary materials for this article are available online.

Original languageEnglish (US)
Pages (from-to)1274-1285
Number of pages12
JournalJournal of the American Statistical Association
Volume119
Issue number546
DOIs
StatePublished - 2024

All Science Journal Classification (ASJC) codes

  • Statistics and Probability
  • Statistics, Probability and Uncertainty

Keywords

  • Aggregation
  • Debiased estimator
  • Meta learning
  • Multi-task learning

Fingerprint

Dive into the research topics of 'Estimation and Inference for High-Dimensional Generalized Linear Models with Knowledge Transfer'. Together they form a unique fingerprint.

Cite this