arXiv Analytics

Sign in

arXiv:1906.04716 [cs.LG]AbstractReferencesReviewsResources

Graph Convolutional Transformer: Learning the Graphical Structure of Electronic Health Records

Edward Choi, Zhen Xu, Yujia Li, Michael W. Dusenberry, Gerardo Flores, Yuan Xue, Andrew M. Dai

Published 2019-06-11Version 1

Effective modeling of electronic health records (EHR) is rapidly becoming an important topic in both academia and industry. A recent study showed that utilizing the graphical structure underlying EHR data (e.g. relationship between diagnoses and treatments) improves the performance of prediction tasks such as heart failure diagnosis prediction. However, EHR data do not always contain complete structure information. Moreover, when it comes to claims data, structure information is completely unavailable to begin with. Under such circumstances, can we still do better than just treating EHR data as a flat-structured bag-of-features? In this paper, we study the possibility of utilizing the implicit structure of EHR by using the Transformer for prediction tasks on EHR data. Specifically, we argue that the Transformer is a suitable model to learn the hidden EHR structure, and propose the Graph Convolutional Transformer, which uses data statistics to guide the structure learning process. Our model empirically demonstrated superior prediction performance to previous approaches on both synthetic data and publicly available EHR data on encounter-based prediction tasks such as graph reconstruction and readmission prediction, indicating that it can serve as an effective general-purpose representation learning algorithm for EHR data.

Related articles: Most relevant | Search more
arXiv:1810.09593 [cs.LG] (Published 2018-10-22)
MiME: Multilevel Medical Embedding of Electronic Health Records for Predictive Healthcare
arXiv:1909.09248 [cs.LG] (Published 2019-09-19)
Representation Learning for Electronic Health Records
arXiv:1907.09538 [cs.LG] (Published 2019-07-22)
BEHRT: Transformer for Electronic Health Records
Yikuan Li et al.