News Analytics for Global Infectious Disease Surveillance.
Degree: PhD, Computer Science, 2017, Virginia Tech
Traditional disease surveillance can be augmented with a wide variety of open sources, such
as online news media, twitter, blogs, and web search records. Rapidly increasing volumes of
these open sources are proving to be extremely valuable resources in helping analyze, detect,
and forecast outbreaks of infectious diseases, especially new diseases or diseases spreading
to new regions. However, these sources are in general unstructured (noisy) and construction
of surveillance tools ranging from real-time disease outbreak monitoring to construction of
epidemiological line lists involves considerable human supervision. Intelligent modeling of
such sources using text mining methods such as, topic models, deep learning and dependency
parsing can lead to automated generation of the mentioned surveillance tools. Moreover, realtime
global availability of these open sources from web-based bio-surveillance systems, such
as HealthMap and WHO Disease Outbreak News (DONs) can aid in development of generic
tools which will be applicable to a wide range of diseases (rare, endemic and emerging) across
different regions of the world.
In this dissertation, we explore various methods of using internet news reports to develop
generic surveillance tools which can supplement traditional surveillance systems and aid in
early detection of outbreaks. We primarily investigate three major problems related to infectious
disease surveillance as follows. (i) Can trends in online news reporting monitor and
possibly estimate infectious disease outbreaks? We introduce approaches that use temporal
topic models over HealthMap corpus for detecting rare and endemic disease topics as well as
capturing temporal trends (seasonality, abrupt peaks) for each disease topic. The discovery
of temporal topic trends is followed by time-series regression techniques to estimate future
disease incidence. (ii) In the second problem, we seek to automate the creation of epidemiological
line lists for emerging diseases from WHO DONs in a near real-time setting. For
this purpose, we formulate Guided Epidemiological Line List (GELL), an approach that
combines neural word embeddings with information extracted from dependency parse-trees
at the sentence level to extract line list features. (iii) Finally, for the third problem, we
aim to characterize diseases automatically from HealthMap corpus using a disease-specific
word embedding model which were subsequently evaluated against human curated ones for
Advisors/Committee Members: Ramakrishnan, Narendran (committeechair), Nsoesie, Elaine Okanyene (committee member), Lewis, Bryan Leroy (committee member), Lu, Chang Tien (committee member), Marathe, Madhav Vishnu (committee member).
Subjects/Keywords: Infectious Disease Surveillance; HealthMap; WHO DONs; Temporal Topic Modeling; Guided Epidemiological Line List; Word Embeddings
to Zotero / EndNote / Reference
APA (6th Edition):
Ghosh, S. (2017). News Analytics for Global Infectious Disease Surveillance. (Doctoral Dissertation). Virginia Tech. Retrieved from http://hdl.handle.net/10919/80574
Chicago Manual of Style (16th Edition):
Ghosh, Saurav. “News Analytics for Global Infectious Disease Surveillance.” 2017. Doctoral Dissertation, Virginia Tech. Accessed March 20, 2018.
MLA Handbook (7th Edition):
Ghosh, Saurav. “News Analytics for Global Infectious Disease Surveillance.” 2017. Web. 20 Mar 2018.
Ghosh S. News Analytics for Global Infectious Disease Surveillance. [Internet] [Doctoral dissertation]. Virginia Tech; 2017. [cited 2018 Mar 20].
Available from: http://hdl.handle.net/10919/80574.
Council of Science Editors:
Ghosh S. News Analytics for Global Infectious Disease Surveillance. [Doctoral Dissertation]. Virginia Tech; 2017. Available from: http://hdl.handle.net/10919/80574