Thursday, 28 March, 2024
HomeTechnologyFluSense turns coughing sounds into data for flu and pandemic forecasting

FluSense turns coughing sounds into data for flu and pandemic forecasting

University of Massachusetts Amherst computer scientists tested 'FluSense' in campus clinic waiting rooms.

The FluSense creators say the new edge-computing platform, envisioned for use in hospitals, healthcare waiting rooms and larger public spaces, may expand the arsenal of health surveillance tools used to forecast seasonal flu and other viral respiratory outbreaks, such as the COVID-19 pandemic or SARS.

Models like these can be lifesavers by directly informing the public health response during a flu epidemic. These data sources can help determine the timing for flu vaccine campaigns, potential travel restrictions, the allocation of medical supplies and more.

"This may allow us to predict flu trends in a much more accurate manner," says co-author Dr Tauhidur Rahman, assistant professor of computer and information sciences, who advises PhD student and lead author Forsad Al Hossain.

To give their invention a real-world try-out, the FluSense inventors partnered with Dr George Corey, executive director of University Health Services; biostatistician Nicholas Reich, director of the UMass-based CDC Influenza Forecasting Centre of Excellence; and epidemiologist Andrew Lover, a vector-borne disease expert and assistant professor in the School of Public Health and Health Sciences.

The FluSense platform processes a low-cost microphone array and thermal imaging data with a Raspberry Pi and neural computing engine. It stores no personally identifiable information, such as speech data or distinguishing images. In Rahman's Mosaic Lab, where computer scientists develop sensors to observe human health and behaviour, the researchers first developed a lab-based cough model. Then they trained the deep neural network classifier to draw bounding boxes on thermal images representing people, and then to count them. "Our main goal was to build predictive models at the population level, not the individual level," Rahman says.

They placed the FluSense devices, encased in a rectangular box about the size of a large dictionary, in four healthcare waiting rooms at UMass's University Health Services clinic. From December 2018 to July 2019, the FluSense platform collected and analysed more than 350,000 thermal images and 21m non-speech audio samples from the public waiting areas.

The researchers found that FluSense was able to accurately predict daily illness rates at the university clinic. Multiple and complementary sets of FluSense signals "strongly correlated" with laboratory-based testing for flu-like illnesses and influenza itself. According to the study, "the early symptom-related information captured by FluSense could provide valuable additional and complementary information to current influenza prediction efforts," such as the FluSight Network, which is a multidisciplinary consortium of flu forecasting teams, including the Reich Lab at UMass Amherst.

"I've been interested in non-speech body sounds for a long time," Rahman says. "I thought if we could capture coughing or sneezing sounds from public spaces where a lot of people naturally congregate, we could utilize this information as a new source of data for predicting epidemiologic trends."

Al Hossain says FluSense is an example of the power of combining artificial intelligence with edge computing, the frontier-pushing trend that enables data to be gathered and analysed right at the data's source. "We are trying to bring machine-learning systems to the edge," Al Hossain says, pointing to the compact components inside the FluSense device. "All of the processing happens right here. These systems are becoming cheaper and more powerful."

The next step is to test FluSense in other public areas and geographic locations. "We have the initial validation that the coughing indeed has a correlation with influenza-related illness," Lover says. "Now we want to validate it beyond this specific hospital setting and show that we can generalise across locations."

Abstract
We developed a contactless syndromic surveillance platform FluSense that aims to expand the current paradigm of influenza-like illness (ILI) surveillance by capturing crowd-level bio-clinical signals directly related to physical symptoms of ILI from hospital waiting areas in an unobtrusive and privacy-sensitive manner. FluSense consists of a novel edge-computing sensor system, models and data processing pipelines to track crowd behaviors and influenza-related indicators, such as coughs, and to predict daily ILI and laboratory-confirmed influenza caseloads. FluSense uses a microphone array and a thermal camera along with a neural computing engine to passively and continuously characterize speech and cough sounds along with changes in crowd density on the edge in a real-time manner.
We conducted an IRB-approved 7 month-long study from December 10, 2018 to July 12, 2019 where we deployed FluSense in four public waiting areas within the hospital of a large university. During this period, the FluSense platform collected and analyzed more than 350,000 waiting room thermal images and 21 million non-speech audio samples from the hospital waiting areas. FluSense can accurately predict daily patient counts with a Pearson correlation coefficient of 0.95. We also compared signals from FluSense with the gold standard laboratory-confirmed influenza case data obtained in the same facility and found that our sensor-based features are strongly correlated with laboratory-confirmed influenza trends.

Authors
Forsad Al Hossain, Andrew A Lover, George A Corey, Nicholas G Reich, Tauhidur Rahman

[link url="https://www.sciencedaily.com/releases/2020/03/200319125126.htm"]University of Massachusetts Amherst material[/link]

[link url="https://dl.acm.org/doi/10.1145/3381014"]Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies abstract[/link]

MedicalBrief — our free weekly e-newsletter

We'd appreciate as much information as possible, however only an email address is required.