Thursday, Nov 20, pm 2pm EB 3546 DIET MONITORING THROUGH BREATHING SIGNAL ANALYSIS USING WEARABLE SENSORS. Bo Dong. Advisor: Dr.

Size: px

Start display at page:

Download "Thursday, Nov 20, pm 2pm EB 3546 DIET MONITORING THROUGH BREATHING SIGNAL ANALYSIS USING WEARABLE SENSORS. Bo Dong. Advisor: Dr."

Tyrone Bates
5 years ago
Views:

1 Thursday, Nov 20, pm 2pm EB 3546 DIET MONITORING THROUGH BREATHING SIGNAL ANALYSIS USING WEARABLE SENSORS Bo Dong Advisor: Dr. Subir Biswas ABSTRACT This dissertation presents a framework of wearable food and drink intake monitoring system that analyzes human breathing signal for identifying swallows during the intake process. The system works based on a key observation that a person s otherwise continuous breathing cycles are interrupted by brief intra-cycle apneas during the swallows. This dissertation develops wireless wearable electronics for capturing and processing human breathing signal, and algorithms for identifying intake-related swallows via recognizing apneas extracted from breathing signal. A family of apnea detection mechanisms including matched filters and machine learning has been developed. Algorithms are developed for detecting various types of swallowing events including for solid and liquid in the presence of many artifacts presents in free-living conditions. It is demonstrated that using these algorithms and the electronics, run-time intake monitoring and analysis are feasible at acceptable accuracy levels. Further accuracy improvements were explored using a Hidden Markov Model (HMM) based mechanism that leverages known temporal locality in the human swallow sequence. Finally, it was demonstrated

2 that by combining swallowing signatures from breathing signal with hand movement signatures using accelerometers, it is possible to train a hierarchical Support Vector Machine (SVM) classifiers and a Hidden Markov Model (HMM) for accurate mealtime and duration estimation. The developed wearable system, along with a smartphone App, was experimentally validated on tens of subjects with approval from MSU s Institutional Review Board (IRB).

3 LIST OF PUBLICATIONS Peer Reviewed Journals 1. Bo Dong and Subir Biswas, Wearable Sensing for Liquid Intake Monitoring via Apnea Detection in Breathing Signals, Accepted, In Press, Biomedical Engineering Letters, Bo Dong and Subir Biswas, Mealtime and Duration Monitoring Using Wearable Sensors, Submitted to Special issue Sensor Informatics and Quantified Self of IEEE Journal of Biomedical and Health Informatics, Alexander Montoye*, Bo Dong*, Subir Biswas, and Karin Pfeiffer, Use of a Wireless Network of Accelerometers for Improved Measurement of Human Energy Expenditure, Electronics, 2014, (* indicates co-first author with equal contribution). 4. Debasmit Banerjee, Bo Dong, Mahmoud Taghizadeh, and Subir Biswas, Privacy Preserving Channel Access for Internet of Things, Accepted, In Press, IEEE Internet of Things Journal. 5. Alexander Montoye*, Bo Dong*, Subir Biswas, and Karin Pfeiffer, Validation of a wireless accelerometer network for energy expenditure measurement in a simulated freeliving setting, Submitted to Physiological Measurement (* indicates co-first author with equal contribution). 6. Qiong Huo, Bo Dong, and Subir Biswas, A Cellular Pulse Switching Paradigm for Ultra Low Power Sensor Networks, Elsevier Pervasive and Mobile Computing, Debasmit Banerjee, Courtney L Daigle, Bo Dong, Kaitlin Wurtz, Ruth C Newberry, Janice M Siegford and Subir Biswas, Detection of jumping and landing force in laying hens using wireless wearable sensors, Poultry Science, Bo Dong and Subir Biswas, Analyzing Breathing Signal and Swallow Sequence Locality for Solid Food Intake Monitoring, Submitted to Biomedical Engineering Online. Patents 9. International patent application PCT/US2013/28179, S. Biswas and Bo Dong, Food Intake Monitoring via Apnea Detection via Breathing Signal Analysis, Michigan State University.

4 10. U.S. provisional patent application 61/910,952, S. Biswas, S. Lorenz, Q. Huo, and Bo Dong, Systems and Methods for Ultrasonic Pulse Communication in Solid Substrates, Michigan State University 11. U.S. provisional patent application 62/021,430, S. Biswas, Bo Dong, and R. Gallant, System and Methods for a Smart Water Bottle Converter, Michigan State University. Peer Reviewed Conferences 12. Bo Dong, Alexander Montoye, Subir Biswas, and Karin Pfeiffer, Metabolic Energy Expenditure Estimation using a Position-agnostic Wearable Sensor System, Healthcare Innovations and Point-of-Care Technologies Conference (HICPT 14), Seattle, Washington, USA, Oct Bo Dong, Ryan Gallant, and Subir Biswas, A self-monitoring Water Bottle for Tracking Liquid Intake, Healthcare Innovations and Point-of-Care Technologies Conference (HICPT 14), Seattle, Washington, USA, Oct William Tomlinson, Bo Dong, Stephan Lorenz, and Subir Biswas, Node Localization via Analyzing Multi-path Signals in Ultrasound Sensor Networks, SPIE Defense, Security, and Sensing, Baltimore, Maryland USA, May Debasmit Banerjee, Bo Dong, and Subir Biswas, Privacy-preserving Channel Access using Blindfolded Packet Transmissions, COMSNETS 2014, 6th International Conference on Communication System and Networks, Bangalore, India, Jan Alexander Montoye, Bo Dong, Subir Biswas, and Karin Pfeiffer, Assessing the Effects of Accelerometer Placement and Modeling Methods on Energy Expenditure Measurement, 41st Annual Meeting of American College of Sports Medicine, Midwest Chapter, Merrillville, Indiana, Nov Bo Dong, Robert Gernhardt, Janik Schlemminger, and Subir Biswas, A Mobile Food Intake Monitoring System based on Breathing Signal Analysis, BODYNETS 2013, 8th International Conference on Body Area Networks, Boston, Massachusetts, Oct Bo Dong and Subir Biswas, Wearable Diet Monitoring Through Breathing Signal Analysis, EMBC 2013, 35th Annual International Conference of the IEEE Engineering in Medicine and Biology Society, Osaka, Japan, July Bo Dong, Subir Biswas, Alexander Montoye, and Karin Pfeiffer, Comparing Metabolic Energy Expenditure Estimation Using Wearable Multi-Sensor Network and Single Accelerometer, EMBC 2013, 35th Annual International Conference of the IEEE Engineering in Medicine and Biology Society, Osaka, Japan, July 2013.

5 20. Alexander H. Montoye, Bo Dong, Subir Biswas, and Karin A. Pfeiffer, Comparing Energy Expenditure Prediction from a Wireless Network of Accelerometers Compared to Indirect Calorimetry, Amerian College of Sports Medicine Annual Meeting, Indianapolis, Indiana, USA, May, Alexander H. Montoye, Bo Dong, Subir Biswas, and Karin A. Pfeiffer, Comparing Energy Expenditure Prediction from an Accelerometer-Based Artificial Neural Network to Indirect Calorimetry, 3rd International Conference on Ambulatory Monitoring of Physical Activity and Movement, Amherst, Massachusetts, USA, June Karin A. Pfeiffer, Alexander H. Montoye, Bo Dong, and Subir Biswas, Comparing Energy Expenditure Prediction from a Wearable Wireless Network of Accelerometers to Indirect Calorimetry, 3rd International Conference on Ambulatory Monitoring of Physical Activity and Movement, Amherst, Massachusetts, USA, June Bo Dong, Subir Biswas, Karin Pfeiffer, Alexander Montoye, and Rebecca Moore, A machine learning approach for energy-aware activity classification using wearable sensor networks, SPIE Defense, Security, and Sensing, Baltimore, Maryland USA, April Bo Dong, Subir Biswas, Noninvasive wearable diet monitoring through breathing signal analysis, SPIE Defense, Security, and Sensing, Baltimore, Maryland USA, April Stephan Lorenz, Bo Dong, Subir Biswas, Pulse-based sensor networking using mechanical waves through metal substrates, SPIE Defense, Security, and Sensing, Baltimore, Maryland USA, April Qiong Huo, Bo Dong, and Subir Biswas, A novel self-organized distributed pulse switching architecture for binary sensing and actuation applications, SPIE Defense, Security, and Sensing, Baltimore, Maryland USA, April Debasmit Banerjee, Bo Dong, Subir Biswas, ZEA-TDMA: design and system level implementation of a TDMA protocol for anonymous wireless networks, SPIE Defense, Security, and Sensing, Baltimore, Maryland USA, April Qiong Huo, Bo Dong, and Subir Biswas, Cellular Pulse Switching: An Architecture forevent Sensing and Localization in Sensor Networks, 14th International Conference, ICDCN 2013, Mumbai, India, January 3-6, Qiong Huo, Bo Dong, and Subir Biswas, A Cellular Pulse Switching Architecture for Binary Event Sensing, In Proceedings of Globecom 2012, IEEE Global Communications Conference, GLOBECOM, December, Bo Dong and Subir Biswas, Swallow Monitoring Through Apnea Detection in Breathing Signal, EMBC 2012, 34th Annual International Conference of the IEEE Engineering in Medicine and Biology Society, San Diego, California, USA, August 2012.

6 31. Bo Dong and Subir Biswas, Wearable Networked Sensing for Human Mobility and Activity Analytics: A Systems Study, NetHealth 2012, Fourth International Conference on COMmunication Systems and NETworkS, IEEE COMSNETS 2012, Bangalore, India, January Peer Reviewed Book Chapter 32. Qiong Huo, Bo Dong, and Subir Biswas, Pulse Switching: A Packet-less Networking Paradigm for Energy-constrained Monitoring Applications, Wireless Sensor Networks: Theory and Application, CRC Press.

Analysis of Acceleration Value based on the Location of the Accelerometer

Analysis of Acceleration Value based on the Location of the Accelerometer Shin-Hyeong Choi Abstract Physical activity is essential for human health maintenance. We investigate the effects of acceleration