README.md 2.91 KB
Newer Older
1
2
3
# Instrumented Hand Washing Detection and Monitoring System

In the file references.bib the references cited in this file in a Latex-like manner can be found.
goelzhae's avatar
goelzhae committed
4

5
6
## Description

Simon Gölzhäuser's avatar
Simon Gölzhäuser committed
7
In the literature some work can be found which focuses on detecting hand washing events \cite{kinsella2007} \cite{levchenko2010} \cite{levchenko2011} \cite{fagert2017}. Their overall goal is mostly to improve hand hygiene of healthcare staff in medical environments, like hospitals.
8
9

The hand washing detection and monitoring system which will be built in this master project aims at a different goal. It wants to establish an automatically triggered camera-based ground truth data recording system which can then be used in many different studies. One novel example is the detection of obsessive-compulsive hand washing with wrist-worn devices \cite{scholl2020}.
10

Simon Gölzhäuser's avatar
Simon Gölzhäuser committed
11
Already existing is a wrist motion data recording software for Android smartwatches \cite{githubSogge} \cite{githubScholl}. Currently there is only limited context in the collected data given by user interaction. No ground truth is automatically recorded. This gap should be filled with:
12

Simon Gölzhäuser's avatar
Simon Gölzhäuser committed
13
* **Bluetooth beacons** placed at sinks, which communicate with the smartwatches. Start and endpoints of hand washing activities (as ground truth) can then be detected with rough accuracy instead of asking the user for it. This gives primary evidence.
14

Simon Gölzhäuser's avatar
Simon Gölzhäuser committed
15
* An **automatically triggered video recording system integrated into an electric soap dispenser**. After placing this device appropriately at a sink it should record ground truth video data each time when someone is washing hands. Timestamp information can then be used to associate the videos with the wrist motion data from the smartwatch. This provides secondary evidence.
16

17
18
19
* A **flow rate sensor** added to the soap dispenser setup. This should then be utilized to add more accuracy to the detection of hand washing events

These are also the three levels of complexity the work will be divided in. The final setup could then be used for studies addressing all kinds of hand washing activities.
20

Simon Gölzhäuser's avatar
Simon Gölzhäuser committed
21
22
The collected video data can then in future work also be used to create ground truth data for any kind of gesture recognition Machine Learning approaches based on the wrist motion data. Or also to apply Machine Learning to the video data itself.

23
24
## Roadmap & Deliverables

25
26
27
- [x] **May:** Integration of Bluetooth beacons in wrist motion recording software
- [x] **May:** Choice of appropriate hardware for video recording integrated soap dispenser (ESP32, ...)
- [x] **June:** Hard- and software concept for integrated soap dispenser
Simon Gölzhäuser's avatar
Simon Gölzhäuser committed
28
- [x] **June/July:** First prototype of integrated soap dispenser
Simon Gölzhäuser's avatar
Simon Gölzhäuser committed
29
30
31
- [x] **July:** Finetuning of integrated soap dispenser
- ~~[ ] **July/August:** Integration of flow rate sensor into video recording soap dispenser~~
- [x] **August:** Final evaluation (10 hand washing events, all recognized and recorded correctly)
32
- [ ] **August:** Documentation & report