Autonomous Patient Monitoring in the Intermediate Care Unit by Live Video Analysis

Abstract: Patients admitted to intermediate care units require frequent monitoring by hospital personnel. An automatisation of this monitoring would save a considerable amount of resources and could also improve the quality of the treatment. In this thesis, a deep learning-based video action recognition model is through different transfer learning approaches trained to distinguish between behaviours of patients in TV-series and a prediction system which collects, processes and predicts on images in real-time is proposed. The results from the model-training suggest that it is possible to detect behaviours that need human intervention but training on a large-scale, real-life dataset is required to form a solid conclusion. The performance results of the prediction system show that live-streamed predictions are possible at frame rates sufficient for capturing sought events, without GPU acceleration.