COVID 19 Detection System For Oculus Rift

Community Project

The Magic Leap COVID-19 Detection System For Oculus Rift is a Mixed Reality application for Oculus Rift that interfaces with a Convolutional Neural Network to provide real-time detection of COVID-19 in a Virtual Reality Environment.

project-image
project-image
project-image

 

About this project

Virtual Reality diagnostics system including integration with open-source classifier for SARS-CoV-2.

The COVID-19 Detection System For Oculus Rift uses Tensorflow 2, Raspberry Pi 4 & Oculus Rift to provide a Virtual Reality detection system.

The project uses the COVID-19 Tensorflow DenseNet Classifier, a Tensorflow implementation of a DenseNet model and the SARS-COV-2 Ct-Scan Dataset, a large dataset of CT scans for SARS-CoV-2 (COVID-19) identification.

I use the trained model from COVID-19 Tensorflow DenseNet Classifier with the COVID-19 Tensorflow DenseNet Classifier For Raspberry Pi 4 and serve an API endpoint that exposes the Artificial Intelligence classifier allowing Oculus Rift to communicate with it.

The classifier is connected to the HIAS iotJumpWay MQTT broker, requests are authenticated using the HIAS private blockchain via the MQTT IoT Agent, and classifications are stored in the historical database along with a hash of the classification for data integrity. The IoT Agent stores contextual data of the classifier in the HIASCDI Context Broker.

Technologies Used

  • Oculus Rift
  • Unity
  • Tensorflow
  • Raspberry Pi