KneeVIEW: A Virtual Education Window for musculoskeletal training
Collaborators: Mariana Kersh, PhD, Scott Barrows, MA, FAMI, Dr. Thomas Santoro, David Dominguese, PhD, Anthony Dwyer, Joel Baber, Grace I-Hsuan Hsu, B.Sc., ALM, MS, Meenakshy Aiyer, MD, FACP
Despite the increasing prevalence of orthopedic injuries, clinicians are poorly equipped to treat musculoskeletal problems. Musculoskeletal training is ineffective due to limited exposure to clinical patients resulting in a lack of organized clinical instruction. This project aims to develop a realistic knee simulator model, supported by virtual reality and augmented reality educational modules, to enhance clinician training and improve patient outcomes. The biomechanically accurate model will replicate the stiffness of each individual component of the human knee to simulate both normal and pathological cases.
Multi-modal Skin Lesion Identification & Education Simulator
Collaborators: Scott Barrows, MA, FAMI, Stephen A. Boppart, M.D., Ph.D., Thomas Golemon, MD, Brent Cross, BS, MS
Current simulated skin and models of skin lesions used in education are unrealistic in both visual and tactile characteristics. This project aims to create a skin simulation model with realistic appearance and texture. In the project’s first phase, the model will consist of 2D surface images of skin lesions displayed on a tablet computer with a translucent elastomer overlay replicating the surface topography of the lesion. Future efforts will seek to extend the model to 3D and incorporate additional features.
Interactive Technology Support for Patient Medication Self-Management (continued funding)
Collaborators: Dan Morrow, PhD, Suma Pallathadka Bhat, PhD, Mark Hasegawa-Johnson, PhD, Thomas Huang, BS, MS, ScD, James Graumlich, MD, Ann Willemsen-Dunlap, PhD, Don Halpin, EMBA, MS
Electronic health record (EHR) systems are underutilized by chronically ill adult patients. A barrier to patient/provider collaboration and self-care via EHR systems is that information in EHRs is technical, not patient-specific. This project aims to develop a natural language processing tool to translate technical information in the EHR into patient-centered language. A prototype translation algorithm has been created, with preliminary results showing the translation is both accurate and easier to understand. Development of a conversational agent (CA) system using an animated avatar to deliver the patient-centered language is also underway. Goals for further development are refinement and expansion of the translation tool and CA capabilities, including making the CA interactive and able to ask and respond to questions.
AirwayVR Virtual Reality based trainer for Endotracheal Intubation
Collaborators: Pavithra Rajeswaran, Praveen Kumar, MBBS, DCH, MD, Eric Bugaieski, MD, Priti Jani, MD, MPH
Endotracheal intubation is a procedure with risks of severe complications; this risk has been found to be associated with experience. This project seeks to develop a stable, immersive, high quality, low cost VR simulation trainer for learning and practicing intubation. It will create a curriculum for intubation training that uses a VR trainer featuring 3D models of the head and neck and other interactive learning tools. VR input will be provided by a 3D printed laryngoscope as a VR controller. Validation studies will be performed to assess the impact of the VR trainer in intubation training.
Simulation Training for Mechanical Circulatory Support using Extra-Corporeal Membrane Oxygenation (ECMO) in Adult Patients (continued funding)
Collaborators: Pramod Chembrammel, PhD, Matt Bramlet, MD, Pavithra Rajeswaran
Widespread adoption of extra-corporeal membrane oxygenation (ECMO) in adults is limited by the difficulty of deployment of cannulae. To address this deficiency, this project aims to build a physical simulator for training ECMO. The trainer will use customized mannequins with flexible vasculature and a programmable pump to simulate the circulatory system. This artificial vasculature will be integrated with the BioGears physiology engine to control simulated physiological parameters. The physical components will be manufactured by 3D printing. Simulation experts and ECMO-experienced surgeons will evaluate the simulator’s performance.
A Natural Language Powered Platform for Post-Operative Care for Long Distance Caregiving
Collaborators: Ramavarapu Sreenivas, MS, PhD, Sarah De Ramirez, MD, MSc, Kesh T. Kesavadas, PhD
A 2011 study found that patients with severe postoperative grade IV complications cost the US $159,345. This projects aims to diminish these costs by using a Natural Language Powered Platform that patients can verbally interface with. The project consists of three phases: coding voice-commands to fulfill postoperative protocols and test it in a VR environment, connecting the platform to sensors to see if it can process motion assessments and testing these in the VR environment, and conducting studies with test patients at OSF.
Heart Failure & Behavior Change: Patient/Provider Interactive Clinical Education App for Mobile Devices
Collaborators: Scott Barrows, MA, FAMI, Wawrzyniec, Dobrucki, MS, PhD, Barry Clemson, MD, Kyle Formella, Don Halpin, EMBA, MS, Ann Willemsen-Dunlap, PhD
Heart failure (HF) is a complex physiological ailment that requires high cost interventions to manage. However, it has been shown that clear communication during the process improves patient outcomes and decreases human and financial burdens. This study aims to use a mobile app to support patients with Stage A, B, and C of HF. The aims of this project are to use a literature search and needs analysis to determine gaps and barriers, revise and add interactive 3D visual assets for the application, develop a repository of information of HF to be housed in the app, and begin integration of conversation agents developed through previously-funded ARCHES projects. Desired outcomes for the project are improved communication and understanding of HF for patients and improved adherence to treatment by patients.
Flexible, low-cost, Single Port Minimally Invasive robotic Surgical Platform
Collaborators: Placid Ferreira, PhD, Kesh T. Kesavadas, PhD, Nicholas Toombs, Fanxin Wang, Xiao Li, Jorge Correa
Minimally invasive robotic Single Port Laparoscopic Surgery (SPLS) has allowed for surgeons to perform various complex procedures with less burden on the patients. The downside to these robotic systems is an increased economic, maintenance and operation burden, resulting in limited hospital access. This project aims to improve upon their SPLS prototype to develop a cheaper, portable and more flexible device to address those issues. Three advancements in the field with the prototype have been demonstrated. Adding three more improvements will increase the adaptivity of the device and lower the price to an affordable point for middle class hospitals.
Interactive Mixed Reality (IMR) based Medical Curriculum for Medical Education
Collaborators: Kesh T. Kesavadas, PhD, David Crawford, MD, Meenakshy Aiyer, MD, FACP, Jessica Hanks, MD, John Vozenilek, MD
Clinical education and training is a highly complex area, and strides have been taken to improve upon the pre-existing methods of teaching. This project aims to combine the strengths of Jump and HCESC to develop a highly interactive platform for learning that uses Interactive Mixed Reality, a combination of Virtual Reality and 360-degree video. The hope is to eliminate the barrier of the simulation technical skillset so that instructors can easily develop educational content. Future goals of the platform are to provide an easy, immersive and portable method for adult professional learners to maintain, acquire and improve current knowledge while maintaining communication between them and healthcare education centers.