Sci-fi moviegoers love it when interactive displays float in space to be poked, flipped, and swiped to access valuable data to help move along the plot.
We do, too.
SoftServe’s R&D team has been interacting with augmented reality (AR) to enable a live, and direct view of a human heart whose elements are augmented by computer-generated sensory inputs, including ultrasound, video, and graphics.
This allows the user to view, ‘touch’, and ‘move’ the augmented human heart, which is an overlay on the real world, but it’s not anchored to or part of it. In this particular version, the data is tied directly to the user. The solution showcases the best of mixed reality (MR) to let the user see the heart (object) in the real world in a single display. By using MR, data is synchronized between the Apple Watch and the model of the heart. This enhances customer engagement and user experience (UX).
- MR combines smart glasses (Meta2) + haptic feedback (Ultrahaptics)
- The beating heart in this demo is a representation of an actual pulse of the user’s heartbeat, while wearing smart glasses and an Apple Watch
Use Cases
Turn complexity into simplicity – can help doctors during complex operations and be used to share expertise about procedures with other doctors around the world in near real-time.
Improve quality – Using AR and MR in the operating theatre could help surgeons to improve the outcome of reconstructive surgery for patients.
Data Visualization – MR allows the visualization of data to help professionals make important decisions about projects, especially as industries (whether it be fintech or health) become more complex and there is more data to analyze.
Training – Before carrying out difficult operations, surgeons can use this tool to carry out training with students, and can focus on telemedicine (e.g. remote assistance on CVDs by doctors etc.).
Applications
AR/MR education, AR/MR training, complex operations and virtualization of expensive equipment, remote diagnostics and controlling, digital twins, and gamification.