The Rise of technology- VR,AR & MR


Virtual Reality (VR)

Virtual Reality is a completely immersive digital experience. It is when the images and sounds around you are replaced by virtual content, generated and managed by a computer.  It aids in the creation of realistic simulations and the “immersion” of the spectator through the use of computers and sensory instruments such as headsets and gloves. This simulated environment can be totally different than the reality of this world and yet you can perceive it as reality. So Virtual Reality is really just that, a “Virtual Reality” that you can move around in and experience as if you were really there. Virtual reality (VR) indicates a complete involvement experience that shuts out the physical world. 

Virtual reality is utilized for training, education, and science in addition to gaming and enjoyment. You can view Virtual Reality using a VR headset such as the Oculus Rift S etc.

 
                               Oculus  VR headset

 Sensors inside the headset precisely track your movements and instantly translate them into VR, while helping you steer clear of nearby objects. And with Oculus Touch controllers, your hands are in the game, so you can see your every gesture and feel the power of every impact.

But, how does it work?

Visually, a VR headset has one or two screens that project a 3D environment. You will either need staff who can shoot a 360-degree video and/or individuals who can create 3D animations. Talented graphic artists or videographers will create the scenery that will make your VR experience come to life.

Your VR world has to be laid out on a 3D axis, and some unique technology has to be used to make the world truly look “deep”. Stereoscopy is a technique that takes advantage of our binocular vision to add depth. Plus, a VR content creator has to decide how far they will let the user “move” in the environment (also called the degrees of freedom, or DOF). The VR creators have to account for all of the user’s potential perspectives.

Potential Use case in Medical applications:

Medicine is one of the areas that is undergoing the most transformations with virtual reality. Resident doctors, for example, can now train surgeries in an immersive way so that they have greater security when performing procedures in real settings. They can also follow live surgery being performed, without having to fight for space in the room or having to look over the shoulders of the head surgeon. In treatments, immersion makes a difference.

Augmented Reality (AR)

Augmented Reality (AR) superimposes digital content or information into the real environment. Augmented Reality (AR) merges virtual objects, in either 2 or 3 dimensions, with the real world. By extending the real world with virtual, computer-generated information, the perception of natural environments can be enriched, and the surrounding world can be interactively manipulated. To realize AR, you don't require a headset. You just need a mobile device with an application that supports AR.


                     An AR showroom demo developed by Microsoft and Volvo provides an X-ray view of the engine, Ref: 1

To understand AR in a more easy way, let's take an example of an Instagram video calling.

As explained, AR is about adding digital objects to the existing real environment. So, while using Snapchat or Instagram video calling, one can add different filters to the face as shown in the image below.

  
               Image filter in Instagram

The AR software or algorithms detect the user's face and place the selected filter in real-time. The user can select many different filters and place them on the face.

Take another example of buying a watch. You went to a shop and an application on your mobile phone allows you to view different models of a watch on your wrist. Isn't it cool?

Augmented reality in shopping

Take another example of a cup of coffee placed on a table. The users can take his/her mobile phone, open an application and add any digital objects to the existing environment. The AR model detects the cup of tea, calculates the depth and the user can add any virtual objects.

Adding digital object over a cup of coffee

Potential Use case in Medical Field

  • Project medical images onto patients:-During chest examination, skull, or abdomen, the operators can add the digital image of patients' skeleton anatomy and collimates accurately to the selected area to improve the image content.

The medical image displayed on patients, source: ref 2

  • During surgery, AR systems provide medical imaging data and other patient information superimposed on the operation area in the most intuitive way

 An intra-operative AR system concept source: ref 3
  • AR-aided navigation systems can reduce the risk of complications and improve the safety and quality of surgeries.
  • AR education systems train the surgeons to acquire critical skills and AR rehabilitation concepts help patients to recover faster after interventions.
  • With augmented reality, medical imaging can be more readily accessible or displayed in actual 3-dimensional space during procedures to enhance guidance, at times when this information is most needed.
Mixed reality (MR)

Virtual reality (VR), is a fully digital experience in a computer-generated, 3-D environment, and augmented reality (AR), is a semi-digital experience in our real, physical environment. So, where does mixed reality (MR) fall on that spectrum?

Mixed reality is the result of merging the physical world with a virtual world to create new environments where the physical and digital objects interact with one another in real-time. In short, mixed reality takes place in a hybrid of our physical and digital worlds.

Does it sound very similar to augmented reality?

So, let's see what is difference between mixed reality and augmented reality.

Mixed reality encompasses both augmented reality and augmented virtuality. Mixed reality aims to create an environment with interactive digital objects. Augmented reality requires a screen to experience the augmented experience. Mixed reality is commonly experienced through a headset (similar to virtual reality).

Mixed reality spectrum

The Mixed Reality Continuum covers every combination of real and virtual objects and environments (4).

 
The real world is on the far left where nothing is digital. Completely virtual environments are on the far right, where everything is computer generated.

Potential Applications

MR wearable computers
Headsets aren’t new but the possible applications for them are endless. They map the surrounding physical environment to create a digital display. So you could move furniture around in a room without ever lifting anything (4).
 
This example of MR technology shows digital apps pinned to places that make the most sense. Think about having a to-do list on your fridge and a recipe app next to your oven. It’s convenient and this tech takes multitasking to the next level.

HoloLens to Control Smart Devices
In 2015 Ian Sterling created an app that allows you to interact with smart objects in your very own home through augmented reality using gestures. The way this is achieved is by connecting the augmented reality device to an Arduino to create an independent network. Any device that is Arduino-based can be then controlled by the HoloLens (5).

The connectivity between Arduino and a mixed reality device is something that holds a huge amount of creative opportunity for developers to create some very exciting applications.

To realize the MR technology, one can start with controlling smart devices (smart music players, light bulbs, etc.)
  • Create a GUI/App in HoloLens and interact with smart/IoT devices to manipulate and control it.
  • Create a GUI/App and control LEDs or motors.
You need to establish a network or wireless/serial communication to transfer data

References:

1. https://hbr.org/2017/11/why-every-organization-needs-an-augmented-reality-strategy
2. https://physicsworld.com/a/augmented-reality-projects-medical-images-onto-patients/
3. https://www.medicalaugmentedreality.org/)
4.https://learn.g2.com/mixed-reality
5. https://medium.com/code3100/week-5-part2-arduino-the-hololens-can-this-work-f1138fa1d076


Comments

Post a Comment

Popular posts from this blog

FPGA In Layman''S Terms

Image
FPGA is an Integrated Circuit which can be reconfigured again and again to perform different tasks as desired. For example, an FPGA can be configured to function as a processor, and then it can be reconfigured to function as a Graphics Processing Unit (GPU), or hardware video encoder, or something else. The point is that FPGA can theoretically be programmed to function as any other Digital Integrated Circuit. Think of FPGA as a breadboard for Digital Circuits. All the gates and flip-flops are present on the FPGA, and there are wires going through the complete chip. Circuits are made by connecting these wires to the relevant gates or flip-flops as per intended design. Instead of connecting the gates/flip-flops using a physical wire as in a breadboard, FPGAs has programmable interconnects that can be rewired programmatically. There are dedicated wires/routes for clock signals and only a selected number of FPGA pins are allowed to drive those global clock routing wires. FPGA Vs Microcontr...
Read more

High Speed Digital Design Considerations

Image
The four main consideration of today’s high-speed design:                                                                                                                                                            Ref(1) We need to consider signal integrity , which includes parameters such as Overshoot and Ringing. Need to look at crosstalk which is about EMI coupling between traces on PCB board Timing is about calculating the flight time EMI and radiation  These parameters are related to each other and aff...
Read more

Single Ended vs Differential Inputs

Image
One of the most common questions asked is the difference between single-ended and differential signals inputs, and what applications they should be considered in. It is important to know the difference between single-ended and differential inputs as it can greatly affect the quality of your data Differential signaling  is a method for electrically transmitting information  using two complementary signals . The technique sends the same electrical signal as a  differential pair  of signals, each in its own conductor. The pair of conductors can be wires (typically twisted together) or traces on a circuit board. The receiving circuit responds to the electrical difference between the two signals, rather than the difference between a single wire and ground . The opposite technique is called single-ended signaling. A  single-ended input  measures the voltage difference between a wire and the ground. This difference is then amplified to provide the output. Single-e...
Read more