Think Augmented or Virtual Reality Won't Effect You? Think Again

By Jodi Schiller

Sam Murley, a developer colleague of mine, hasn’t had much sleep lately.

That’s because he’s recently tested the new, heavily hyped augmented reality product by Microsoft. As much as Sam assumed he knew what to expect, he found the actual experience astonishing. Since the demo that day, he’s been way too excited to catch many zzzs.

The product? Microsoft’s Hololens, a wearable computer and mixed-reality headset that lets users experience a combination of virtual, augmented, and “real” reality. In Virtual Reality (VR), you’re immersed in an entirely rendered world, with no interaction with your actual surroundings.

Augmented Reality (AR) lets you add to or “augment” your real, existing environment with anything – yes, anything – you can dream up. (Fancy a majestic lion reclining on your bed? No problem.)

Welcome To A World Of Robots And Rubble

Here’s how Sam describes his experience with the insomnia-inspiring Hololens, which will be available in a developer version in early 2016:“I take a seat on a couch in a staged “living room.” The wireless headset lets me control my AR/VR experience with my gaze (the Hololens tracks eye movement), my gesture (I motion to “click” a mouse or “shoot” with my finger), or my voice.

When I put on my headset, suddenly the entire room is mapped precisely with a wave of blue tesseracting squares. Then I hear a deep, loud rumbling from right outside the living room. Suddenly, one of the walls crumbles. Out of the rubble steps an entirely realistic, three-dimensional robot – and it’s shooting at me. I duck to avoid the spray of bullets, using the couch as a shield. I catch my breath, then cock my finger and “shoot” back. When I miss, bullets ricochet back at me. When my aim is true, the robot crumples into a broken heap. During this “battle,” my heart races and my adrenaline pumps like crazy.

It’s completely exhilarating.

Is AR/VR More Than Just A Gaming Technology?

I was blown away by Sam’s description, and not just because he successfully destroyed evil robots. For me – and for others involved in this emerging, seemingly futuristic AR/VR industry — the Hololens and related technology has significant, and serious, implications that go way beyond bringing interactive gaming to a whole new level. (To be clear, although it gets the most media attention, gaming represents just a small subset of the future applications of this technology.) Advanced AR/VR products, including those in development by CastAR, Magic Leap, and Seebright, as well as AR glasses already in the market, will eventually change how we work, play, educate – and even heal people.

This technology will touch every industry, and most areas of our private lives, too. Augmented and Virtual Reality will influence, shape and, ultimately, change life as we know it in myriad ways.

The following list outlines some of the AR/VR applications are either already in use or likely to be used in the future.

AR/VR technology will:

Replace your computer, keyboard, dials, and gauges. You’ll wear high-tech headgear and use your words, hands, and eyes to control an interactive display floating in midair.

Replace your physical TV or screen. Your virtual screen will appear on whatever surface you want.Boost the potential of the “Internet of Things.” You’ll effortlessly interact with and control the products and space around you. Think god-like power, with a wave of your hand the door opens, the lights turn on. With a glance and a nod, dinner is delivered to your door, or your food “printer” makes dinner. I think you’ll still have to make your bed and put the dishes in the dishwasher, for now. Enable “in-person” meetings and collaboration with remote colleagues, clients, or friends via 3D holographs (think Princess Leia appealing to Obi Wan Kenobi in Star Wars).

Enhance brand power

Whether you challenge Luke Skywalker to a light saber duel, watch fountains of Coca Cola dance in a choreographed light display, or applaud pop-up theater on your street corner, you’ll interact with 3D-rendered brands and entertainment wherever you want – and these can be easily modified over time to create a serialized, ongoing story.

Streamline shopping and design

Try on clothes and jewelry, test-drive a car, and give new furniture or paint colors a whirl, with no commitment necessary (check out www.roomhints.com). For architecture and real estate, tour a potential home or office space (even unfinished ones) before you sign on the dotted line (see www.matterport.com).

Encourage exploration

Roam the streets of Paris or wander through Mayan ruins before (but hopefully not instead of!) heading to the airport.

Make media-sharing instantaneous

Got a hilarious Vine to show a friend? You’ll simply move your eyes from the selected clip (it would “live” behind a visual icon) and say, “Share with Sally.” Hey presto – now you’re watching that cat fall into the bathtub, together.

Entertainment And Healthcare: Science Fiction Is Now Science Fact

Does this all sound far-fetched? The truth is, even we in the AR/VR industry sometimes find it challenging to grasp the technology’s full potential for transforming our ideas about, and experience of, entertainment.

Consider this: movies of all kinds will offer an immersive 360-degree experience. In theaters, the action will take place all around you, everywhere you look. Virtual Reality is more akin to immersive live theater than to traditional movies. Virtual Reality storytellers are hard at work creating an entirely new medium for conveying story.

When you watch your favorite home movies, you’ll feel like you’re actually exploring the world with your toddler again. I discovered the intensity of this experience when I saw a video shot with SilVRthread technology. Tai Crosby, the CEO, took a home “video” of his three-year-old son accompanying him on a hike. The boy chatters away to his dad and shows him all the special rocks he’s found. In my viewing experience, instead of Tai, I was the one having a powerful one-on-one experience exploring the outdoors with this delightful boy. I was so thoroughly transported back to the days of discovering the world with my own young children that I wept.

If you like the idea of family movies becoming an immersive family history experience, I hope you’ll be inspired to fund companies like SilVRthread .. (For now, this technology is too expensive for average consumers.)

Augmented Reality will also give birth to a unique approach to storytelling, one that’s more akin to the stage than screen. Three-dimensional avatars or holographs of actors will seem to appear in the room with you, acting out stories in an immersive theatrical performance. You’ll be able to interact with the characters and even participate in and influence the performance (like a choose your own adventure book) while in your own home. Perhaps elves will dance on your dining room table and take a peek into your fridge to see what’s for dinner.

Gaming will become ever more life-like

You will be networked with gamers around the world while having a realistic battle in 3D. It will be the Star Trek Holodeck.

AR/VR improving and (re)shaping healthcare

Mental health care will be more effective and efficient than ever before. Current and future treatments with Virtual Reality include helping patients with anxiety disorders (including PTSD), phobias, panic attacks, anger management, stress inoculation training, eating disorders and obesity, pain, addictions, autism, cognitive rehabilitation after TBI/stroke, and physical rehabilitation. Drama therapists and cognitive behavioralists will be particularly well-positioned to use this approach.

Eventually (though probably not in the next five years), surgeons will be able to “get inside” their patients as they are repairing them using tiny 360-degree cameras.

Surgeons will be able to access a transmission sent from inside of the patient – in real time. They will experience themselves inside the patient’s body.

New Frontiers — And A Few Fears

This list of changes brought about by advances in Augmented and Virtual Reality is by no means exhaustive. But I hope it gives you an idea of the frontiers AR/VR experts are exploring, and, to some extent, already conquering. I think most people will applaud eliminating cumbersome screens, improving our movie-going experience, and helping trauma patients recover faster.

However, I also believe it’s important to acknowledge and discuss the bigger social and cultural implications that go hand-in-hand with this future-forward technology. (You can read about some of the ethical and social challenges related to AR/VR here.)

In the meantime, like my pal Sam, I’m still buzzing from his Hololens adventure – and I can’t wait to put on a headset and take out a robot or two myself.