How to Use Voice Interaction in Augmented Reality

by Frank Spillers and Ditte Mortensen • 14 min read

597 Shares

The user experience with augmented reality applications is at its best when it’s multimodal. As much as possible, users should be able to use gaze, gesture and voice in a seamless blend to create an interaction with the digital world that’s as natural as interaction with the physical world -but with all the added action possibilities that the digital overlay affords. That means that in order to create awesome augmented reality user experiences, you need to be able to design user interaction for all modalities. In this video, we’ll go through what you need to consider when designing voice interaction for augmented reality. Voice interactions have become ubiquitous and are also part of augmented reality, so you should know how to design for them!

Transcript

The Takeaway

Using voice interaction with augmented reality can really benefit the user by making the interaction fast and effortless, but it also has limitations; so, make sure you use it where it’s most appropriate – public places and fine-grained control are not the best match for voice interaction. When you design voice commands, make sure they are brief and simple, so they’re easy for users to utter and remember. To ensure that your entire user base can use your design, check that it can understand people with different accents. Testing your app with different types of users will help in broadening its scope to deliver pleasing and impressive experiences every time.

References and Where to Learn More

You can see Microsoft’s guidelines for voice design for HoloLens here.

Hero Image: Copyright holder: Jisc. Copyright terms and license: CC BY-NC-ND

Learn More in This Course:

AI for Designers

11 days
12 % booked
View Course

What You Should Read Next

  • Read full article
    Beyond AR vs. VR: What is the Difference between AR vs. MR vs. VR vs. XR? - Article hero image
    Interaction Design Foundation logo

    Beyond AR vs. VR: What is the Difference between AR vs. MR vs. VR vs. XR?

    There is a fair amount of confusion about the differences between the terms virtual reality (VR), augmented reality (AR), mixed reality (MR), and extended reality (XR). While most people have stuck with AR and VR to describe the different technologies, these terms are not enough to fully comprehend

    Social shares
    1.2k
    Published
    Read Article
  • Read full article
    Natural User Interfaces – What does it mean & how to design user interfaces that feel naturaly - Article hero image
    Interaction Design Foundation logo

    Natural User Interfaces – What does it mean & how to design user interfaces that feel naturaly

    User interfaces that you interact with using modalities such as touch, gestures or voice are often referred to as Natural User Interfaces (NUI). We consider them interfaces that we find so easy to use that they feel natural. However, what does it mean for an interface to be natural? Also, how do you

    Social shares
    1k
    Published
    Read Article
  • Read full article
    How to Design Voice User Interfaces - Article hero image
    Interaction Design Foundation logo

    How to Design Voice User Interfaces

    If you are new to designing voice user interfaces, you may quickly find yourself unsure of how to create great user experiences. The way users interact with voice user interfaces is very different from how they interact with graphical ones. Not surprisingly, users' expectations for voice user interf

    Social shares
    949
    Published
    Read Article
  • Read full article
    Healthcare UX: Design that Saves Lives - Article hero image
    Interaction Design Foundation logo

    Healthcare UX: Design that Saves Lives

    UX (user experience) design has the potential to improve people’s everyday lives. The stakes are even higher if you work as a UX designer in the healthcare industry. The health-tech sector is among the fastest-growing in the world, with expected revenue of USD 1,305.1 billion in 2030, according to G

    Social shares
    824
    Published
    Read Article
  • Read full article
    How to manage the users’ expectations when designing smart products - Article hero image
    Interaction Design Foundation logo

    How to manage the users’ expectations when designing smart products

    Smart products that adapt to aspects of the users’ activity, context or personality have become commonplace. With more and more products which act intelligently emerging in the market place, users often end up expecting to interact with them more like they would among themselves, as humans. In the f

    Social shares
    742
    Published
    Read Article
  • Read full article
    How to Design Gesture Interactions for Virtual and Augmented Reality - Article hero image
    Interaction Design Foundation logo

    How to Design Gesture Interactions for Virtual and Augmented Reality

    Gesture interactions have become an easy and convenient form of interaction on touch devices largely because we have developed conventions for how gestures should be performed. In virtual and augmented reality, gestures are also a very natural way to interact with digital artifacts and menus, but we

    Social shares
    677
    Published
    Read Article
  • Read full article
    Innovate with UX: Design User-Friendly AR Experiences - Article hero image
    Interaction Design Foundation logo

    Innovate with UX: Design User-Friendly AR Experiences

    What if your favorite video game characters could come to life or your online shopping could appear right in your living room? Augmented reality (AR) transforms how we interact with digital content. Imagine creating immersive experiences where users can explore 3D models, overlay information on real

    Social shares
    608
    Published
    Read Article
  • Read full article
    How to Create Design Plans for Virtual and Augmented Reality Experiences - Article hero image
    Interaction Design Foundation logo

    How to Create Design Plans for Virtual and Augmented Reality Experiences

    Whenever you design something new – be it an interface, service or a product– you should start with a plan for what you want the user’s experience to be like. Having a clear goal for what you want the user to feel and achieve during the interaction will help guide you through the myriad of different

    Social shares
    595
    Published
    Read Article
  • Read full article
    Less is (Also) More in Virtual and Augmented Reality Design - Article hero image
    Interaction Design Foundation logo

    Less is (Also) More in Virtual and Augmented Reality Design

    One of the most exciting things about designing virtual and augmented reality experiences is all the things you’re able to do as a designer. You can take advantage of all of the user’s senses in design, you can create first-person stories, and you can overlay reality with any virtual object you can

    Social shares
    525
    Published
    Read Article
  • Read full article
    How to Design for AR Experiences on the Go - Article hero image
    Interaction Design Foundation logo

    How to Design for AR Experiences on the Go

    From a design perspective, UX for Augmented Reality (AR) is similar to mobile UX in that users are often on the move and use the interface in short bursts of activity. In contrast, the user experience of a virtual reality application is more similar to web or desktop UX, designed for immersive, cont

    Social shares
    493
    Published
    Read Article

Top Articles

Top Topic Definitions

Feel Stuck?
Want Better Job Options?

AI is replacing jobs everywhere, yet design jobs are booming with a projected 45% job growth. With design skills, you can create products and services people love. More love means more impact and greater salary potential.

At IxDF, we help you from your first course to your next job, all in one place.

See How Design Skills Turn Into Job Options
Privacy Settings
By using this site, you accept our Cookie Policy and Terms of Use.
Customize
Accept all

Be the One Who Inspires

People remember who shares great ideas.

Share on:

Academic Credibility — On Autopilot

Don't waste time googling citation formats. Just copy, paste and look legit in seconds.

Feel Stuck? Want Freedom?

Join 326,062+ designers who get one powerful email each week. Learn to design a life you love.

Next email in
0
days
22
hrs
14
mins
16
secs

Free forever. No spam. Unsubscribe anytime.