A doctor examining virtual cranium and neck bones with AR.

How to Use the Environment in Your AR Experience

by Riley Hunt • 11 min read

393 Shares

Augmented Reality (AR) is an exciting medium because of the unique way it interacts with physical space to add new information and meaning. Let's look at what makes AR unique: the context of use. Unlike other devices and platforms, using an AR headset or mobile phone for AR allows you to interact with the world differently than usual.

UX designers of all sorts pay special attention to the context of use. Frank Spillers is the founder of UX consultancy Experience Dynamics and an AR/VR designer. In this video, he will cover why the context of use is essential for AR.

Copyright
Transcript

What is Context of Use?

As a UX designer for AR, you need to understand the context of use, which refers to the specific situation or environment in which your users will use AR technology. For example, people use desktop programs at home or in an office, generally with more powerful computers than a phone or tablet. In contrast, people often use mobile apps while they travel, walk, or use public transit. Although AR headsets exist, many AR experiences are on mobile devices like phones or tablets.

Here are some key characteristics of the context of use that you should consider to create successful AR experiences:

  • User characteristics: Think about the age, gender, education level, task load and experience with technology of your users. Design interfaces that are intuitive and easy to use and consider your target users’ familiarity with AR.

  • Task characteristics: Tailor the complexity, duration, and frequency of users' tasks to the environment and situation. Your interfaces should be streamlined and efficient to enable users to complete tasks quickly and easily.

  • Environmental characteristics: Consider the lighting, noise level, and physical space where users interact with the AR system. Design interfaces that are legible, clear, easy to understand, and safe, even in unusual or unsafe conditions. Take the field of view (FOV) into account to avoid discomfort.

  • Device characteristics: Consider the technical specifications of the AR device, such as its size, weight, display quality, and battery life. 

  • Social context: Consider the social context in which users use AR and the expectations of others around them. Think about how to create interfaces that are respectful, appropriate, and don't interfere with social interactions.

  • Cultural context: Consider the cultural context of your users. This includes their beliefs, values, and norms. Design interfaces that are culturally sensitive and inclusive based on the diversity of your user base.

Context of Use in Practice

Let's look at how this museum AR experience caters to its context of use. The enhanced AR experience at Casa Batlló uses AR to show the visitors the inspiration for architect Antoni Gaudí's designs and how the house looked when the Batlló family lived there in the 1900s.

© Casa Batlló SLU, Fair Use

  • User characteristics: The app is easy to use, even by small children, with the assistance of an adult with a smartphone. We can't assume a lot about the demographic or psychographics of the user, but in this case, the app is an optional part of the tour, so users can decide if they want to use it. We can assume only they have chosen to come to the house and use the app. The app can be as in-depth as a tour guide might be.

  • Task characteristics: In this case, the task is to inform the user and have them engage with their environment in a new way. It has no set time limit and very low stakes. It is exploratory.

  • Environmental characteristics: The AR experience is limited to the inside of the house, a tourist location. As a historical site, the experience should be careful not to damage valuable artifacts. The app shouldn't require the user to touch or move real objects.

  • Device characteristics: This smartphone app is usable by anyone with a smartphone. Users may get tired if they hold the phone for too long. The museum should also provide free wifi to allow users to download the app when they arrive and encourage users to download it beforehand via email or other means.

  • Social context: Other visitors may be on the same tour, with or without AR. The app shouldn't require quick movement, which might have users collide with other people. Too much sound will also make the experience disruptive for others unless the user has headphones.

  • Cultural context: This museum gets almost a million visitors a year from around the world, so the app should be available in multiple languages. The content should be sensitive to the fact that the users may be from various cultures to be as accessible as possible. For example, the app should not expect the user to have deep knowledge of the history of Barcelona or use cultural slang or jargon that might confuse the user.

As with all UX, iteration and user research are critical, so there should be a way for users to provide feedback on their experience to make sure the app has satisfied their goals. This could be a survey, user reviews of the app, or the observations of the staff who work at the museum.

If you consider all of these factors, you can design AR that genuinely enhances the museum experience and allows visitors to interact with their surroundings in a new way. The app can provide additional information about exhibitions, bring them to life with animations and sounds, and allow users to delve deeper into the history and context of each space. The experience should also be intuitive, safe and easy to use. Users should feel they can seamlessly transition between the physical and digital worlds. Ultimately, the goal is to create an experience that feels natural, immersive, and enjoyable for users of all ages and backgrounds.

The Take Away

As a UX designer for AR, you have the power to create unforgettable experiences that can enhance the way people interact with the world around them. To achieve this, you need to understand the context in which your users will use your AR technology; you should consider factors such as their age, gender, education level, and familiarity with AR. You will have to understand the opportunities and constraints of the space, like lighting, noise level, and the physical space where they'll use your product.

If you design intuitive, streamlined, safe and culturally sensitive interfaces, you can create AR experiences that meet users' needs and expectations.

References and Where to Learn More

How AR can enhance the visitor experience in the article Virtual and Augmented Reality Technologies to Enhance the Visitor Experience in Cultural Tourism.

Read this Forbes article on why Context Is Everything When It Comes To AR.

Hero Image: © Microsoft, Fair Use

Learn More in This Course:

AI for Designers

12 days
13 % booked
View Course

What You Should Read Next

  • Read full article
    Beyond AR vs. VR: What is the Difference between AR vs. MR vs. VR vs. XR? - Article hero image
    Interaction Design Foundation logo

    Beyond AR vs. VR: What is the Difference between AR vs. MR vs. VR vs. XR?

    There is a fair amount of confusion about the differences between the terms virtual reality (VR), augmented reality (AR), mixed reality (MR), and extended reality (XR). While most people have stuck with AR and VR to describe the different technologies, these terms are not enough to fully comprehend

    Social shares
    1.2k
    Published
    Read Article
  • Read full article
    Healthcare UX: Design that Saves Lives - Article hero image
    Interaction Design Foundation logo

    Healthcare UX: Design that Saves Lives

    UX (user experience) design has the potential to improve people’s everyday lives. The stakes are even higher if you work as a UX designer in the healthcare industry. The health-tech sector is among the fastest-growing in the world, with expected revenue of USD 1,305.1 billion in 2030, according to G

    Social shares
    824
    Published
    Read Article
  • Read full article
    Functionality and Mobile Design – Don’t Shrink the Screen, Focus on the Tasks - Article hero image
    Interaction Design Foundation logo

    Functionality and Mobile Design – Don’t Shrink the Screen, Focus on the Tasks

    Designing for mobile devices is not the same as designing for laptops or desktops. It's about creating a unique user experience that focuses on what matters to mobile users. To achieve this, it's important to focus on the tasks that users want to accomplish and ensure they can be executed efficientl

    Social shares
    781
    Published
    Read Article
  • Read full article
    Context of Use for Mobile - Article hero image
    Interaction Design Foundation logo

    Context of Use for Mobile

    Before we dive into design approaches for mobile, you need to understand the context of mobile users and their unique characteristics. That means you need to know when, why, and under what conditions and constraints users interact with your app or mobile content. If you, therefore, understand the bi

    Social shares
    690
    Published
    Read Article
  • Read full article
    How to Design Gesture Interactions for Virtual and Augmented Reality - Article hero image
    Interaction Design Foundation logo

    How to Design Gesture Interactions for Virtual and Augmented Reality

    Gesture interactions have become an easy and convenient form of interaction on touch devices largely because we have developed conventions for how gestures should be performed. In virtual and augmented reality, gestures are also a very natural way to interact with digital artifacts and menus, but we

    Social shares
    677
    Published
    Read Article
  • Read full article
    Innovate with UX: Design User-Friendly AR Experiences - Article hero image
    Interaction Design Foundation logo

    Innovate with UX: Design User-Friendly AR Experiences

    What if your favorite video game characters could come to life or your online shopping could appear right in your living room? Augmented reality (AR) transforms how we interact with digital content. Imagine creating immersive experiences where users can explore 3D models, overlay information on real

    Social shares
    607
    Published
    Read Article
  • Read full article
    How to Use Voice Interaction in Augmented Reality - Article hero image
    Interaction Design Foundation logo

    How to Use Voice Interaction in Augmented Reality

    The user experience with augmented reality applications is at its best when it’s multimodal. As much as possible, users should be able to use gaze, gesture and voice in a seamless blend to create an interaction with the digital world that’s as natural as interaction with the physical world -but with

    Social shares
    597
    Published
    Read Article
  • Read full article
    How to Create Design Plans for Virtual and Augmented Reality Experiences - Article hero image
    Interaction Design Foundation logo

    How to Create Design Plans for Virtual and Augmented Reality Experiences

    Whenever you design something new – be it an interface, service or a product– you should start with a plan for what you want the user’s experience to be like. Having a clear goal for what you want the user to feel and achieve during the interaction will help guide you through the myriad of different

    Social shares
    595
    Published
    Read Article
  • Read full article
    Less is (Also) More in Virtual and Augmented Reality Design - Article hero image
    Interaction Design Foundation logo

    Less is (Also) More in Virtual and Augmented Reality Design

    One of the most exciting things about designing virtual and augmented reality experiences is all the things you’re able to do as a designer. You can take advantage of all of the user’s senses in design, you can create first-person stories, and you can overlay reality with any virtual object you can

    Social shares
    525
    Published
    Read Article
  • Read full article
    How to Design for AR Experiences on the Go - Article hero image
    Interaction Design Foundation logo

    How to Design for AR Experiences on the Go

    From a design perspective, UX for Augmented Reality (AR) is similar to mobile UX in that users are often on the move and use the interface in short bursts of activity. In contrast, the user experience of a virtual reality application is more similar to web or desktop UX, designed for immersive, cont

    Social shares
    493
    Published
    Read Article

Top Articles

Top Topic Definitions

Feel Stuck?
Want Better Job Options?

AI is replacing jobs everywhere, yet design jobs are booming with a projected 45% job growth. With design skills, you can create products and services people love. More love means more impact and greater salary potential.

At IxDF, we help you from your first course to your next job, all in one place.

See How Design Skills Turn Into Job Options
Privacy Settings
By using this site, you accept our Cookie Policy and Terms of Use.
Customize
Accept all

Be the One Who Inspires

People remember who shares great ideas.

Share on:

Academic Credibility — On Autopilot

Don't waste time googling citation formats. Just copy, paste and look legit in seconds.

Feel Stuck? Want Freedom?

Join 326,029+ designers who get one powerful email each week. Learn to design a life you love.

Next email in
1
day
13
hrs
46
mins
43
secs

Free forever. No spam. Unsubscribe anytime.