Research › Visual search & notifications

NUILab · Research

XR Visual Search and Notifications

Notifications, cues, and clutter in augmented reality, and how they shape attention, search performance, and cognitive load.

Overview

Augmented reality (AR) can put an arrow on the object you are looking for. The questions are where to place that arrow and whether the cue is correct — and what information-access effort costs. Related to visual search cues, we have notifications and timers: how do they compete for attention with the world they exist to explain, and where do we place them? Our work in visual search and information-access effort includes timers, cues, and notifications.

One example of how we have conducted experiments is with the visual search paradigm. We tested cueing, clutter, and placement against real search and monitoring tasks. Correct spatial guidance works, and works well. A north-up situation display cut response time by 8 seconds; a gaze line saved 7.47 seconds in 360-degree multi-target search. We then broke the cue on purpose to measure what an error costs. In a VRST 2026 paper, we asked which targets a cue should point to and how many at once. Choosing the next target adaptively, or cueing several targets together, both cut search time and head movement compared with cueing one target at a time in a fixed order, but combining the two added no further benefit. When order does not matter, cueing every target works as well as adaptive selection; when it does, cueing three at a time is the better choice. Please read the paper (opens in new tab) for more information.

Our work enables many applications, from civilian use cases (e.g., rescue) and health applications (e.g., CPR) to military applications (e.g., searching for targets).

  • Notifications
  • Time-critical cueing (e.g., timers for CPR)
  • Visual cues & automation bias
  • Adaptive cueing
  • Navigation
  • Information access & cognitive load

Supported by Office of Naval Research · grants behind this work

Papers in this area 41

Journal Articles 8

Conference Papers 20

Workshop Articles 4

Posters & Late-Breaking 6

Pre-Prints 2

Software 1

See these in the full publication list →

Funding for this area 4

Completed

  • Office of Naval Research · PI Perceptual/Cognitive Aspects of Augmented Reality: Experimental Research and a Computational Model $900,000 · 2021 – 2024
  • ONR DURIP · PI WARFighting Performance: Augmented Reality Multi-Modal Interaction Techniques for JTAC and Battlefield Readiness $201,420 · 2021 – 2023
  • ONR sub-award via VR Rehab, Inc. · PI Fused Augmented Realities with Synthetic Vision (FAR/SV) Systems for Ground Forces $198,914 · 2019 – 2023
  • ONR via VR Rehab, Inc. · PI SAIPAN: Single Amphibious Integrated Precision Augmented Reality Navigation System (SBIR Phase I) $44,000 · 2020
All lab funding →