ABOUT    EXTRA
Project Page


The Sum of the Things We Leave Behind

Mixed Reality Installation

Interactivity is key to driving engagement in museum environments. The Sum of the Things We Leave Behind is a mixed reality installation that uses digital storytelling to transform static artifacts into immersive touchpoints, enhancing how visitors connect with the past through layered, multisensory experiences.

Exhibited: 2025

Platforms: Meta Quest 3

Tools: Unity 3D, Premiere Pro, Figma, Maya

Role: Experience Designer, Immersive Storyteller, Creative Technologist

Result: Drove sustained headset and artifact engagement at From the Outside In, with visitors spending an average of 30+ minutes in the experience.

01 | Context

Capturing the Esssence of the past        

Artifact displays open historical gateways for museum visitors, but digital add-ons like tabbed text or voiceovers often fail to engage, lacking the emotional weight that gives the object meaning. This project leverages XR and ambient storytelling to bridge that gap, creating a more intuitive and embodied connection between visitors and artifacts.

Drawn from research in edutainment and multisensory learning, I designed the installation to tell a non-linear story through sound and hands-on exploration. Visitors engage with both physical and digital touchpoints, uncovering fragments of the past in a way that feels personal, immersive, and self-directed.

02 | Design Process

TIMELINE

A major part of this solo project was developing artifacts to tell my own story. Inspired by personal experiences,  I designed a fictional narrative and a set of handcrafted, symbolic artifacts that also functioned as unlockable puzzles.        

I split time between designing these interactive artifacts to anchor the experience and building a digital interface that could support intuitive exploration in mixed reality.        



Story + Sound Development Cut
User Flow Prototype
Mood Sketch of Installation
Technical Mockup of Installation
User Flow of Artifacts
Interactive Component of Narrative

03 | Design Solution

design principles

Building the digital interface was guided by three core principles to ensure the story behind each artifact remained central to the experience.  

  1. Emotional Presence
    Audio feedback and ambient soundscapes tied to object themes.


  2. Minimal Distraction
    Limit on-screen text and provide information as necessary.


  3. Easy Exploration
    Allow users to drop in and out without losing context.

Key Features

📍Touch and Gesture-Based Interface
To avoid cognitive overload and maintain consistency, every interaction was designed around direct hand touch. Whether manipulating physical artifacts, typing on a projected keyboard overlay, or activating digital layers, visitors engaged through natural, tactile gestures. This approach replaced traditional XR inputs like remote controllers or cursor-aiming, opting for a more intuitive grounded feel.

Typing correct input after inspecting an artifact
Tutorial sequence with one artifact, filmed in a dim setting to replicate the installation environment
📍Multi-Modal Displays
To support different play styles and reduce friction from the Quest’s limited passthrough clarity, instructional content was made permanently visible both in-headset and in the physical space, allowing users to freely move in and out of XR without losing context.

Installation 360 overview
Always-on-display instructions at the top for returning and new visitors.
📍Multisensory Feedback + Storytelling
Touch, sound, and ambient storytelling were key. Whether turning a lock or triggering an interface, visitors received tactile and audio feedback to reinforce their actions. Each unlocked artifact also played unique soundscapes, pulling users deeper into the narrative.

Memory sequence with spatial sound and captions (Sound on)

04 | Reflection + Results

Reflection

Simplicity builds trust
Early iterations included multiple modes of interaction, but streamlining all interactions to hand-touch controls created a more consistent and intuitive experience, especially for users unfamiliar with XR. Reducing complexity made the installation feel more approachable and allowed users to focus on the story.

Plan for the future, not the technology
Although I was limited by constraints like budget and hardware, I focused on designing a strong conceptual foundation that could scale with future improvements. Prioritizing narrative flow, emotional clarity, and user comfort ensured that the experience could remain compelling, regardless of future technical upgrades. 

Owning the full pipeline brought clarity
From writing the story to designing, programming, and even mixing the audio, I oversaw every aspect of the project. Delivering clear diagrams and documentation of design decisions was key to making the transition from design and implementation smooth. This process gave me a stronger grasp of the communication and foresight needed to build a successful project, skills I now apply to better collaborate across disciplines.

Results

Users were able to self-navigate the installation using the optional tutorial I designed directly into the headset. On average, visitors spent over 30 minutes in the experience, with some staying for up to two hours. Feedback from visitors indicated that they were motivated by curiosity about the story and a desire to complete every puzzle. Because the puzzles encouraged observation and deduction, users were organically drawn to read the artifact placards more closely, deepening their engagement and eagerness to learn about the artifact’s history.


Thanks for reading!

View Suggested projects 












XR