The Sum of the Things We Leave Behind
Mixed Reality Installation
Interactivity is key to driving engagement in museum environments. The Sum of the Things We Leave Behind is a mixed reality installation that uses digital storytelling to transform static artifacts into immersive touchpoints, enhancing how visitors connect with the past through layered, multisensory experiences.
Exhibited: 2025
Platforms: Meta Quest 3
Tools: Unity 3D, Premiere Pro, Figma, Maya
Role: Experience Designer, Immersive Storyteller,
Creative Technologist
Result: Drove sustained headset and artifact engagement at From the Outside In, with visitors spending an average of 30+ minutes in the experience.
01 | Context
Artifact displays open historical gateways for museum visitors, but digital add-ons like tabbed text or voiceovers often fail to engage, lacking the emotional weight that gives the object meaning. This project leverages XR and ambient storytelling to bridge that gap, creating a more intuitive and embodied connection between visitors and artifacts.
Drawn from research in edutainment and multisensory learning, I designed the installation to tell a non-linear story through sound and hands-on exploration. Visitors engage with both physical and digital touchpoints, uncovering fragments of the past in a way that feels personal, immersive, and self-directed.
02 | Design Process
A major part of this solo project was developing artifacts to tell my own story. Inspired by personal experiences, I designed a fictional narrative and a set of handcrafted, symbolic artifacts that also functioned as unlockable puzzles.
I split time between designing these interactive artifacts to anchor the experience and building a digital interface that could support intuitive exploration in mixed reality.
03 | Design Solution
Building the digital interface was guided by three core principles to ensure the story behind each artifact remained central to the experience.
-
Emotional Presence
Audio feedback and ambient soundscapes tied to object themes. -
Minimal Distraction
Limit on-screen text and provide information as necessary. -
Easy Exploration
Allow users to drop in and out without losing context.
Key Features
04 | Reflection + Results
Early iterations included multiple modes of interaction, but streamlining all interactions to hand-touch controls created a more consistent and intuitive experience, especially for users unfamiliar with XR. Reducing complexity made the installation feel more approachable and allowed users to focus on the story.
Although I was limited by constraints like budget and hardware, I focused on designing a strong conceptual foundation that could scale with future improvements. Prioritizing narrative flow, emotional clarity, and user comfort ensured that the experience could remain compelling, regardless of future technical upgrades.
From writing the story to designing, programming, and even mixing the audio, I oversaw every aspect of the project. Delivering clear diagrams and documentation of design decisions was key to making the transition from design and implementation smooth. This process gave me a stronger grasp of the communication and foresight needed to build a successful project, skills I now apply to better collaborate across disciplines.
Users were able to self-navigate the installation using the optional tutorial I designed directly into the headset. On average, visitors spent over 30 minutes in the experience, with some staying for up to two hours. Feedback from visitors indicated that they were motivated by curiosity about the story and a desire to complete every puzzle. Because the puzzles encouraged observation and deduction, users were organically drawn to read the artifact placards more closely, deepening their engagement and eagerness to learn about the artifact’s history.