Exploring AR Filters and Body-Centered Digital Play 🤸🎭

November 4, 2024

AR Filters and Physical-Digital Interaction

In exploring AR (augmented reality) filters overlaying virtual content onto physical environments, a central question emerges: ”How do we design meaningful and joyful interactions between users and digital content?“ This question goes beyond the novelty of seeing digital objects in the real world; it asks how we can elevate those experiences to make them impactful, intuitive, and immersive.

Rethinking Interaction: From Passive Engagement to Physical Immersion

A key strength of AR lies in the potential to transform how we interact with digital elements. Traditional screens and interfaces have accustomed us to limited interaction methods—often based on finger swipes and clicks. But AR can blend digital content with the physical space, opening up possibilities for physical gestures, spatial exploration, and tangible engagement. With AR, interaction is no longer confined to the screen but moves with us, responding to our movements and physical context. This invites the opportunity to create embodied interactions where the physical and digital blend seamlessly, fostering a more immersive experience.

Designing Joyful Interactions: Makey Makey as the tool

This topic also brought to mind a Makey Makey workshop I’m designing for another course, where students will explore the possibilities of creating physical interactions to trigger digital content with Makey Makey. In the workshop, I plan to show students how they can extend digital interactions beyond standard screens and buttons, moving toward body-centered, physical interactions.

Here is the link of my workshop plan.

Interaction Design as a Bridge Between the Physical and Digital

At the core of this exploration is a philosophy that digital interaction should feel as natural and joyful as physical interaction. Whether in AR or through tools like Makey Makey, the goal is to create a harmonious relationship where the digital responds to our physical actions and surroundings, heightening the sense of connection and presence. By shifting control from isolated finger movements to full-body engagement, we can reimagine digital interaction as something more expressive, empowering, and enjoyable.

In rethinking interaction design, we’re not just adding layers of technology to our environment; we’re crafting experiences that invite users to engage their whole selves.

Based on the thinking, I add another layer on my previous breadcrumb game, The Chromatic Balance. I amplified the interaction from finger-typing to full-body movement. This way, players can jump, tap, or even dance to interact with the game, allowing the digital experience to feel more embodied and immediate.