‹ back to portfolio

Tangible interfaces · Collaborative storytelling

Sonic Stitches

Touch a stitch. Hear a story.

An interactive embroidered tablecloth that brings recorded memories of food and home back to the dinner table.

MIT Media Lab · Research prototype
Close-up of a finger touching embroidered flowers on the Sonic Stitches tablecloth
Role
Interaction Design Researcher
Context
MIT Media Lab, Tangible Media Group
Duration
10 weeks

Overview

Sonic Stitches is an interactive tablecloth that transforms collaborative embroidery into a tangible storytelling medium. Community members sew patterns into a shared cloth while recording personal narratives about food and home. Later, dinner guests touch the stitched patterns to hear those stories — bridging past and present at the same table.

What is the potential of fiber interfaces in collaborative storytelling activated through sound, movement, and touch?
Arduino Processing Conductive Thread Capacitive Sensing Textile Sensors Tangible UI

Concept & Motivation

How do we feel the presence of someone who isn't there? TeleAbsence — the felt absence of a distant loved one — is a deeply human experience. We wanted to explore how tangible artifacts could carry traces of a person's presence: their voice, their touch, their stories — so that others could encounter them later, across time and distance. Specifically, we believe the sense of touch is critical for humans to feel connected, so we aim to use tactile sensations as a way to evoke that presence.

We ground this in the ritual of shared meals. Food evokes powerful memories of home, identity, and belonging. We ask participants "What foods remind you of home?" — a question that reliably surfaces intimate, sensory-rich stories. The dinner table became our site of encounter: a place where past voices could rejoin the present.

The medium we choose is collaborative embroidery. Textile craft practices are inherently slow — requiring makers to sit together for hours. That slowness creates a natural space for reflection and storytelling. By recording narratives during the act of sewing and embedding them into the stitchwork itself, the tablecloth becomes both the artifact and the archive.

Historical collaborative quilting traditions Colorful embroidery artwork showing narrative scenes

Left: Collaborative textile traditions that inspired our approach.
Right: Narrative embroidery as a storytelling medium.

Artistic Approach

The physicality of embroidery offers specific important affordances:

  • The practice is slow and collaborative — you build a mindful connection to the tablecloth artifact
  • When touching hand-sewn embroidery, you can feel the journey of the craft maker in every stitch
  • By playing stories while you interact with stitchwork, the artifact and voice become entangled — the maker's presence is embedded in the cloth
Community members sewing patterns collaboratively
Part 1 — Gather
Collaborative Embroidery Session

Communities are invited to sew their own patterns into the tablecloth. As they sit and stitch, they reflect on a meaningful question — "What food reminds you most of home?" Their spoken responses are recorded and mapped to their specific stitchwork.

Guests touching tablecloth patterns during dinner
Part 2 — Share
Sonic Dinner Experience

Guests sit for dinner on the Sonic Stitches tablecloth. Running their hands along the hand-stitched patterns plays audio snippets from the person who sewed that portion — past and present voices share the same table.

Research & Materials

We experimented with various forms of conductive textiles and sensing methods as points of entry for our project's core question.

Conductive thread spools
Conductive Thread
Carries electricity like wires. Enables soft circuit construction through tufting and knitting techniques.
Fabric pressure sensor
Pressure Sensors
Textile sensors that measure physical pressure and squeezing, mapped to various sound outputs.
Capacitive sensor
Capacitive Sensing
The circuit itself acts as a capacitive sensor, detecting finger proximity and touch through fabric.

Design Scenarios

We explored three modes of interaction that the system could support:

Scenario 1
Individual Exploration

A user traces their finger along the fabric to explore audio stories woven into a tapestry — a glimpse of dinnertime conversations from the past. The fabric becomes a beyond-the-present portal.

Scenario 2
Shared Storytelling

Collocated sharing where conversations of the past interleave with those physically present — a family reunion at the dinner table where absent voices join in.

Scenario 3
Textile Mapping

A knitted object is directly associated with its audio story. Computation disappears into everyday objects — a scarf, a placemat, a quilt square.

Prototyping

We built the system iteratively — starting with material explorations and moving through circuit design to a fully integrated tablecloth prototype.

Sewing conductive thread into the tablecloth with a needle
Step 1 — Input
Conductive Thread Circuits

Sewed conductive thread into specific embroidery zones on the tablecloth. Each thread path acts as a capacitive sensor pad — when a finger touches the stitches, the change in capacitance is detected by the circuit.

Pressure sensor fabric
Step 2 — Sensing
Pressure & Capacitive Sensors

Integrated textile pressure sensors beneath the embroidered sections. Calibrated sensitivity thresholds so touches and presses trigger audio behaviors.

Arduino processing bridge
Step 3 — Processing
Arduino → Processing Bridge

Arduino reads analog sensor values via serial and sends them to a Processing sketch. Wrote firmware to debounce touch signals and map multiple zones simultaneously.

Recording oral narratives while sewing
Step 4 — Output
Audio Playback & Story Mapping

Processing maps each touch zone to a recorded oral narrative. When a guest touches a stitched pattern, the corresponding maker's story plays through speakers beneath the table.

Technical Architecture

The system uses a three-stage pipeline from physical touch to audio playback:

🧵
Input
Conductive threads sewn into fabric act as capacitive sensor pads. Touch is detected as changes in capacitance.
→
⚡
Processing
Arduino reads analog pressure values and sends serial data to a Processing sketch running on a laptop.
→
🔊
Output
Processing maps touch zones to audio files and plays oral narratives through speakers beneath the table.

My Contribution

I was responsible for the entire technical architecture, from sensor integration to embedded programming — writing the Arduino firmware that reads capacitive touch values from conductive thread zones, calibrating sensor thresholds, and building the serial communication bridge to Processing. I also led the interaction design, defining how touch gestures would map to different audio playback behaviors based on different embroidery.

Final Result

Overhead view of Sonic Stitches tablecloth set for dinner Guest interacting with the embroidered tablecloth

Left: The final Sonic Stitches tablecloth set for dinner, with embroidered patterns visible between place settings.
Right: A guest touching the stitched patterns to trigger audio narratives.

Close-up of the interactive embroidered tablecloth

Close-up showing the hand-stitched patterns that serve as touch-sensitive interaction zones.

Demo

Outcome & Reflection

Sonic Stitches was to demonstrate how computation can disappear into handcrafted objects, creating intimate connections between makers separated by time and space.

This project deepened our understanding of how tangible interfaces can mediate human connection in ways that screens cannot. The slow, embodied act of sewing creates a fundamentally different relationship to a digital artifact than typing or tapping — and that difference matters for storytelling.

Future Directions

  • Deploy product across more communities to gather further user feedback
  • Improve hardware integration — embedding the Arduino and wiring seamlessly within the tablecloth to achieve a more ubiquitous computing experience
  • Explore narratives that "cross" — playing on the interwoven nature of the piece where touching intersecting threads blends multiple stories