Library
Design Is Storytelling · 1 of 14
Design Is Storytelling
AI Software Development HIGH

Affordance and Multisensory Design

Design Is Storytelling Ellen Lupton
affordance path-dependence qwerty active-vision just-in-time cross-modal synesthesia multisensory naming sensation

Key Principle

Sensation is not passive reception — it is an active, constructive, and cross-modal process that designers can shape at every layer. Affordances encode learned action into form and persist through path dependence long after their original rationale disappears. Vision dominates the other senses so thoroughly that color overrides taste and smell even in trained experts. Language compounds this by framing sensory experience before it begins. Effective design works with these biases — engaging multiple sensory channels simultaneously — rather than treating vision as the only channel that matters.

Why This Matters

Digital designers default to visual-only thinking, but the brain never processes a single channel in isolation. Color changes how food tastes, naming changes how color feels, and affordance patterns learned on typewriters persist unchanged on smartphones. Ignoring cross-modal interaction means products that look right but feel wrong. Ignoring path dependence means superior alternatives no one adopts. Ignoring multisensory redundancy means products that collapse when a single sense is unavailable. Designing for the body's actual wiring — not a rationalist abstraction of it — is what separates functional design from resonant design.

Good Examples

QWERTY across 140 years. The keyboard layout was designed to prevent mechanical jamming by slowing typists. The mechanical problem vanished decades ago, but learned muscle memory made switching prohibitively costly. The layout transferred intact from typewriter to computer to smartphone — "zero mechanical resemblance, full behavioral continuity." Path dependence in action. (pp. 134-135)

Wine color experiment (Morrot, Brochet, Dubourdieu, 2001). 54 expert wine tasters described a white wine's aromas, then described the same wine dyed red. Experts overwhelmingly switched to red-wine descriptors and dropped white-wine language. Vision overrode both olfactory reality and years of professional training. (p. 150-151)

Adobe "Food and Beverage Palette." Identical color swatches labeled with appetizing names (Lemonade, Green Tea, Cafe Latte) in one column and repulsive names (Urine, Vomit, Dog Farts) in another. Same colors, opposite reactions — naming rewrites the sensory story. (p. 149)

Shower-in-the-dark exercise. MICA students showered blindfolded. Feet became spatial sensors, scent and sound grew acute, errors emerged (slipping, pulling controls off walls). A low-cost empathy method that reveals how much functional information non-visual channels carry. (p. 144)

Counterpoints

Path dependence is not always sacred. QWERTY persists, but that does not mean every legacy affordance should be preserved. The design consequence is bilateral: ignoring path dependence produces unadoptable alternatives, but blindly replicating legacy patterns without understanding why they exist is equally dangerous.

Cross-modal bias is not deception. Color making ice cream taste sweeter is not false or misleading — "it's the stuff of lived experience, the everyday reality of how our senses intermix." But the same mechanism can be weaponized through dark patterns and misleading packaging.

Multisensory design has diminishing returns for utility tools. A transit schedule or calculator may not benefit from tactile differentiation or olfactory cues. The argument is strongest for experiential products where engagement and memory matter.

Key Quotes

"The QWERTY keyboard was explicitly designed to prevent optimal performance." — Ellen Lupton, Design Is Storytelling (p. 135)

"The results were astonishing. Overwhelmingly, participants used red-wine colors to describe the white wine that had been dyed red, and they tended to eliminate descriptors used in round one that refer to light or yellow sources." — Ellen Lupton, Design Is Storytelling (p. 151), on Morrot et al. (2001)

"Color makes ice cream taste sweeter, veggies taste fresher, and coffee taste richer. This phenomenon isn't false or misleading — it's the stuff of lived experience, the everyday reality of how our senses intermix." — Ellen Lupton, Design Is Storytelling (p. 148)

"Try taking a shower in the dark. For a sighted person, this will be a disorienting experience. You may struggle to adjust the water temperature or to find the right soap, but you will learn about the importance of multisensory design." — Ellen Lupton, Design Is Storytelling (p. 144)

Rules of Thumb

  1. Respect path dependence before redesigning. If users have decades of muscle memory invested in an affordance pattern, the burden of proof is on the new design, not the old one.
  2. Design affordances on the spectrum. Know whether your affordance is accidental, instinctive, or learned — each type demands a different design strategy. Learned affordances need borrowed physics (shadows, depth) to feel instinctive in digital contexts.
  3. Use just-in-time representation. The brain filters for goal-relevant stimuli and ignores the rest. Create strong shapes and clear separations so users find meaning without testing every element one by one.
  4. Never design for vision alone. Convey critical information through multiple sensory channels (touch, sound, color, language) so that losing one channel does not collapse functionality.
  5. Name before you present. Language primes the sensory schema. Descriptive labels ("farm-fresh eggs," "plum notes and a toasted nut finish") change not just selection but perceived quality.
  6. Test cross-modal coherence. If color and flavor conflict, color wins. If the name and the color conflict, the name wins. Audit every sensory channel for contradictory signals.
  7. Treat typographic choices as sensory cues. Typefaces can evoke taste and texture (Ann Sunwoo's sweet/sour/salty/bitter typefaces). Font selection is not neutral — it is multisensory.

Related References