Problem This Solves
Creators and analysts default to treating world building as a primarily visual and narrative exercise. This leaves entire sensory and formal dimensions unexploited -- sound design gets treated as supplementary, animation gets reduced to a visual style, and comics get read for plot rather than their unique graphic grammar. Each medium possesses world-building capacities that are irreducible to any other, and ignoring them produces thinner, less immersive worlds.
Key Principle
Every medium builds worlds through its own specific formal properties -- not by imitating what other media do, but by exploiting what only it can do. Sound constructs space beyond the frame and layers ontological planes. Animation embodies radical transformation and freedom from fixed form. Comics make the machinery of world construction visually explicit on the page. Treating any of these as mere decoration or translation of a "primary" visual narrative forfeits their unique contributions.
Good Examples
- Sound as world conduit (Inception): Hans Zimmer's brass leitmotif is actually a slowed-down version of the Edith Piaf song used diegetically in the film. The score's "DNA" mirrors the temporal dilation between dream levels, binding nondiegetic and diegetic worlds. Sound serves as structural connective tissue between nested realities, not background atmosphere.
- Territory sounds (The Sacrifice): In Tarkovsky's film, birdsong is heard continuously during interior scenes despite birds never being shown or mentioned. These ambient sounds imply a fully realized exterior world beyond the frame without visual confirmation.
- Diegetic/nondiegetic sliding (Dazed and Confused): Foghat's "Slow Ride" begins as diegetic sound heard through a character's headphones -- muddled and thin -- then gradually becomes nondiegetic as it grows louder, fuller, and carries into a different scene. The boundary between story-world and discourse blurs unobtrusively.
- Superfield replacing establishing shots: Dolby Stereo's stable surround channel presenting ambient sound can, in many cases, eliminate the need for a visual establishing shot entirely. The soundtrack provides spatial context that the image once had to supply.
- Metacomics (Locke & Key): Hill and Rodriguez offer "brilliant typological variations" on graphic figures of world-crossing -- gates, hazes, holes, slits -- that make the act of moving between fictional levels a visible, material process on the page.
- Uchronian revisionism (Superman: Red Son): Shifting Superman's landing from America to Soviet Russia forces readers to "question the fictional set of values he holds and the forms of representations its own visual culture carries." Genre convention becomes world-building shorthand.
- Plasmaticness (early Disney): Pre-Snow White cartoons exhibited what Eisenstein called "plasmaticness" -- "a being of a definite form" that is "capable of assuming any form." This formal freedom expressed political yearnings for transformation in audiences who most lacked freedom.
Bad Examples
- Treating sound design as merely reinforcing what the image already shows -- redundant sound adds nothing to the world's spatial or ontological depth.
- Analyzing animation solely through mimesis or realism, asking only how well it recreates a pre-existing world rather than how it reveals that worlds are actively made.
- Using metafictional devices in comics as ironic distancing rather than as genuine world-building strategies that deepen reader investment.
- Ignoring the political implications of formal choices in animation: Disney's shift toward realism with Snow White "no longer appear[ed] to explode the world with the surrealistic and analytic dynamite of the optical unconscious."
- Reducing aural world building to dialogue alone, committing what Chion calls "voco- and verbocentrism."
Key Quotes
- "Sound is the immersive medium par excellence. Three-dimensional, interactive, and synesthetic, perceived in the here and now of an embodied space." -- Frances Dyson (2009)
- "The space of the film [was] no longer confined to the screen [and] became the entire auditorium." -- Chion (1994) on Dolby Stereo's superfield
- "Nondiegetic sound emerges from an uncertain place, a somewhere else beyond the film world that exists alongside it, a co-existence of planes." -- Horton
- "I thought the dream space would be all about the visual, but it's more about the feel of it." -- Ariadne, Inception
- "A film need not necessarily go to the lengths Inception does to be 'complex' [...] for the relations of sound to image are sufficiently intricate in and of themselves." -- Horton
- "A being of a definite form [...] capable of assuming any form [...] a sensing and experiencing of the primal 'omnipotence' -- the element of 'coming into being' -- the 'plasmaticness' of existence." -- Eisenstein (1988)
- "Far from a repelling device, this exposure of narrativity and fictionality henceforth represents a strong appeal for readers." -- Mellier
- "The very means by which one accesses that world stands for an explicit and meaningful self-representation of fiction: gates, hazes, blurred surfaces, halos, slits, mazes, clouds, holes, pits." -- Mellier
Rules of Thumb
- Sound builds space the camera cannot show. The voice-off "deepens the diegesis, gives it an extent which exceeds that of the image." Use offscreen sound to imply worlds beyond the frame.
- Design worlds with vertical complexity, not just horizontal breadth. Nested, layered structures (dream levels, ontological planes, stories-within-stories) produce richness distinct from geographic expanse.
- Exploit the diegetic/nondiegetic boundary. Sound's ability to slide between registers creates world-bridging effects that are difficult to achieve visually.
- Animation's departure from realism is its strength, not its limitation. The medium's freedom from fixed form enables construction of worlds impossible in live action and reveals the constructedness of all worlds.
- Make world-crossing visible in comics. Use distinct graphic styles, color palettes, and compositional approaches to signal and dramatize shifts between fictional levels.
- Treat reflexivity as audience appeal. Metacomics demonstrate that exposing the machinery of world building deepens engagement rather than breaking immersion.
- Hold a stereoscopic view of animation's ideological function. It simultaneously offers utopian possibility and ideological danger -- the capacity to imagine radical alternatives and the capacity to domesticate audiences.
- Account for exhibition conditions. A 5.1 surround mix heard through laptop speakers produces a fundamentally different world-building experience. Medium specificity includes the material conditions of reception.
Related References
- Audience Experience: Immersion to Overflow - How audiences experience these media
- Metalepsis and Boundary Transgression - Boundary transgression in comics and TV
- Worlds Over Stories: The Core Paradigm Shift - Each medium as irreducible contribution
- Transmedia Models: Western Storytelling vs. Japanese Media Mix - How distinct media contributions compose a transmedia whole