The same scene, two ways of hearing

A sphere moves, stops, passes through an opening. We watch the same animation twice; only what we hear changes.

Cinema and audiovisual media
A blue sphere stopped before a rectangular opening on a grey plane; a frame from an original animation.
A frame from the animated sequence made for this article. The scene is constructed graphically and does not depict a real place.

The sphere stops before an opening. Is it waiting for something? Has it met an obstacle? The image does not give us enough to decide. If low sounds keep pulsing beneath that pause, it may feel as if something has yet to happen. With a few spaced notes, the stop can become a moment of observation.

To test this difference I prepared an eighteen-second animation with two soundtracks. The frames are identical, as are duration and movement. Sound changes the material we use to interpret the scene.

This is not a scientific experiment on emotions. It is a design comparison: it makes two choices audible and lets us return to the same gesture without having to remember it from another film.

Watch, then change how you listen

Start track A and follow the sphere to the end. Then choose B and return the video to the beginning. For a closer comparison, stop during the pause, around the eighth second, and change tracks: the player preserves the position and waits for another Play.

The names “Open” and “Suspended” describe the intentions behind the two compositions. You may find other adjectives more fitting. Before reading the commentary, try naming the sphere’s stop in each version.

Same scene / two soundtracks18 seconds

Track A · Open. Start the video using its Play button.

Read the description of the scene and sounds

A blue sphere moves across a grey plane, stops before an opening, then passes through it and disappears. The camera is fixed. A: short, spaced notes with a timbre like a small percussion instrument; a higher note accompanies the exit. B: sustained low sounds, regular pulses and a low accent as movement resumes. No voice or dialogue. The track names describe a compositional choice, not a required response.

Original synthetic animation and soundtracks, created for this article. No live footage, environmental recordings or pre-existing music samples. Changing tracks preserves the position and pauses the video.

In track A, short notes are separated by intervals wide enough to let the movement breathe. The timbre suggests a pitched percussion instrument, but the sound is synthesised. When the sphere starts again, the notes rise. I built this accompaniment to suggest passage without giving the opening the weight of an obstacle.

In track B, sustained low sounds and a regular pulse remain. The background grows as the sphere approaches; when it stops, the pulse continues. A low accent accompanies the restart. I left this continuity precisely where the image stops: visual movement ends for a few seconds, while sonic movement continues.

The pause has a duration and a character

The stop lasts equally long in both videos. Yet its function within the short sequence can seem different. A continuing pulse invites us to await the next beat; more widely spaced notes leave gaps without such an obvious appointment.

The interesting point is this gap between what we can count and what we interpret. We need not claim that one soundtrack makes the pause seem longer to everyone. It is enough to recognise that it offers different clues for making sense of it.

The sphere’s direction also stays the same. In both versions it moves towards the opening. With the second accompaniment, that gap can become a destination charged with anticipation; with the first, it can remain one of the landscape’s few elements. Geometry alone does not tell us which reading to choose.

Sound enters what we see

In Audio-Vision: Sound on Screen, Michel Chion proposes considering seeing and listening together: in audiovisual experience, each component modifies our perception of the other. This is a useful reference for asking where a quality we attribute to an image comes from.

If we describe the sphere as “hesitant”, for example, we are already interpreting its stop. Movement alone shows deceleration, a pause and a restart. Hesitation is a possible reading of that succession, to which sound can contribute.

This also matters for designers. Choosing a soundtrack after deciding that the scene already has a complete meaning risks hiding part of the work. An accent can give importance to a barely visible gesture; a continuous sound can sustain anticipation when nothing changes within the frame.

The limits of this small study

I removed faces, dialogue and recognisable objects from the scene. The sphere has no expression to read; the opening belongs to neither a house nor a station. This scarcity of clues makes it easier to concentrate on the two tracks but distances the comparison from the complexity of real footage.

Several sonic features also change together: pitch, timbre, rhythm and development. We cannot attribute a response to a single parameter. To isolate rhythm, we would need to keep the same sounds and change only their sequence; this comparison concerns two complete soundtracks.

The order in which we hear them matters too. After the first viewing, we already know the sphere will pass through the opening. The second arrives with this extra information. That is why reversing the order and listening again is worthwhile: it does not erase what we know, but makes the comparison’s dependence on memory apparent.

A third listen, without the track

Finally, try muting the audio using the video controls. The grey plane, movement and stop remain. After hearing both versions, you might keep imagining one accompaniment. That would not measure its effect; it would be a good reason to distinguish again between what the file shows and what we add to it.

The player’s silence is not a third soundtrack, either. Other noises may be present in the room, and the device may reproduce bass differently. The description beneath the video makes the design choices available without listening, but does not replace comparing the timbres.

For this exercise, the final question stays concrete: what function should that stop have? Once that is chosen, we can work on the interval between notes, the sound that continues or the point at which to end it. Before looking for suitable music, we should know what we are asking it to do.

References and credits

  • Michel Chion, Audio-Vision: Sound on Screen, second edition, Columbia University Press, 2019; translated and edited by Claudia Gorbman, foreword by Walter Murch.

The animation and both soundtracks are original, generated procedurally for this article. They contain no pre-existing footage, music samples or environmental recordings. The synthesis is also disclosed beside the player.

Another comparison between identical elements and different relationships appears in What a grid does: there, the page arrangement changes while the words remain the same.