NINGYUAN WANGRESEARCHAll stories

MULTISENSORY PERCEPTION

When vibration takes shape

We rarely see and feel an interface as two separate events. Our study asks whether the geometry we see and the vibration we feel can speak with one perceptual voice.

Abstract geometric forms transitioning between sharp and rounded states as tactile signals pass through them

If a button looks soft and circular but responds with a harsh, intense buzz, the interface sends conflicting signals.

Visual and tactile feedback are often designed independently. Yet people experience them together, and mismatched sensory cues can add cognitive load. We investigated a more basic question: do people naturally associate particular vibrations with particular shapes?

This is a question about coherence rather than decoration. A coherent multisensory interface can make an interaction feel more legible, comfortable, and immediate—before a user has to reason about what the feedback means.

02

controlled experiments

110

frequency–amplitude combinations

33

valid participant datasets

36

shape variants in the second study

Making touch visible

Participants held a vibration device and experienced signals that varied from 100 to 200 Hz across ten relative amplitude levels. In the first experiment, they matched each signal to a circle, triangle, quadrilateral, pentagon, or hexagon.

The second experiment went beyond category labels. Participants selected a shape and then adjusted its corner radius, allowing us to examine perceived roundness as a continuous quality.

From sharp and intense to round and calmAngular shapes are associated with stronger vibration, while circular shapes are associated with lower vibration frequency and amplitude.SHARPERROUNDERVIBRATION AMPLITUDEHIGHERLOWER
FIG. 01 / PERCEPTUAL MAPPING

The clearest pattern concerned amplitude: stronger vibrations were consistently matched with sharper forms.

Roundness has a tactile character

As the basic shapes became more circular, the vibration frequency and amplitude associated with them tended to decrease. Circles were matched with significantly lower frequencies and amplitudes than the sharper shapes.

Amplitude produced the most stable relationship: higher-amplitude vibrations corresponded to lower roundness. Frequency was more complex. Perceived roundness first decreased and then increased as frequency rose, suggesting that emotional qualities such as calmness, tension, and alertness may mediate the mapping rather than physical intensity alone.

Sensory coherence is not sameness. It is the careful alignment of meanings carried by different modalities.

FROM FINDING TO INTERFACE

Design feedback as one composition

CALM / CONTINUOUS

Rounded controls

Lower-amplitude vibration can reinforce the smooth, stable quality of a circular or softly rounded control.

URGENT / DISCRETE

Angular warnings

Stronger vibration can support sharp warning symbols when urgency must be felt as well as seen.

ACCESS / TRANSLATION

Tactile displays

Calibrated vibration may offer an alternate channel for communicating visual shape to people with visual impairments.

These are design directions, not universal presets. The study used a custom device, and actuator type, body location, context, and culture may change the perceptual mapping.