A blink, a glance and a pointing hand are not interchangeable decoration. Each changes what a viewer notices and what they infer about the character. Once a mascot becomes an interface, those small movements become part of the information architecture.
Research on pedagogical agents gives designers unusually concrete evidence. It shows that movement can improve retention and guide visual attention, while also showing why adding every possible gesture is not the same as communicating well.
Expression creates a social signal
A moving character can change how deeply people process a message.
Schneider and colleagues tested an onscreen instructor with and without gestures and facial expressions. Learners perceived the moving agents as more human-like. The combination of gesture and expression improved retention, while either cue on its own improved transfer in that experiment.
The researchers did not find the expected increase in extraneous processing from those learning-unrelated movements. Their result supports a social-agency explanation: expressive behaviour can invite people to treat the communication as a social exchange and pay closer attention.
Gaze guides; pointing specifies
The eyes establish a relationship. The hand can direct the task.
Two eye-tracking experiments by Li and colleagues separated eye contact, gaze direction and pointing. When the agent looked toward and pointed at relevant parts of a graphic, learners fixated those areas more and performed better on retention and transfer tests.
Pointing by itself improved retention and attention to relevant content; gaze toward the graphic by itself did not. Eye contact tended to help retention and supported attention in combination with guidance. The practical lesson is not that gaze is weak, but that different cues perform different jobs.
When less is more
Choose the behaviour that fits the outcome.
Baylor and Kim varied facial expression and pointing gestures across procedural and attitude-focused instruction. For procedural learning, gestures helped. For attitude-focused material, facial expression helped when pointing was absent. More animation was not consistently better.
A Brandbot needs the same discipline. Pointing can support navigation, comparison or step-by-step explanation. Facial expression can acknowledge tone or emphasise a message. Idle motion can sustain the illusion of life. If every channel fires at once, the performance can compete with the content.
- Use eye contact to open or re-establish the social connection
- Use gaze to make the character’s attention legible
- Use pointing for a specific object, option or next action
- Use facial expression to clarify emotion and emphasis
- Keep idle motion quiet enough that important cues remain distinct
From animation library to behaviour system
Design states and transitions, not a folder of reactions.
The useful unit is not a smile file or a wave file. It is a moment: waiting, listening, understanding, uncertain, guiding, celebrating, handing off. Each moment needs a clear communicative purpose and a controlled path into the next one.
The studies come from learning contexts, so their outcomes should be tested rather than copied blindly into customer service or sales. They still offer a strong design principle: animate the information people need to notice, and let personality support that job.
Expression is most powerful when the viewer can feel the personality and read the interface at the same time.
At a glance
- 163
- participants in the gesture-and-expression experiment
- 236
- participants in the ‘when less is more’ study
- 2
- eye-tracking experiments separating gaze, contact and pointing
