FACESYNTAX | Computing the Face Syntax of Social Communication

Summary
Social interactions are critical to all societies. One of the most powerful tools for social interaction is the face – a complex system comprising variations of movement (expressions), morphology (shape/structure) and complexion (color/texture). Consequently, the face can elicit myriad rapid social judgments (e.g. personality, emotion, group membership, age, health, social status) with significant consequences (e.g. sentencing/voting decisions, social isolation, job offers). Yet, little is known about how the complex, dynamic face transmits the myriad messages that regulate social interactions in different cultures, how these complex face signals map onto psychological processes (e.g. categorical/dimensional perception) or which signals facilitate or hinder cross-culture communication. This is largely due to fragmented research on social concepts (mental states, personality, emotions), face signals (morphology, movements, complexion) and culture, which, consequently, has overlooked a possible latent algebraic, syntactical structure to social face signals across cultures. My own work hints at such a structure. My ambitious program will unify these fragments to derive the first generative, algebraic and syntactical model of social face signals using innovative methods combining social/cultural psychology, 3D dynamic computer graphics, vision science psychophysical methods, and mathematical psychology. It will thus test and validate a new theoretical framework of social face signals that will unite both categorical/dimensional and universal/culture-specific accounts of social face perception. This framework is highly relevant in the context of globalization and cultural integration where social communication using virtual agents is integral to modern society. It is thus imperative to equip digital agents with the tools to flexibly generate socially and culturally sophisticated face signals. FACESYNTAX will thus transfer the generative model to social robotics.
Unfold all
/
Fold all
More information & hyperlinks
Web resources: https://cordis.europa.eu/project/id/759796
Start date: 01-09-2018
End date: 31-08-2025
Total budget - Public funding: 1 490 050,00 Euro - 1 490 050,00 Euro
Cordis data

Original description

Social interactions are critical to all societies. One of the most powerful tools for social interaction is the face – a complex system comprising variations of movement (expressions), morphology (shape/structure) and complexion (color/texture). Consequently, the face can elicit myriad rapid social judgments (e.g. personality, emotion, group membership, age, health, social status) with significant consequences (e.g. sentencing/voting decisions, social isolation, job offers). Yet, little is known about how the complex, dynamic face transmits the myriad messages that regulate social interactions in different cultures, how these complex face signals map onto psychological processes (e.g. categorical/dimensional perception) or which signals facilitate or hinder cross-culture communication. This is largely due to fragmented research on social concepts (mental states, personality, emotions), face signals (morphology, movements, complexion) and culture, which, consequently, has overlooked a possible latent algebraic, syntactical structure to social face signals across cultures. My own work hints at such a structure. My ambitious program will unify these fragments to derive the first generative, algebraic and syntactical model of social face signals using innovative methods combining social/cultural psychology, 3D dynamic computer graphics, vision science psychophysical methods, and mathematical psychology. It will thus test and validate a new theoretical framework of social face signals that will unite both categorical/dimensional and universal/culture-specific accounts of social face perception. This framework is highly relevant in the context of globalization and cultural integration where social communication using virtual agents is integral to modern society. It is thus imperative to equip digital agents with the tools to flexibly generate socially and culturally sophisticated face signals. FACESYNTAX will thus transfer the generative model to social robotics.

Status

SIGNED

Call topic

ERC-2017-STG

Update Date

27-04-2024
Images
No images available.
Geographical location(s)
Structured mapping
Unfold all
/
Fold all
Horizon 2020
H2020-EU.1. EXCELLENT SCIENCE
H2020-EU.1.1. EXCELLENT SCIENCE - European Research Council (ERC)
ERC-2017
ERC-2017-STG