PhotoCloth | PhotoCloth: A framework to synthesize real-time photorealistic cloth animation from video input.

Summary
Computer Graphics is the area of computer science that studies methods for digitally synthesizing and animating visual content. Among all the potential contexts where computer graphics techniques can be used, cloth animation is a particularly interesting case since, in the real world, clothing is far more than just the physical objects that we wear; clothing is a key element to show someone’s expressiveness and motion, it even defines his or her identity.

However, cloth animation is a complex and extremely high-dimensional problem. To digitally synthesize cloth animation, a large number of properties that affect the way cloth behaves need to be estimated: textures, deformations, collisions, materials, illumination, etc.

Current approaches for cloth animation tried to overcome this challenging problem following two main trends: image-based methods use captured data to construct a low-dimensional model to digitally synthesize new animations, however they can only sample a small portion of the high-dimensional space of cloth and poses; the physics-based methods aim to simulate cloth only using mathematical equations that express physics laws, however, they are computationally expensive and have trouble replicating real-world behavior.

This fellowship will investigate a new model for cloth simulation that combines a physical-based method with image-based infomation to generate real-time believable cloth animation. The new model will use a multi-scale framework to handle the dynamic geometry and appearance at different levels of detail. The most salient dynamic geometric properties of the animation will be handled by a low-resolution representation of the cloth using a physics-based model, which reduces the high-dimensionality of the pose space to a lower-dimensional subspace. Mid- and fine-scale details such as shading, wrinkles and appearance will be incorporated by an image-based approach, using the input imagery to learn to predict those properties.
Unfold all
/
Fold all
More information & hyperlinks
Web resources: https://cordis.europa.eu/project/id/707326
Start date: 01-10-2016
End date: 30-09-2018
Total budget - Public funding: 170 121,60 Euro - 170 121,00 Euro
Cordis data

Original description

Computer Graphics is the area of computer science that studies methods for digitally synthesizing and animating visual content. Among all the potential contexts where computer graphics techniques can be used, cloth animation is a particularly interesting case since, in the real world, clothing is far more than just the physical objects that we wear; clothing is a key element to show someone’s expressiveness and motion, it even defines his or her identity.

However, cloth animation is a complex and extremely high-dimensional problem. To digitally synthesize cloth animation, a large number of properties that affect the way cloth behaves need to be estimated: textures, deformations, collisions, materials, illumination, etc.

Current approaches for cloth animation tried to overcome this challenging problem following two main trends: image-based methods use captured data to construct a low-dimensional model to digitally synthesize new animations, however they can only sample a small portion of the high-dimensional space of cloth and poses; the physics-based methods aim to simulate cloth only using mathematical equations that express physics laws, however, they are computationally expensive and have trouble replicating real-world behavior.

This fellowship will investigate a new model for cloth simulation that combines a physical-based method with image-based infomation to generate real-time believable cloth animation. The new model will use a multi-scale framework to handle the dynamic geometry and appearance at different levels of detail. The most salient dynamic geometric properties of the animation will be handled by a low-resolution representation of the cloth using a physics-based model, which reduces the high-dimensionality of the pose space to a lower-dimensional subspace. Mid- and fine-scale details such as shading, wrinkles and appearance will be incorporated by an image-based approach, using the input imagery to learn to predict those properties.

Status

CLOSED

Call topic

MSCA-IF-2015-EF

Update Date

28-04-2024
Images
No images available.
Geographical location(s)
Structured mapping
Unfold all
/
Fold all
Horizon 2020
H2020-EU.1. EXCELLENT SCIENCE
H2020-EU.1.3. EXCELLENT SCIENCE - Marie Skłodowska-Curie Actions (MSCA)
H2020-EU.1.3.2. Nurturing excellence by means of cross-border and cross-sector mobility
H2020-MSCA-IF-2015
MSCA-IF-2015-EF Marie Skłodowska-Curie Individual Fellowships (IF-EF)