AI-Café presents: Image and Video Generation – A deep Learning Approach

May 25th, 2021 (from 3 PM to 4PM CEST)

Speaker:

Prof. Nicu Sebe

(Professor in the University of Trento, Italy).

Description of the Talk:

Video generation consists of generating a video sequence so that an object in a source image is animated according to some external information (a conditioning label or the motion of a driving video).

In this talk Prof. Sebe will present some of our recent achievements addressing these specific aspects:

1) generating facial expressions, e.g., smiles that are different from each other (e.g., spontaneous, tense, etc.) using diversity as the driving force.

2) generating videos without using any annotation or prior information about the specific object to animate. Once trained on a set of videos depicting objects of the same category (e.g. faces, human bodies), our method can be applied to any object of this class.

To achieve this, we decouple appearance and motion information using a self-supervised formulation. To support complex motions, we use a representation consisting of a set of learned key points along with their local affine transformations. A generator network models occlusions arising during target motions and combines the appearance extracted from the source image and the motion derived from the driving video. Our solutions score best on diverse benchmarks and on a variety of object categories.

Speaker's short bio:

Nicu Sebe is a professor at the University of Trento, Italy, where he is leading the research in the areas of multimedia information retrieval and human-computer interaction in computer vision applications. He received his Ph.D. from the University of Leiden, The Netherlands and has been involved in the past with the University of Amsterdam, The Netherlands and the University of Illinois at Urbana-Champaign, USA.

Watch the recording

AI-Café Team

Carmen Mac Williams Organizer, and Moderator of the AI-Cafe. She is the Director of the company Grassroots Arts, and a partner in the European AI4media project.

Emma and Theresa Co-organisers and co-moderators for this new season of Café Season. They are Research Assistants at Grassroots Arts.

This Café is organized by Grassroots Arts. If you have questions about the organisation of this AI-Café or if you want to become a Speaker yourself in one of the next Web Cafe Sessions, please contact carmen@grassroots-arts.eu.

The recordings of the past Web Cafes you can find on our AI-Café video channel: https://www.gotostage.com/channel/ai-cafe. Here is the link to the AI-Cafe website: https://ai-cafe.eu/

AI-Cafe WEBCAFE – INFORMATION LEGAL NOTICE > HERE