Accurate face swap using cycleGAN

Qingyuan Liu; Yuxuan Zhou; Shuai Bao

doi:10.1117/12.2642855

28 July 2022 Accurate face swap using cycleGAN

Qingyuan Liu, Yuxuan Zhou, Shuai Bao

Proceedings Volume 12303, International Conference on Cloud Computing, Internet of Things, and Computer Applications (CICA 2022); 1230316 (2022) https://doi.org/10.1117/12.2642855
Event: International Conference on Cloud Computing, Internet of Things, and Computer Applications, 2022, Luoyang, China

Abstract

Face swap is to transfer a face image of one person to another given person. It can generate false but very realistic images and video data. At present, numerous frameworks have been proposed, such as CNN, FCN, GAN. Recently, GAN-based methods are popular with satisfying performance. In this paper, we aim to improve the GAN-based face swap methods under the cycleGAN framework and achieve a more realistic face-swapping result. In this method, cycleGAN is applied to to face swap task, which mainly solves the problems of unavailable paired training images, and our model can be trained without pairing real images. More than 1,000 pictures in total have participated in the model training. The test needs to input a video and output a video of the facial changes in a few minutes. We collect Hillary and Trump videos data on the google website for testing and analysis, obtain a trained model, and accurately change the face of the video. Our method can handle face swap effectively with reasonable speed. The quality and speed of its generation are no less than that of other frameworks like GAN, which is more popular nowadays.

Citation Download Citation

Qingyuan Liu, Yuxuan Zhou, and Shuai Bao "Accurate face swap using cycleGAN", Proc. SPIE 12303, International Conference on Cloud Computing, Internet of Things, and Computer Applications (CICA 2022), 1230316 (28 July 2022); https://doi.org/10.1117/12.2642855

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available

Members: $17.00

Non-members: $21.00 ADD TO CART

PROCEEDINGS
6 PAGES

DOWNLOAD PAPER SAVE TO MY LIBRARY

GET CITATION

RIGHTS & PERMISSIONS

Get copyright permission Get copyright permission on Copyright Marketplace

KEYWORDS

Gallium nitride

Video

Data modeling

Facial recognition systems

Image processing

3D acquisition

Image restoration

Show All Keywords

Keywords/Phrases

Search In:

Publication Years