基于特征对比的循环生成对抗网络图像风格转换研究
- 分享到:
摘要：
无监督图像到图像转换任务是在非配对训练数据的情况下学习源域图像到目标域图像的转换。但是，图像风格转换任务依然面临着图像内容丢失、模型坍塌等现象。为了解决上述问题，提出了一种局部特征对比来保持图像内容，通过特征提取器获得多层图像深层特征，使得图像编码器学习到高级语义信息，获得信息更加丰富的图像特征。同时，增加局部特征对比损失来引导特征提取器学习到有利于图像内容生成的特征。实验结果表明,在大多数情况下，所提方法在FID和KID分数方面优于之前的方法，图像生成质量有一定的提升。
The unsupervised image-to-image translation task is to learn the transformation of source domain images to target domain images in the case of unpaired training data.However,the image style conversion task still faces phenomena such as image content loss and model collapse. In order to solve the above problems,we propose a local feature comparison to pre-serve image content,and obtain multi-layer image deep features through a feature extractor,allowing the image encoder to learn high-level semantic information and obtain more informative image features. At the same time,local feature contrast loss is added to guide the feature extractor to learn features that are beneficial to image content generation. Experimental results
show that in most cases, our method out performs previous methods in terms of FID and KID scores, and the quality of image generation is improved to acertain extent。
作者：
闫娟，康鹏帅，王士斌，梅学术，李燕，刘栋
Yan Juan，Kang Pengshuai，Wang Shibin，Mei Xueshub，Li Yan，Liu Dong
机构地区：
betway官方app 信息化建设与管理办公室；计算机与信息工程学院；“教育人工智能与个性化学习”河南省重点实验室
引用本文：
闫娟,康帅,王士赋,等,基于特征对比的循环生成对抗网络图像风格转换研究[1].betway官方app 学报(自然科学版),2024,52(6):73-79.( Yan Juan, Kang Pengshuai, Wang Shibin,et al.Research on image style transfor.mation of eyclie generation adversarial network based on feature contrast[j].Journal of Henan Normal University(Natural Science Edition),2024,52(6):73-79.D01:10.16366/.cnki1000-2367.2023.07.12.0003.)
基金：
国家自然科学基金；河南省科技攻关计划项目；河南省普通本科高等学校智慧教学专项研究项目
关键词：
特征对比；图像风格转换；对比损失
feature comparison；image style conversion；contrastloss
分类号：
TP399
