Seeing the macro in the micro: a diffusion model-based approach for style transfer in cellular images

Jiayi CAI; Yong HE; Feng LIU; Byung-Ho KANG; Xuping FENG

doi:10.1631/jzus.B2500012

Your Location：

Home >

Browse articles >

Seeing the macro in the micro: a diffusion model-based approach for style transfer in cellular images

Scan QR Code

Alert me when the article has been cited

Submit

Correspondence | Updated：2025-06-24

Seeing the macro in the micro: a diffusion model-based approach for style transfer in cellular images
Seeing the macro in the micro: a diffusion model-based approach for style transfer in cellular images
见微知著：基于扩散模型的细胞图像风格迁移方法
Journal of Zhejiang University-SCIENCE B (Biomedicine & Biotechnology) Vol. 26, Issue 6, Pages: 609-612(2025)
Affiliations：

1.College of Biosystems Engineering and Food Science, Zhejiang University, Hangzhou 310058, China
2.College of Life Sciences, Nanjing Agricultural University, Nanjing 210095, China
3.Cellular and Molecular Biology Program, State Key Laboratory of Agrobiotechnology, School of Life Sciences, The Chinese University of Hong Kong, New Territories 999077, Hong Kong, China
Funds：
DOI：10.1631/jzus.B2500012
CLC：
CSTR：
Received：08 January 2025，

Revised：06 March 2025，

Published Online：11 June 2025，

Published：24 June 2025
Accepted：

蔡家一,何勇,刘峰等.见微知著：基于扩散模型的细胞图像风格迁移方法[J].浙江大学学报（英文版）（B辑：生物医学和生物技术）,2025,26(06):609-612.

Jiayi CAI, Yong HE, Feng LIU, et al. Seeing the macro in the micro: a diffusion model-based approach for style transfer in cellular images[J]. Journal of zhejiang university-science b (biomedicine & biotechnology), 2025, 26(6): 609-612.
蔡家一,何勇,刘峰等.见微知著：基于扩散模型的细胞图像风格迁移方法[J].浙江大学学报（英文版）（B辑：生物医学和生物技术）,2025,26(06):609-612. DOI： 10.1631/jzus.B2500012.

Jiayi CAI, Yong HE, Feng LIU, et al. Seeing the macro in the micro: a diffusion model-based approach for style transfer in cellular images[J]. Journal of zhejiang university-science b (biomedicine & biotechnology), 2025, 26(6): 609-612. DOI： 10.1631/jzus.B2500012.

摘要

细胞作为生命的基本单位，其内部结构展现出微观世界的无穷奥秘。细胞图像则可为我们提供一扇探索和理解这些结构组成与功能的奇妙窗口。将科学图像与艺术表达相结合，能进一步拓展图像在科普传播和跨学科应用中的潜力。本研究创新性地提出了一种基于扩散模型的细胞图像风格迁移方法，将科学的严谨性与艺术的表现力相融合。该方法利用免训练的大规模扩散模型，将细胞图像中复杂的形态和纹理特征与多样化的艺术风格相结合，通过引入去噪扩散隐式模型（DDIM）反演、自适应实例归一化（AdaIN）、自注意力风格注入以及注意力温度调控等关键技术，在增强视觉表现力的同时，确保细胞结构的完整性。相关研究结果展示了该策略在跨学科应用中的巨大潜力，为细胞图像的可视化和科普传播增添了更具美学和故事性的表现力。

Abstract

关键词

Keywords

references

Chung J , Hyun S , Heo JP , et al. , 2024 . Style injection in diffusion: a training-free approach for adapting large-scale diffusion models for style transfer . IEEE/CVF Conference on Computer Vision and Pattern Recognition , Seattle, p. 8795 - 8805 . https://doi.org/10.1109/CVPR52733.2024.00840 https://doi.org/10.1109/CVPR52733.2024.00840

Gao SW , Liu F , 2019 . Novel insights into cell cycle regulation of cell fate determination . J Zhejiang Univ-Sci B (Biomed & Biotechnol) , 20 ( 6 ): 467 - 475 . https://doi.org/10.1631/jzus.B1900197 https://doi.org/10.1631/jzus.B1900197

Kim B , Shin W , Jung Y , et al. , 2024 . Explicitly color-inspired neural style transfer using patchified adain . Comput Model Eng Sci , 141 ( 3 ): 2143 - 2164 . https://doi.org/10.32604/cmes.2024.056079 https://doi.org/10.32604/cmes.2024.056079

Shen F , 2018 . Six Chapters of a Floating Life . China Publishing House , Beijing, China , p. 53 - 54 (in Chinese) .

Tumanyan N , Geyer M , Bagon S , et al. , 2023 . Plug-and-play diffusion features for text-driven image-to-image translation . IEEE/CVF Conference on Computer Vision and Pattern Recognition , Vancouver , p. 1921 - 1930 . https://doi.org/10.1109/CVPR52729.2023.00191 https://doi.org/10.1109/CVPR52729.2023.00191

Zhang TG , Gao Y , Gao F , et al. , 2021 . Arbitrary style transfer with parallel self-attention . 25th International Conference on Pattern Recognition , Milan , p. 1406 - 1413 . https://doi.org/10.1109/ICPR48806.2021.9412049 https://doi.org/10.1109/ICPR48806.2021.9412049

Views

Downloads

CSCD

Tools

Publicity Resources

No data

Related Author

No data

Related Institution

No data

Address：Journal of Zhejiang University-SCIENCE, 38 Zheda Road, Hangzhou, China Postal code：310027
Tel：+86-571-87952783 Email：cjzhang@zju.edu.cn
Technical support is provided by Beijing Founder electronics co., LTD 京ICP备09064830号-19 京公网安备11010802024621
It is recommended to read the content of this site in Chrome&IE9+. Please switch to extreme mode in browser 360.
Cookies We use cookies to help provide and enhance our service and tailor content. By continuing, you agree to the use of cookies.

⁰