[hackmd][github][github pages]
Typography is the cross between technology and liberal arts. This page is a research collection that includes computer graphics, computer vision, machine learning that related to typography.
- TypeDance: Creating Semantic Typographic Logos from Image throughPersonalized Generation
- Generate Like Experts: Multi-Stage Font Generation by Incorporating Font Transfer Process into Diffusion Models
- VecFusion: Vector Font Generation with Diffusion
- Vikas Thamizharasan, Difan Liu, Shantanu Agarwal, Matthew Fisher, Michael Gharbi, Oliver Wang, Alec Jacobson, Evangelos Kalogerakis
- CVPR 2024
- [arxiv] [project page]
- FontDiffuser: One-Shot Font Generation via Denoising Diffusion with Multi-Scale Content Aggregation and Style Contrastive Learning
- Zhenhua Yang, Dezhi Peng, Yuxin Kong, Yuyi Zhang, Cong Yao, Lianwen Jin
- AAAI 2024
- [project page][arxiv][code][demo]
- AnyText: Multilingual Visual Text Generation And Editing
- GlyphControl: Glyph Conditional Control for Visual Text Generation
- DiffUTE: Universal Text Editing Diffusion Model
- TextDiffuser: Diffusion Models as Text Painters
- Jingye Chen*, Yupan Huang*, Tengchao Lv, Lei Cui, Qifeng Chen, Furu Wei
- *Equal Contribution
- NeurIPS 2023
- [project page][paper][code][demo][colab]
- Jingye Chen*, Yupan Huang*, Tengchao Lv, Lei Cui, Qifeng Chen, Furu Wei
- GlyphDraw: Learning to Draw Chinese Characters in Image Synthesis Models Coherently
- Jian Ma, Mingjun Zhao, Chen Chen, Ruichen Wang, Di Niu, Haonan Lu, Xiaodong Lin
- arxiv 2023
- [project page][paper][code]
- DeepFloyd IF
- Inspired by "Photorealistic Text-to-Image Diffusion Models with Deep Language Understanding", NeurIPS2022
- aka Imagen
- [code]
- Inspired by "Photorealistic Text-to-Image Diffusion Models with Deep Language Understanding", NeurIPS2022
- Character-Aware Models Improve Visual Text Rendering
- arxiv
- Rosanne Liu∗, Dan Garrette∗, Chitwan Saharia, William Chan, Adam Roberts, Sharan Narang, Irina Blok, RJ Mical, Mohammad Norouzi, Noah Constant∗
- *Equal contribution
- [paper]
- OCR-VQGAN: Taming Text-within-Image Generation
- Juan A. Rodríguez, David Vázquez, Issam Laradji, Marco Pedersoli, Pau Rodríguez
- WACV2023
- [paper(CVF)][paper(arxiv)][code]
- DS-Fusion: Artistic Typography via Discriminated and Stylized Diffusion
- Maham Tanveer, Yizhi Wang, Ali Mahdavi-Amiri, Hao Zhang
- ICCV2023
- [project page][paper][code] [demo]
- Word-As-Image for Semantic Typography
- Shir Iluz*, Yael Vinker*, Amir Hertz, Daniel Berio, Daniel Cohen-Or, Ariel Shamir
- *Denotes equal contribution
- SIGGRAPH 2023 - Honorable Mention Award
- [project page][paper][code][demo]
- Shir Iluz*, Yael Vinker*, Amir Hertz, Daniel Berio, Daniel Cohen-Or, Ariel Shamir
- DeepVecFont-v2: Exploiting Transformers to Synthesize Vector Fonts with Higher Quality
- Yuqing Wang, Yizhi Wang, Longhui Yu, Yuesheng Zhu, Zhouhui Lian
- CVPR 2023
- [paper(CVPR)][code]
- DeepVecFont: Synthesizing High-quality Vector Fonts via Dual-modality Learning
- Yizhi Wang, Zhouhui Lian
- SIGGRAPH Asia 2021
- [project page][code][paper]
-
StrokeStyles: Stroke-based Segmentation and Stylization of Fonts
- Daniel Berio, Frederic Fol Leymarie, Paul Asente, Jose Echevarria
- ACM Transactions on GraphicsVolume 41Issue 3Article No.: 28pp 1–21
- [paper]
-
DG-Font: Deformable Generative Networks for Unsupervised Font Generation
- Yangchen Xie, Xinyuan Chen, Li Sun, Yue Lu
- [paper(CVPR)][paper(arxiv)][code]
- CVPR2021
- Multiple Heads are Better than One:Few-shot Font Generation with Multiple Localized Experts
- Font Style that Fits an Image -- Font Generation Based on Image Context
- Few-shot Font Generation with Localized Style Representations and Factorization
- Song Park*, Sanghyuk Chun*, Junbum Cha, Bado Lee, Hyunjung Shim1
- *: equal contribution
- [project page] [paper][code]
- AAAI 2021
- Song Park*, Sanghyuk Chun*, Junbum Cha, Bado Lee, Hyunjung Shim1
- Handwritten Chinese Font Generation with Collaborative Stroke Refinement
- [paper][WACV2021][code(dead)]
- Chuan Wen, Jie Chang, Ya Zhang, Siheng Chen, Yanfeng Wang, Mei Han, Qi Tian
- WACV 2021
- RD-GAN: Few/Zero-Shot Chinese Character Style Transfer via Radical Decomposition and Rendering
- Yaoxiong Huang, Mengchao He, Lianwen Jin, Yongpan Wang
- [paper(ECVA)]
- ECCV 2020
- Few-shot Compositional Font Generation with Dual Memory
- CalliGAN: Style and Structure-aware Chinese Calligraphy Character Generator
- A Learned Representation for Scalable Vector Graphics
- [paper]
- Raphael Gontijo Lopes, David Ha, Douglas Eck, Jonathon Shlens
- ICCV 2019
- ICLR workshop 2019
-
Large-scale Tag-based Font Retrieval with Generative Feature Learning
-
DynTypo: Example-based Dynamic Text Effects Transfer
- [paper]
- Yifang Men, Zhouhui Lian, Yingmin Tang, Jianguo Xiao
- CVPR 2019
- <iframe width="560" height="315" src="https://www.youtube.com/embed/FkFQ6bV1s-o" frameborder="0" allow="accelerometer; autoplay; encrypted-media; gyroscope; picture-in-picture" allowfullscreen></iframe>
-
Typography with Decor: Intelligent Text Style Transfer
- Wenjing Wang, Jiaying Liu, Shuai Yang, and Zongming Guo
- CVPR2019
- [project page] [paper] [code]
-
DeepGlyph
- [websites]
- <iframe width="560" height="315" src="https://www.youtube.com/embed/T70k-0qgccs" frameborder="0" allow="accelerometer; autoplay; encrypted-media; gyroscope; picture-in-picture" allowfullscreen></iframe>
-
Coconditional Autoencoding Adversarial Networks for Chinese Font Feature Learning
- [paper]
- arxiv 2018
- Zhizhan Zheng, Feiyun Zhang
-
TET-GAN: Text Effects Transfer via Stylization and Destylization
- [paper]
- Shuai Yang, Jiaying Liu, Wenjing Wang, Zongming Guo
- AAAI2019
- SCFont: Structure-Guided Chinese Font Generation via Deep Stacked Networks
- [paper]
- Yue Jiang, Zhouhui Lian*, Yingmin Tang, Jianguo Xiao
- AAAI 2019
-
Separating Style and Content for Generalized Style Transfer
-
Deep Learning for Classical Japanese Literature
-
Multi-Content GAN for Few-Shot Font Style Transfer
-
Learning to Write Stylized Chinese Characters by Reading a Handful of Examples
- [paper]
- Danyang Sun∗, Tongzheng Ren∗, Chongxuan Li, Hang Su†, Jun Zhu†
- IJCAI 2018
- SA-VAE
- DCFont: An End-To-End Deep Chinese Font Generation System
- [paper]
- Juncheng Liu, Zhouhui Lian, Jianguo Xiao
- SIGGRAPH Asia 2017
-
zi2zi: Master Chinese Calligraphy with Conditional Adversarial Networks
- [blog] [code(TensorFlow)] [code(pytorch)(xuan-li)] [code(pytorch)( EuphoriaYan)]
- Yuchen Tian
- 2017
-
Rewrite: Neural Style Transfer For Chinese Fonts
- [code]
- Yuchen Tian
- 2016
-
Automatic generation of large-scale handwriting fonts via style learning
- [paper]
- Zhouhui Lian, Bo Zhao, and Jianguo Xiao
- SIGGRAPH ASIA 2016
- A Book from the Sky 天书: Exploring the Latent Space of Chinese Handwriting
- Letter Spirit: An Emergent Model of the Perception and Creation of Alphabetic Style
- [paper]
- Douglas Hofstadter, Gary McGraw
- 1993
-
Automatic Generation of Typographic Font from a Small Font Subset
- [paper]
- Tomo Miyazaki, Tatsunori Tsuchiya, Yoshihiro Sugaya, Shinichiro Omachi, Masakazu Iwamura, Seiichi Uchida, Koichi Kise
- 2017
-
FlexyFont: Learning Transferring Rules for Flexible Typeface Synthesis
- [paper]
- H. Q. Phan, H. Fu, and A. B. Chan
- 2015 Computer Graphics Forum
-
Awesome Typography: Statistics-Based Text Effects Transfer
-
Easy generation of personal Chinese handwritten fonts
- [paper]
- Baoyao Zhou, Weihong Wang, and Zhanghui Chen
- 2011 ICME(IEEE International Conference on Multimedia and Expo)
-
Automatic shape morphing for Chinese characters
- [paper]
- Zhouhui Lian, and Zhouhui Lian
- SIGGRAPH Asia 2012
-
Analyzing 50k fonts using deep neural networks
- [blog]
- Erik Bernhardsson
- 2016
-
Learning a Manifold of Fonts
- [paper][project(demo)]
- Neill D.F. Campbell, and Jan Kautz
- SIGGRAPH 2014
- Chinese Handwriting Recognition Competition 2013
- Deep Learning for Classical Japanese Literature
- FontCode: Embedding Information in Text Documents Using Glyph Perturbation
- [paper][project page]
- Chang Xiao, Cheng Zhang, Changxi Zheng
- SIGGRAPH 2018
- <iframe width="560" height="315" src="https://www.youtube.com/embed/dejrBf9jW24" frameborder="0" allow="autoplay; encrypted-media" allowfullscreen></iframe>