PyTorchKR Papers

최신 논문

총 48편
태그·기간 등 상세 필터

카테고리 탐색

로그인 후 이 태그 구독

arXiv:2004.03339

Automatic Generation of Chinese Handwriting via Fonts Style Representation Learning

In this paper, we propose and end-to-end deep Chinese font generation system. This system can generate new style fonts by interpolation of latent style-related embeding variables that could achieve smooth transition between different style. Our method is simpler and more effective than other methods, which will help to improve the font design efficiency

arXiv:2001.07321

Neural Style Difference Transfer and Its Application to Font Generation

Designing fonts requires a great deal of time and effort. It requires professional skills, such as sketching, vectorizing, and image editing. Additionally, each letter has to be designed individually. In this paper, we will introduce a method to create fonts automatically. In our proposed method, the difference of font styles between two different fonts is found and transferred to another font using neural style transfer. Neural style transfer is a method of stylizing the contents of an image with the styles of another image. We proposed a novel neural style difference and content difference loss for the neural style transfer. With these losses, new fonts can be generated by adding or removing font styles from a font. We provided experimental results with various combinations of input fonts and discussed limitations and future development for the proposed method.

arXiv:1905.12502

GlyphGAN: Style-Consistent Font Generation Based on Generative Adversarial Networks

In this paper, we propose GlyphGAN: style-consistent font generation based on generative adversarial networks (GANs). GANs are a framework for learning a generative model using a system of two neural networks competing with each other. One network generates synthetic images from random input vectors, and the other discriminates between synthetic and real images. The motivation of this study is to create new fonts using the GAN framework while maintaining style consistency over all characters. In GlyphGAN, the input vector for the generator network consists of two vectors: character class vector and style vector. The former is a one-hot vector and is associated with the character class of each sample image during training. The latter is a uniform random vector without supervised information. In this way, GlyphGAN can generate an infinite variety of fonts with the character and style independently controlled. Experimental results showed that fonts generated by GlyphGAN have style consistency and diversity different from the training images without losing their legibility.

arXiv:1904.13268

Handwritten Chinese Font Generation with Collaborative Stroke Refinement

Automatic character generation is an appealing solution for new typeface design, especially for Chinese typefaces including over 3700 most commonly-used characters. This task has two main pain points: (i) handwritten characters are usually associated with thin strokes of few information and complex structure which are error prone during deformation; (ii) thousands of characters with various shapes are needed to synthesize based on a few manually designed characters. To solve those issues, we propose a novel convolutional-neural-network-based model with three main techniques: collaborative stroke refinement, using collaborative training strategy to recover the missing or broken strokes; online zoom-augmentation, taking the advantage of the content-reuse phenomenon to reduce the size of training set; and adaptive pre-deformation, standardizing and aligning the characters. The proposed model needs only 750 paired training samples; no pre-trained network, extra dataset resource or labels is needed. Experimental results show that the proposed method significantly outperforms the state-of-the-art methods under the practical restriction on handwritten font synthesis.

arXiv:1811.08106

Pyramid Embedded Generative Adversarial Network for Automated Font Generation

In this paper, we investigate the Chinese font synthesis problem and propose a Pyramid Embedded Generative Adversarial Network (PEGAN) to automatically generate Chinese character images. The PEGAN consists of one generator and one discriminator. The generator is built using one encoder-decoder structure with cascaded refinement connections and mirror skip connections. The cascaded refinement connections embed a multiscale pyramid of downsampled original input into the encoder feature maps of different layers, and multi-scale feature maps from the encoder are connected to the corresponding feature maps in the decoder to make the mirror skip connections. Through combining the generative adversarial loss, pixel-wise loss, category loss and perceptual loss, the generator and discriminator can be trained alternately to synthesize character images. In order to verify the effectiveness of our proposed PEGAN, we first build one evaluation set, in which the characters are selected according to their stroke number and frequency of use, and then use both qualitative and quantitative metrics to measure the performance of our model comparing with the baseline method. The experimental results demonstrate the effectiveness of our proposed model, it shows the potential to automatically extend small font banks into complete ones.

arXiv:1603.04000

Learning Typographic Style

Typography is a ubiquitous art form that affects our understanding, perception, and trust in what we read. Thousands of different font-faces have been created with enormous variations in the characters. In this paper, we learn the style of a font by analyzing a small subset of only four letters. From these four letters, we learn two tasks. The first is a discrimination task: given the four letters and a new candidate letter, does the new letter belong to the same font? Second, given the four basis letters, can we generate all of the other letters with the same characteristics as those in the basis set? We use deep neural networks to address both tasks, quantitatively and qualitatively measure the results in a variety of novel manners, and present a thorough investigation of the weaknesses and strengths of the approach.

arXiv:1701.05703

Automatic Generation of Typographic Font from a Small Font Subset

This paper addresses the automatic generation of a typographic font from a subset of characters. Specifically, we use a subset of a typographic font to extrapolate additional characters. Consequently, we obtain a complete font containing a number of characters sufficient for daily use. The automated generation of Japanese fonts is in high demand because a Japanese font requires over 1,000 characters. Unfortunately, professional typographers create most fonts, resulting in significant financial and time investments for font generation. The proposed method can be a great aid for font creation because designers do not need to create the majority of the characters for a new font. The proposed method uses strokes from given samples for font generation. The strokes, from which we construct characters, are extracted by exploiting a character skeleton dataset. This study makes three main contributions: a novel method of extracting strokes from characters, which is applicable to both standard fonts and their variations; a fully automated approach for constructing characters; and a selection method for sample characters. We demonstrate our proposed method by generating 2,965 characters in 47 fonts. Objective and subjective evaluations verify that the generated characters are similar to handmade characters.

arXiv:2606.13382v1cs.CV

SmartFont: 퓨샷 폰트 생성을 위한 동적 조건 할당

SmartFont: Dynamic Condition Allocation for Few-Shot Font Generation

퓨샷 폰트 생성은 동시에 전역적인 구조적 완전성과 세밀한 국소 스타일 충실도를 요구한다. 기존 방법들은 보통 전역 콘텐츠-스타일 모델링에 의존하여 견고하지만 완벽하게 분리되지 않거나, 컴포넌트/국소 모델링을 강조하여 세부 사항을 포착하지만 국소 사전 지식과 참조 커버리지에 크게 의존한다. 우리는 핵심 과제가 더 순수한 조건을 학습하는 것만이 아니라, 생성 과정에서 다단계 할당을 통해 상호 보완적이면서도 편향된 전역 및 국소 조건을 조직하는 데 있다고 주장한다. 이를 위해 우리는 전역 콘텐츠-스타일 생성과 약 지도 국소 보정 전문가를 결합한 확산 기반 퓨샷 폰트 생성 프레임워크인 SmartFont를 제안한다. 국소 분기는 약한 컴포넌트 지도 하에 전문가별 국소 개념과 의미적으로 유의미한 공간 맵을 학습하여 의미-공간 할당을 수행하며, 명시적인 컴포넌트 조건 추론 없이도 세밀한 보정을 가능하게 한다. 이를 바탕으로 노이즈 제거 상태 조건 할당 모듈이 시간 단계와 주입 블록에 걸쳐 전역 콘텐츠, 전역 스타일, 국소 보정 특징을 적응적으로 가중한다. 광범위한 실험 결과 SmartFont가 더 나은 전역-국소 균형을 달성하고 글리프 품질과 국소 세부 충실도를 향상시킴을 보여준다.