GitHub - jiupinjia/stylized-neural-painting: Official Pytorch implementation of the preprint paper “Stylized Neural Painting”, in CVPR 2021.
▻https://github.com/jiupinjia/stylized-neural-painting
▻https://www.youtube.com/watch?v=oerb-nwrXhk
We propose an image-to-painting translation method that generates vivid and realistic painting artworks with controllable styles. Different from previous image-to-image translation methods that formulate the translation as pixel-wise prediction, we deal with such an artistic creation process in a vectorized environment and produce a sequence of physically meaningful stroke parameters that can be further used for rendering. Since a typical vector render is not differentiable, we design a novel neural renderer which imitates the behavior of the vector renderer and then frame the stroke prediction as a parameter searching process that maximizes the similarity between the input and the rendering output. Experiments show that the paintings generated by our method have a high degree of fidelity in both global appearance and local textures. Our method can be also jointly optimized with neural style transfer that further transfers visual style from other images.