Deep Learning for Computer Vision

Interactive image generation

Generative models can be used to create images by interaction. A user can add edits and the images can be generated, reflecting the edits as shown here as proposed by Zhu et al. (https://arxiv.org/pdf/1609.03552v2.pdf):  

Reproduced from Zhu et al.

As shown, the images are generated based on the shape and color of the edits. A green color stroke at the bottom creates a grassland, a rectangle creates a skyscraper and so on. The images will be generated and fine-tuned with further inputs from the user. The generated image can also be used to retrieve the most similar real image that can be utilized. Interactive image ...