Generate Image from Text

Text to image using Jupyter Notebook on Google Colab.

Overview

In one of my articles, I went through code examples on image classification using CLIP and ResNext. In this article let’s go through a few algorithms and libraries which can be used to generate an image from text.

Image Classification: CLIP and ResNext

CLIP + BigGAN

This library uses OpenAI’s CLIP and the generator from a BigGAN to generate images from text.

• From Colab, open this notebook.
• I use 100 iterations and 5 epochs to reduce the time to generate the image.

And this is the image generated for the phrase “flying cartoon elephant”.

Generated Image by Big Sleep

CLIP + Siren

This library uses OpenAI’s CLIP and Siren to generate images from text.

• From Colab, open this notebook.
• I use 100 iterations and 5 epochs to reduce the time to generate the image. Increase them for a better image.