13
Generating Images with ControlNet
Stable Diffusion’s ControlNet is a neural network plugin that allows you to control diffusion models by adding extra conditions. It was first introduced in a paper called Adding Conditional Control to Text-to-Image Diffusion Models [1] by Lvmin Zhang and Maneesh Agrawala, published in 2023.
This chapter will cover the following topics:
- What is ControlNet and how is it different?
- Usage of ControlNet
- Using multiple ControlNets in one pipeline
- How ControlNet works
- More ControlNet usage
By the end of this chapter, you will understand how ControlNet works and how to use Stable Diffusion V1.5 and Stable Diffusion XL ControlNet models.
What is ControlNet and how is it different?
In terms of “control,” you may ...
Get Using Stable Diffusion with Python now with the O’Reilly learning platform.
O’Reilly members experience books, live events, courses curated by job role, and more from O’Reilly and nearly 200 top publishers.
