One of the secrets of writing effective prompts for stable diffusion is in the ability to provide as much detail as possible about what we want to create without confusing the machine. It is really all about the balance of detail, structure, and power keywords.
What is in This Post?
How to structure a good prompt? What words to use in each prompt section to get the best results? What are the powerful words that make everything beautiful? Where to get good prompt ideas from?
As you probably know there are tons of ways to write prompts. But some structures are better (much better) than others.
Words order matters and special characters can make a difference. Things you put in curly brackets are considered important. Descriptions placed in square brackets are less important. The machine gives more weight to words appearing at the beginning of the description and less to the ones that appear at the end. Also if the description is very long, then each word has less weight.
If you are looking for photorealistic results, start your prompt with curly brackets and include the details about what exactly you want to create there. Since the subject is usually the most important thing about the generated images that would be the thing to start with.
However, in some cases, it would actually be smarter to start with the type of picture you want to create. That is true for scenarios in which the type of image is hard to create using ai and therefore you need to emphasize the importance of the specific image type/style by placing this in the front of the prompt.
This description itself should include the subject, the action he performs, and adjectives that describe him best. The subject can be a person, animal, creature, robot, etc. But you need to be specific about it. You can: write a military person standing on the street. But it is better to write: A military old man with a machine gun walking on an abandoned street.
Descriptive adjectives you use also make a difference, here are a few that are used often:
State the exact image type you want to create: realistic photograph, digital illustration, or comic book cover, here is a big list of options:
Art style can refer to the exact artistic style you want to create and terms that may relate to that style. You can write a pencil illustration to define the style, but adding terms like sketch and cross-hatching may help the algorithm understand the exact direction you are going toward with your prompt.
Overall Style Related
Pencil Drawing Related Terms
It is good to list places/artists to take inspiration from. If you list more than one artists to be inspired by, the algorithm will create some sort of combination between the artists which often will result in a completely new style driven by all the influencers you mentioned. You can mention specific names. You can also mention artistic platforms like Art Station, Dribble, Behance, etc…
Can Be inspired by:
At the end of the prompt, it is best to place the related information about lighting, camera angles, render style, resolution, the required level of detail, etc…
Camera Shot Type
In the next example, I will take a description for a dinosaur illustration and see how adding different styles and changing some other words in its prompt will affect the result. The random seed as well as all other settings will remain the same for all the images generated in this example. That is in order to see the influence the prompt itself has on the generation.
The base prompt I used was:
Light and Color Changes
Type of Image
Art Styles Combination
There are online documents as well entire website dedicated to the art of good ai prompts.
This is a git document with a few templates and instructions on how to achieve certain types of imagery in stable diffusion.
A website with lots of beautiful ai images in different categories and prompts for them. When you click on the image you like, besides the exact prompt used you also can see the stable diffusion model used for it, the seed number, cfg scale, and sampling steps. Helping you to recreate that same image.
One more site where you can browse through beautiful images and get the prompts used to create them together with all the other setting values.
Now it is time to create your own prompts and bring your ideas to life. It is important to note that technology is new and is changing massively all the time. Most likely that as time passes it will be much easier and much more intuitive to create effective descriptions that produce amazing results.
Stay tuned for new tutorials.