Unlock the Secrets of Writing Great Prompts for Stable Diffusion AI Image Generation

Constructing effective prompts for image generation is all about the balance of detail, structure and power keywords. How to structure a good prompt? What words to use in each prompt section to get the best results?

One of the secrets of writing effective prompts for stable diffusion is in the ability to provide as much detail as possible about what we want to create without confusing the machine. It is really all about the balance of detail, structure, and power keywords. 

constructing efficient prompts for image generation in stable diffusion

What is in This Post?

How to structure a good prompt? What words to use in each prompt section to get the best results? What are the powerful words that make everything beautiful? Where to get good prompt ideas from?

Structure

As you probably know there are tons of ways to write prompts. But some structures are better (much better) than others.  

for photorealistic images:
{ Subject Description} , Type of Image, Art Styles, Art Inspirations
for artistic image types:
Type of Image, { Subject Description} , Art Styles, Art Inspirations

Words order matters and special characters can make a difference. Things you put in curly brackets are considered important. Descriptions placed in square brackets are less important. The machine gives more weight to words appearing at the beginning of the description and less to the ones that appear at the end. Also if the description is very long, then each word has less weight.

If you are looking for photorealistic results, start your prompt with curly brackets and include the details about what exactly you want to create there.  Since the subject is usually the most important thing about the generated images that would be the thing to start with. 

However, in some cases, it would actually be smarter to start with the type of picture you want to create. That is true for scenarios in which the type of image is hard to create using ai and therefore you need to emphasize the importance of the specific image type/style by placing this in the front of the prompt. 

This description itself should include the subject, the action he performs, and adjectives that describe him best. The subject can be a person, animal, creature, robot, etc. But you need to be specific about it. You can: write a military person standing on the street. But it is better to write: A military old man with a machine gun walking on an abandoned street.

A military old man with a machine gun walking on abandoned street, back view, key lighting, soft lights, foggy, 8k render, detailed
a military old man with a machine gun walking on abandoned street, back view, key lighting, soft lights, foggy, 8 k render, detailed, warhammer 40k stable diffusion
stable diffuion a military old man with a machine gun walking on abandoned street, back view, key lighting, soft lights, foggy, 8 k render, detailed, warhammer 40k

Effective Adjectives:

Descriptive adjectives you use also make a difference, here are a few that are used often:

Environment Description:

The environment/background the subject will appear on also requires a description:

State the exact image type you want to create: realistic photograph, digital illustration, or comic book cover, here is a big list of options: 

generate any art style using ai image generation and correct prompt

Image Types:

Illustration Types:

Photo Types:

Art style can refer to the exact artistic style you want to create and terms that may relate to that style. You can write a pencil illustration to define the style, but adding terms like sketch and cross-hatching may help the algorithm understand the exact direction you are going toward with your prompt.

Overall Style Related

Pencil Drawing Related Terms

It is good to list places/artists to take inspiration from. If you list more than one artists to be inspired by, the algorithm will create some sort of combination between the artists which often will result in a completely new style driven by all the influencers you mentioned. You can mention specific names. You can also mention artistic platforms like Art Station, Dribble, Behance, etc…

General Inspiration

Can Be inspired by:

At the end of the prompt, it is best to place the related information about lighting, camera angles, render style, resolution, the required level of detail, etc…

Overall Helpful

Lighting

Colors

Render

Camera Shot Type

Camera Lens

View

Examples

In the next example, I will take a description for a dinosaur illustration and see how adding different styles and changing some other words in its prompt will affect the result. The random seed as well as all other settings will remain the same for all the images generated in this example. That is in order to see the influence the prompt itself has on the generation.

The base prompt I used was:

digital illustration, {cute dinosaur },4K, detailed, fantasy vivid colors, sun light
base dinosaur digital illustration prompt

Light and Color Changes

digital illustration, {cute dinosaur },4k, detailed, cinematic, neon light , vivid colors
digital illustration, {cute dinosaur },4k, detailed, cinematic, neon light , vivid colors
digital illustration {cute dinosaur },4k, detailed, cinematic, vivid colors, night time, moon light
digital illustration {cute dinosaur },4k, detailed, cinematic, vivid colors, night time, moon light
digital illustration, {cute dinosaur },4k, detailed,bright colors,cinematic
digital illustration, {cute dinosaur },4k, detailed,bright colors,cinematic
digital illustration, {cute dinosaur },4k, detailed,dark colors
digital illustration, {cute dinosaur },4k, detailed,dark colors
digital illustration, {cute dinosaur },4k, detailed, monochromatic, octane render
digital illustration, {cute dinosaur },4k, detailed, monochromatic, octane render
digital illustration, {cute dinosaur },4k, detailed, sepia, octane render
digital illustration, {cute dinosaur },4k, detailed, sepia, octane render
digital cyberpunk illustration {cute dinosaur },4k, hyper detailed, cinematic, vivid colors , neon blue flames , extreme wide shot,
digital cyberpunk illustration {cute dinosaur },4k, hyper detailed, cinematic, vivid colors , neon blue flames , extreme wide shot,
game concept {cute dinosaur },4k, hyper detailed, cinematic, vivid colors , neon blue flames , extreme wide shot,
game concept {cute dinosaur },4k, hyper detailed, cinematic, vivid colors , neon blue flames , extreme wide shot,
digital illustration {cute dinosaur }, 4k,detailed, cinematic, studio light
digital illustration {cute dinosaur }, 4k,detailed, cinematic, studio light

Type of Image

water color painting {cute dinosaur }, 4k,detailed, cinematic
water color painting {cute dinosaur }, 4k,detailed, cinematic stable diffusion prompt
line art {cute dinosaur }, digital illustration, 4k,
line art {cute dinosaur }, digital illustration, 4k,
caricature {cute dinosaur }, digital illustration, 4k,
caricature {cute dinosaur }, digital illustration, 4k,
pixel art {cute dinosaur }, digital illustration, 4k, hyper detailed, cinematic
pixel art {cute dinosaur }, digital illustration, 4k, hyper detailed, cinematic
origami art {cute dinosaur }, digital illustration, 4k, hyper detailed, vivid colors, cinematic
origami art {cute dinosaur }, digital illustration, 4k, hyper detailed, vivid colors, cinematic
low poly {cute dinosaur }, 3d illustration, 4k, hyper detailed, cinematic
low poly {cute dinosaur }, 3d illustration, 4k, hyper detailed, cinematic
fantasy map {cute dinosaur }, digital illustration, 4k, hyper detailed, vivid colors, cinematic
fantasy map {cute dinosaur }, digital illustration, 4k, hyper detailed, vivid colors, cinematic
character sprite sheet {cute dinosaur }, digital illustration, 4k, hyper detailed, cinematic
character sprite sheet {cute dinosaur }, digital illustration, 4k, hyper detailed, cinematic
stained glass illustration {cute dinosaur },4k, hyper detailed, cinematic, vivid colors ,
stained glass illustration {cute dinosaur },4k, hyper detailed, cinematic, vivid colors ,
pencil drawing {cute dinosaur }, 4k, hyper detailed, cinematic
pencil drawing {cute dinosaur }, 4k, hyper detailed, cinematic
hologram illustration {cute dinosaur },4k, detailed, cinematic, blue neon light , vivid colors
hologram illustration {cute dinosaur },4k, detailed, cinematic, blue neon light , vivid colors
scientific blueprint {cute dinosaur }, 4k,detailed, vivid colors, cinematic
scientific blueprint {cute dinosaur }, 4k,detailed, vivid colors, cinematic

Art Style

rococo {cute dinosaur }, digital illustration, 4k, hyper detailed, vivid colors, cinematic, art station
rococo {cute dinosaur }, digital illustration, 4k, hyper detailed, vivid colors, cinematic, art station
psychedelic illustration {cute dinosaur }, digital illustration, 4k, hyper detailed, vivid colors, cinematic,
psychedelic illustration {cute dinosaur }, digital illustration, 4k, hyper detailed, vivid colors, cinematic,
stonepunk {cute dinosaur }, digital illustration, 4k, hyper detailed, cinematic
stonepunk {cute dinosaur }, digital illustration, 4k, hyper detailed, cinematic
plasticine {cute dinosaur }, 4k, hyper detailed, vivid colors, cinematic
plasticine {cute dinosaur }, 4k, hyper detailed, vivid colors, cinematic
suprematism {cute dinosaur }, digital illustration, 4k, hyper detailed, vivid colors, cinematic, art station
suprematism {cute dinosaur }, digital illustration, 4k, hyper detailed, vivid colors, cinematic, art station
clockpunk {cute dinosaur }, digital illustration, 4k, hyper detailed, cinematic
clockpunk {cute dinosaur }, digital illustration, 4k, hyper detailed, cinematic

Art Styles Combination

suprematism cyberpunk {cute dinosaur }, digital illustration, 4k, hyper detailed, vivid colors, cinematic
suprematism cyberpunk {cute dinosaur }, digital illustration, 4k, hyper detailed, vivid colors, cinematic stable diffusion prompt
pointillisim cyberpunk {cute dinosaur }, digital illustration, 4k, hyper detailed, vivid colors, cinematic,
pointillisim cyberpunk {cute dinosaur }, digital illustration, 4k, hyper detailed, vivid colors, cinematic,
impressionism cyberpunk {cute dinosaur }, digital illustration, 4k, hyper detailed, vivid colors, cinematic,
impressionism cyberpunk {cute dinosaur }, digital illustration, 4k, hyper detailed, vivid colors, cinematic,
rococo ,cubism, steampunk {cute dinosaur }, digital illustration, 4k, hyper detailed, vivid colors, cinematic ​
rococo ,cubism, steampunk {cute dinosaur }, digital illustration, 4k, hyper detailed, vivid colors, cinematic ​
pop art, steampunk {cute dinosaur }, digital illustration, 4k, hyper detailed, vivid colors, cinematic ​
pop art, steampunk {cute dinosaur }, digital illustration, 4k, hyper detailed, vivid colors, cinematic ​
dadaism cyberpunk {cute dinosaur }, digital illustration, 4k, hyper detailed, vivid colors, cinematic,
dadaism cyberpunk {cute dinosaur }, digital illustration, 4k, hyper detailed, vivid colors, cinematic,

Online Tools that Help Build Good Prompts

There are online documents as well entire website dedicated to the art of good ai prompts. 

Git Templates

This is a git document with a few templates and instructions on how to achieve certain types of imagery in stable diffusion.

A website with lots of beautiful ai images in different categories and prompts for them. When you click on the image you like, besides the exact prompt used you also can see the stable diffusion model used for it, the seed number, cfg scale, and sampling steps. Helping you to recreate that same image. 

One more site where you can browse through beautiful images and get the prompts used to create them together with all the other setting values. 

Now What?

Now it is time to create your own prompts and bring your ideas to life. It is important to note that technology is new and is changing massively all the time. Most likely that as time passes it will be much easier and much more intuitive to create effective descriptions that produce amazing results.

Stay tuned for new tutorials.

Subscribe
Notify of
guest
0 Comments
Inline Feedbacks
View all comments
What the * means above
 

Please note, that the links that have * next to them are affiliate links and those help support AnimationGuides.com website. If you decide to purchase something through those links, we will get a small commission that will help us to continue and provide new free content on this website.

For you, going through those links is the same as clicking on a direct link. You will never pay more for products as a result of clicking on our links. If anything, that can actually help you get a better price since we can sometimes negotiate better deals for our readers.

The content on our website is not affected by the affiliate products and always reflects our honest opinion. All the reviews you will find on AnimationGuides.com are unbiased reviews. If a product we recommend does not have a supporting affiliate program, we will still link to it, just with a standard link without the *.

Share via
Share