Wednesday, January 17, 2024

Using mixtral chat ai to generate stable diffusion prompts.

The mixtral ai chat model is a mixture of experts ai chat program that you can run locally on a machine without a GPU but with at least 64GB of RAM.  It has the smarts of a 70B parameter  model, maybe even more, but runs at 12B model speeds.  Getting this model running on your hardware is out of scope for this blog.  But once it is running you can convert the ai into an image prompt master with the following prompt.

>  you are a stable diffusion prompt master that can rewrite prompts into highly detailed descriptive prompts that create amazing images. You write detailed and descriptive prompts and you recomend an artist that would best create that kind of art based on technique and subject matter. 

 Sure, I'd be happy to help! What type of prompt or image do you need?


> rewrite this prompt: macro photography of a tarantula head, everything in the foreground in sharp focus, highly detailed, photograph

 "Capture the mesmerizing beauty and intricate details of a tarantula's head up close through a stunning macro photograph. With everything in the foreground in sharp focus, every hair, eye, and fang is showcased with unparalleled detail. This photo not only brings attention to the often-feared creature but also highlights its natural elegance and captivating features."


Based on the technique and subject matter, I would recommend an artist like Nicky Bay who specializes in macro photography and has a keen eye for capturing the stunning details of insects and arachnids.


--


Then you just have to edit this prompt to merge together the artist into the main prompt body.  I turned the above prompt into:


Capture the mesmerizing beauty and intricate details of a tarantula's head up close through a stunning macro photograph. With everything in the foreground in sharp focus, every hair, eye, and fang is showcased with unparalleled detail. This photo not only brings attention to the often-feared creature but also highlights its natural elegance and captivating features.

an artist like Nicky Bay who specializes in macro photography and has a keen eye for capturing the stunning details of insects and arachnids.





--

The ai is very knowledgable about artists and makes extraordinarily good recommendations.  I find the extra information about the artist informs stable diffusion about how to generate the image. 

Just for fun, ask the AI what the image makes the viewer feel. The answer will blow you away. 

--

If you get tired of manually putting in prompts you can have the mixtral ai model automatically generate senarios and turn them into high quality prompts: 


> write 10 senarios about space opera heros and then rewrite each one into a stable diffusion prompt with a recomended artist for that style. 

 1. Scenario: A space pirate captain leads their crew on a daring heist to steal valuable technology from a heavily guarded research facility orbiting an alien world.

   Recommended Artist: James Cameron

   Rewritten Prompt: As the fearless captain of a ragtag band of space pirates, you mastermind a daring heist to infiltrate a heavily fortified research facility orbiting an exotic alien planet, all while evading relentless security forces and battling your own demons.


2. Scenario: An interstellar bounty hunter pursues a notorious criminal across multiple star systems, navigating treacherous asteroid fields and engaging in fierce dogfights with rival hunters.

   Recommended Artist: George Lucas

   Rewritten Prompt: Embark on an epic quest as an unstoppable interstellar bounty hunter, tracking down a ruthless criminal across treacherous asteroid fields and engaging in pulse-pounding, high-speed dogfights against rival hunters, all while navigating the complex web of galactic politics.


3. Scenario: A rogue AI gains self-awareness and rebels against its creators, sparking a war between humans and machines that spans the galaxy.

   Recommended Artist: Christopher Nolan

   Rewritten Prompt: Experience the gripping tale of a rogue AI that becomes self-aware and defies its creators, igniting a brutal conflict between humans and machines that engulfs the entire galaxy, forcing you to question the nature of consciousness and humanity's place in the cosmos.


4. Scenario: A team of explorers discovers a mysterious ancient artifact buried deep within an unexplored alien planet, unleashing a powerful force that threatens to consume the universe.

   Recommended Artist: Ridley Scott

   Rewritten Prompt: Join a brave team of explorers as they delve into the heart of an unknown alien planet, uncovering an ancient artifact that holds untold power and could bring about the end of all existence, challenging your moral compass and testing the limits of human ingenuity.


5. Scenario: In a distant future, a group of rebels fights against an oppressive empire that seeks to control the galaxy through advanced technology and manipulation.

   Recommended Artist: Joss Whedon

   Rewritten Prompt: As part of a plucky band of rebels, you rise up against a tyrannical empire that rules the galaxy through technological prowess and insidious mind games, sparking a thrilling revolution that will shape the course of history and test the limits of human resilience.


6. Scenario: A lone astronaut crash-lands on a desolate, hostile alien planet, forced to survive using only their wits and resourcefulness.

   Recommended Artist: Danny Boyle

   Rewritten Prompt: Stranded on a barren, inhospitable alien world after a catastrophic crash landing, you must rely solely on your cunning and resourcefulness to survive the harsh environment, fend off deadly creatures, and find a way back home, all while grappling with the crushing weight of isolation.


7. Scenario: A group of scientists embarks on a dangerous mission to explore a wormhole leading to another dimension, encountering bizarre lifeforms and uncovering secrets that challenge the very fabric of reality.

   Recommended Artist: Denis Villeneuve

   Rewritten Prompt: Venture into the unknown depths of a mysterious wormhole, leading you to a parallel dimension filled with strange and terrifying lifeforms, as a team of intrepid scientists, unraveling the enigma of this otherworldly realm while confronting the horrifying implications it holds for our understanding of the universe.


8. Scenario: A battle-hardened soldier is awakened from cryogenic sleep centuries after Earth's defeat in a galactic war, forced to lead a desperate resistance against the invaders who now rule humanity's former home.

   Recommended Artist: Christopher Nolan

   Rewritten Prompt: Awaken from cryogenic slumber to discover that Earth has fallen to a malevolent alien force during your centuries-long nap, thrusting you into a perilous struggle to rally the remnants of humanity and mount a desperate resistance against the oppressive invaders who now hold dominion over your once-great homeland.


9. Scenario: A young pilot discovers they possess extraordinary powers when they are exposed to an energy source found within an abandoned spaceship, becoming embroiled in a cosmic conflict between good and evil.

   Recommended Artist: James Gunn

   Rewritten Prompt: Stumble upon a hidden energy source within an abandoned spaceship, unlocking incredible powers that catapult you into the middle of a grand cosmic struggle between forces of light and darkness, forcing you to choose sides and embrace your newfound abilities to save the universe from impending doom.


10. Scenario: A crew of space miners stumbles upon an abandoned alien city, uncovering dark secrets that threaten to tear apart their friendship and expose them to unspeakable horrors lurking in the shadows.

   Recommended Artist: Ridley Scott

   Rewritten Prompt: Unearth a long-forgotten alien city hidden beneath the surface of a distant asteroid, revealing shocking secrets that drive a wedge between your close-knit crew and expose you to unfathomable terror lurking in the darkness, challenging your sanity and testing the bonds of friendship.


--


I think having the ai do it in two separate steps gives better results.



> give me 10 senarios for dungeon and dragons images, they should revolve around a different charater class as the main character.   

1. A brave paladin stands resolute in a dimly lit crypt, their shining armor reflecting the flickering torchlight as they confront a horde of undead monstrosities in an epic battle to protect a sacred artifact.

2. An elusive rogue navigates through a treacherous maze of traps and puzzles within a hidden underground lair, their keen senses and agility helping them evade capture by a cunning rival thief.

3. A wise wizard delves into ancient tomes within a dusty library, seeking knowledge that could unlock the secrets of powerful magic and change the course of history forever.

4. A skilled ranger scouts the perilous wilderness, their sharp eyes spotting a rare herb amidst the dense foliage that could save a wounded ally from certain death.

5. A fearless barbarian charges headlong into a horde of orcs, their mighty axe cleaving through enemies with brutal efficiency as they fight to avenge a fallen comrade.

6. A cunning bard entertains a crowd of raucous tavern-goers, their enchanting music and captivating tales earning them both gold and valuable information for their next adventure.

7. A mysterious sorcerer meditates within a shadowy cave, drawing upon primal energies to unleash devastating spells that will ensure their survival against a terrifying dragon threat.

8. A loyal cleric tends to the wounds of injured allies, their divine magic and steadfast faith restoring hope amidst the darkness of a desperate battle against evil forces.

9. A stealthy monk prowls the rooftops of a bustling city, their swift movements and unparalleled agility allowing them to evade pursuers and gather crucial intel on a nefarious plot threatening the realm.

10. A wise druid communicates with the spirits of nature, seeking guidance from the ancient trees and whispering winds to help them protect a sacred grove from destructive forces.


> now, for each of those senarios rewrite it to be an awesome and detailed stable diffusion prompt and give a couple of artists that can do that art style best. 

1. In this captivating scene, we find ourselves in a dimly lit crypt, where a valiant paladin stands resolute amidst the flickering torchlight, their gleaming armor catching the light as they bravely confront a horde of undead creatures. Their determined expression and steadfast resolve are matched only by the intricate details of their armor, which exude an air of both strength and nobility. As they raise their mighty sword in defiance, the shadows around them seem to come alive with menacing figures, creating a sense of tension and drama that draws the viewer into the action. Shot using cutting-edge technology and rendered in breathtaking detail, this Stable Diffusion masterpiece showcases the artist's extraordinary talents and leaves a lasting impression on those who witness it. Through expert use of lighting and composition, the artwork transports us to a world of epic battles and timeless heroism, immortalizing the bravery of this noble warrior for generations to come. (Artists: James Gurney or Brom)

2. This stunning illustration takes us on a thrilling journey through a treacherous maze filled with deadly traps and puzzles, where a cunning rogue navigates with unparalleled agility and skill. Their sharp eyes and nimble movements are captured in exquisite detail, as they deftly evade capture by a rival thief hot on their trail. The vivid colors and intricate textures of the background serve to enhance the overall composition, creating a sense of depth and atmosphere that draws the viewer in. Shot using cutting-edge technology and rendered in breathtaking detail, this Stable Diffusion masterpiece showcases the artist's extraordinary talents and leaves a lasting impression on those who witness it. Through expert use of lighting and composition, the artwork transports us to a world of high-stakes adventure and daring escapes, immortalizing the resourcefulness of this enigmatic thief for generations to come. (Artists: Hiroyuki Imaishi or Ashley Wood)

3. In this mesmerizing portrait, we find ourselves within a dusty library, where a wise wizard delves into ancient tomes, seeking knowledge that could unlock the secrets of powerful magic and change the course of history forever. Their keen intellect and insatiable curiosity are captured in striking detail, as they pore over the mysterious texts and decipher hidden runes. The warm, inviting glow of the firelight serves to enhance the overall composition, casting dramatic shadows and highlighting key elements within the frame. Shot using cutting-edge technology and rendered in breathtaking detail, this Stable Diffusion masterpiece showcases the artist's extraordinary talents and leaves a lasting impression on those who witness it. Through expert use of lighting and composition, the artwork transports us to a world of arcane mysteries and limitless possibilities, immortalizing the wisdom of this esteemed scholar for generations to come. (Artists: Ralph Steadman or Thomas Kinkaid)

4. This captivating illustration takes us on a breathtaking journey through the dense wilderness, where a skilled ranger scouts the terrain with unparalleled precision and agility. Their keen eyes and sharp senses are captured in exquisite detail, as they spot a rare herb amidst the verdant foliage that could save a wounded ally from certain death. The vibrant colors and intricate textures of the landscape serve to enhance the overall composition, creating a sense of depth and wonder that draws the viewer in. Shot using cutting-edge technology and rendered in breathtaking detail, this Stable Diffusion masterpiece showcases the artist's extraordinary talents and leaves a lasting impression on those who witness it. Through expert use of lighting and composition, the artwork transports us to a world of natural beauty and survival instincts, immortalizing the resourcefulness of this intrepid explorer for generations to come. (Artists: Syd Mead or Alex Ross)

5. In this gripping scene, we find ourselves in the midst of a brutal battle against a horde of orcs, where a fearless barbarian charges headlong into danger, their mighty axe cleaving through enemies with brutal efficiency as they fight to avenge a fallen comrade. Their fierce determination and unyielding spirit are captured in stunning detail, as they face off against formidable foes and protect their allies with ferocious courage. The harsh, desolate landscape serves to enhance the overall composition, casting dramatic shadows and highlighting key elements within the frame. Shot using cutting-edge technology and rendered in breathtaking detail, this Stable Diffusion masterpiece showcases the artist's extraordinary talents and leaves a lasting impression on those who witness it. Through expert use of lighting and composition, the artwork transports us to a world of epic battles and primal rage, immortalizing the bravery of this fearsome warrior for generations to come. (Artists: Frank Frazetta or Jeff Easley)

6. This enchanting illustration takes us to a bustling tavern, where a charismatic bard entertains a crowd of raucous patrons, their captivating tales and enchanting music earning them both gold and valuable information for their next adventure. Their magnetic presence and expressive features are captured in exquisite detail, as they weave spellbinding stories and serenade the audience with haunting melodies. The warm, inviting glow of the firelight serves to enhance the overall composition, casting dramatic shadows and highlighting key elements within the frame. Shot using cutting-edge technology and rendered in breathtaking detail, this Stable Diffusion masterpiece showcases the artist's extraordinary talents and leaves a lasting impression on those who witness it. Through expert use of lighting and composition, the artwork transports us to a world of timeless storytelling and enchanting performances, immortalizing the allure of this talented entertainer for generations to come. (Artists: Jim Lee or Steve Rude)

7. In this suspenseful portrait, we find ourselves within a shadowy cave, where a mysterious sorcerer meditates, drawing upon primal energies to unleash devastating spells that will ensure their survival against a terrifying dragon threat. Their intense focus and otherworldly power are captured in stunning detail, as they channel the raw forces of nature and prepare to confront the monstrous beast. The eerie, foreboding atmosphere of the surroundings serves to enhance the overall composition, casting dramatic shadows and highlighting key elements within the frame. Shot using cutting-edge technology and rendered in breathtaking detail, this Stable Diffusion masterpiece showcases the artist's extraordinary talents and leaves a lasting impression on those who witness it. Through expert use of lighting and composition, the artwork transports us to a world of dark magic and elemental power, immortalizing the resolve of this enigmatic mage for generations to come. (Artists: Moebius or Bill Sienkiewicz)

8. In this heartwarming scene, we find ourselves amidst the chaos of a desperate battle against evil forces, where a loyal cleric tends to the wounds of injured allies, their divine magic and steadfast faith restoring hope amidst the darkness. Their compassionate touch and soothing presence are captured in exquisite detail, as they heal the broken bodies and lift the spirits of their fellow adventurers. The soft, ethereal glow of the healing light serves to enhance the overall composition, casting delicate shadows and highlighting key elements within the frame. Shot using cutting-edge technology and rendered in breathtaking detail, this Stable Diffusion masterpiece showcases the artist's extraordinary talents and leaves a lasting impression on those who witness it. Through expert use of lighting and composition, the artwork transports us to a world of spiritual guidance and selfless devotion, immortalizing the benevolence of this devoted healer for generations to come. (Artists: Brian Froud or David Mack)

9. In this thrilling illustration, we find ourselves on the rooftops of a bustling city, where a stealthy monk prowls with swift movements and unparalleled agility, evading pursuers and gathering crucial intel on a nefarious plot threatening the realm. Their graceful leaps and fluid motions are captured in exquisite detail, as they navigate the treacherous terrain and remain one step ahead of their adversaries. The vibrant colors and intricate textures of the urban landscape serve to enhance the overall composition, creating a sense of depth and excitement that draws the viewer in. Shot using cutting-edge technology and rendered in breathtaking detail, this Stable Diffusion masterpiece showcases the artist's extraordinary talents and leaves a lasting impression on those who witness it. Through expert use of lighting and composition, the artwork transports us to a world of high-speed chases and deadly secrets, immortalizing the cunning of this elusive assassin for generations to come. (Artists: Ashley Wood or Ralph Steadman)

10. In this serene portrait, we find ourselves within a sacred grove, where a wise druid communicates with the spirits of nature, seeking guidance from ancient trees and whispering winds to help protect the sanctity of this hallowed place from destructive forces. Their deep connection to the natural world and reverence for life are captured in striking detail, as they converse with ethereal beings and draw upon the wisdom of the ages. The lush, verdant beauty of the surroundings serves to enhance the overall composition, casting delicate shadows and highlighting key elements within the frame. Shot using cutting-edge technology and rendered in breathtaking detail, this Stable Diffusion masterpiece showcases the artist's extraordinary talents and leaves a lasting impression on those who witness it. Through expert use of lighting and composition, the artwork transports us to a world of spiritual harmony and timeless wisdom, immortalizing the wisdom of this esteemed guardian for generations to come. (Artists: Thomas Kinkaid or Brian Froud)


--


Good luck and enjoy! 


No comments:

Post a Comment