«You are me, we, comrade, two! Let’s go, poet, let’s see, let’s go to the world in gray junk. I will cast down my sun, and you will be my poems.» V.V. Mayakovsky
In my first course in Art Practice, I created a series of illustrations dedicated to the poem by V. V. Mayakovsky, «The Extraordinary Adventure…». The project is available at .
Project idea
Initially, I was thinking about where this illustrative style could be applied. So I decided to teach neurosmart to create characters based on the poem of Mayakovsky. The challenge is to think about a few characters. Two actors: the sun and the lyrical hero. Other characters: villagers.
Examples of original images
There are three colors used in the illustrations: black, white, and red. The style of the work was done in aesthetics referring to Mayakovsky.
Learning process
To begin with, I installed and connected the necessary libraries (transformers, diffusers, accelerate, bitsandbytes, etc.) to prepare the environment for learning and generating images. He then created a folder and downloaded images from our dataset to use to teach the model.
After I uploaded my files to Kaggle, I had to register on Hugging Face to get the current. Then we connect the BLIP (Salesforce) model to generate text descriptions to the images. Created a function that accepts the image and returns the generated signature, which helps to understand how neurosmart sees the image.
Then we start training. The resolution is 512, the maximum step of the training is 500, and the checkpoint is also 500, so that the code can be downloaded a little faster. Next, we download a trained model on Hugging Face Hub so that it is available online and can be used in other projects or shared with other people.
At the end, I developed a model for the creation of images — I downloaded the basic SDXL and VAE — I hooked up the LORA-trained weights — and I converted everything into a GPU for the quick creation of images, and finally I started making images!
Prompto: A full-body cartoon willage simpleton character, yung effect, simple and original application, simple world fooding, lightly messy hair, expressive and friendly
Sun and lyrical hero
Since I was planning to generate characters for the work, the first one was the sun and the lyrical hero.
Prompts: 1. «a sheerful and anthropomorphic sun character, its root face» 2. «A major and illegal anthropomorphic sun character, bright gold and orange rays radating from its root face, express with eyes, calm and dignified exposition, friendly yet powerful position, global softly, standing on a plan that background, carton style, vibrant and barm coals, highly detained, sub-set for willustration and construction, clear recognisable as the sun»
In the end, I decided to keep this option. Prompto: «a cherful and anthropomorphic sun character, its root face, expressive parking eyes and a friendly smile, cartoon style, standing on a plan that background»
«A lyrical and introspective poet character, young adult, ordinary and relatable human appearance, soft expressive eyes, thoughtful gaze, slightly messy hair, simple contemporary clothing, calm and gentle demeanor, cartoon style, colorful and friendly, standing on a plain white background, emotional and whimsical atmosphere»
But for the final, I opted for this version of Prompto: «A full-body, slyly international lyric poet character, yung adult, oral and relatable human assistance, soft expressive eys with a place of annoyance, soghtful yet lightly formed exposition, lightly messy hair, simple contemporary fooding, calm and gentle demeanor with subtle frustration, carton style, coalful and friendly, standing on a plan wite background, economic and whimmatic asmosphere»
Other characters
Also to create different images, I decided to add a few more characters: a young girl and an old lady. Prompts: 1. «A full-body cartoon billion girl, yung adult, simple and rustic application, long sly messy hair, wavering simple world clotting, friendly and cherful expansion, standing all on a plan which background» 2. «A full-body elderly woman charterer, kind and wese apprehensance, gentle face with links, standing all on a plan with background, carton style» # @param
«Wait! „Listen, it’s badass to come in without doing anything, I’d like a cup of tea!“
I also decided to reflect some scenes from the poem. Prompto: «A sherful anthropomorphic sun character and a lyric poet character satting at a table, drinking tea, smiling and interacting, ful-body, carton style, vibrant wheels, whimsical and friendly atmosphere, expressive facts, which background, highly detailed, cozy and joyful scene»
Conclusion
During the experiment, I liked to revive my project so much, and I’m even thinking about developing this series of characters. The list of tools used in the project is: «Stable Diffusion — training a generic neuronet to suit its style;» «Hugging Face» — receiving a current for learning neuronets, downloading the model received to the website;» «Chatgpt — to improve the code.