Wan2.1 Text to Image - Wan2.1 을 이용한 이미지 생성 (Comfyui)

Wan 2.1 은 텍스트나 이미지를 입력하면 고품질의 영상을 만들어주는 AI 비디오 생성 모델입니다.

지금은 Wan2.2 모델이 출시되었다. 보통 Wan2.1 은 Video 를 생성할 수있는 오픈소스 모델로 Comfyui 에서 Wan2.1 또는 Wan2.2 를 통하여 Text 나 Image 를 가지고 쉽게 Video 를 생성할 수 있는데, 여기서는 Wan2.1 모델을 이용하여 Text to Image 를 생성해 볼 려고 한다.

Wan2.1 모델을 이용하여 이미지를 생성해 보면, 상당히 품질이 뛰어나며 생생한 사실적인 이미지를 만들어준다. 다만 모델의 크기가 커서 이미지 생성 속도가 느린 단점이 있다.

Wan2.1 로 만든 이미지

위의 이미지를 보면 상당히 고품질 이미지로 얼굴의 솜털마저 자연스럽게 보이며, 좀 더 사실적인 사진 느낌을 나타내 준다.

1. Wan2.1 을 사용하기 위한 필요 모델들 다운로드

wan2.1_t2v_14B_fp8_scaled : 여기서는 이 모델을 사용하여 이미지를 만들어 본다. 이 모델의 다운 로드는 Hugging Face 에 있기 때문에 구글에서 검색하여 Hugging Face 에 서 다운 받아 기존의 Flux 모델 설치된 폴더에 설치하면 된다.
CLIP 모델 : umt5_xxl_fp8_e4m3fn_scaled.safetensors 이것을 다운 받아 설치하여 사용한다. 다운 받을 곳은 ( https://comfyanonymous.github.io/ComfyUI_examples/wan/ ) 에 들어가면 다운 받을 수 있다.
VAE : wan_2.1_vae.safetensors 이 모델을 다운받아 사용해야 한다.
Lora 모델 : Wan2.1_T2V_14B_FusionX_LoRA 와 Wan21_T2V_14B_lightx2v_cfg_step_distill_lora_rank32 두 종류를 구글 검색하여 다운 받아 사용한다. 물론 Lora 파일이 없어도 이미지 생성이 가능하지만 생성 시간이 좀 더 걸린다. ( https://huggingface.co/vrgamedevgirl84/Wan14BT2VFusioniX/tree/main/FusionX_LoRa ), ( https://huggingface.co/Kijai/WanVideo_comfy/blob/main/Wan21_T2V_14B_lightx2v_cfg_step_distill_lora_rank32.safetensors ) 참조.
Sampler 와 Scheduler 는 euler , Simple 를 사용해도 되지만, 좀 더 고품질을 위하여 "res_2s"와 "bong_tangent" 를 사용하면 좋다. 두 샘플러와 스케줄러는 각각 "Res4Lyf" 커스텀 노드를 설치하면 사용가능하다.

2. Workflow

Wan2.1 용 text to image Workflow

Workflow는 특별히 복잡하지 않는 다른 이미지 생성형 Workflow 와 유사하다.

step 은 8 step, cfg 는 1 로 하여 생성, 가급적 이미지 사이즈는 1536 x 1536 이 좋다.

필요한 모델들을 정상적으로 다운하고 설치 하였으면 실행해 보면 된다.

3. 이미지 생성 비교

Prompt : masterpiece,best quality,amazing quality,absurdres,

black hair,short hair,bob cut,straight hair,hair between eyes,nail polish,

1girl,petite, tall, slim, slender, small head,

wearing black microskirt,white_shirt,black blazer,red lace thighhighs, business_suit, red panties, long legs, high heel, confidently pose,

She bites her lower lip slightly while gazing seductively at the camera,

cross arms,

simple background,studio background,shadows,looking at viewer,front view,facing viewer,seductive smile,dutch angle,full body,

Flux 이미지

Wan2.1 이미지

Wan2.1 이미지가 좀 더 사실적인 이미지 느낌이다.

Prompt : Create a stunning pyrography artwork on a wooden canvas in brown frame,depicting a beautiful korean lady,

a green, knitted dress designed with a halter neck style. The fabric has a mesh-like, open-knit pattern that creates a breathable look. It is form-fitting, accentuating the curves of the body, and extends to mid-thigh in length. The halter neck is secured with ties, adding a playful touch to the overall design. This dress appears suited for casual summer outings or beachwear.

The pyrography technique uses finely burned lines and shading to create a realistic yet artistic representation of the woman, with varying depths and tones to emphasize the outline of woman. The background remains minimalist of flower symbol, allowing the intricate details of the dress to stand out, evoking a serene and timeless aesthetic.

Flux 이미지

Wan2.1 이미지

이미지를 확대해 보면 Wan2.1 이미지가 좀 더 디테일하고 고품질인것을 알 수 있다.

이미지의 스타일은 각자의 취향이기 때문에 어느것이 더 낫다고 단정하기는 어렵다.

Prompt : A mesmerizing and intricate work of art featuring a water droplet-shaped design that embodies the purity and tranquility of nature. Within the transparent droplet, A sophisticated black-and-white silhouette illustration featuring an elegant woman at the center. Her long, flowing hair is gently swept by the wind, creating a sense of movement and grace. half body drawing,

Her body is depicted using smooth, flowing curves, emphasizing elegance and fluidity.

Surrounding and seamlessly intertwining with her silhouette are organic botanical elements, including delicate leaf-like shapes and vine-like curves, symbolizing harmony between humanity and nature. filled with ivy plants, leaves and red flowers. The composition maintains a natural rhythm with soft, fluid lines, enhancing the sense of unity.

The strong contrast between the black silhouette and the white background creates a bold and visually striking effect, making the design both minimalistic and sophisticated.

The smooth, curved edges of the droplet contrast beautifully with the soft, atmospheric blend of colors, creating a visually captivating and ethereal composition.

Flux 이미지

Wan2.1 이미지

개인적으로 이번 이미지는 Flux 에서 만든 이미지가 더 prompt 에 적합하다고 생각된다.

그렇지만 Wan2.1 이미지도 선명하게 잘 만들어 졌다.

Prompt : This image is a stylized representation merging feminine allure with romantic elements. The composition features a woman's face rendered in delicate black line art, with a vibrant red rose positioned above her hair, symbolizing love and beauty. text "Love" in heart, side view,An intricate arrangement of swirling vines adds a touch of fluidity. In the foreground, a red heart and an ampersand, embellished with a bow, contribute depth, while a subtle starry texture on the heart evokes a magical quality. The visual style draws inspiration from modern graphic design, combining elegance with minimalist aesthetics.

Flux 이미지

Wan2.1 이미지

두 이미지 모두 Text 표시도 정확하게 만들어 준다. Flux 가 좀 더 예술적이고 추상적인 느낌이 들지만 , Wan2.1 도 다른 느낌으로 좋은 이미지를 만들어 준다.

Prompt : illustration of a beautiful woman,

A highly realistic 8K rendering of a cozy mountain retreat in winter. A charming log cabin with warm, golden light glowing from the windows, nestled among snow-covered pine trees. Soft smoke gently rises from the chimney, blending into the crisp evening air. A wooden porch with a rustic rocking chair and a small snow-covered table adds to the cozy charm. Tiny lanterns hang along the porch, casting a soft, welcoming glow. Light snowflakes drift peacefully from the sky.

Sitting at the front door is a beautiful woman with long, wavy hair, wearing a cozy oversized sweater, warm leggings, and fluffy boots. She holds a steaming cup of coffee with both hands, gently blowing on it. Wisps of hot steam curl upward from the cup, glowing softly in the cold air, adding to the sense of warmth. Her expression is serene and content as she gazes at the snowy landscape. The frosted windows behind her reveal a crackling fireplace and festive decorations, enhancing the warmth of the scene. The background features a serene winter landscape with a soft pink and orange sunset, adding a dreamy and tranquil atmosphere.

Flux 이미지

Wan2.1 이미지

같은 프롬프트 다른 느낌의 두 이미지 이다.

Prompt : animation style, animation character,A stunning woman with long, wavy, chestnut-brown hair sitting elegantly on a marble staircase.detailed eyes, perfect eyes, ((deep violet eyes:1.4)), She wears a short, white, sleeveless dress with intricate floral lace embroidery, designed with a slit that subtly reveals her leg, exuding sophistication and allure. Her pose is confident and poised, with one leg bent close to her chest and the other elegantly extended downward, showcasing the graceful curves of her figure. Her arms rest lightly on her raised knee, adding to her natural and captivating demeanor. She wears gold high-heeled shoes with delicate ankle straps, perfectly complementing her outfit. The background features classic architectural elements, such as stone columns and steps, enhancing the timeless elegance of the scene. Soft, natural lighting bathes her in a warm glow, accentuating her flawless skin and delicate facial features.

Wan2.1 이미지

Prompt : masterpiece, ultra-detailed , best quality, Clear focus, shadow, anime-style,

Sensual Pose on Calm Waters,

This enchanting silhouette scene features a romantic woman against a softly illuminated background.

soft ambient lighting, beautiful korean woman kneeling on a reflective lake surface, water gently splashing around her, wet lace bodysuit clinging to her body, long wavy hair falling over her shoulders, confident and intense expression, gentle water droplets rising as she moves, soft blue and golden lighting creating dramatic reflections, sensual and elegant, water reflecting the sky and her delicate silhouette, subtle mist creating an aura of mystery.((looking away, face up, half close eyes:1.4)), sunshine on the face,

Wan2.1 이미지

이 블로그 검색