Skip to content

Commit

Permalink
Update character concept art workflow and add new JSON for FLUX Girl …
Browse files Browse the repository at this point in the history
…without pupils
  • Loading branch information
fire committed Dec 27, 2024
1 parent c741f9d commit 8c288fd
Show file tree
Hide file tree
Showing 3 changed files with 40 additions and 5 deletions.
5 changes: 3 additions & 2 deletions decisions/20241220-character-concept-art-creation.md
Original file line number Diff line number Diff line change
Expand Up @@ -72,14 +72,13 @@ docker run -it -p 7860:7860 --gpus all registry.hf.space/jeffreyxiang-trellis:la
### 6. Iterative Refinement

The process emphasizes iterative refinement of the prompt based on results from Shoebox or TRELLIS. This cyclical process ensures the generation of optimized concept art and sprites.

### Workflow

1. **Define Core Concept:** Establish the character's essential characteristics.
2. **Craft Optimized Prompt:** Create a concise, descriptive prompt using Easy Diffusion.
3. **Generate and Evaluate:** Produce images and assess their suitability.
4. **Remove Background:** Use Krita to remove the background.
5. **Erase Face:** Use Krita to erase the facial features (eyebrows, nose, mouth).
5. **Erase Face:** Use the Grounded-SAM model to identify and remove facial features (eyebrows, nose, mouth) and paint the area skin color.
6. **Create Sprites:** Utilize Shoebox to generate sprites from the alpha'd image.
7. **(Optional) 3D Conversion:** Utilize TRELLIS to generate 3D models.
8. **Iterate and Refine:** Adjust the prompt based on the evaluation.
Expand All @@ -100,6 +99,7 @@ The process emphasizes iterative refinement of the prompt based on results from
- Any specific style or details from your concept art
- [ ] **Refine in Krita:**
- Use the Magic Wand tool to remove the background.
- Use the Grounded-SAM model to identify and remove facial features, then paint the area a solid color.
- Use brush tools to clean up any artifacts or unwanted details. Pay close attention to the hands and fingers.

**2. Sprite Creation and Rigging**
Expand Down Expand Up @@ -186,3 +186,4 @@ Status: Draft
9. [Shoebox](https://renderhjs.net/shoebox/)
10. [Creative Image Enhancer/Upscaler](https://github.com/pinokiofactory/clarity-refiners-ui)
11. [Project-Babble/ProjectBabble](https://github.com/Project-Babble/ProjectBabble)
12. [schananas/grounded_sam](https://replicate.com/schananas/grounded_sam)
6 changes: 3 additions & 3 deletions decisions/attachments/FLUX_Girl_Magical_Staff_01.json
Original file line number Diff line number Diff line change
@@ -1,14 +1,14 @@
{
"numOutputsTotal": 256,
"seed": 3731300378,
"seed": 698122729,
"reqBody": {
"prompt": "A young woman reaching both sides. She stands barefoot against a coloured background. She has realistic proportions featuring long legs, a slender waist, and balanced shoulders—her short, slightly messy brown hair frames expressive brown eyes. A medium bust balances her slim figure. Her legs are slightly apart with a gentle bend at the knees. Rendered in a clean anime style with soft shading, emphasizing smooth shapes, proper proportions, and balanced anatomy. Multiple consistent front views are provided on the reference sheet.",
"prompt": "A young woman reaching both sides. She stands barefoot against a coloured background. She has realistic proportions featuring long legs, a slender waist, and balanced shoulders—her short, slightly messy brown hair frames expressive brown eyes. A medium bust balances her slim figure. Her legs are slightly apart with a gentle bend at the knees. Rendered in a clean anime style with soft shading, emphasizing smooth shapes, proper proportions, and balanced anatomy.",
"negative_prompt": "",
"active_tags": [],
"inactive_tags": [],
"width": 1024,
"height": 1024,
"seed": 3731300378,
"seed": 698122729,
"num_inference_steps": 8,
"guidance_scale": 1,
"distilled_guidance_scale": 1.1,
Expand Down
34 changes: 34 additions & 0 deletions decisions/attachments/FLUX_Girl_No_Pupils_01.json
Original file line number Diff line number Diff line change
@@ -0,0 +1,34 @@
{
"numOutputsTotal": 256,
"seed": 3627537984,
"reqBody": {
"prompt": "A young woman reaching both sides. She has no pupils. She stands barefoot against a coloured background. She has realistic proportions featuring long legs, a slender waist, and balanced shoulders—her short, slightly messy brown hair frames expressive brown eyes. A medium bust balances her slim figure. Her legs are slightly apart with a gentle bend at the knees. The image is rendered in a clean anime style with soft shading.",
"negative_prompt": "",
"active_tags": [],
"inactive_tags": [],
"width": 1024,
"height": 1024,
"seed": 3627537984,
"num_inference_steps": 8,
"guidance_scale": 1,
"distilled_guidance_scale": 1.1,
"preserve_init_image_color_profile": true,
"upscale_amount": "4",
"latent_upscaler_steps": "0",
"sampler_name": "forge_flux_realistic",
"scheduler_name": "beta",
"use_stable_diffusion_model": "flux1-schnell-fp8",
"clip_skip": true,
"tiling": "",
"use_vae_model": "ae",
"use_controlnet_model": "",
"control_filter_to_apply": "",
"control_alpha": 1,
"use_lora_model": ["CharacterDesign-FluxV2"],
"lora_alpha": ["0.8"],
"num_outputs": 4,
"stream_image_progress": false,
"show_only_filtered_image": true,
"output_format": "png"
}
}

0 comments on commit 8c288fd

Please sign in to comment.