This commit is contained in:
mike
2026-06-26 17:28:17 +02:00
parent 37bf5281c3
commit 61cd2e559b
14 changed files with 451 additions and 3418 deletions

View File

@@ -33,6 +33,50 @@ Scenery:
## Open
- remove "clean-db" button from UI- studio. But perhaps check daily for inconsistencies and show identified issues in a "Archive/Trash" view perhaps seperate html?
- ✅ OUTPAINT feature/ crop/ pad call qwen
- the pad/crop i think should allow also percentage values, since we looking in scaled images.
- valid multi-input way to facilite the 2.5/3d orbit
- Refine a POSE, so we have the ref (source) image + pose prompt. use the tour GPU + api to refine the pose with user instruction. Then use the source image + updated prompt to generate a new image.
- introduce custom padding features - auto crop afterwards
- in car.html - studio view we have a action to pad the image we also have this feature in the "Generate" tab.
- add a checkbox (or similar) to instruct the image-model to outpaint the padded area. Also implement the outpainting functionality in edit_api.py, we can instruct qwen-image. We can have the same functionality in the "Generate" tab when no prompt is given but a padding is given.
- ✅ we have a bug that when pressing the ui-action "duplicate" and "pad" the browser needs to refresh before we see the result. Other actions like generating from pose do not hae this bug, fix the bug and boy scout adjecnt actions if they are missing the required technical follow up. Fix the bug for the features.
- ✅ In the "Generate" tab, the CUSTOM prompt is shown twice, above POSES and statically always in view in the right bottom. Remove the statically CUSTOM prompt from the UI.
- The Generate button is always visible in the "Generate" tab, however we cannot jump to it via keyboard. Add a keyboard shortcut to jump to the Generate button "G" or simialler.
- remove the "set prompt"
- after pose generation, sometimes small black area's occur in the subject. ( presumably the _apply_transparency_black_bg addition)
- studio view - orbit tab - view sometimes seems accelerated, liek the tiems is set twice. And most of all a step in the turn seems in in the wrong direction. maybe its an image-ordering bug, but i think its because the image-model generated the step 240deg into the wrong direction
- Improve the UI/UX for the end-user experience. Where effort is low and impact is high.
- Use own insight for further refinement of these improvements.
- animate limbs along keyframe curves (true motion)
- 3D-aware rotation / "circling around" with depth estimation
- camera-orbit batch with consistent lighting across views
- ✅ extract a frame from a clip (scenery)
- faceswap defaults nothing enabled, see jobs even when refresh
- rating based pose, thumbs up/down find good/bad poses easier, (pairs well with the new pose index — could weight similar-pose results by rating)
- after orbit generation, the images cannot be duplicated, set preferred, archived or otherwise modified server response "{"detail":"Not Found"}"
- after orbit generation, dont generate the mp4, but do show the orbit orbit-full-img-wrap and render the alpha images 1fps ourselves.
- allow re-ordering of the images in the orbit generated frames
- sometimes the UI renders two orbits in the same orbitFullViewer, must be a timer not being cleared in the ui
-
## refine
- when refresh page, we lose track of current jobs running.
- generating poses themself should use the adviced dimensions rather than the base image reference.
- introduce a like/dislike base system for images/group to determine the sort order (and more), would also dislike the pose
- ✅ creating scenery should keep both video-frame + ref images as references, we only see 1 image now. ✅ fixed
- gesture ideas for future (require ControlNet / OpenPose conditioning):
## notes
pose bestaat gewoon uit meerdere delen, camera, scenery + addition
poses: hyper realistic, lighting, detailled skin etc.. see last generations for better results.
focus op head + sam2.hyria seg + mesh (3D / mesh — pose editor is currently 2D only)
sam2 saifrail, connected pixels from mid? als invertor?
poses assignment bij de camera positie generaties
create disk 128gb 70b dolphin uncencored op server.
fix queen.mp
moet gegenereerd worden door de htmlbuilder, niet via de webserver
images.json
@@ -40,54 +84,4 @@ group-names.json
names.json
groups.json
config
videos
extract a frame from a clip (scenery)
faceswap defaults nothing enabled, see jobs even when refresh
pose bestaat gewoon uit meerdere delen, camera, scenery + addition
focus op head + sam2.hyria seg + mesh (3D / mesh — pose editor is currently 2D only)
sam2 saifrail, connected pixels from mid? als invertor?
poses assignment bij de camera positie generaties
poses: hyper realistic, lighting, detailled skin etc.. see last generations for better results.
create disk 128gb 70b dolphin uncencored op server.
rating based pose, thumbs up/down find good/bad poses easier
(pairs well with the new pose index — could weight similar-pose results by rating)
when refresh page, we lose track of current jobs running.
generating poses themself should use the adviced dimensions rather than the base image reference.
introduce a like/dislike base system for images/group to determine the sort order (and more)
- would also dislike the pose
creating scenery should keep both video-frame + ref images as references, we only see 1 image now. ✅ fixed
gesture ideas for future (require ControlNet / OpenPose conditioning):
- animate limbs along keyframe curves (true motion)
- 3D-aware rotation / "circling around" with depth estimation
- camera-orbit batch with consistent lighting across views
# backlog2
- remove "clean-db" button from UI- studio. But perhaps check daily for inconsistencies and show identified issues in a "Archive/Trash" view perhaps seperate html?
- OUTPAINT feature/ crop/ pad call qwen
- the pad/crop i think should allow also percentage values, since we looking in scaled images.
- valid multi-input way to facilite the 2.5/3d orbit
- Refine a POSE, so we have the ref (source) image + pose prompt. use the tour GPU + api to refine the pose with user instruction. Then use the source image + updated prompt to generate a new image.
- introduce custom padding features - auto crop afterwards
in car.html - studio view we have a action to pad the image we also have this feature in the "Generate" tab.
1) add a checkbox (or similar) to instruct the image-model to outpaint the padded area. Also implement the outpainting functionality in edit_api.py, we can instruct qwen-image. We can have the same functionality in the "Generate" tab when no prompt is given but a padding is given.
2) we have a bug that when pressing the ui-action "duplicate" and "pad" the browser needs to refresh before we see the result. Other actions like generating from pose do not hae this bug, fix the bug and boy scout adjecnt actions if they are missing the required technical follow up. Fix the bug for the features.
3) In the "Generate" tab, the CUSTOM prompt is shown twice, above POSES and statically always in view in the right bottom. Remove the statically CUSTOM prompt from the UI.
4) The Generate button is always visible in the "Generate" tab, however we cannot jump to it via keyboard. Add a keyboard shortcut to jump to the Generate button "G" or simialler.
5) remove the "set prompt"
Improve the UI/UX for the end-user experience. Where effort is low and impact is high.
Use own insight for further refinement of these improvements.
videos