Files
qwen-image/backlog.md
2026-06-30 04:05:18 +02:00

12 KiB
Raw Blame History

Backlog

Shipped (recent)

Studio / Generate UX:

  • Crop reaches the bottom edge (toolbar moved to top); choose copy-vs-replace ("Save as copy")
  • Paste-to-group image shows immediately (no refresh needed)
  • Generated images store the prompt used (and pose name) in the DB
  • Edit / add / delete poses from the Generate tab (persists to poses.md)
  • flag beta poses in ui — beta badge + editable beta flag
  • Custom prompt field auto-grows; keeps list="promptHistory" autocomplete
  • Remove-BG persists has_background + refreshes static data (survives reload)
  • Invert-α button (fixes wrong-segment background removal)
  • zien van de geselecteerde images in de prompt — multi-ref thumbs visible; click to deselect
  • Landing-page group merge syncs immediately (synchronous static write)
  • Rotate ±90° in the studio

Pose tools (rtmlib / RTMPose, 2D):

  • Pose skeleton preview overlay in studio
  • Draggable joints to refine/explore a pose
  • Find similar poses across the library (translation/scale/mirror-invariant; poses_index.json)
  • Gesture presets in pose toolbar (T-pose, wave, arms raised, hands on hips, turn ±45°)
  • "Generate ▸" in pose toolbar — renders skeleton as OpenPose image → Qwen image2 guide → new generation
  • "Orbit all" button in Generate tab selects all 6 absolute camera angles at once

Scenery:

  • source_refs now stores all references: person image + video name + extra ref image
  • /scenery/library endpoint — all scenery grouped by source video
  • "Previous scenery" panel in Scenery tab — browse & reuse scenery from any group, grouped by video

Open

  • remove "clean-db" button from UI- studio. But perhaps check daily for inconsistencies and show identified issues in a "Archive/Trash" view perhaps seperate html?
  • OUTPAINT feature/ crop/ pad call qwen
  • the pad/crop i think should allow also percentage values, since we looking in scaled images.
  • valid multi-input way to facilite the 2.5/3d orbit
  • Refine a POSE, so we have the ref (source) image + pose prompt. use the tour GPU + api to refine the pose with user instruction. Then use the source image + updated prompt to generate a new image.
  • introduce in the custom padding features + auto crop afterwards
  • in car.html - studio view we have a action to pad the image we also have this feature in the "Generate" tab.
  • add a checkbox (or similar) to instruct the image-model to outpaint the padded area. Also implement the outpainting functionality in edit_api.py, we can instruct qwen-image. We can have the same functionality in the "Generate" tab when no prompt is given but a padding is given.
  • we have a bug that when pressing the ui-action "duplicate" and "pad" the browser needs to refresh before we see the result. Other actions like generating from pose do not hae this bug, fix the bug and boy scout adjecnt actions if they are missing the required technical follow up. Fix the bug for the features.
  • In the "Generate" tab, the CUSTOM prompt is shown twice, above POSES and statically always in view in the right bottom. Remove the statically CUSTOM prompt from the UI.
  • The Generate button is always visible in the "Generate" tab, however we cannot jump to it via keyboard. Add a keyboard shortcut to jump to the Generate button "G" or simialler.
  • remove the "set prompt"
  • after pose generation, sometimes small black area's occur in the subject. ( presumably the _apply_transparency_black_bg addition)
  • studio view - orbit tab - view sometimes seems accelerated, liek the tiems is set twice. And most of all a step in the turn seems in in the wrong direction. maybe its an image-ordering bug, but i think its because the image-model generated the step 240deg into the wrong direction
  • Improve the UI/UX for the end-user experience. Where effort is low and impact is high.
  • add an action + key-bind to move a the current selected image in the filmstrip to the end of the filmstrip. ( so also do the actual reordering of the image )
  • animate limbs along keyframe curves (true motion)
  • 3D-aware rotation / "circling around" with depth estimation
  • camera-orbit batch with consistent lighting across views
  • extract a frame from a clip (scenery)
  • faceswap defaults nothing enabled, see jobs even when refresh
  • rating based pose, thumbs up/down find good/bad poses easier, (pairs well with the new pose index — could weight similar-pose results by rating)
  • after orbit generation, the images cannot be duplicated, set preferred, archived or otherwise modified server response "{"detail":"Not Found"}"
  • after orbit generation, dont generate the mp4, but do show the orbit orbit-full-img-wrap and render the alpha images 1fps ourselves.
  • allow re-ordering of the images in the orbit generated frames
  • sometimes the UI renders two orbits in the same orbitFullViewer, must be a timer not being cleared in the ui
  • The UI wants to car.html:2817 GET file:///mnt/zim/tour-comfy/output/_turntable/up_34e48ffb/turntable.jpg?t=1782562827857 net::ERR_FILE_NOT_FOUND, often want to show the wireframe - pose
  • Fixed: statically serve turntable and orbit preview files from filesystem, not via server (avoid GET /output/... 304 Not Modified log spam)
  • Check face similarity in a group of images.
  • Fixed: implement a tag-system for images, will be used to filter, group, sort and search images. Obvious tags are VISIBLE, ARCHIVED, LIKE, DISLIKE, RATED, GROUP_ANCHOR, GROUP_MEMBER, BACKGROUND etc..
  • Fixed: mark image as source (with dedicated 'S' keybind)
  • Fixed: introduce multiple filmstrips (Group, Hidden, Source, Archived with drag-and-drop & bulk selection actions).
  • samengestelde outpaint featurue lijkt niet goed te werken, but individual steps work perfect.
  • regenerate a single orbit - pose
  • when generating a known pose, we should know roughly the image ratio. Make a pose-table, when a pose is generated store the wireframe and meta data
  • we can rate an image if its OVER21, manually now in the UI. this is fine, however we want to backfill this TAG for evey image
  • backfill, people-count, 21+, IS_COMPLETE, RESTRAINT
  • the wireframe / videos / sub-clips worden niet direct weergegeven
  • make the faceswap preview mode fixed size instead of 50% we dont know how big the original clip is. just 470p or something.
  • include 2 filter(s) in the filmstrip for VIDEO and ORBIT only show them if the sub-set is not empty.
  • add a 2nd visible filmstrip to easy move items from one to another strip in the UI
  • on the landing page we now just play all images of an group. However if the orbit generaition is complete. I want to circulate those images , (this basically is a new filmstrip feature)) so we set the orbit in a filmstrip by default, but can modify it. Also we want the face to be visible in the landing page and the most prominent (most 3d alike full body with femine descriptors)) image
  • still looking for that killer-feminine shot, one image that would show most characteristics of a nude female including eyes.
  • scrolling past the Scne - STANDALONE / UPLOADED IMAGES still is unpleasant. I think all images get completly resized and 100x recalculated when moving the scrollbar there.
  • introduce bulk select in trash.html
  • tab "SAM" checkerboard icon to studio-view overlay
  • in the landing page hide SOURCE images
  • als het input bestand real is, dan gaat echt elke opvolging perfect. supe plaatjes.. (3 kwart maakt de opvolgende plaatjes ook altijd engaging.. top down (vanwege ruimte))

refine

  • when refresh page, we lose track of current jobs running.
  • generating poses themself should use the adviced dimensions rather than the base image reference.
  • introduce a like/dislike base system for images/group to determine the sort order (and more), would also dislike the pose
  • creating scenery should keep both video-frame + ref images as references, we only see 1 image now. fixed
  • gesture ideas for future (require ControlNet / OpenPose conditioning):
  • add expand preset for sqaure image

notes

pose bestaat gewoon uit meerdere delen, camera, scenery + addition poses: hyper realistic, lighting, detailled skin etc.. see last generations for better results. focus op head + sam2.hyria seg + mesh (3D / mesh — pose editor is currently 2D only) sam2 saifrail, connected pixels from mid? als invertor? poses assignment bij de camera positie generaties create disk 128gb 70b dolphin uncencored op server.

  • Use own insight for further refinement of these improvements. fix queen.mp moet gegenereerd worden door de htmlbuilder, niet via de webserver images.json group-names.json names.json groups.json config videos

generieke stappen

  1. 3ref image HQ detail
  2. 3ref image MERGE
  3. 3ref straight on- head-on - looking viewer

ok cool, Let do some work in the "Info" tab. Pose information GAZE: - BODY: - SUBJECTS: - TRACKING

  1. we basically always see GAZE: - BODY: - etc.. (perhaps we only mis it passing thru in the frontend)

  2. We would like to see information about the face, completeness of the anatomy (perhaps an indication on how much to outpaint to make it anatomically correct), camera/view oriention. Objects found in the image. We use this information later on to refine the prompts

  3. we can move some actions (or duplicate) the actions into the "studioAngleBar". It already got included the Expand canvas icon. we can ad the icons for Pose, Duplicate, Crop...(auto-crop) and Crop

  4. add a new video filter, and hide video by default in the Group Active -- feel free to furhter optimize the studio view "info" tab

  5. for every image we have an entry in the database, keep for every image an entry with the same filename in the same folder but ending with json. in the json we store the functional representation of the database record and keep it up-to-date when data changes. . In the app we looking at groups of images, so also keep track of the group, this include the additional functional features we show in the UI for that group with the images it includes. Keep the data up-to-date in the backend when data changes, also update the referring data files.

  6. introduce a rating feature. to thumps up or thumbs down an image. When an image gets athamps up or thumbs down add a tag in the db and show it in the UI. Also the default filter in "Group Active" should filter out the images with a negative rating, but also include a filter that would show only images with a positive rating. The rating should also cascade (calculated? perhaps) into the poses. So images with pose that have good rating will define the rating of a pose, same for the image group (use a clever normalized formula ) over the positive and negative thumbs to compare it with another group

  7. introduce (?cosine) similarity variation indexes in a group. Also for the faces in a group. To keep track of authenticity of a person in a group

  8. In the Design tab we will refine new poses. Often we want to reverse ingineer an existing image. Find a way/add a llm-model or reuse the VID or wd tagger or w/e to get something similar from an image we that we provide to qwen to generate images. We could also use this feature in the Info tab to suggest an updated description of the image.

  9. Given a POSE, we want to estimate the image-size-ratio of the corresponding end-pose-skeleton to estimate if we need to pad the image before the actual image generation, try to see if we can fit this feature in somewhere, for now we will only do a suggestion based on that information.

  10. make the faceswap preview mode fixed size instead of 50% we dont know how big the original clip is. just 470p or something standard.

  11. on the landing page we now just play all images of an group. However if the orbit generaition is complete. I want to circulate (semi-video-view) those images (small in a corner or something of that group card) (and filtered out of the rest of the circulating images.) (same for the face feature to show that static on the group card.)