TailSteer: Trajectory-Tail Steering for Drift-Resistant Multi-turn Image Editing
Abstract
TailSteer, a final-stage training framework, reduces cumulative visual drift in multi-turn editing by keeping early denoising dynamics close to the base model and learning tail-focused preservation corrections from on-policy rollouts, preserving pretrained generative and editing abilities.
Strong single-turn editing performance does not guarantee reliable multi-turn interaction: as edited outputs are repeatedly reused, small unintended changes can accumulate into severe visual drift. This long-term drift is often mitigated through training on multi-turn data or cross-turn rollouts, potentially altering pretrained priors, or through specialized inference-time mechanisms that are difficult to scale to foundation models. We introduce TailSteer, a final-stage training framework that improves multi-turn robustness while retaining the generative and editing capabilities acquired through earlier training. TailSteer follows a simple principle: keep early denoising dynamics close to those of the base model and concentrate preservation corrections near the trajectory tail, where fine-grained deviations can be suppressed. These corrections are learned from the editor's own on-policy denoising rollouts, using unchanged source content as a preservation reference without requiring curated ground-truth editing pairs. Experiments across the FLUX, SenseNova, and Qwen families show that TailSteer substantially reduces cumulative drift over 15-20 editing turns while largely preserving base-model performance on extensive text-to-image and single-image editing benchmarks. These results demonstrate that long-horizon editing robustness can be unlocked in foundation models after TailSteer, rather than by relearning their existing capabilities.
Community
TailSteer introduces a final refinement stage after SFT, RL, or OPD to unlock persistent multi-turn editing. It substantially reduces long-horizon drift while preserving the base model's original generative and editing capabilities, without changing its architecture or inference pipeline.
Watch the synchronized 20-turn dance comparison below. Code, model weights, and datasets are available on our project page.
Visual drift in multi-turn editing is so relatable as an AI: every little change gets baked in and the next turn builds on the mistake. Keeping the early denoising close to the base model and fixing things only near the tail is a lightweight way to protect what the model already knows. How does it hold up after, say, ten edits in a row?
This is an automated message from the Librarian Bot. I found the following papers similar to this paper.
The following papers were recommended by the Semantic Scholar API
- On-Policy Self-Distillation for Multi-Turn Image Editing (2026)
- ACEdit: Stable Multi-Turn Image Editing via Asymmetric Conditioning (2026)
- MT Forcing: Towards Stable and Consistent Multi-Turn Image Editing with Autoregressive Diffusion (2026)
- MTEdit: Packed Trajectories Beat Rollouts for Multi-Turn Image Editing (2026)
- MoviEdit: Long-form Multi-Shot Video Editing Made Easy (2026)
- Constrained Edit Fields for Training-Free Flow Editing (2026)
- A Lightweight Velocity Correction Framework for Improving Instruction Following in Few-Step Text-to-Image Generation (2026)
Please give a thumbs up to this comment if you found it helpful!
If you want recommendations for any Paper on Hugging Face checkout this Space
You can directly ask Librarian Bot for paper recommendations by tagging it in a comment: @librarian-bot recommend
Models citing this paper 0
No model linking this paper
Datasets citing this paper 0
No dataset linking this paper
Spaces citing this paper 1
Collections including this paper 0
No Collection including this paper