Summary (Overview)

• UniEvo-VL is a novel self-evolving framework for unified multimodal models (MMMs) that enables models to improve their image generation capabilities without external supervision, using their own critique feedback as privileged information.
• The framework leverages on-policy self-distillation (OPSD) where a single model acts as both teacher and student: the student sees only the original prompt, while the teacher conditions on a critique-derived revised prompt, with training matching their denoising distributions along the student's sampling trajectories.
• Key results: On GenEval, the method improves from 0.747 to 0.808 (and up to 0.882 with a stronger external critic GPT-5.6-Luna); on GenEval2 Soft-TIFA, from 32.97 to 35.53.
• The approach demonstrates that training and inference-time reflection are complementary: improvements persist even when both models are given additional reflection opportunities.
• Gains are concentrated on hard prompts where the base model initially struggles, with small regressions (1–4 points on a 0–100 scale) on easy prompts.

Introduction and Theoretical Foundation

Background and Motivation

Unified multimodal models (MMMs) combine visual generation and understanding in a single system, creating an unprecedented opportunity for self-improvement without external supervision. These models can identify discrepancies between their generated images and given instructions, then use this self-feedback for future improvements.

The work builds on the widely accepted hypothesis that verification is easier than generation (Hübotter et al., 2026; Zhao et al., 2026). Prior approaches to self-improvement include:

• Selecting self-generated outputs for supervised fine-tuning and preference optimization
• Reconstructing self-generated interactions into captioning, judgment, and reflection tasks
• Training models to refine images conditioned on explicit reflections
• Aggregating multimodal assessments into rewards for test-time policy optimization

Key Gap

Prior approaches do not directly distill corrective conditioning into the original-prompt generation policy along its own sampling trajectories. A critique like "restore the missing object" describes a desired correction but does not specify how the generator should change its intermediate denoising predictions. UniEvo-VL bridges this gap.

Theoretical Foundation

The framework is based on on-policy self-distillation (OPSD) with privileged information. The core idea: a critique-conditioned prompt serves as privileged information visible only to the teacher policy, enabling dense state-wise supervision over the student's sampling trajectories.

Methodology

Problem Formulation

Given a multimodal model $M_\theta$ with two modes:

$$I = M^{\text{gen}}_\theta(p, \epsilon), \quad (c, a) = M^{\text{und}}_\theta(p, I)$$

where $I$ is the generated image, $p$ is the user prompt, $\epsilon \sim \mathcal{N}(0, I)$ is random noise, $c$ is the discrepancy critique, and $a \in \{0,1\}$ is a binary acceptance decision.

Corrective Conditioning and Experience Acquisition

1. Critique generation: The understanding mode assesses the generated image against the prompt across semantic, text, and quality axes.
2. Prompt synthesis: For rejected images ($a=0$), a revised prompt is synthesized:

$$\tilde{p} = M^{\text{und}}_\theta(p, c)$$

3. Post-revision verification (optional): Regenerate $I' = M^{\text{gen}}_\theta(\tilde{p}, \epsilon)$ and verify it passes a second assessment against the original prompt $p$ before accepting the training triple $(p, \tilde{p}, \epsilon)$.

On-Policy Self-Distillation

The training objective matches teacher and student denoising distributions at each state along the student's trajectory:

$$\mathcal{L}(\theta) = \mathbb{E}_{(p, \tilde{p}, \epsilon) \sim \mathcal{A}_k, \tau \sim M^{\text{gen}}_\theta(p, \epsilon), s_j \sim \tau} \mathcal{D}\left(M^{\text{gen}}_\theta(\text{sg}[s_j], p), \text{sg}\left[M^{\text{gen}}_{\bar{\theta}}(\text{sg}[s_j], \tilde{p})\right]\right)$$

where $\mathcal{A}_k$ is the finalized training set, $\mathcal{D}(\cdot, \cdot)$ measures discrepancy (KL or JS divergence), $\text{sg}(\cdot)$ denotes stop-gradient, and $\bar{\theta}$ is an EMA version of $\theta$.

Flow-Based Implementation

For the flow-based Qwen-Image model, the local prediction is a velocity with classifier-free guidance:

$$v^{(g)}_\theta(z, \sigma, p) = v_\theta(z, \sigma, \emptyset) + g\left[v_\theta(z, \sigma, p) - v_\theta(z, \sigma, \emptyset)\right], \quad g = 4$$

The per-transition loss is:

$$\ell^{\text{flow}}_j(\theta) = \frac{(\Delta\sigma_j)^2}{2d}\left\|M^{\text{gen}}_\theta(\text{sg}[s_j], p) - \text{sg}\left[M^{\text{gen}}_{\bar{\theta}}(\text{sg}[s_j], \tilde{p})\right]\right\|^2_2$$

Only the generator's LoRA parameters are updated; the critic remains fixed. The EMA teacher uses decay $\beta = 0.999$.

Empirical Validation / Results

Experimental Setup

• Model: Qwen-Image-2512 (generation) with Qwen3-VL-8B (critique/synthesis)
• Tasks: GenEval (553 prompts), GenEval2 (800 prompts), OCR text rendering (1,018 prompts)
• Training: 20 denoising steps, CFG 4.0, LoRA rank/alpha 16/16, learning rate $3 \times 10^{-4}$, noisy timestep fraction 0.3 (six highest-noise transitions selected)

Main Results

Table 1: Performance of UniEvo-VL

Training vs. Reflection Complementarity

Table 2: Direct generation and reflection before and after training

Key findings:

• Training improves direct generation on every metric across all benchmarks
• Reflection remains useful after training (GenEval reflection gain decreases from +0.078 to +0.030, but GenEval2 gains remain substantial)
• Under the same one-reflection protocol, UniEvo-VL exceeds the reflected base model on all benchmarks, indicating capability beyond inference-only prompt revision

Effect of Critic Capacity

Using GPT-5.6-Luna as an external critic yields larger gains in specific categories:

• GenEval2 two-object composition: +1.21 (Luna) vs. +0.28 (Qwen)
• GenEval2 color: +1.02 (Luna) vs. +0.37 (Qwen)
• Position and attribute scores improve only modestly under either configuration

Difficulty Analysis

Gains concentrate on prompts the base model initially struggles with (Hard group: +19% to +67% normalized gains), while Easy prompts show small regressions (−1% to −4%). This is consistent with the acquisition mechanism, which only collects training signal from drafts that require revision.

Theoretical and Practical Implications

Theoretical Contributions

1. Critique-conditioned on-policy self-distillation: The framework provides a principled way to convert visual critique into dense, state-wise supervision without requiring corrected-image targets, scalar rewards, or differentiable image rewards.

2. Separation of learned improvements from inference-time correction: The paired evaluation methodology distinguishes gains retained in the model parameters from benefits of reflection at inference time, showing they are complementary.

3. Critic capacity as a ceiling: The results demonstrate that stronger critics enable higher self-evolving ceilings, suggesting the model's verification capability bounds its improvement potential.

Practical Implications

• Self-improvement without external supervision: The method enables MMMs to improve from their own feedback, reducing reliance on larger teacher models or human annotations.
• Post-revision verification is crucial: Without verification, training signals can be unreliable (GenEval2 shows intermediate decline, OCR fluctuates). With verification, 10–21% of acquisition attempts are accepted, providing more stable learning.
• Task-dependent gains: Improvements are not uniform—text rendering shows mixed results across configurations, highlighting the need for careful recipe design.
• Aesthetic bias accumulation: The feedback-prompt design for realism introduces stylistic biases (muted colors, plain backgrounds) that could accumulate during self-evolution, warranting caution in prompt design.

Conclusion

UniEvo-VL introduces a self-evolving framework that uses on-policy self-distillation to transform visual critique into dense supervision for multimodal model improvement. Key takeaways:

1. Training improves direct generation on compositional benchmarks (GenEval: 0.747→0.808; GenEval2: 32.97→35.53) and can be further boosted with stronger external critics (GenEval: 0.882 with GPT-5.6-Luna).

2. Training and reflection are complementary: the combination achieves the best results, and training provides persistent improvements beyond inference-only revision.

3. Gains concentrate on hard prompts, with small regressions on easy ones—a pattern driven by the acquisition mechanism focusing on generation failures.

4. Post-revision verification provides more reliable training signals and more stable learning trajectories.

Future Directions

The authors suggest exploring:

• Time-varying teacher schedules (beyond fixed EMA decay)
• More complex regularization for SFT alternatives (preliminary SFT attempts were unsuccessful)
• Understanding which capabilities a vision-language model needs for steady self-evolution improvement
• Addressing the aesthetic bias accumulation observed in feedback-prompt design