Integrate Lumina-T2X

[PommesPeter]

Model/Pipeline/Scheduler description

Lumina-T2X is a text-to-any generation model. Our model is capable of generating multiple modalities, most notably image generation. Currently, our image generation supports any resolution, achieving stunning results. We will unify various modalities and integrate them into diffusers, including controlnet, Lora fine-tune, compositional generation, etc.

Paper: Lumina-Next
Paper: Lumina-T2X

Open source status

• The model implementation is available.
• The model weights are available (Only relevant if addition is not a scheduler).

Provide useful links for the implementation

Weight v1: https://huggingface.co/Alpha-VLLM/Lumina-Next-T2I
Weight v2: https://huggingface.co/Alpha-VLLM/Lumina-Next-SFT
Code: https://github.com/Alpha-VLLM/Lumina-T2X/
HF Space: https://huggingface.co/spaces/Alpha-VLLM/Lumina-Next-T2I

[PommesPeter]

We are currently preparing our code to integrate diffusers.

[xhinker]

This model is SO cool

[yiyixuxu]

@PommesPeter look forward to the PR!

[PommesPeter]

PR here: #8652