Diffusers documentation
ErnieImageTransformer2DModel
快速入门
推理
使用扩散流水线
适配器与个性化
优化与扩展
模块化 Diffusers
训练与微调
资源
贡献
API
主要类
模块化
加载器
模型
概述AutoModel
ControlNets
Transformers
AceStepTransformer1DModelAllegroTransformer3DModelAnyFlowFARTransformer3DModelAnyFlowTransformer3DModelAuraFlowTransformer2DModelBriaFibo2Transformer2DModelBriaFiboTransformer2DModelBriaTransformer2DModelChromaTransformer2DModelChronoEditTransformer3DModelCogVideoXTransformer3DModelCogView3PlusTransformer2DModelCogView4Transformer2DModelConsisIDTransformer3DModelCosmos3OmniTransformerCosmosTransformer3DModelDiTTransformer2DModelEasyAnimateTransformer3DModelErnieImageTransformer2DModelFlux2Transformer2DModelFlux3Transformer2DModelFluxTransformer2DModelGlmImageTransformer2DModelHeliosTransformer3DModelHiDreamImageTransformer2DModelHunyuanDiT2DModelHunyuanImageTransformer2DModelHunyuanVideo15Transformer3DModelHunyuanVideoTransformer3DModelIdeogram4Transformer2DModelJoyImageEditPlusTransformer3DModelJoyImageEditTransformer3DModelKandinsky 6 TransformersKandinskyS2VTransformer3DModelKrea2Transformer2DModelLatteTransformer3DModelLongCatImageTransformer2DModelLTX2VideoTransformer3DModelLTXVideoTransformer3DModelLumina2Transformer2DModelLuminaNextDiT2DModelMiniMaxH3ImageTransformer2DModelMiniMaxH3Transformer3DModelMiniMaxMusic3Transformer1DModelMochiTransformer3DModelMotifVideoTransformer3DModelOmniGenTransformer2DModelOvisImageTransformer2DModelPAN2Transformer3DModelPixArtTransformer2DModelPriorTransformerQwenImage21Transformer2DModelQwenImageTransformer2DModelRFD4ProteinaAutoencoderRFD4ProteinaTransformerSanaTransformer2DModelSanaVideoTransformer3DModelSanaWMLTX2RefinerTransformer3DModelSanaWMTransformer3DModelSD3Transformer2DModelSkyReelsV2Transformer3DModelStableAudio3DiTModelStableAudioDiTModelTransformer2DModelTransformerTemporalModelWanAnimate2Transformer3DModelWanAnimateTransformer3DModelWanTransformer3DModelZImageTransformer2DModel
UNets
VAEs
管道
调度器
内部类
ErnieImageTransformer2DModel
用于 ERNIE-Image 中类图像数据的 Transformer 模型。
用于类图像数据的 Transformer 模型,来自 ERNIE-Image-Turbo。
ErnieImageTransformer2DModel
class diffusers.ErnieImageTransformer2DModel
< source >( hidden_size: int = 3072num_attention_heads: int = 24num_layers: int = 24ffn_hidden_size: int = 8192in_channels: int = 128out_channels: int = 128patch_size: int = 1text_in_dim: int = 2560rope_theta: int = 256rope_axes_dim: typing.Tuple[int, int, int] = (32, 48, 48)eps: float = 1e-06qk_layernorm: bool = True )
forward
< source >( hidden_states: Tensortimestep: Tensortext_bth: Tensortext_lens: Tensorreturn_dict: bool = True )
参数
- hidden_states(形状为
(batch_size, in_channels, height, width)的torch.Tensor)— 输入的hidden_states。 - timestep (
torch.LongTensor) — 用于指示去噪步骤。 - text_bth (
torch.Tensor) — 要使用的条件文本嵌入(根据提示等输入条件计算得出的嵌入),形状为(batch_size, text_length, embed_dims)。 - text_lens (
torch.Tensor) — 用于构建注意力掩码的每个样本的文本序列长度。 - return_dict (
bool,可选,默认为True) — 是否返回~models.transformer_2d.Transformer2DModelOutput而不是普通的元组。
ErnieImageTransformer2DModel 的前向方法。