Diffusers documentation

ErnieImageTransformer2DModel

Hugging Face's logo
Join the Hugging Face community

and get access to the augmented documentation experience

to get started

ErnieImageTransformer2DModel

用于 ERNIE-Image 中类图像数据的 Transformer 模型。

用于类图像数据的 Transformer 模型,来自 ERNIE-Image-Turbo。

ErnieImageTransformer2DModel

class diffusers.ErnieImageTransformer2DModel

< >

( hidden_size: int = 3072num_attention_heads: int = 24num_layers: int = 24ffn_hidden_size: int = 8192in_channels: int = 128out_channels: int = 128patch_size: int = 1text_in_dim: int = 2560rope_theta: int = 256rope_axes_dim: typing.Tuple[int, int, int] = (32, 48, 48)eps: float = 1e-06qk_layernorm: bool = True )

forward

< >

( hidden_states: Tensortimestep: Tensortext_bth: Tensortext_lens: Tensorreturn_dict: bool = True )

参数

  • hidden_states(形状为 (batch_size, in_channels, height, width) 的 torch.Tensor)— 输入的 hidden_states。
  • timestep (torch.LongTensor) — 用于指示去噪步骤。
  • text_bth (torch.Tensor) — 要使用的条件文本嵌入(根据提示等输入条件计算得出的嵌入),形状为 (batch_size, text_length, embed_dims)。
  • text_lens (torch.Tensor) — 用于构建注意力掩码的每个样本的文本序列长度。
  • return_dict (bool,可选,默认为 True) — 是否返回 ~models.transformer_2d.Transformer2DModelOutput 而不是普通的元组。

ErnieImageTransformer2DModel 的前向方法。

Update on GitHub