Diffusers documentation
ErnieImageTransformer2DModel
시작하기
추론
확산 파이프라인 사용
어댑터 및 개인화
최적화 및 확장
모듈형 Diffusers
학습 및 파인튜닝
리소스
기여하기
API
주요 클래스
모듈형
로더
모델
개요AutoModel
ControlNets
Transformers
AceStepTransformer1DModelAllegroTransformer3DModelAnyFlowFARTransformer3DModelAnyFlowTransformer3DModelAuraFlowTransformer2DModelBriaFibo2Transformer2DModelBriaFiboTransformer2DModelBriaTransformer2DModelChromaTransformer2DModelChronoEditTransformer3DModelCogVideoXTransformer3DModelCogView3PlusTransformer2DModelCogView4Transformer2DModelConsisIDTransformer3DModelCosmos3OmniTransformerCosmosTransformer3DModelDiTTransformer2DModelEasyAnimateTransformer3DModelErnieImageTransformer2DModelFlux2Transformer2DModelFlux3Transformer2DModelFluxTransformer2DModelGlmImageTransformer2DModelHeliosTransformer3DModelHiDreamImageTransformer2DModelHunyuanDiT2DModelHunyuanImageTransformer2DModelHunyuanVideo15Transformer3DModelHunyuanVideoTransformer3DModelIdeogram4Transformer2DModelJoyImageEditPlusTransformer3DModelJoyImageEditTransformer3DModelKandinsky 6 TransformersKandinskyS2VTransformer3DModelKrea2Transformer2DModelLatteTransformer3DModelLongCatImageTransformer2DModelLTX2VideoTransformer3DModelLTXVideoTransformer3DModelLumina2Transformer2DModelLuminaNextDiT2DModelMiniMaxH3ImageTransformer2DModelMiniMaxH3Transformer3DModelMiniMaxMusic3Transformer1DModelMochiTransformer3DModelMotifVideoTransformer3DModelOmniGenTransformer2DModelOvisImageTransformer2DModelPAN2Transformer3DModelPixArtTransformer2DModelPriorTransformerQwenImage21Transformer2DModelQwenImageTransformer2DModelRFD4ProteinaAutoencoderRFD4ProteinaTransformerSanaTransformer2DModelSanaVideoTransformer3DModelSanaWMLTX2RefinerTransformer3DModelSanaWMTransformer3DModelSD3Transformer2DModelSkyReelsV2Transformer3DModelStableAudio3DiTModelStableAudioDiTModelTransformer2DModelTransformerTemporalModelWanAnimate2Transformer3DModelWanAnimateTransformer3DModelWanTransformer3DModelZImageTransformer2DModel
UNets
VAE
Pipelines
스케줄러
내부 클래스
ErnieImageTransformer2DModel
ERNIE-Image의 이미지형 데이터용 Transformer 모델입니다.
ERNIE-Image-Turbo의 이미지형 데이터용 Transformer 모델입니다.
ErnieImageTransformer2DModel
class diffusers.ErnieImageTransformer2DModel
< source >( hidden_size: int = 3072num_attention_heads: int = 24num_layers: int = 24ffn_hidden_size: int = 8192in_channels: int = 128out_channels: int = 128patch_size: int = 1text_in_dim: int = 2560rope_theta: int = 256rope_axes_dim: typing.Tuple[int, int, int] = (32, 48, 48)eps: float = 1e-06qk_layernorm: bool = True )
forward
< source >( hidden_states: Tensortimestep: Tensortext_bth: Tensortext_lens: Tensorreturn_dict: bool = True )
매개변수
- hidden_states (
torch.Tensor, shape(batch_size, in_channels, height, width)) — 입력hidden_states. - timestep (
torch.LongTensor) — 디노이징 단계를 나타내는 데 사용됩니다. - text_bth (
torch.Tensor) — 사용할 조건부 텍스트 임베딩(프롬프트와 같은 입력 조건에서 계산된 임베딩)으로, 크기는(batch_size, text_length, embed_dims)입니다. - text_lens (
torch.Tensor) — 어텐션 마스크를 구성하는 데 사용되는 샘플별 텍스트 시퀀스 길이. - return_dict (
bool, 선택 사항, 기본값True) — 단순 tuple 대신~models.transformer_2d.Transformer2DModelOutput를 반환할지 여부.
ErnieImageTransformer2DModel의 forward 메서드입니다.