Skip to content

Wan Animate Pipeline#367

Open
csgoogle wants to merge 11 commits intomainfrom
sagarchapara/wananimate-pipeline
Open

Wan Animate Pipeline#367
csgoogle wants to merge 11 commits intomainfrom
sagarchapara/wananimate-pipeline

Conversation

@csgoogle
Copy link
Copy Markdown
Collaborator

No description provided.

…sharding

- wan_pipeline_animate.py: Full JAX/Flax port of diffusers WanAnimatePipeline
  supporting both "animate" (pose+face) and "replace" (background+mask) modes,
  segmented inference with overlap conditioning, and optional CFG.
- image_processor.py: WanAnimateImageProcessor with letterbox resize (vs
  center-crop) and vae_scale_factor*spatial_patch_size-aligned dimensions for
  the reference character image.
- transformer_wan_animate.py: Added nnx.with_partitioning sharding annotations
  to patch_embedding, pose_patch_embedding, proj_out, scale_shift_table, and
  all FlaxWanAnimateFaceBlockCrossAttention projections; added
  nn.with_logical_constraint on the input hidden_states.
- wan_utils.py: Added load_wan_animate_transformer with motion-encoder-aware
  weight loading (skip weight→kernel rename and transpose for FlaxMotionConv2d/
  FlaxMotionLinear; map activation.bias→act_fn.bias for FusedLeakyReLU).
@github-actions
Copy link
Copy Markdown

@csgoogle csgoogle marked this pull request as ready for review April 6, 2026 16:33
@csgoogle csgoogle requested a review from entrpn as a code owner April 6, 2026 16:33
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant