Skip to content

Fix prompt padding mask per sample#71

Open
seasideGargantua wants to merge 1 commit into
dreamzero0:mainfrom
seasideGargantua:fix-prompt-emb-padding-mask
Open

Fix prompt padding mask per sample#71
seasideGargantua wants to merge 1 commit into
dreamzero0:mainfrom
seasideGargantua:fix-prompt-emb-padding-mask

Conversation

@seasideGargantua
Copy link
Copy Markdown

Summary

  • fix prompt embedding padding cleanup to zero only the current sample's padded tokens
  • prevent one sample's sequence length from masking later prompt tokens for every batch item

Testing

  • python -m compileall -q groot/vla/model/dreamzero/action_head/wan_flow_matching_action_tf.py

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant