Skip to content

Conversation

zty-king
Copy link
Contributor

@zty-king zty-king commented Sep 27, 2025

Before submitting

  • Lint code. If there are lint issues, please format the code first.
# Install and register `pre-commit` in the project folder
pip install pre-commit && pre-commit install

# Process previous code files separately
pre-commit run --file XXXX.py
  • Add test cases into tests folder. If there are codecov issues, please add tests cases first.

PR types

Bug fixes

PR changes

Others

Description

当前的optimizer_init会读取metadata,然后根据其中存在的优化器状态来过滤,判断是否要创建当前optimizer内的参数的优化器状态;然而存在一个问题,例如,当fuse_qkv->q,k,v这种情况时,原来的metadata文件,是没有q,k,v的优化器状态的,但是却需要做转换,所以也要初始化q,k,v的优化器状态,因此,不能在此处做过滤,而是在后续做过滤。
对应paddle修改的链接:PaddlePaddle/Paddle#75566

Copy link

paddle-bot bot commented Sep 27, 2025

Thanks for your contribution!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants