Skip to content

Conversation

ArthurZucker
Copy link
Collaborator

What does this PR do?

As we are moving towards having a dynamic weight loader, we need to have a simple from_pretrained call.
This should help

@ArthurZucker ArthurZucker changed the title [from_pretrained] Refactor from_pretrained: unbloat, separate and simplify? [from_pretrained] Small efactor from_pretrained: move around unrelated stuff Oct 8, 2025
@ArthurZucker ArthurZucker changed the title [from_pretrained] Small efactor from_pretrained: move around unrelated stuff [from_pretrained] Small refactor from_pretrained: move around unrelated stuff Oct 8, 2025
@HuggingFaceDocBuilderDev

The docs for this PR live here. All of your documentation changes will be reflected on that endpoint. The docs are available until 30 days after the last update.

Copy link
Member

@Cyrilvallez Cyrilvallez left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Nice, will allow us to have much better visibility over what's happening!

ArthurZucker and others added 5 commits October 9, 2025 11:19
@ArthurZucker ArthurZucker force-pushed the dynamic-weight-loader branch from cd32b80 to 155b44e Compare October 13, 2025 06:08
@ArthurZucker ArthurZucker force-pushed the dynamic-weight-loader branch from e8e48ef to 06515b6 Compare October 13, 2025 07:31
Copy link
Contributor

[For maintainers] Suggested jobs to run (before merge)

run-slow: fbgemm_fp8, finegrained_fp8

@BlackSamorez
Copy link
Contributor

Can you really delete _process_model_after_weight_loading?
I'm getting TypeError: Can't instantiate abstract class FPQuantHfQuantizer with abstract method _process_model_after_weight_loading on fp_quant and AQLM tests now.

@BlackSamorez
Copy link
Contributor

Oh, fixed by #41613, I see.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants