Skip to content

Conversation

wenhuach21
Copy link
Contributor

@wenhuach21 wenhuach21 commented Sep 25, 2025

  • support 16 bits in options
  • support gguf
  • support mixed data type
  • gguf group_size fallback
  • check gguf scale_dtype
  • layer_config ut
  • support FP8 model
  • AutoSchme could also be patched by group_size, etc
  • gguf could not be mixed with other formats
  • support non_str dataset

wenhuach21 and others added 30 commits September 25, 2025 14:14
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant