Skip to content

Multi-GPU support for finetuner.py #134

Open
@wbrown

Description

@wbrown

Currently, our finetuner.py script only supports 1 GPU; this limits its utility. It should be fairly straightforward to add HuggingFaceaccelerate support or deepspeed multi-GPU support to the finetuner-workflow.

Metadata

Metadata

Assignees

Labels

No labels
No labels

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions