Any documented examples of using DeepSpeed without trainer?

iwatog · January 25, 2023, 7:50pm

I would like to be able to use DeepSpeed with NLP Transformers but I don’t want to use Trainer. Are there any examples of this available?

muellerzr · January 25, 2023, 7:52pm

You can try with Accelerate instead! DeepSpeed

Topic		Replies	Views
Exact difference between Transformers' and Accelerate's DeepSpeed integrations? DeepSpeed	5	971	February 13, 2024
Difference between using the Trainer class vs Accelerate library DeepSpeed	0	1029	June 27, 2023
Besides writing your own training loop, is there any other advantage for using it with deepspeed? 🤗Accelerate	2	753	July 4, 2023
Deepspeed script launcher vs accelerate script launcher for TRL DeepSpeed	0	415	December 25, 2023
Using deepspeed script launcher vs accelerate script launcher for TRL 🤗Accelerate	3	2226	January 24, 2024