# Distributed GPU training not working

**URL:** <https://discuss.huggingface.co/t/distributed-gpu-training-not-working/17469>\
**Category:** 🤗Accelerate\
**Created:** [May 3, 2022, 12:46pm UTC](https://discuss.huggingface.co/t/distributed-gpu-training-not-working/17469 "2022-05-03T12:46:48Z")\
**Posts on this page:** 3\
**Page:** 1

<div class="post-metadata">

**Author:** ![rishikesh](https://avatars.discourse-cdn.com/v4/letter/r/a9a28c/32.png) [@rishikesh](https://discuss.huggingface.co/u/rishikesh)\
**Post date:** [May 3, 2022, 12:46pm UTC](https://discuss.huggingface.co/t/distributed-gpu-training-not-working/17469/1 "2022-05-03T12:46:48Z")

</div>

I have made config file using ‘accelerate config’, I gave below parameters :

> In which compute environment are you running? ([0] This machine, [1] AWS (Amazon SageMaker)): \>0  
> Which type of machine are you using? ([0] No distributed training, [1] multi-CPU, [2] multi-GPU, [3] TPU):  
> 2  
> How many different machines will you use (use more than 1 for multi-node training)? [1]:  
> 2  
> What is the rank of this machine (from 0 to the number of machines - 1 )? [0]:  
> 1  
> What is the IP address of the machine that will host the main process?  
> 172.31.27.4 (private ip address of AWS machine)  
> What is the port you will use to communicate with the main process?  
> 8000  
> Do you want to use DeepSpeed? [yes/NO]: NO  
> Do you want to use FullyShardedDataParallel? [yes/NO]: NO  
> How many processes in total will you use? [1]: 2  
> Do you wish to use FP16 or BF16 (mixed precision)? [NO/fp16/bf16]: NO

and then execute  
accelerate launch train.py

 ![image](https://us1.discourse-cdn.com/hellohellohello/original/2X/2/29e7d114777c8aaf45319b8024a6c70cca381b28.png)  
It shows above warnings and gets stuck. I waited for more than 30 minutes but no output. What am I doing wrong ? Also, do I need to provide public ip address ? or private ip address of the AWS machine am using ?

---

<div class="post-metadata">

**Author:** ![dydavide](https://avatars.discourse-cdn.com/v4/letter/d/22d042/32.png) [@dydavide](https://discuss.huggingface.co/u/dydavide)\
**Post date:** [November 29, 2023, 8:19am UTC](https://discuss.huggingface.co/t/distributed-gpu-training-not-working/17469/2 "2023-11-29T08:19:47Z")

</div>

Did you fix this issue?

---

<div class="post-metadata">

**Author:** ![muellerzr](https://sea2.discourse-cdn.com/hellohellohello/user_avatar/discuss.huggingface.co/muellerzr/32/21583_2.png) [@muellerzr](https://discuss.huggingface.co/u/muellerzr)\
**Post date:** [November 30, 2023, 1:50pm UTC](https://discuss.huggingface.co/t/distributed-gpu-training-not-working/17469/3 "2023-11-30T13:50:25Z")

</div>

If using multinode you need a config file on each node, one with rank `0` one with rank `1`