fairseq/examples/roberta/README.pretraining.md

[yucoian]

When I followed this tutorial for pretraining the Roberta on a 16GPUs machine, I found it didn't output a step result, like a loss, ppl etc. However, the GPUs and CPUs utilization both are 100%. Is there any solutions?

[ngoyal2707]

Can you please share the logs?
GPUs being stuck exactly at 100% and not doing anything could mean different things, it could mean one or more GPU oomed in distributed training.

[lematt1991]

Closing due to inactivity. Please open a new issue if you are still having problems.