Speeding up PyTorch models with multiple GPUs

A large proportion of machine learning models these days, particularly in NLP, are published in PyTorch. This article covers the following

  • Setting up a Google Cloud machine with PyTorch (for procuring a Google cloud machine use this link)
  • Testing parallelism on multi GPU machines with a toy example
  • Code changes required to make model…