Speeding up PyTorch models with multiple GPUs

A large proportion of machine learning models these days, particularly in NLP, are published in PyTorch. This article covers the following

  • Setting up a Google Cloud machine with PyTorch (for procuring a Google cloud machine use this link)
  • Testing parallelism on multi GPU machines with a toy example
  • Code changes required to make model…

--

--

--

Machine learning practitioner

Love podcasts or audiobooks? Learn on the go with our new app.

Get the Medium app

A button that says 'Download on the App Store', and if clicked it will lead you to the iOS App store
A button that says 'Get it on, Google Play', and if clicked it will lead you to the Google Play store
Ajit Rajasekharan

Ajit Rajasekharan

Machine learning practitioner

More from Medium

PyTorch and Tensorflow in Natural Language Processing Pipeline_Data Preprocessing

Review: MT-DNN (NLP)

All of the [ PyTorch | Transformers ]

Overview — ZeroGen, Efficient Zero-shot Learning via Dataset Generation