Deep Learning for Natural Language Processing: Choosing the Right GPU for the Job

Ever wonder what types of neural networks are used to create modern translation, and NLP apps? Transformers are the latest state of the art NLP technology, however they simply won't train well on certain GPU models. Find out the best GPU for training modern NLP networks including Transformers.

Get the Right Tools and Best Practices for Deep Learning NLP Model Training

This site is protected by reCAPTCHA and the Google Privacy Policy and Terms of Service apply.

What's in the paper?

  • A short overview about Transformer NLP models including what they are, why they work so well, and best practices for training modern transformers.
  • What type of GPU gets the right results? We trained 3 different transformers of different sizes on different GPU types, see the results.
  • System recommendations: Are you ready to train? We have some of the best NLP training systems in the industry, for all budgets.
  • Resources: A curated list of recommended readings for further learning about NLP and transformer models.