PYTORCH

End to End Deep Learning with PyTorch

PyTorch is a widely used, open source deep learning platform used for easily writing neural network layers in Python enabling a seamless workflow from research to production. Based on Torch, PyTorch has become a powerful machine learning framework favored by esteemed researchers around the world. PyTorch is primarily developed by Facebook's artificial-intelligence research group, and Uber's "Pyro" software for probabilistic programming is built on it.



PyTorch Capabilities & Features

  • Tensor computation (similar to numpy) with strong GPU acceleration
  • Deep Neural Networks built on a tape-based autodiff system
  • Python-First approach, allows popular libraries and packages to be used for crafting neural network layers
  • torch.distributed backend allows scalable distributed training and performance



Why Use PyTorch for Deep Learning?

PyTorch is extremely powerful for creating computational graphs. Compared to Tensorflow's static graph, PyTorch believes in a dynamic graph. Instead of first having to define the entire computation graph of the model before running your model (as in Tensorflow), in PyTorch, you can define and manipulate your graph on-the-fly.This feature is what makes PyTorch a extremely powerful tool for researcher, particularly when developing Recurrent Neural Networks (RNNs).



Source: github.com/pytorch/pytorch

The PyTorch Ecosystem

The PyTorch Ecosystem offers a rich set of tools and libraries to support the development of AI applications. Featured projects include:



ALLEN NLP

An open-source NLP research library, built on PyTorch.



ELF

A platform for game research with AlphaGoZero/AlphaZero reimplementation.



FAST.AI

Simplifying training fast and accurate neural nets using modern best practices.



GLOW

A ML compiler for Neural Network hardware accelerators.



GPYTORCH

A Gaussian process library implemented using PyTorch for creating Gaussian Process Models.



HOROVOD

An easy to use, distributed library for deep learning frameworks.



PYRO

A Deep Universal Probabilistic Programming Languate (PPL) written in Python.



TENSORLY

A high level API for tensor methods and deep tensorized neural networks in Python.



TRANSLATE

An open source project based on the machine translation technologies of Facebook.



The PyTorch Modules

torch
A Tensor library, similar to NumPy, but with powerful GPU support.

torch.autograd
A tape-based automatic differentiation library that supports differentiable Tensor operations in torch.

torch.nn
The heart of PyTorch deep learning, torch.nn is a neural networks library deeply integrated with autograd designed for maximum flexibility.

torch.muliprocessing
Python multiprocessing, but with magical memory sharing of torch Tensors across processes.

torch.utils
DataLoader, Trainer and other utility functions for convenience.

tor.legacy(.nn/optim)
Legacy code ported over from torch for backward compatibility.

Exxact Deep Learning GPU Solutions


Our deep learning GPU solutions are powered by the leading hardware, software, and systems engineering. Each system comes with our pre-installed deep learning software stack and are fully turnkey to run right out of the box.



SHOP NOW