This is the Linux app named Torch-TensorRT whose latest release can be downloaded as Torch-TensorRTv1.3.0.zip. It can be run online in the free hosting provider OnWorks for workstations.
Download and run online this app named Torch-TensorRT with OnWorks for free.
Follow these instructions in order to run this app:
- 1. Downloaded this application in your PC.
- 2. Enter in our file manager https://www.onworks.net/myfiles.php?username=XXXXX with the username that you want.
- 3. Upload this application in such filemanager.
- 4. Start the OnWorks Linux online or Windows online emulator or MACOS online emulator from this website.
- 5. From the OnWorks Linux OS you have just started, goto our file manager https://www.onworks.net/myfiles.php?username=XXXXX with the username that you want.
- 6. Download the application, install it and run it.
SCREENSHOTS:
Torch-TensorRT
DESCRIPTION:
Torch-TensorRT is a compiler for PyTorch/TorchScript, targeting NVIDIA GPUs via NVIDIA’s TensorRT Deep Learning Optimizer and Runtime. Unlike PyTorch’s Just-In-Time (JIT) compiler, Torch-TensorRT is an Ahead-of-Time (AOT) compiler, meaning that before you deploy your TorchScript code, you go through an explicit compile step to convert a standard TorchScript program into a module targeting a TensorRT engine. Torch-TensorRT operates as a PyTorch extension and compiles modules that integrate into the JIT runtime seamlessly. After compilation using the optimized graph should feel no different than running a TorchScript module. You also have access to TensorRT’s suite of configurations at compile time, so you are able to specify operating precision (FP32/FP16/INT8) and other settings for your module.
Features
- Build a docker container for Torch-TensorRT
- NVIDIA NGC Container
- Requires Libtorch 1.12.0 (built with CUDA 11.3)
- Build using cuDNN & TensorRT tarball distributions
- Test using Python backend
- You have access to TensorRT's suite of configurations at compile time
Programming Language
C++
Categories
This is an application that can also be fetched from https://sourceforge.net/projects/torch-tensorrt.mirror/. It has been hosted in OnWorks in order to be run online in an easiest way from one of our free Operative Systems.