This is the Linux app named Colossal-AI whose latest release can be downloaded as Versionv0.3.3ReleaseToday!.zip. It can be run online in the free hosting provider OnWorks for workstations.
Download and run online this app named Colossal-AI with OnWorks for free.
Follow these instructions in order to run this app:
- 1. Downloaded this application in your PC.
- 2. Enter in our file manager https://www.onworks.net/myfiles.php?username=XXXXX with the username that you want.
- 3. Upload this application in such filemanager.
- 4. Start the OnWorks Linux online or Windows online emulator or MACOS online emulator from this website.
- 5. From the OnWorks Linux OS you have just started, goto our file manager https://www.onworks.net/myfiles.php?username=XXXXX with the username that you want.
- 6. Download the application, install it and run it.
SCREENSHOTS
Ad
Colossal-AI
DESCRIPTION
The Transformer architecture has improved the performance of deep learning models in domains such as Computer Vision and Natural Language Processing. Together with better performance come larger model sizes. This imposes challenges to the memory wall of the current accelerator hardware such as GPU. It is never ideal to train large models such as Vision Transformer, BERT, and GPT on a single GPU or a single machine. There is an urgent demand to train models in a distributed environment. However, distributed training, especially model parallelism, often requires domain expertise in computer systems and architecture. It remains a challenge for AI researchers to implement complex distributed training solutions for their models. Colossal-AI provides a collection of parallel components for you. We aim to support you to write your distributed deep learning models just like how you write your model on your laptop.
Features
- Heterogeneous Memory Management
- 24x larger model size on the same hardware
- Pull from DockerHub
- Build On Your Own
- Parallelism strategies
- Parallelism based on configuration file
Programming Language
Python
Categories
This is an application that can also be fetched from https://sourceforge.net/projects/colossal-ai.mirror/. It has been hosted in OnWorks in order to be run online in an easiest way from one of our free Operative Systems.
