This is the Linux app named Text Generation Web UI whose latest release can be downloaded as snapshot-2023-10-15sourcecode.zip. It can be run online in the free hosting provider OnWorks for workstations.
Download and run online this app named Text Generation Web UI with OnWorks for free.
Follow these instructions in order to run this app:
- 1. Downloaded this application in your PC.
- 2. Enter in our file manager https://www.onworks.net/myfiles.php?username=XXXXX with the username that you want.
- 3. Upload this application in such filemanager.
- 4. Start the OnWorks Linux online or Windows online emulator or MACOS online emulator from this website.
- 5. From the OnWorks Linux OS you have just started, goto our file manager https://www.onworks.net/myfiles.php?username=XXXXX with the username that you want.
- 6. Download the application, install it and run it.
SCREENSHOTS
Ad
Text Generation Web UI
DESCRIPTION
A gradio web UI for running Large Language Models like LLaMA, llama.cpp, GPT-J, Pythia, OPT, and GALACTICA. Dropdown menu for switching between models. Notebook mode that resembles OpenAI's playground. Chat mode for conversation and role playing. Instruct mode compatible with Alpaca and Open Assistant formats. Nice HTML output for GPT-4chan. Markdown output for GALACTICA, including LaTeX rendering. Custom chat characters. Advanced chat features (send images, get audio responses with TTS). Very efficient text streaming. Parameter presets, 8-bit mode. Layers splitting across GPU(s), CPU, and disk. CPU mode, FlexGen, DeepSpeed ZeRO-3, API with streaming and without streaming. LLaMA model, including 4-bit GPTQ. RWKV model, LoRA (loading and training), Softprompts, and extensions.
Features
- Dropdown menu for switching between models
- Notebook mode that resembles OpenAI's playground
- Chat mode for conversation and role playing
- Instruct mode compatible with Alpaca and Open Assistant formats
- Nice HTML output for GPT-4chan
- Markdown output for GALACTICA, including LaTeX rendering
- Advanced chat features (send images, get audio responses with TTS)
- Layers splitting across GPU(s), CPU, and disk
Programming Language
Python
Categories
This is an application that can also be fetched from https://sourceforge.net/projects/text-generation-web-ui.mirror/. It has been hosted in OnWorks in order to be run online in an easiest way from one of our free Operative Systems.
