This is the Linux app named SageMaker Hugging Face Inference Toolkit whose latest release can be downloaded as v2.1.1.zip. It can be run online in the free hosting provider OnWorks for workstations.
Download and run online this app named SageMaker Hugging Face Inference Toolkit with OnWorks for free.
Follow these instructions in order to run this app:
- 1. Downloaded this application in your PC.
- 2. Enter in our file manager https://www.onworks.net/myfiles.php?username=XXXXX with the username that you want.
- 3. Upload this application in such filemanager.
- 4. Start the OnWorks Linux online or Windows online emulator or MACOS online emulator from this website.
- 5. From the OnWorks Linux OS you have just started, goto our file manager https://www.onworks.net/myfiles.php?username=XXXXX with the username that you want.
- 6. Download the application, install it and run it.
SCREENSHOTS
Ad
SageMaker Hugging Face Inference Toolkit
DESCRIPTION
SageMaker Hugging Face Inference Toolkit is an open-source library for serving Transformers models on Amazon SageMaker. This library provides default pre-processing, predict and postprocessing for certain Transformers models and tasks. It utilizes the SageMaker Inference Toolkit for starting up the model server, which is responsible for handling inference requests. For the Dockerfiles used for building SageMaker Hugging Face Containers, see AWS Deep Learning Containers. The SageMaker Hugging Face Inference Toolkit implements various additional environment variables to simplify your deployment experience. The Hugging Face Inference Toolkit allows user to override the default methods of the HuggingFaceHandlerService. SageMaker Hugging Face Inference Toolkit is licensed under the Apache 2.0 License.
Features
- Create a Amazon SageMaker endpoint with a model from the Hub
- Create a Amazon SageMaker endpoint with a trained model
- The HF_TASK environment variable defines the task for the used Transformers pipeline
- The HF_MODEL_ID environment variable defines the model id, which will be automatically loaded
- The HF_API_TOKEN environment variable defines the your Hugging Face authorization token
- User defined code/modules
Programming Language
Python
Categories
This is an application that can also be fetched from https://sourceforge.net/projects/sagemak-hug-face-inf-tk.mirror/. It has been hosted in OnWorks in order to be run online in an easiest way from one of our free Operative Systems.
