EnglishFrenchSpanish

OnWorks favicon

SageMaker Hugging Face Inference Toolkit download for Linux

Free download SageMaker Hugging Face Inference Toolkit Linux app to run online in Ubuntu online, Fedora online or Debian online

This is the Linux app named SageMaker Hugging Face Inference Toolkit whose latest release can be downloaded as v2.1.1.zip. It can be run online in the free hosting provider OnWorks for workstations.

Download and run online this app named SageMaker Hugging Face Inference Toolkit with OnWorks for free.

Follow these instructions in order to run this app:

- 1. Downloaded this application in your PC.

- 2. Enter in our file manager https://www.onworks.net/myfiles.php?username=XXXXX with the username that you want.

- 3. Upload this application in such filemanager.

- 4. Start the OnWorks Linux online or Windows online emulator or MACOS online emulator from this website.

- 5. From the OnWorks Linux OS you have just started, goto our file manager https://www.onworks.net/myfiles.php?username=XXXXX with the username that you want.

- 6. Download the application, install it and run it.

SCREENSHOTS

Ad


SageMaker Hugging Face Inference Toolkit


DESCRIPTION

SageMaker Hugging Face Inference Toolkit is an open-source library for serving Transformers models on Amazon SageMaker. This library provides default pre-processing, predict and postprocessing for certain Transformers models and tasks. It utilizes the SageMaker Inference Toolkit for starting up the model server, which is responsible for handling inference requests. For the Dockerfiles used for building SageMaker Hugging Face Containers, see AWS Deep Learning Containers. The SageMaker Hugging Face Inference Toolkit implements various additional environment variables to simplify your deployment experience. The Hugging Face Inference Toolkit allows user to override the default methods of the HuggingFaceHandlerService. SageMaker Hugging Face Inference Toolkit is licensed under the Apache 2.0 License.



Features

  • Create a Amazon SageMaker endpoint with a model from the Hub
  • Create a Amazon SageMaker endpoint with a trained model
  • The HF_TASK environment variable defines the task for the used Transformers pipeline
  • The HF_MODEL_ID environment variable defines the model id, which will be automatically loaded
  • The HF_API_TOKEN environment variable defines the your Hugging Face authorization token
  • User defined code/modules


Programming Language

Python


Categories

UML, Libraries

This is an application that can also be fetched from https://sourceforge.net/projects/sagemak-hug-face-inf-tk.mirror/. It has been hosted in OnWorks in order to be run online in an easiest way from one of our free Operative Systems.


Free Servers & Workstations

Download Windows & Linux apps

  • 1
    PHP QR Code
    PHP QR Code
    PHP QR Code is open source (LGPL)
    library for generating QR Code,
    2-dimensional barcode. Based on
    libqrencode C library, provides API for
    creating QR Code barc...
    Download PHP QR Code
  • 2
    Freeciv
    Freeciv
    Freeciv is a free turn-based
    multiplayer strategy game, in which each
    player becomes the leader of a
    civilization, fighting to obtain the
    ultimate goal: to bec...
    Download Freeciv
  • 3
    Cuckoo Sandbox
    Cuckoo Sandbox
    Cuckoo Sandbox uses components to
    monitor the behavior of malware in a
    Sandbox environment; isolated from the
    rest of the system. It offers automated
    analysis o...
    Download Cuckoo Sandbox
  • 4
    LMS-YouTube
    LMS-YouTube
    Play YouTube video on LMS (porting of
    Triode's to YouTbe API v3) This is
    an application that can also be fetched
    from
    https://sourceforge.net/projects/lms-y...
    Download LMS-YouTube
  • 5
    Windows Presentation Foundation
    Windows Presentation Foundation
    Windows Presentation Foundation (WPF)
    is a UI framework for building Windows
    desktop applications. WPF supports a
    broad set of application development
    features...
    Download Windows Presentation Foundation
  • 6
    SportMusik
    SportMusik
    Mit dem Programm kann man schnell und
    einfach Pausen bei Sportveranstaltungen
    mit Musik �berbr�cken. Hierf�r haben sie
    die M�glichkeit, folgende Wiedergabvaria...
    Download SportMusik
  • More »

Linux commands

Ad