5 results for tag "huggingface-tokenizers"
A large collection of Claude Code skill templates sponsored by Z.AI, providing ready-to-use development skill configurations across various domains.
Hugging Face Tokenizers skill from the AI Research Engineering skills library, providing guidance for text tokenization workflows used in NLP and language model development.
HuggingFace tokenizers skill from ltk, a personal development toolkit for Claude Code that is extensible and per-project.
Enables lightning-fast text tokenization with Rust-powered performance, supporting custom vocabulary training and multiple tokenization algorithms for NLP tasks.