4 results for tag "sentencepiece"
A large collection of Claude Code skill templates sponsored by Z.AI, providing ready-to-use development skill configurations across various domains.
A sentencepiece skill from AI Research Skills by Orchestra Research, providing skills for academic research, paper analysis, and scientific workflows.
Tokenizes raw Unicode text using unsupervised BPE and Unigram algorithms, enabling multilingual and CJK language support with deterministic, lightweight vocabulary generation.