r-wordpiece 2.1.3
Propagated dependencies: r-wordpiece-data@2.0.0 r-stringi@1.8.7 r-rlang@1.2.0 r-piecemaker@1.0.2 r-memoise@2.0.1 r-fastmatch@1.1-8 r-dlr@1.0.1
Channel: guix-cran
Licenses: FSDG-compatible
Build system: r
Synopsis: R Implementation of Wordpiece Tokenization
Description:
Apply Wordpiece (<arXiv:1609.08144>) tokenization to input text, given an appropriate vocabulary. The BERT (<arXiv:1810.04805>) tokenization conventions are used by default.
Total packages: 1