Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Add BPE pre-tokenization for Command-R/R+. #7063

Merged
merged 3 commits into from
May 5, 2024
Merged

Add BPE pre-tokenization for Command-R/R+. #7063

merged 3 commits into from
May 5, 2024
+168 −1

Commits on May 4, 2024

  1. Add BPE pre-tokenization for Command-R/R+.

    @dranger003
    dranger003 committed May 4, 2024
    Configuration menu
    Copy the full SHA
    d5d6731 View commit details
    Browse the repository at this point in the history

  2. Bump transformers convert requirement.

    @dranger003
    dranger003 committed May 4, 2024
    Configuration menu
    Copy the full SHA
    20157cf View commit details
    Browse the repository at this point in the history

Commits on May 5, 2024

  1. command-r : add individual digits regex

    @ggerganov
    ggerganov committed May 5, 2024
    Configuration menu
    Copy the full SHA
    f5806b2 View commit details
    Browse the repository at this point in the history