Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Add GGML saving option to Unsloth for easier Ollama model creation and testing. #345

Open
wants to merge 23 commits into
base: main
Choose a base branch
from
Open

Add GGML saving option to Unsloth for easier Ollama model creation and testing. #345

wants to merge 23 commits into from

Commits on Apr 14, 2024

  1. Add save to llama.cpp GGML to save.py.

    @mahiatlinux
    mahiatlinux committed Apr 14, 2024
    Configuration menu
    Copy the full SHA
    43014fc View commit details
    Browse the repository at this point in the history

  2. Fix conversion command and path of convert to GGML function.

    @mahiatlinux
    mahiatlinux committed Apr 14, 2024
    Configuration menu
    Copy the full SHA
    96b8c78 View commit details
    Browse the repository at this point in the history

  3. Add autosaving lora to the GGML function

    @mahiatlinux
    mahiatlinux committed Apr 14, 2024
    Configuration menu
    Copy the full SHA
    129d692 View commit details
    Browse the repository at this point in the history

  4. Create lora save function for conversion to GGML

    @mahiatlinux
    mahiatlinux committed Apr 14, 2024
    Configuration menu
    Copy the full SHA
    b9c6207 View commit details
    Browse the repository at this point in the history

  5. Test fix unslothai#2 for saving lora

    @mahiatlinux
    mahiatlinux committed Apr 14, 2024
    Configuration menu
    Copy the full SHA
    a83218c View commit details
    Browse the repository at this point in the history

  6. Test fix unslothai#3 to save the lora adapters to convert to GGML

    @mahiatlinux
    mahiatlinux committed Apr 14, 2024
    Configuration menu
    Copy the full SHA
    ecb83de View commit details
    Browse the repository at this point in the history

  7. Remove unwated tokenizer saving for conversion to ggml and added a fe… 

    …w print statements.
    @mahiatlinux
    mahiatlinux committed Apr 14, 2024
    Configuration menu
    Copy the full SHA
    534303d View commit details
    Browse the repository at this point in the history

  8. Needed tokenizer for saving, added it back, also made it more unsloth… 

    …y style by having positional arguments, and added a few messages.
    @mahiatlinux
    mahiatlinux committed Apr 14, 2024
    Configuration menu
    Copy the full SHA
    786c010 View commit details
    Browse the repository at this point in the history

  9. Positional arguments didn't work out, so reverted to older version of… 

    … the code, and added a few comments.
    @mahiatlinux
    mahiatlinux committed Apr 14, 2024
    Configuration menu
    Copy the full SHA
    8ccf015 View commit details
    Browse the repository at this point in the history

  10. Test fix 1 for arch

    @mahiatlinux
    mahiatlinux committed Apr 14, 2024
    Configuration menu
    Copy the full SHA
    c337e97 View commit details
    Browse the repository at this point in the history

  11. Test fix 2 new Mistral error.

    @mahiatlinux
    mahiatlinux committed Apr 14, 2024
    Configuration menu
    Copy the full SHA
    57c9d0d View commit details
    Browse the repository at this point in the history

  12. Test fix 3

    @mahiatlinux
    mahiatlinux committed Apr 14, 2024
    Configuration menu
    Copy the full SHA
    8430b32 View commit details
    Browse the repository at this point in the history

  13. Revert to old version for testing.

    @mahiatlinux
    mahiatlinux committed Apr 14, 2024
    Configuration menu
    Copy the full SHA
    da8bdca View commit details
    Browse the repository at this point in the history

  14. Upload issue test fix 1

    @mahiatlinux
    mahiatlinux committed Apr 14, 2024
    Configuration menu
    Copy the full SHA
    522b641 View commit details
    Browse the repository at this point in the history

  15. Fix 2 uploading ggml

    @mahiatlinux
    mahiatlinux committed Apr 14, 2024
    Configuration menu
    Copy the full SHA
    e268f18 View commit details
    Browse the repository at this point in the history

  16. Positional ags added.

    @mahiatlinux
    mahiatlinux committed Apr 14, 2024
    Configuration menu
    Copy the full SHA
    1f8c2c5 View commit details
    Browse the repository at this point in the history

  17. Temporray remove positional args

    @mahiatlinux
    mahiatlinux committed Apr 14, 2024
    Configuration menu
    Copy the full SHA
    a8f6bb4 View commit details
    Browse the repository at this point in the history

  18. Fix upload again!!!

    @mahiatlinux
    mahiatlinux committed Apr 14, 2024
    Configuration menu
    Copy the full SHA
    0102ce9 View commit details
    Browse the repository at this point in the history

Commits on Apr 15, 2024

  1. Add print statements and fix link

    @mahiatlinux
    mahiatlinux committed Apr 15, 2024
    Configuration menu
    Copy the full SHA
    b031111 View commit details
    Browse the repository at this point in the history

  2. Make the calling name better

    @mahiatlinux
    mahiatlinux committed Apr 15, 2024
    Configuration menu
    Copy the full SHA
    ba526d1 View commit details
    Browse the repository at this point in the history

  3. Create local saving for GGML

    @mahiatlinux
    mahiatlinux committed Apr 15, 2024
    Configuration menu
    Copy the full SHA
    2b276b6 View commit details
    Browse the repository at this point in the history

  4. Add choosing directory to save local GGML.

    @mahiatlinux
    mahiatlinux committed Apr 15, 2024
    Configuration menu
    Copy the full SHA
    947a91d View commit details
    Browse the repository at this point in the history

  5. Fix lil variable error in the save_to_custom_dir func

    @mahiatlinux
    mahiatlinux committed Apr 15, 2024
    Configuration menu
    Copy the full SHA
    6c4ab40 View commit details
    Browse the repository at this point in the history