Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

bug: weird responses from nitro when cache enabled #526

Open
vansangpfiev opened this issue Apr 19, 2024 · 2 comments
Open

bug: weird responses from nitro when cache enabled #526

vansangpfiev opened this issue Apr 19, 2024 · 2 comments
Assignees
@vansangpfiev
Labels
type: bug Something isn't working

Comments

@vansangpfiev
Copy link
Contributor

Describe the bug
Nitro seems to be broken when enabled cache. It spams nonsense text after some time.

To Reproduce
Steps to reproduce the behavior:

  1. Load model with caching_enabled = true
  2. Start conversation
  3. Nitro responses with some nonsense texts

Expected behavior
Nitro responses nicely when cache enabled.
@vansangpfiev vansangpfiev added the type: bug Something isn't working label Apr 19, 2024
@vansangpfiev vansangpfiev self-assigned this Apr 19, 2024
@vansangpfiev vansangpfiev mentioned this issue Apr 19, 2024
Closed
@tikikun
Copy link
Collaborator

tikikun commented Apr 22, 2024

Can you attach current fixing branch to this issue

@vansangpfiev
Copy link
Contributor Author

Fixing branch is: #508

@vansangpfiev vansangpfiev mentioned this issue May 2, 2024
Merged
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@vansangpfiev vansangpfiev

Labels
type: bug Something isn't working
Projects
Jan Project
Archived in project
Milestone
No milestone
Development

No branches or pull requests
2 participants
@vansangpfiev @tikikun