Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Updates to fast profile #1246

Open
wants to merge 5 commits into
base: main
Choose a base branch
from
Open

Conversation

jasonkneen
Copy link

Describe the changes you have made:

Updated this to:

  • support gpt-4-turbo which should be super fast enough
  • improve prompt to avoid confusion with 'Task is done'
  • subtle prompt changes
  • version number update to avoid messages

Reference any relevant issues (e.g. "Fixes #000"):

Pre-Submission Checklist (optional but appreciated):

  • I have included relevant documentation updates (stored in /docs)
  • [x ] I have read docs/CONTRIBUTING.md
  • [x ] I have read docs/ROADMAP.md

OS Tests (optional but appreciated):

  • Tested on Windows
  • Tested on MacOS
  • Tested on Linux

Updates to fast profile

Updated this to:

- support gpt-4-turbo which should be super fast enough
- improve prompt to avoid confusion with 'Task is done'
- subtle prompt changes
- version number update to avoid messages
@KillianLucas
Copy link
Collaborator

Hi Jason! I think 3.5 is still the best option for speed, the default is 4.5-turbo now so I think --fast should be faster. (Tbh I think if the user has a Groq API Key then --fast should even use Groq)

I also am not sure I understand "If the user has set you a task and it's done has been completed, say 'Ready to code.'".

If you have experimented, and you experience better results with this system message (I don't use fast mode very much) then I'll merge. Let me know what you think about switching back to 3.5 and perhaps removing that line! 👍

@jasonkneen
Copy link
Author

jasonkneen commented May 5, 2024

ahh ok slight mistake on that line it should be

If the user has set you a task and you have completed it and they are finished say 'OK, Ready to code.'

Essentially I found it a bit confusing when it kept saying "The task is done." when I was testing it with "hello" etc, which of course makes sense if it's been told not to chit-chat so whs trying to make it clearer to OI and the user what was going on. Just thought it was a bit friendlier and re-focus user.

Re 3.5 sure I'll revert it and leave as-is.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

3 participants