Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Support cost estimation before execution and improve configuration #22

Open
shaoyijia opened this issue Apr 17, 2024 · 1 comment
Open

Support cost estimation before execution and improve configuration #22

shaoyijia opened this issue Apr 17, 2024 · 1 comment
Assignees
@shaoyijia

Comments

@shaoyijia
Copy link
Collaborator

The default configurations in the Readme.md are corresponding to our hyper-parameters setup in the NAACL'24 paper.

As people are using/building on top of this project, having cost estimation (maximum number of call to language model, maximum number of call to search engine/retriever) is necessary.
@shaoyijia shaoyijia self-assigned this Apr 17, 2024
@shaoyijia
Copy link
Collaborator Author

Currently, we provide a profiling function after processing a topic. You can call summary() to see the time, model usage for each step. Run reset() before starting a new topic.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@shaoyijia shaoyijia

Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
1 participant
@shaoyijia