Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Create test sets from CLI #1001

Open
mmabrouk opened this issue Dec 5, 2023 · 2 comments · May be fixed by #1178
Open

Create test sets from CLI #1001

mmabrouk opened this issue Dec 5, 2023 · 2 comments · May be fixed by #1178
Assignees
@aybruhm
Labels
CLI linear Created by Linear-GitHub Sync

Comments

@mmabrouk
Copy link
Member

mmabrouk commented Dec 5, 2023

Is your feature request related to a problem? Please describe.
We would like to be able to manage and create test sets from CLI

agenta testset
agenta testset list: List testsets in the app.
agenta testset add --file_name mytestset.csv --testset_name mytestsetname: Upload a file and create a testset.
agenta testset remove --testset_id: Remove an existing testset.

#991 is a requirement for starting this (otherwise we would need to write the client SDK)
@mmabrouk mmabrouk added the CLI label Dec 5, 2023
@mmabrouk mmabrouk mentioned this issue Dec 5, 2023
Closed
@poerty
Copy link

poerty commented Dec 7, 2023

@mmabrouk Can I work on this?

@mmabrouk
Copy link
Member Author

mmabrouk commented Dec 7, 2023

of course :)

@mmabrouk mmabrouk assigned poerty and unassigned devgenix Dec 7, 2023
@mmabrouk mmabrouk mentioned this issue Dec 17, 2023
Open
@mmabrouk mmabrouk assigned devgenix and unassigned poerty Jan 8, 2024
@devgenix devgenix linked a pull request Jan 10, 2024 that will close this issue
Open
3 tasks
@devgenix devgenix linked a pull request Jan 10, 2024 that will close this issue
Feat: Manage Testsets From CLI #1178
Open
3 tasks
@mmabrouk mmabrouk self-assigned this Jan 28, 2024
@aybruhm aybruhm added the linear Created by Linear-GitHub Sync label May 20, 2024
@aybruhm aybruhm self-assigned this May 20, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@aybruhm aybruhm

Labels
CLI linear Created by Linear-GitHub Sync
Projects
None yet
Milestone
No milestone
Development

Successfully merging a pull request may close this issue.

Feat: Manage Testsets From CLI Agenta-AI/agenta
4 participants
@mmabrouk @poerty @aybruhm @devgenix