Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add explicit APIs in BenchmarkModel #1459

Open
wants to merge 1 commit into
base: main
Choose a base branch
from
Open

Add explicit APIs in BenchmarkModel #1459

wants to merge 1 commit into from

Conversation

janeyx99
Copy link
Contributor

@janeyx99 janeyx99 commented Mar 7, 2023

This is part 1 of adding ways to more granularly benchmark.

Also explicitly document what methods we expect BenchmarkModels to have.

@facebook-github-bot
Copy link
Contributor

@janeyx99 has imported this pull request. If you are a Meta employee, you can view this diff on Phabricator.

torchbenchmark/util/model.py Show resolved Hide resolved
@facebook-github-bot
Copy link
Contributor

@janeyx99 has imported this pull request. If you are a Meta employee, you can view this diff on Phabricator.

@janeyx99
Copy link
Contributor Author

janeyx99 commented Mar 7, 2023

This will likely have to wait until #1457 is landed for the test cases to pass

Update is_staged_train_test to check whether functions are actually implemented
@facebook-github-bot
Copy link
Contributor

@janeyx99 has imported this pull request. If you are a Meta employee, you can view this diff on Phabricator.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

3 participants