Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[TD] Improved historical file failure correlation #5205

Merged
merged 2 commits into from
May 20, 2024

Conversation

clee2000
Copy link
Contributor

@clee2000 clee2000 commented May 15, 2024

Some tests don't generate xml and when a test segfaults, no xml gets created, so these two cases won't show up in the failed_tests_run table.

Instead, query the td_test_failure_stats_v2 table since that is populated by test file failure/the name returned by discover tests.

Split up historical class and historical file correlation calculations since they use different queries now
Reuse as many functions as possible from utils.py

Copy link

vercel bot commented May 15, 2024

The latest updates on your projects. Learn more about Vercel for Git ↗︎

1 Ignored Deployment
Name Status Preview Comments Updated (UTC)
torchci ⬜️ Ignored (Inspect) Visit Preview May 15, 2024 6:38pm

@facebook-github-bot facebook-github-bot added the CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. label May 15, 2024
@clee2000 clee2000 force-pushed the csl/improved_historical_failure_correlation branch from 7fde00c to 8d78a28 Compare May 15, 2024 17:52
@clee2000 clee2000 force-pushed the csl/improved_historical_failure_correlation branch from 8d78a28 to a3d8360 Compare May 15, 2024 17:57
@clee2000 clee2000 marked this pull request as ready for review May 15, 2024 18:04
@clee2000 clee2000 requested a review from a team May 15, 2024 18:04
@clee2000 clee2000 requested review from a team and ZainRizvi May 15, 2024 18:38
@clee2000 clee2000 merged commit f99581d into main May 20, 2024
10 checks passed
pytorchmergebot pushed a commit to pytorch/pytorch that referenced this pull request May 20, 2024
Some tests don't get run through pytest and pytest crashes when a test segfaults, so in both caess, the pytest cache won't have an entry (similar to pytorch/test-infra#5205).

Instead, manually upload/download an extra file that lists the failing test files

Technically this would be more general than the pytest cache
Pull Request resolved: #126315
Approved by: https://github.com/ZainRizvi
pytorchmergebot pushed a commit to pytorch/pytorch that referenced this pull request May 21, 2024
Some tests don't get run through pytest and pytest crashes when a test segfaults, so in both caess, the pytest cache won't have an entry (similar to pytorch/test-infra#5205).

Instead, manually upload/download an extra file that lists the failing test files

Technically this would be more general than the pytest cache
Pull Request resolved: #126315
Approved by: https://github.com/ZainRizvi
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

3 participants