Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Minimizing timeout test cases #11950

Open
szhorvat opened this issue May 13, 2024 · 2 comments
Open

Minimizing timeout test cases #11950

szhorvat opened this issue May 13, 2024 · 2 comments

Comments

@szhorvat
Copy link
Contributor

szhorvat commented May 13, 2024

In my experience, test cases for timeouts are not minimized. I'm not sure if this is intentional, or a failure of the system to do the minimization. When triggering minimization manually, I get "Minimize task errored out: LibFuzzer minimization failed.". Given how painful it is to minimize these locally, it would be very useful to support this, including setting a reasonable timeout value.

In many cases, timeouts relate directly to the size of the input. In igraph, we encountered cases where it's the specific structure of the input was to blame. Obtaining a small test case is usually necessary to debug these.

@maflcko
Copy link
Contributor

maflcko commented May 13, 2024

including setting a reasonable timeout value.

I think this is already possible, though I haven't tried it. See for example https://github.com/google/oss-fuzz/blob/master/projects/json/fuzzer-parse.options#L3 . (However, max_len should be done inside the fuzz target code itself, see #5408)

@szhorvat
Copy link
Contributor Author

What I am looking for is to set a lower timeout just for the sake of minimization, not to get a global timeout for all fuzzing. Actually, I am just looking for way to help the minimizer succeed on OSS-Fuzz, so I wouldn't have to do it locally.

@szhorvat szhorvat changed the title Minimizing timeouts Minimizing timeout test cases May 13, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants