Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Postman tests results display is inconsistent in case of errors #1168

Closed
lbroudoux opened this issue May 16, 2024 · 0 comments
Closed

Postman tests results display is inconsistent in case of errors #1168

lbroudoux opened this issue May 16, 2024 · 0 comments

Comments

@lbroudoux
Copy link
Member

Describe the bug

The test result page for Postman tests shows several inconsistencies:

  • When an operation is not tested because of no script in the collection, it is marked as timed out
  • When a test case is a success but the global test is timed out, it is still marked as timed out
  • When a test case is a failure but the global test is timed out, it is still marked as timed out
  • When a test request is a success but the global test is timed out, it is still marked as timed out
  • When a test request is a failure but the global test is timed out, it is still marked as timed out

Expected behavior

  • Not tested operation because of lack of scripts should be marked as a failure with a clear explanation message
  • Partial success or failure results (as the operation or at the request level) should appear clearly

Actual behavior

See the bug description above.

How to Reproduce?

Launch a Postman test on an operation for which we have no test scripts in the corresponding collection. To see the partial results inconsistencies, each operation must have several requests.

Microcks version or git rev

1.9.0 and earlier

Install method (docker-compose, helm chart, operator, docker-desktop extension,...)

all

Additional information

No response

@lbroudoux lbroudoux added this to the 1.9.1 milestone May 16, 2024
@lbroudoux lbroudoux self-assigned this May 16, 2024
lbroudoux added a commit that referenced this issue May 16, 2024
Signed-off-by: Laurent Broudoux <laurent.broudoux@gmail.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

1 participant