-
Notifications
You must be signed in to change notification settings - Fork 5
[DT-1051] Remove flaky test #1872
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Conversation
| azureBlobIOTestUtility.teardown(); | ||
| } | ||
|
|
||
| @Test |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Instead of removing, what do you think about tagging it with @ignore instead? This test is still functional and could be used to test a particular error case, but is flaky so we don't want it to run with our nightly test runs.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
I agree, I would prefer to leave the test in until we remove the azure code it's testing.
Another solution is to add a @Category to this method so it's no longer run as part of Integration.class. TDR already has OnDemand for this purpose:
@Catregory(OnDemand.class)
fboulnois
left a comment
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Based on internal discussion, lgtm 👍
| } | ||
|
|
||
| @Test | ||
| @Disabled |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Make sure to verify that this works; this test is using JUnit 4 annotations and @Disabled is JUnit 5. I think the JUnit 4 tests are run using 5 internally so it should work. If it doesn't then using @Ignored will work.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Oh yeah, I still see it in the test results - https://scans.gradle.com/s/a73cfymlzig3g/tests/overview

I don't see where we are using Disabled anywhere in TDR.
|



Jira ticket: https://broadworkbench.atlassian.net/browse/dt-1051
Addresses
Summary of changes
Testing Strategy