ckaczor/azuredatastudio
1
0
Fork 0
mirror of https://github.com/ckaczor/azuredatastudio.git synced 2026-02-16 10:58:30 -05:00
Code Issues Packages Projects Releases Wiki Activity

introduce unstable smoke test suite (#20639)

Browse Source 
* allow mark tests as unstable

* fix

* fix invert

* stable and whole test suite

* docs and mark test cases as unstable

* a couple more unstable test cases
This commit is contained in:
Alan Ren
2022-09-21 13:09:06 -07:00
committed by GitHub
parent 12c5aa0f80
commit 0e21258fe8
5 changed files with 31 additions and 6 deletions
Download Patch File Download Diff File Expand all files Collapse all files

9
test/smoke/README.md
View File

@@ -14,6 +14,9 @@ yarn --cwd test/smoke
# Prepare OSS in repo*
node build/lib/preLaunch.js
# By default, only the stable test cases will be executed, to run all the test cases run the following script to set the 'RUN_UNSTABLE_TESTS' environment variable to true
# export RUN_UNSTABLE_TESTS="true"
# Dev (Electron)
yarn smoketest
@@ -72,6 +75,12 @@ cd test/smoke
yarn watch
```
### Mark test case as unstable
A test case should be marked as unstable if it is failing due to test reliability issue and a fix cannot be made immediately. Unstable test cases won't be picked up in the normal build pipelines, there is a dedicated build pipeline to run the unstable test cases.
To mark a test case as unstable, simply append the tag "@UNSTABLE@" to the title of the test case. Similarly, remove the tag if you want to mark it as stable.
## Troubleshooting
### Error: Could not get a unique tmp filename, max tries reached