You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardExpand all lines: README.md
+3-1Lines changed: 3 additions & 1 deletion
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -53,9 +53,10 @@ You can also run this step directly with [Bitrise CLI](https://github.com/bitris
53
53
| Key | Description | Flags | Default |
54
54
| --- | --- | --- | --- |
55
55
|`zip_path`| Open finder, and navigate to the directory you designated for Derived Data output. Open the folder for your project, then the Build/Products folders inside it. You should see a folder Debug-iphoneos and PROJECT_NAME_iphoneos_DEVELOPMENT_TARGET-arm64.xctestrun. Select them both, then right-click on one of them and select Compress 2 items. | required |`$BITRISE_TEST_BUNDLE_ZIP_PATH`|
56
-
| `test_devices` | Format: One device configuration per line and the parameters are separated with `,` in the order of: `deviceID,version,language,orientation` For example: `iphone8,14.7,en,portrait` `iphone8,14.7,en,landscape` Available devices and its versions: ``` ┌─────────────┬────────────────────────┬────────────────┬──────────────┐ │ MODEL_ID │ NAME │ OS_VERSION_IDS │ TAGS │ ├─────────────┼────────────────────────┼────────────────┼──────────────┤ │ ipad10 │ iPad (10th generation) │ 16.6 │ │ │ iphone11pro │ iPhone 11 Pro │ 16.6 │ │ │ iphone13pro │ iPhone 13 Pro │ 15.7,16.6 │ default │ │ iphone14pro │ iPhone 14 Pro │ 16.6 │ │ │ iphone15 │ iPhone 15 │ 18.0 │ preview=18.0 │ │ iphone15pro │ iPhone 15 Pro │ 18.0 │ preview=18.0 │ │ iphone8 │ iPhone 8 │ 15.7,16.6 │ │ └─────────────┴────────────────────────┴────────────────┴──────────────┘ ``` Device and OS Capacity: ``` ┌─────────────┬────────────────────────┬───────────────┬─────────────────┐ │ MODEL_ID │ MODEL_NAME │ OS_VERSION_ID │ DEVICE_CAPACITY │ ├─────────────┼────────────────────────┼───────────────┼─────────────────┤ │ ipad10 │ iPad (10th generation) │ 16.6 │ Low │ │ iphone11pro │ iPhone 11 Pro │ 16.6 │ High │ │ iphone13pro │ iPhone 13 Pro │ 15.7 │ Medium │ │ iphone13pro │ iPhone 13 Pro │ 16.6 │ High │ │ iphone14pro │ iPhone 14 Pro │ 16.6 │ High │ │ iphone15 │ iPhone 15 │ 18.0 │ Low │ │ iphone15pro │ iPhone 15 Pro │ 18.0 │ Medium │ │ iphone8 │ iPhone 8 │ 15.7 │ Medium │ │ iphone8 │ iPhone 8 │ 16.6 │ Medium │ └─────────────┴────────────────────────┴───────────────┴─────────────────┘ ``` | required | `iphone13pro,16.6,en,portrait` |
56
+
| `test_devices` | Format: One device configuration per line and the parameters are separated with `,` in the order of: `deviceID,version,language,orientation` For example: `iphone8,14.7,en,portrait` `iphone8,14.7,en,landscape` Available devices and its versions: ``` ┌─────────────┬────────────────────────┬────────────────┬──────────────┐ │ MODEL_ID │ NAME │ OS_VERSION_IDS │ TAGS │ ├─────────────┼────────────────────────┼────────────────┼──────────────┤ │ ipad10 │ iPad (10th generation) │ 16.6 │ │ │ iphone11pro │ iPhone 11 Pro │ 16.6 │ │ │ iphone13pro │ iPhone 13 Pro │ 15.7,16.6 │ default │ │ iphone14pro │ iPhone 14 Pro │ 16.6 │ │ │ iphone15 │ iPhone 15 │ 18.0 │ preview=18.0 │ │ iphone15pro │ iPhone 15 Pro │ 18.0 │ preview=18.0 │ │ iphone8 │ iPhone 8 │ 15.7,16.6 │ │ └─────────────┴────────────────────────┴────────────────┴──────────────┘ ``` Device and OS Capacity: ``` ┌─────────────┬────────────────────────┬───────────────┬─────────────────┐ │ MODEL_ID │ MODEL_NAME │ OS_VERSION_ID │ DEVICE_CAPACITY │ ├─────────────┼────────────────────────┼───────────────┼─────────────────┤ │ ipad10 │ iPad (10th generation) │ 16.6 │ Low │ │ iphone11pro │ iPhone 11 Pro │ 16.6 │ High │ │ iphone13pro │ iPhone 13 Pro │ 15.7 │ High │ │ iphone13pro │ iPhone 13 Pro │ 16.6 │ High │ │ iphone14pro │ iPhone 14 Pro │ 16.6 │ High │ │ iphone15 │ iPhone 15 │ 18.0 │ Medium │ │ iphone15pro │ iPhone 15 Pro │ 18.0 │ Medium │ │ iphone8 │ iPhone 8 │ 15.7 │ Medium │ │ iphone8 │ iPhone 8 │ 16.6 │ High │ └─────────────┴────────────────────────┴───────────────┴─────────────────┘ ``` | required | `iphone13pro,16.6,en,portrait` |
57
57
|`test_timeout`| Max time a test execution is allowed to run before it is automatically canceled. The default value is 900 (15 min). Duration in seconds with up to nine fractional digits. Example: "3.5". ||`900`|
58
58
|`download_test_results`| If this input is set to `true` all files generated in the test run will be downloaded. Otherwise, no any file will be downloaded. | required |`false`|
59
+
|`num_flaky_test_attempts`| Specifies the number of times a test execution should be reattempted if one or more of its test cases fail for any reason. An execution that initially fails but succeeds on any reattempt is reported as FLAKY. The maximum number of reruns allowed is 10. (Default: 0, which implies no reruns.) | required |`0`|
59
60
|`api_base_url`| The URL where test API is accessible. | required |`https://vdt.bitrise.io/test`|
60
61
|`api_token`| The token required to authenticate with the API. | required, sensitive |`$ADDON_VDTESTING_API_TOKEN`|
61
62
</details>
@@ -66,6 +67,7 @@ You can also run this step directly with [Bitrise CLI](https://github.com/bitris
66
67
| Environment Variable | Description |
67
68
| --- | --- |
68
69
|`VDTESTING_DOWNLOADED_FILES_DIR`| The directory containing the downloaded files if you have set `download_test_results` inputs above. |
70
+
|`BITRISE_FLAKY_TEST_CASES`| A list of flaky test cases. A test case is considered flaky if it has failed at least once, but passed at least once as well. The list contains the test cases in the following format: ``` - TestSuit_1.TestClass_1.TestName_1 - TestSuit_1.TestClass_1.TestName_2 - TestSuit_1.TestClass_2.TestName_1 - TestSuit_2.TestClass_1.TestName_1 ... ``` To export `BITRISE_FLAKY_TEST_CASES` Step Output `download_test_results` Step Input should be set to `true`. |
0 commit comments