You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
*[#870](https://github.com/magento/magento2-functional-testing-framework/pull/870) -- Removing the csharpru/vault-php-guzzle6-transport not needed dependency
71
94
*[#871](https://github.com/magento/magento2-functional-testing-framework/pull/871) -- Changed loose comparisons into strict
* Added new `config:parallel --groups` option in `generate:tests` command to generate and split tests/suites into required number of execution time balanced groups.
136
+
* Added new `config:parallel --groups` option in `generate:tests` command to generate and split tests/suites into required number of execution time balanced groups.
*[#817](https://github.com/magento/magento2-functional-testing-framework/pull/817) -- Add support for admin WebAPI token refresh.
140
-
163
+
141
164
* Maintainability
142
165
*[#814](https://github.com/magento/magento2-functional-testing-framework/pull/814) -- Update dependencies in order to make mftf php8 compatible, fix running phpcpd
143
-
*[#815](https://github.com/magento/magento2-functional-testing-framework/pull/815) -- Upgrade csharpru/vault-php to 4.1
144
-
166
+
*[#815](https://github.com/magento/magento2-functional-testing-framework/pull/815) -- Upgrade csharpru/vault-php to 4.1
167
+
145
168
### Fixes
146
169
147
170
* Fixed test generation error in a split suite group (--config=parallel) to allow generation of subsequent groups.
* Introduced error tolerance during test and suite generation. See the [command page](./docs/commands/mftf.md#error-tolerance-during-generation) for details.
* Removed `travis.yml` and replaced with `.github/workflows/main.yml`
184
207
185
208
### Fixes
186
-
Fixed issue with XPath locators for waits in MagentoPwaWebDriver.
209
+
Fixed issue with XPath locators for waits in MagentoPwaWebDriver.
187
210
188
211
3.1.0
189
212
---------
@@ -197,13 +220,13 @@ Fixed issue with XPath locators for waits in MagentoPwaWebDriver.
197
220
* Usability
198
221
* Introduced new action `pause`, to invoke codeception interactive pause for debugging during test execution. See the [Interactive Pause](./docs/interactive-pause.md) page for details.
199
222
* Introduced a new `.env` configuration option `ENABLE_PAUSE`, to enable the new pause feature.
200
-
201
-
* Maintainability
223
+
224
+
* Maintainability
202
225
* Added a new static check that checks for the usage of the `pause` action. See the [command page](./docs/commands/mftf.md#static-checks) for details.
203
-
204
-
* Modularity
226
+
227
+
* Modularity
205
228
* MFTF now supports the use of actions from multiple modules within suites.
206
-
229
+
207
230
* Traceability
208
231
* A deprecation notice is now added at test execution time for deprecated metadata usage.
209
232
@@ -219,7 +242,7 @@ Fixed issue with XPath locators for waits in MagentoPwaWebDriver.
219
242
*[#683](https://github.com/magento/magento2-functional-testing-framework/pull/683) -- Docs: Renamed sample test name with the correct one
220
243
*[#691](https://github.com/magento/magento2-functional-testing-framework/pull/691) -- Docs: Branch name updates
221
244
*[#678](https://github.com/magento/magento2-functional-testing-framework/pull/678) -- Docs: Command added to modify the web server rewrites configuration
222
-
*[#745](https://github.com/magento/magento2-functional-testing-framework/pull/745) -- Docs: Remove invalid sample test name
245
+
*[#745](https://github.com/magento/magento2-functional-testing-framework/pull/745) -- Docs: Remove invalid sample test name
223
246
224
247
3.0.0
225
248
---------
@@ -230,22 +253,22 @@ Fixed issue with XPath locators for waits in MagentoPwaWebDriver.
230
253
* Introduced MFTF helpers `<helper>` to create custom actions outside of MFTF.[See custom-helpers page for details](./docs/custom-helpers.md)
231
254
* Removed deprecated actions `<executeSelenium>` and `<performOn>`.
232
255
*`<group value="skip"/>` no longer skips a test. Instead, the test is added to the `skip` group.
233
-
256
+
234
257
* Maintainability
235
258
* Added support for PHP 7.4.
236
259
* Added support for PHPUnit 9.
237
260
* Dropped support for PHP 7.0, 7.1, 7.2.
238
261
* Schema updates for test entities to only allow single entity per file except Data and Metadata.
239
262
* Support for sub-folders in test modules.
240
-
* Removed support to read test entities from `<magento>dev/tests/acceptance/tests/functional/Magento/FunctionalTest`.
263
+
* Removed support to read test entities from `<magento>dev/tests/acceptance/tests/functional/Magento/FunctionalTest`.
241
264
* Removed file attribute for `<module>` in suiteSchema.
242
265
* Removed action `pauseExecution` and added `pause`. [See actions page for details](./docs/test/actions.md#pause)
243
-
* Removed action `formatMoney` and added `formatCurrency`. [See actions page for details](./docs/test/actions.md#formatcurrency)
244
-
* Improved assertion actions to support PHPUnit 9 changes. [See assertions page for details](./docs/test/assertions.md)
266
+
* Removed action `formatMoney` and added `formatCurrency`. [See actions page for details](./docs/test/actions.md#formatcurrency)
267
+
* Improved assertion actions to support PHPUnit 9 changes. [See assertions page for details](./docs/test/assertions.md)
245
268
* Added new actions: `assertEqualsWithDelta`, `assertNotEqualsWithDelta`, `assertEqualsCanonicalizing`, `assertNotEqualsCanonicalizing`, `assertEqualsIgnoringCase`, `assertNotEqualsIgnoringCase`.
246
269
* Added new actions: `assertStringContainsString`, `assertStringNotContainsString`, `assertStringContainsStringIgnoringCase`, `assertStringNotContainsStringIgnoringCase` for string haystacks.
* Removed delta option from `assertEquals` and `assertNotEquals`.
271
+
* Removed delta option from `assertEquals` and `assertNotEquals`.
249
272
* Added static check `deprecatedEntityUsage` that checks and reports references to deprecated test entities.
250
273
* Added static check `annotations` that checks and reports missing annotations in tests.
251
274
* Updated `bin/mftf static-checks` command to allow executing static-checks defined in `staticRuleSet.json` by default. [See command page for details](./docs/commands/mftf.md#static-checks)
@@ -254,19 +277,19 @@ Fixed issue with XPath locators for waits in MagentoPwaWebDriver.
254
277
*`mftf.log` no longer includes notices and warnings at test execution time.
255
278
* Added unhandledPromptBehavior driver capability for Chrome 75+ support.
256
279
* Added the Chrome option `--ignore-certificate-errors` to `functional.suite.dist.yml`.
257
-
280
+
258
281
* Traceability
259
282
* Removed `--debug` option `NONE` to disallow ability to turn off schema validation.
260
283
* Notices added for test entity naming convention violations.
261
284
* Metadata file names changed to `*Meta.xml`.
262
-
* Introduced new `.env` configuration `VERBOSE_ARTIFACTS` to toggle saving attachments in Allure. [See configuration page for details](./docs/configuration.md)
285
+
* Introduced new `.env` configuration `VERBOSE_ARTIFACTS` to toggle saving attachments in Allure. [See configuration page for details](./docs/configuration.md)
263
286
* Changed the `bin/mftf static-checks` error file directory from the current working directory to `TESTS_BP/tests/_output/static-results/`.
264
-
287
+
265
288
* Readability
266
-
* Support only nested assertion syntax [See assertions page for details](./docs/test/assertions.md).
289
+
* Support only nested assertion syntax [See assertions page for details](./docs/test/assertions.md).
* Removed blacklist/whitelist terminology in MFTF.
269
-
291
+
* Removed blacklist/whitelist terminology in MFTF.
292
+
270
293
* Upgrade scripts added to upgrade tests to MFTF major version requirements. See upgrade instructions below.
271
294
* Bumped dependencies to support PHP/PHPUnit upgrade.
272
295
@@ -354,7 +377,7 @@ Fixed issue with XPath locators for waits in MagentoPwaWebDriver.
354
377
* Page
355
378
* Section
356
379
* Section Element
357
-
* See DevDocs for details
380
+
* See DevDocs for details
358
381
* Improved `mftf static-checks` command to allow executing all or specific static checks.
359
382
* Added a new static check that checks and reports unused arguments in action groups.
360
383
* Customizability
@@ -406,12 +429,12 @@ Fixed issue with XPath locators for waits in MagentoPwaWebDriver.
406
429
-----
407
430
408
431
* Traceability
409
-
* Allure report enhanced to display file path of tests.
432
+
* Allure report enhanced to display file path of tests.
410
433
* Maintainability
411
434
* Added support to read MFTF test entities from `<magento>dev/tests/acceptance/tests/functional/<vendor_name>/<module_name>/*`
412
435
* Removed path deprecation warning from `ModuleResolver`.
413
436
* Refactored problem methods to reduce cyclomatic complexity.
414
-
437
+
415
438
### Fixes
416
439
* Fixed issue with builds due to absence of AcceptanceTester class.
417
440
@@ -478,7 +501,7 @@ Fixed issue with XPath locators for waits in MagentoPwaWebDriver.
478
501
* Customizability
479
502
* Use of `_CREDS` has been extended to `<magentoCLI>` and `<createData>` actions
480
503
* Traceability
481
-
* A Test step is now generated and injected in the allure report when a test is reported as `BROKEN`.
504
+
* A Test step is now generated and injected in the allure report when a test is reported as `BROKEN`.
482
505
483
506
### Fixes
484
507
*`static-checks` command now properly returns `1` if any static check failed.
@@ -580,7 +603,7 @@ Fixed issue with XPath locators for waits in MagentoPwaWebDriver.
580
603
### Enhancements
581
604
* Maintainability
582
605
* Added new `mftf run:failed` commands, which reruns all failed tests from last run configuration.
583
-
606
+
584
607
### Fixes
585
608
* Fixed an issue where mftf would fail to parse test materials for extensions installed under `vendor`.
586
609
* Fixed a Windows compatibility issue around the use of Magento's `ComponentRegistrar` to aggregate paths.
@@ -669,15 +692,15 @@ Fixed issue with XPath locators for waits in MagentoPwaWebDriver.
669
692
670
693
2.3.1
671
694
-----
672
-
### Enhancements
695
+
### Enhancements
673
696
* Maintainability
674
697
*`mftf build:project` now copies over the `command.php` file into the parent Magento installation, if detected.
675
698
676
699
2.3.0
677
700
-----
678
-
### Enhancements
701
+
### Enhancements
679
702
* Traceability
680
-
* MFTF now outputs generation run-time information, warnings, and errors to an `mftf.log` file.
703
+
* MFTF now outputs generation run-time information, warnings, and errors to an `mftf.log` file.
681
704
* Overall error messages for various generation errors have been improved. Usage of the `--debug` flag provides file-specific errors for all XML-related errors.
682
705
* Allure Reports now require a unique `story` and `title` combination, to prevent collisions in Allure Report generation.
683
706
* The `features` annotation now ignores user input and defaults to the module the test lives under (for clear Allure organization).
@@ -728,7 +751,7 @@ Fixed issue with XPath locators for waits in MagentoPwaWebDriver.
728
751
729
752
2.2.0
730
753
-----
731
-
### Enhancements
754
+
### Enhancements
732
755
* Traceability
733
756
* Javascript errors are now logged and reported in test output.
734
757
* Test failures are no longer overwritten by failures in an `<after>` hook.
@@ -805,7 +828,7 @@ Fixed issue with XPath locators for waits in MagentoPwaWebDriver.
805
828
-----
806
829
### Enhancements
807
830
* Traceability
808
-
* Severity in `<annotation>` tags now properly reflect Magento severity values.
831
+
* Severity in `<annotation>` tags now properly reflect Magento severity values.
809
832
* Modularity
810
833
* Added ability to pass in simple values to actionGroups via addition of `type` attribute in actionGroup `<argument>` declaration.
811
834
* For examples, see devdocs article on actionGroups.
@@ -841,7 +864,7 @@ Fixed issue with XPath locators for waits in MagentoPwaWebDriver.
841
864
* Added the ability to refer to `custom_attribute` data in persisted entities via `key` instead of index.
842
865
* ex. `url_key` in category entity: `$category.custom_attributes[3][value]$` and `$category.custom_attributes[url_key]$` are both valid.
843
866
* Maintainability
844
-
* Added check for duplicate `stepKey` attributes at test generation. This check is scoped to `<testAction>` tags within a single `<test>` tag in a single file.
867
+
* Added check for duplicate `stepKey` attributes at test generation. This check is scoped to `<testAction>` tags within a single `<test>` tag in a single file.
845
868
846
869
### Fixes
847
870
* Fixed inability to use `<actionGroup>` with `<arguments>` in test hooks.
0 commit comments