Skip to content

Commit f0ebf21

Browse files
authored
Merge pull request #181 from magento-gl/3.9.0-RC
3.9.0-RC : 3.9.0 Change log, version bump to develop
2 parents a934c0b + 88ddb9e commit f0ebf21

File tree

112 files changed

+1635
-316
lines changed

Some content is hidden

Large Commits have some content hidden by default. Use the searchbox below for content that may be hidden.

112 files changed

+1635
-316
lines changed

CHANGELOG.md

+61-38
Original file line numberDiff line numberDiff line change
@@ -1,5 +1,28 @@
11
Magento Functional Testing Framework Changelog
22
================================================
3+
3.9.0
4+
---------
5+
6+
### Fixes
7+
8+
* Fixed invalid UTF-8 chars returned from magentoCLI that breaks allure reporting
9+
* Fixed MFTF tests failure without access to S3
10+
* Removed sub heading Parameters from allure report
11+
* Removed truncation of parameters on running MFTF run:test
12+
13+
### Enhancements
14+
* MFTF group summary file
15+
* Static check to detect unused entities
16+
* Ability To Run MFTF JSON Configuration From File
17+
* Test generation error on invalid entities
18+
* Update MFTF to not pass NULL into non-nullable arguments
19+
* Static check for created data outside action group
20+
* Deleted the unused images
21+
* CreateData's <field> to allow uniqueness attribute
22+
* Set proper weight for action <startMessageQueue> for config parallel generation
23+
* Test before/after comments in test/allure
24+
* Throw error message if key value pair is not mapped properly in .credentials file
25+
326
3.8.0
427
---------
528

@@ -70,7 +93,7 @@ Magento Functional Testing Framework Changelog
7093
* [#870](https://github.com/magento/magento2-functional-testing-framework/pull/870) -- Removing the csharpru/vault-php-guzzle6-transport not needed dependency
7194
* [#871](https://github.com/magento/magento2-functional-testing-framework/pull/871) -- Changed loose comparisons into strict
7295
* [#872](https://github.com/magento/magento2-functional-testing-framework/pull/872) -- Fix broken MFTF tests
73-
96+
7497
3.6.1
7598
---------
7699

@@ -86,7 +109,7 @@ Magento Functional Testing Framework Changelog
86109

87110
* Maintainability
88111
* Updated composer dependencies to be PHP 8 compatible with the except of codeception/aspect-mock.
89-
112+
90113
### GitHub Pull Requests:
91114

92115
* [#830](https://github.com/magento/magento2-functional-testing-framework/pull/830) -- Add ability to configure multiple OTPs
@@ -110,7 +133,7 @@ Magento Functional Testing Framework Changelog
110133
### Enhancements
111134

112135
* Customizability
113-
* Added new `config:parallel --groups` option in `generate:tests` command to generate and split tests/suites into required number of execution time balanced groups.
136+
* Added new `config:parallel --groups` option in `generate:tests` command to generate and split tests/suites into required number of execution time balanced groups.
114137

115138
### Fixes
116139

@@ -129,19 +152,19 @@ Magento Functional Testing Framework Changelog
129152

130153
* Maintainability
131154
* Added support for composer 2.
132-
155+
133156
3.3.0
134157
---------
135158

136159
### Enhancements
137160

138161
* Usability
139162
* [#817](https://github.com/magento/magento2-functional-testing-framework/pull/817) -- Add support for admin WebAPI token refresh.
140-
163+
141164
* Maintainability
142165
* [#814](https://github.com/magento/magento2-functional-testing-framework/pull/814) -- Update dependencies in order to make mftf php8 compatible, fix running phpcpd
143-
* [#815](https://github.com/magento/magento2-functional-testing-framework/pull/815) -- Upgrade csharpru/vault-php to 4.1
144-
166+
* [#815](https://github.com/magento/magento2-functional-testing-framework/pull/815) -- Upgrade csharpru/vault-php to 4.1
167+
145168
### Fixes
146169

147170
* Fixed test generation error in a split suite group (--config=parallel) to allow generation of subsequent groups.
@@ -167,8 +190,8 @@ Magento Functional Testing Framework Changelog
167190
* Usability
168191
* Introduced error tolerance during test and suite generation. See the [command page](./docs/commands/mftf.md#error-tolerance-during-generation) for details.
169192
Addressed github issue [#276](https://github.com/magento/magento2-functional-testing-framework/issues/276).
170-
171-
* Maintainability
193+
194+
* Maintainability
172195
* Updated annotation static-check to check all required annotations.
173196

174197
### Fixes
@@ -183,7 +206,7 @@ Magento Functional Testing Framework Changelog
183206
* Removed `travis.yml` and replaced with `.github/workflows/main.yml`
184207

185208
### Fixes
186-
Fixed issue with XPath locators for waits in MagentoPwaWebDriver.
209+
Fixed issue with XPath locators for waits in MagentoPwaWebDriver.
187210

188211
3.1.0
189212
---------
@@ -197,13 +220,13 @@ Fixed issue with XPath locators for waits in MagentoPwaWebDriver.
197220
* Usability
198221
* Introduced new action `pause`, to invoke codeception interactive pause for debugging during test execution. See the [Interactive Pause](./docs/interactive-pause.md) page for details.
199222
* Introduced a new `.env` configuration option `ENABLE_PAUSE`, to enable the new pause feature.
200-
201-
* Maintainability
223+
224+
* Maintainability
202225
* Added a new static check that checks for the usage of the `pause` action. See the [command page](./docs/commands/mftf.md#static-checks) for details.
203-
204-
* Modularity
226+
227+
* Modularity
205228
* MFTF now supports the use of actions from multiple modules within suites.
206-
229+
207230
* Traceability
208231
* A deprecation notice is now added at test execution time for deprecated metadata usage.
209232

@@ -219,7 +242,7 @@ Fixed issue with XPath locators for waits in MagentoPwaWebDriver.
219242
* [#683](https://github.com/magento/magento2-functional-testing-framework/pull/683) -- Docs: Renamed sample test name with the correct one
220243
* [#691](https://github.com/magento/magento2-functional-testing-framework/pull/691) -- Docs: Branch name updates
221244
* [#678](https://github.com/magento/magento2-functional-testing-framework/pull/678) -- Docs: Command added to modify the web server rewrites configuration
222-
* [#745](https://github.com/magento/magento2-functional-testing-framework/pull/745) -- Docs: Remove invalid sample test name
245+
* [#745](https://github.com/magento/magento2-functional-testing-framework/pull/745) -- Docs: Remove invalid sample test name
223246

224247
3.0.0
225248
---------
@@ -230,22 +253,22 @@ Fixed issue with XPath locators for waits in MagentoPwaWebDriver.
230253
* Introduced MFTF helpers `<helper>` to create custom actions outside of MFTF.[See custom-helpers page for details](./docs/custom-helpers.md)
231254
* Removed deprecated actions `<executeSelenium>` and `<performOn>`.
232255
* `<group value="skip"/>` no longer skips a test. Instead, the test is added to the `skip` group.
233-
256+
234257
* Maintainability
235258
* Added support for PHP 7.4.
236259
* Added support for PHPUnit 9.
237260
* Dropped support for PHP 7.0, 7.1, 7.2.
238261
* Schema updates for test entities to only allow single entity per file except Data and Metadata.
239262
* Support for sub-folders in test modules.
240-
* Removed support to read test entities from `<magento>dev/tests/acceptance/tests/functional/Magento/FunctionalTest`.
263+
* Removed support to read test entities from `<magento>dev/tests/acceptance/tests/functional/Magento/FunctionalTest`.
241264
* Removed file attribute for `<module>` in suiteSchema.
242265
* Removed action `pauseExecution` and added `pause`. [See actions page for details](./docs/test/actions.md#pause)
243-
* Removed action `formatMoney` and added `formatCurrency`. [See actions page for details](./docs/test/actions.md#formatcurrency)
244-
* Improved assertion actions to support PHPUnit 9 changes. [See assertions page for details](./docs/test/assertions.md)
266+
* Removed action `formatMoney` and added `formatCurrency`. [See actions page for details](./docs/test/actions.md#formatcurrency)
267+
* Improved assertion actions to support PHPUnit 9 changes. [See assertions page for details](./docs/test/assertions.md)
245268
* Added new actions: `assertEqualsWithDelta`, `assertNotEqualsWithDelta`, `assertEqualsCanonicalizing`, `assertNotEqualsCanonicalizing`, `assertEqualsIgnoringCase`, `assertNotEqualsIgnoringCase`.
246269
* Added new actions: `assertStringContainsString`, `assertStringNotContainsString`, `assertStringContainsStringIgnoringCase`, `assertStringNotContainsStringIgnoringCase` for string haystacks.
247270
* Removed actions: `assertInternalType`, `assertNotInternalType`, `assertArraySubset`.
248-
* Removed delta option from `assertEquals` and `assertNotEquals`.
271+
* Removed delta option from `assertEquals` and `assertNotEquals`.
249272
* Added static check `deprecatedEntityUsage` that checks and reports references to deprecated test entities.
250273
* Added static check `annotations` that checks and reports missing annotations in tests.
251274
* Updated `bin/mftf static-checks` command to allow executing static-checks defined in `staticRuleSet.json` by default. [See command page for details](./docs/commands/mftf.md#static-checks)
@@ -254,19 +277,19 @@ Fixed issue with XPath locators for waits in MagentoPwaWebDriver.
254277
* `mftf.log` no longer includes notices and warnings at test execution time.
255278
* Added unhandledPromptBehavior driver capability for Chrome 75+ support.
256279
* Added the Chrome option `--ignore-certificate-errors` to `functional.suite.dist.yml`.
257-
280+
258281
* Traceability
259282
* Removed `--debug` option `NONE` to disallow ability to turn off schema validation.
260283
* Notices added for test entity naming convention violations.
261284
* Metadata file names changed to `*Meta.xml`.
262-
* Introduced new `.env` configuration `VERBOSE_ARTIFACTS` to toggle saving attachments in Allure. [See configuration page for details](./docs/configuration.md)
285+
* Introduced new `.env` configuration `VERBOSE_ARTIFACTS` to toggle saving attachments in Allure. [See configuration page for details](./docs/configuration.md)
263286
* Changed the `bin/mftf static-checks` error file directory from the current working directory to `TESTS_BP/tests/_output/static-results/`.
264-
287+
265288
* Readability
266-
* Support only nested assertion syntax [See assertions page for details](./docs/test/assertions.md).
289+
* Support only nested assertion syntax [See assertions page for details](./docs/test/assertions.md).
267290
* Documented [3.0.0 Backward Incompatible Changes](./docs/backward-incompatible-changes.md).
268-
* Removed blacklist/whitelist terminology in MFTF.
269-
291+
* Removed blacklist/whitelist terminology in MFTF.
292+
270293
* Upgrade scripts added to upgrade tests to MFTF major version requirements. See upgrade instructions below.
271294
* Bumped dependencies to support PHP/PHPUnit upgrade.
272295

@@ -354,7 +377,7 @@ Fixed issue with XPath locators for waits in MagentoPwaWebDriver.
354377
* Page
355378
* Section
356379
* Section Element
357-
* See DevDocs for details
380+
* See DevDocs for details
358381
* Improved `mftf static-checks` command to allow executing all or specific static checks.
359382
* Added a new static check that checks and reports unused arguments in action groups.
360383
* Customizability
@@ -406,12 +429,12 @@ Fixed issue with XPath locators for waits in MagentoPwaWebDriver.
406429
-----
407430

408431
* Traceability
409-
* Allure report enhanced to display file path of tests.
432+
* Allure report enhanced to display file path of tests.
410433
* Maintainability
411434
* Added support to read MFTF test entities from `<magento>dev/tests/acceptance/tests/functional/<vendor_name>/<module_name>/*`
412435
* Removed path deprecation warning from `ModuleResolver`.
413436
* Refactored problem methods to reduce cyclomatic complexity.
414-
437+
415438
### Fixes
416439
* Fixed issue with builds due to absence of AcceptanceTester class.
417440

@@ -478,7 +501,7 @@ Fixed issue with XPath locators for waits in MagentoPwaWebDriver.
478501
* Customizability
479502
* Use of `_CREDS` has been extended to `<magentoCLI>` and `<createData>` actions
480503
* Traceability
481-
* A Test step is now generated and injected in the allure report when a test is reported as `BROKEN`.
504+
* A Test step is now generated and injected in the allure report when a test is reported as `BROKEN`.
482505

483506
### Fixes
484507
* `static-checks` command now properly returns `1` if any static check failed.
@@ -580,7 +603,7 @@ Fixed issue with XPath locators for waits in MagentoPwaWebDriver.
580603
### Enhancements
581604
* Maintainability
582605
* Added new `mftf run:failed` commands, which reruns all failed tests from last run configuration.
583-
606+
584607
### Fixes
585608
* Fixed an issue where mftf would fail to parse test materials for extensions installed under `vendor`.
586609
* Fixed a Windows compatibility issue around the use of Magento's `ComponentRegistrar` to aggregate paths.
@@ -669,15 +692,15 @@ Fixed issue with XPath locators for waits in MagentoPwaWebDriver.
669692

670693
2.3.1
671694
-----
672-
### Enhancements
695+
### Enhancements
673696
* Maintainability
674697
* `mftf build:project` now copies over the `command.php` file into the parent Magento installation, if detected.
675698

676699
2.3.0
677700
-----
678-
### Enhancements
701+
### Enhancements
679702
* Traceability
680-
* MFTF now outputs generation run-time information, warnings, and errors to an `mftf.log` file.
703+
* MFTF now outputs generation run-time information, warnings, and errors to an `mftf.log` file.
681704
* Overall error messages for various generation errors have been improved. Usage of the `--debug` flag provides file-specific errors for all XML-related errors.
682705
* Allure Reports now require a unique `story` and `title` combination, to prevent collisions in Allure Report generation.
683706
* The `features` annotation now ignores user input and defaults to the module the test lives under (for clear Allure organization).
@@ -728,7 +751,7 @@ Fixed issue with XPath locators for waits in MagentoPwaWebDriver.
728751

729752
2.2.0
730753
-----
731-
### Enhancements
754+
### Enhancements
732755
* Traceability
733756
* Javascript errors are now logged and reported in test output.
734757
* Test failures are no longer overwritten by failures in an `<after>` hook.
@@ -805,7 +828,7 @@ Fixed issue with XPath locators for waits in MagentoPwaWebDriver.
805828
-----
806829
### Enhancements
807830
* Traceability
808-
* Severity in `<annotation>` tags now properly reflect Magento severity values.
831+
* Severity in `<annotation>` tags now properly reflect Magento severity values.
809832
* Modularity
810833
* Added ability to pass in simple values to actionGroups via addition of `type` attribute in actionGroup `<argument>` declaration.
811834
* For examples, see devdocs article on actionGroups.
@@ -841,7 +864,7 @@ Fixed issue with XPath locators for waits in MagentoPwaWebDriver.
841864
* Added the ability to refer to `custom_attribute` data in persisted entities via `key` instead of index.
842865
* ex. `url_key` in category entity: `$category.custom_attributes[3][value]$` and `$category.custom_attributes[url_key]$` are both valid.
843866
* Maintainability
844-
* Added check for duplicate `stepKey` attributes at test generation. This check is scoped to `<testAction>` tags within a single `<test>` tag in a single file.
867+
* Added check for duplicate `stepKey` attributes at test generation. This check is scoped to `<testAction>` tags within a single `<test>` tag in a single file.
845868

846869
### Fixes
847870
* Fixed inability to use `<actionGroup>` with `<arguments>` in test hooks.

composer.json

+2-1
Original file line numberDiff line numberDiff line change
@@ -2,7 +2,7 @@
22
"name": "magento/magento2-functional-testing-framework",
33
"description": "Magento2 Functional Testing Framework",
44
"type": "library",
5-
"version": "3.8.0",
5+
"version": "3.9.0",
66
"license": "AGPL-3.0",
77
"keywords": ["magento", "automation", "functional", "testing"],
88
"config": {
@@ -15,6 +15,7 @@
1515
"ext-intl": "*",
1616
"ext-json": "*",
1717
"ext-openssl": "*",
18+
"ext-iconv": "*",
1819
"allure-framework/allure-codeception": "^1.4",
1920
"aws/aws-sdk-php": "^3.132",
2021
"codeception/codeception": "^4.1",

0 commit comments

Comments
 (0)