Merge pull request #3135 from molgenis/setup-ssr-manual-tests

* chore: update e2e (playwright) readme
* chore: added catalogue-test_1 through _9

e2e/README.md

@@ -1,5 +1,3 @@
-#
-
 We have e2e tests using playwright
 
 To install:
@@ -19,9 +17,12 @@ You can also run from the molgenis-emx2 project root as follows
 
 The test is part of .circleci/config.yml running that same command
 
-### Adding tests 
+## playwright vscode plugin
+
+[Playwright: Getting started - VS Code](https://playwright.dev/docs/getting-started-vscode)
+
+## Adding tests
 
-We suggest to use the vscode plugin for creating/recording new (tests https://playwright.dev/docs/codegen)
-The `playwright.config.ts` file contains the test configuarion including the default server path. It is suggested to use relative server paths ( instead of `https://my-server.com/my-page` use `/my-page` ) to make it possible for test to run agains diffent servers. 
+We suggest to use the vscode plugin for [creating/recording](https://playwright.dev/docs/codegen) new tests. The `playwright.config.ts` file contains the test configuration including the default server path. It is suggested to use relative server paths ( instead of `https://my-server.com/my-page` use `/my-page` ) to make it possible for test to run against different servers.
 
-By default tests are run for all pull requests, on the server connected to the pull request preview ( i.e. test for pr `007` will  by ( default ) run on `https://preview-emx2-pr-3404.dev.molgenis.org/` 
+By default tests are run for all pull requests, on the server connected to the pull request preview ( i.e. test for pr `007` will  by ( default ) run on `https://preview-emx2-pr-007.dev.molgenis.org/`

e2e/manual-tests/README.md

@@ -0,0 +1,36 @@
+# Catalogue manual tests
+
+The folder `e2e/catalogue` contains the manual test used by cohort data managers to test with multiple user roles in mind. For example the markdown file `catalogue-test_1.md`.
+
+ Some of these manual steps will overlap the automated steps described above but we aim to minimize overlap. The tests will describe which server and page needs testing. The cohort team manager will specify the [version](https://github.com/molgenis/molgenis-emx2/releases) that will be tested. Only when this version is considered stable the update will be rolled out to the defined production server.
+
+## Catalogue user roles
+
+1. Naïve user.
+2. Researcher.
+3. Data manager of a cohort.
+4. Data manager of a data source.
+5. Data manager of harmonized variables
+6. Data manager of a network.
+
+## Catalogue manual test template
+
+The manual test is formatted as markdown and minimally should contain the following information.
+
+- Number
+- Role
+- Goal
+- Steps
+  - Step number
+  - Action(s)
+  - Expected result(s)
+  - Github bug/issue (If step has known bug or issue set to: bug/issue number)
+  - Playwright test (If step is covered by playwright set to: true)
+
+## Catalogue playwright test
+
+The folder `e2e/catalogue` also contains the playwright tests. These follow the same naming schema but their extension end with `spec.ts`. For example the manual test `catalogue-test_1.md` is saved in the folder `e2e/tests/catalogue/` as playwright test: `catalogue-test_1.spec.ts`
+
+### playwright vscode plugin
+
+[Playwright: Getting started - VS Code](https://playwright.dev/docs/getting-started-vscode)

e2e/manual-tests/catalogue/catalogue-test_1.md

@@ -0,0 +1,32 @@
+# Number
+
+1
+
+# Role
+
+Naïve user of the data catalogue
+
+# Goal
+
+A naïve visitor to the data catalogue can click around in the catalogue and understand what s/he is seeing when viewing a network of networks.
+
+# Steps
+
+| Step | Action | Expected result | Github bug/issue | Playwright test |
+| -----| -------| ----------------| -----------------| ----------------|
+| 1 | Navigate to [https://data-catalogue-acc.molgeniscloud.org/testCatalogue/ssr-catalogue/](https://data-catalogue-acc.molgeniscloud.org/testCatalogue/ssr-catalogue/) | Landing page: European health research data and sample catalogue| | true |
+| 2 | In section 'Project catalogues' hover over the testNetworkofNetworks row | Row should be highlighted | | true |
+| 3 | Click on the testNetworkofNetworks row | Should be directed to the testNetworkofNetworks with 'Welcome to the catalogue of testNetworkofNetworks: name for test network of networks [etc]', and Cohorts (3), Variables (3) and Networks (2) buttons | | true |
+| 3a | | There should be 700 participants, 250 samples and 67% Longitudinal given.| | true |
+| 3b | | In the ribbon at the top of the page there should be: Left: MOLGENIS logo (test logo to be implemented in test data), Right: (L-R) Overview, Cohorts, Variables, Networks, More  | | true |
+| 4 | Click on the MOLGENIS logo | The page doesn't change | | true |
+| 5| Click on the 'Overview' button| The page doesn't change | | true |
+| 6| Click on the 'Cohorts' button at the top | Should be directed to the list of cohorts for the testNetworkofNetworks | | true |
+| 7 | Click on the MOLGENIS logo | Should be directed back to the home page for testNetworkofNetworks | | true |
+| 8 | Click on the 'Variables' button at the top |  Should be directed to the list of variables for the testNetworkofNetworks | | true |
+| 9| Click on the 'Overview' button at the top |Should be directed back to the home page for testNetworkofNetworks | | true |
+| 10 | Click on the 'Networks' button at the top | Should be directed to the list of networks with which testNetworkofNetworks is associated (testNetwork1, testNetwork2) | | true |
+| 11 | Click on testNetwork1 | Should be directed to the testNetwork1 detailed network page with description, website, list of cohorts and list of variables | | true |
+| 12 | Click on the 'Overview' button at the top | Should be directed back to the home page for testNetworkofNetworks | | true |
+| 13 | Click on More --> About | Should be directed to the detailed network page for testNetworkofNetworks (THIS IS NOT THE SAME AS THE HOME PAGE!) with description, website, list of cohorts and list of variables | | true |
+| 14 | Click on More --> Other catalogues | Should be directed to the landing page showing all thematic and project catalogues, entitled "European Health Research Data and Sample Catalogue" | | true |

e2e/manual-tests/catalogue/catalogue-test_2.md

@@ -0,0 +1,30 @@
+# Number
+
+2
+
+# Role
+
+Naïve user of the data catalogue
+
+# Goal
+
+A naïve visitor to the data catalogue can click around in the catalogue and understand what she is seeing when viewing a network.
+
+# Steps
+
+| Step | Action | Expected result | Github bug/issue | Playwright test |
+| ---- | ------ | --------------- | -----------------| ----------------|
+| 1 | Navigate to [https://data-catalogue-acc.molgeniscloud.org/testCatalogue/ssr-catalogue/](https://data-catalogue-acc.molgeniscloud.org/testCatalogue/ssr-catalogue/) | Landing page: European health research data and sample catalogue| | |
+| 2 | In section 'Thematic catalogues' hover over the testNetwork1 row | Row should be highlighted | | |
+| 3 | Click on the testNetwork1 logo (to be implemented, now MOLGENIS logo) | Should be directed to the testNetwork1 home page with 'Welcome to the catalogue of testNetwork1: [etc]', and Cohorts (4), Data sources (1), Variables (3) buttons | | |
+| 3a | | There should be 700 participants, 250 samples and 50% Longitudinal given. | | |
+| 3b | | In the ribbon at the top of the page there should be: Left: testnetwerk1 logo, Right: (L-R) Overview, Cohorts, Data sources, Variables, More | | |
+| 4 | Click on the testNetwork1 logo (to be implemented, now MOLGENIS logo) | The page doesn't change | | |
+| 5 | Click on the 'Overview' button| The page doesn't change | | |
+| 6 | Click on the 'Cohorts' button at the top | Should be directed to the list of cohorts for testNetwork1 | | |
+| 7 | Click on the testNetwork1 logo (to be implemented, now MOLGENIS logo) | Should be directed back to the home page for testNetwork1 | | |
+| 8 | Click on the 'Data Sources' button at the top | Should be directed to the list of data sources for testNetwork1 | | |
+| 9 | Click on the 'Variables' button at the top |  Should be directed to the list of variables for testNetwork1 | | |
+| 10 | Click on the 'Overview' button at the top |Should be directed back to the home page for testNetwork1 | | |
+| 11 | Click on More --> 'About' button | Should be directed to the detailed network page for testNetwork1 with description, website, list of cohorts and list of variables | | |
+| 12 | Click on More --> Other catalogues | Should be directed to the landing page showing all thematic and project catalogues, entitled "European Health Research Data and Sample Catalogue" | | |

e2e/manual-tests/catalogue/catalogue-test_3.md

@@ -0,0 +1,27 @@
+# Number
+
+3
+
+# Role
+
+Naïve user of the data catalogue
+
+# Goal
+
+A naïve visitor to the data catalogue can click around in the catalogue and understand what s/he is seeing when viewing a cohort.
+
+# Steps
+
+| Step | Action | Expected result | Github bug/issue | Playwright test |
+| -----| -------| ----------------| -----------------| ----------------|
+| 1 | Navigate to [https://data-catalogue-acc.molgeniscloud.org/testCatalogue/ssr-catalogue/](https://data-catalogue-acc.molgeniscloud.org/testCatalogue/ssr-catalogue/) | Landing page: European health research data and sample catalogue| | |
+| 2 | Hover over the testNetwork1 row | Row should be highlighted | | |
+| 3 | Click on the testNetwork1 row | Should be directed to the testNetwork1 home page with 'Welcome to the catalogue of testNetwork1: name for test network1. Select one of the content categories listed below.', and Cohorts (4), Data Sources (1) and Variables (3) buttons | | |
+| 3a | | There should be 700 participants, 250 samples and 50% Longitudinal given. | | |
+| 3b | | In the ribbon at the top of the page there should be: Left: testNetwork1 logo, Right: (L-R) Overview, Cohorts, Data Sources, Variables, More | | |
+| 4 |  Click on the 'Cohorts' button under 'Cohorts' | Should be directed to the list of cohorts for testNetwork1 with: Cohorts logo, "Group of individuals sharing a defining demographic characteristic", Detailed/Compact toggle buttons (Default is selected), Filters on the LHS | | |
+| 5 | Click on Compact | The list of cohorts turns into a list of cohort acronyms and cohort names-in-full, with an arrow after each cohort | | |
+| 6 | Scroll down and click on the arrow next to 'acronym for test cohort 2' | Should be directed to the cohort home page with: 'testnetwork1 > COHORTS', 'ACRONYM FOR TEST COHORT 2', 'Name for test cohort 2' | | |
+|6a ||In the ribbon at the top of the page there should be: Left: testnetwork1 logo, Right: (L-R) Overview, Cohorts, Data Sources, Variables, More | | |
+| 6b ||The following elements are listed: name of cohort, website, Description, General design, Contact & contributors, Available data & samples, Subpopulations, Collection events, Datasets, Networks, Partners, Access conditions, Funding & Citation requirements, Attached files | | |
+| 7 | Click on the Cohorts button in the ribbon | Should be directed back to the list of cohorts for testnetwork1 | | |

e2e/manual-tests/catalogue/catalogue-test_4.md

@@ -0,0 +1,33 @@
+# Number
+
+4
+
+# Role
+
+Researcher searching for specific variables of a project.
+
+# Goal
+
+A researcher working in consortium X (*example: testNetwork1*) searches for specific variables (*example: all ADHD variables*) to check which cohorts have these available.
+
+# Steps
+
+| Step | Action | Expected result |  Playwright test |
+| -----| -------| ----------------| -----------------| 
+| 1 | Navigate to [https://data-catalogue-acc.molgeniscloud.org/testCatalogue/ssr-catalogue/](https://data-catalogue-acc.molgeniscloud.org/testCatalogue/ssr-catalogue/) | Landing page: European health research data and sample catalogue| | 
+| 2 | Go to the catalogue 'testNetwork1', under 'Thematic catalogues' | From left to right the network logo, testNetwork1 name (link) and description, arrow right (link) | | 
+| 3 | Hover over the testNetwork1 row | Row should be highlighted | | 
+| 4 | Click on the testNetwork1 logo | Should be redirected to the testNetwork1 'Welcome to... Select one of the content categories listed below.' | | 
+| 4a |  Go back | Return to the European Health Research Data and Sample Catalogue page
+| 5 | Click on the testNework1 name | Should be redirected to the testNetwork1 'Welcome to... Select one of the content categories listed below.'. Cohorts should show 4, variables should show 3. | | 
+| 6 | Hover over yellow Variables button | Button should be highlighted | | 
+| 7 | Click Variables button | Should be redirected to testNetwork1 variable explorer | | 
+| 8 | Search 'repeats' in search bar | Variables should be filtered on repeats variables ('testVarrepeats' and 'testVarNoRepeats'); topics should be filtered on repeats; active filters should show 'repeats'  | | 
+| 9 | Open topic 'Symptoms and signs' > 'Symptoms and signs involving cognition, perception, emotional state and behaviour (R40-R46)' > 'Behavioral problem domains' > select 'ADHD symptoms' | Variables should be filtered on ADHD variables ('testVarRepeats_' and 'testVarNoRepeats'); active filters should show topic name| | 
+| 10 | Click on the name of first variable 'testVarRepeats_' | Should redirect to variable detailed view; Details should show: 1) description, 2) table with all repeats and cohorts (part of the network) that have information about this variable, 3) harmonization status per repeat per cohort. testCohort1 should show all repeats completely harmonized; testCohort2 should show all repeats NA; testCohort3 and testCohort4 should show partial, NA and complete. Example: testCohort3 should show repeat 1 completely, repeat 3 NA and repeat 4 partial. 4) tabs for each cohorts with further details (variables used, syntax) | | 
+| 11 | Click on second cohort tab | Tab should show information for second cohort | | 
+| 12 | Click first variable used | Dialog should show information available for the source variable | | 
+| 13 | Click back button to return to previous page | Should be redirected to network variable explorer with previously selected filters | | 
+| 14 | Open 'Harmonizations' tab | Harmonizations tab should show only ADHD variables and cohorts part of the network; Show correct statuses for harmonization (testCohort1: has info; testCohort2: no info; testCohort3: has info; testCohort4: no info)| | 
+| 16 | Click first variable | Should show pop up/dialog with information about variable | | 
+| 17 | Click 'more details' in dialog| Should redirect variable detailed view | |