Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

tests: report passed testcases to Fedora Wiki #601

Open
wants to merge 4 commits into
base: main
Choose a base branch
from

Conversation

KKoukiou
Copy link
Contributor

No description provided.

@KKoukiou KKoukiou force-pushed the INSTALLER-4111 branch 3 times, most recently from 083c3f8 to 30ec03a Compare January 22, 2025 15:48
@KKoukiou KKoukiou removed the no-test label Jan 23, 2025
@KKoukiou KKoukiou changed the title WIP: generate a report for Wiki for the latest compose tests: report passed testcases to Fedora Wiki Jan 23, 2025
KKoukiou added a commit to KKoukiou/cockpituous that referenced this pull request Jan 23, 2025
KKoukiou added a commit to KKoukiou/cockpituous that referenced this pull request Jan 23, 2025
martinpitt pushed a commit to cockpit-project/cockpituous that referenced this pull request Jan 23, 2025
The section is needed when reporting the tests results to the Wiki.

Wiki still does not contains Web UI specific tests plans in the
Matrix. The sections specified in this commit are not yet present either.
@KKoukiou KKoukiou force-pushed the INSTALLER-4111 branch 2 times, most recently from 6bae4cc to e809bdc Compare January 23, 2025 15:40
@KKoukiou KKoukiou requested a review from jkonecny12 January 23, 2025 16:18
Copy link
Member

@jkonecny12 jkonecny12 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

A few minor notes. Looks great to me overall.

test/anacondalib.py Outdated Show resolved Hide resolved
dist="Fedora",
env=testcase["env"],
milestone="Rawhide",
release="42",
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Please put the TODO from commit message to the code. It is more visible.

try:
wiki.login()
except mwclient.errors.LoginError:
wiki.login()
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Shouldn't we put at least a small sleep before the second attempt?

Also we should log why was the login unsuccessful if possible.

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Hm, not sure how it would help, we are guessing at this point. Anyway, I copied this code from https://pagure.io/fedora-qa/fedora_openqa/blob/main/f/src/fedora_openqa/report.py#_338

Comment on lines +92 to +94
tmpl = "already reported result for test %s, env %s! Will not report dupe."
logger.info(tmpl, dupe.testcase, dupe.env)
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I don't think that tmpl variable is necessary, just write the message on two lines or create a new line before.

Just a suggestion, I don't insist on fixing this.

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

it would be long line

logger.debug("full ResTuple: %s", dupe)

for insuff in insuffs:
tmpl = "insufficient data for test %s, env %s! Will not report."
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Same here.

test/wiki-report.py Outdated Show resolved Hide resolved
Only when testing against composes.

This was inspired by openQA Wiki report script [1].

TODO: Remove 'Fedora 42' hardcoded values.

[1] https://pagure.io/fedora-qa/fedora_openqa/blob/main/f/src/fedora_openqa/report.py
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants