Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Fix: merging coverage includes plugin tests. #662

Merged
merged 2 commits into from
Nov 11, 2024

Conversation

dblock
Copy link
Member

@dblock dblock commented Nov 11, 2024

Description

We used coverage/test-spec-coverage-${{ matrix.entry.version }}-${{ matrix.entry.tests || 'default' }}.json to make the coverage output file name, which may have contained / in cases like plugins/index-management. This caused the coverage merge code not to pickup those files because it's looking for test-spec-coverage-*.

This fixes that by using the hash instead of the path name. The version still needs to be there to make it unique.

The result as expected is slightly better than in previous PRs (e.g. here vs. #661).

Screenshot 2024-11-11 at 2 43 16 PM Screenshot 2024-11-11 at 2 43 50 PM

We also display paths that don't have tests when merging results so it's easier to identify tests to fill out.

image

By submitting this pull request, I confirm that my contribution is made under the terms of the Apache 2.0 license.
For more information on following Developer Certificate of Origin and signing off your commits, please check here.

@dblock dblock added the skip-changelog No need to update CHANGELOG. label Nov 11, 2024
Copy link
Contributor

github-actions bot commented Nov 11, 2024

Changes Analysis

Commit SHA: 6902eaa
Comparing To SHA: 62f1f5f

API Changes

Summary

NO CHANGES

Report

The full API changes report is available at: https://github.com/opensearch-project/opensearch-api-specification/actions/runs/11785290598/artifacts/2173027532

API Coverage

Before After Δ
Covered (%) 588 (57.59 %) 588 (57.59 %) 0 (0 %)
Uncovered (%) 433 (42.41 %) 433 (42.41 %) 0 (0 %)
Unknown 40 40 0

Copy link
Contributor

Spec Test Coverage Analysis

Total Tested
515 339 (65.83 %)

@Xtansia Xtansia merged commit 0d5f712 into opensearch-project:main Nov 11, 2024
25 checks passed
@dblock dblock deleted the fix-coverage-pct branch November 11, 2024 21:46
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
skip-changelog No need to update CHANGELOG.
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants