Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

MDBF-772: Test all past MariaDB version that they install #593

Draft
wants to merge 34 commits into
base: dev
Choose a base branch
from

Conversation

illuusio
Copy link
Contributor

Add New Build template

Test with all current MariaDB versions that commit can be installed over them and it works after that. This is still in draft and need feedback to be ironed out. As there is probably lot of things that I don't understand.

Checklist

  • Make changes os_info.yaml
  • Schedule the builder for the appropriate branch in constants.py
  • Add builder configuration

grooverdan and others added 30 commits September 19, 2024 15:21
Add worker for openeuler 24.03.

Rename container generation to mathc the same name.
Clients in our binary taballs are linked dynamically with libncurses, which causes a trouble on systems where it is no longer available
As per MDBF-794 only centos7 and debian 10 bintar builders need to link statically with libncurses.

- for debian 10: libncurses.a is already present in /scripts/local/lib/ and -DCURSES_NEED_NCURSES=1 flag is enough to link it statically.
- for centos7: I've rebuilt the image and pushed manually a dev_ tag. libncurses.a was present on the system but not in the library path: /scripts/local/lib/

Tests available at:
- debian10: https://buildbot.dev.mariadb.org/#/builders/187/builds/23
- centos7: https://buildbot.dev.mariadb.org/#/builders/172/builds/292

Reference CMAKE output line:
-- Found Curses: /scripts/local/lib/libncurses.a
Adjust images to 1505 notation as well.
Fedora 41 is including MariaDB 10.11 so
use that as the minimum version.
Centos based have asio-devel in EPEL.

SLES is omitted as it requires a subpackage module
repository to be enabled. Doing so would increase
the package dependencies when using the built packages.
https://packagehub.suse.com/packages/asio/
(SLE-Module-PackageHub-Subpackages-Module )

OpenSUSE also has asio-devel but adds a complicated
path in with the openssl libraries and boost that
we'd be influcting on users if they used a non-bundled
version.

On RHEL - asio-devel in ubi9 EPEL but not 8.
Parts 1 and 2: Switching minor upgrade into "all" mode and extending
it with additional checks (ldd, requirements, capabilities)
During the "Compile step" - create_initial_db.cmake runs a bootstrap as a sanity check to avoid spending time on test runs.

It can happen that some changes on the server may cause a loop during the bootstrap process. Buildbot will terminate the parent process (dojob) when it reaches a timeout, but the MariaDB service will remain up causing new builds to fail.
https://buildbot.mariadb.org/#/builders/234/builds/32911

Modified the stop_processes step so handle this.
Use ( deb | archive ).mariadb.org to download the Packages file. This file is mandatory for both the 'All' and 'Columnstore' test types, exit with error if it is not found.

Apply uniq to remove duplicate values in the package list and sort the list for readability.
… old bb

- .build-id files may also be present on old systems where --noartifact
  does not work
- package dependencies need to be sorted for comparison
- dependency collection hangs frequently in buildbot, enabled logging
  temporarily to get more output for the issue
… old bb

- .build-id files may also be present on old systems where --noartifact
  does not work
- package dependencies need to be sorted for comparison
- dependency collection hangs frequently in buildbot, enabled logging
  temporarily to get more output for the issue
Improving build time by excluding the too many files of mariadb-test package from the ldd check when dependencies are collected.
Align code with old-bb and peform an extra restart after the previous version is installed so plugins are loaded.
The build runs --big-test which puts a lot of memory pressure
on the machine, so adjusting the parallel to mitigate this.
Filter out galera | columnstore. Match old BB configuration.
 - easy to re-trigger all the builds.
 - when new platforms are introduced one can trigger a build by re-building "trigger-galera-builds" for a particular revision . No need to wait for upstream changes to build on new platforms.
@illuusio illuusio marked this pull request as draft October 14, 2024 11:30
Test with all current MariaDB versions that commit
can be installed over them and it works after that
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Development

Successfully merging this pull request may close these issues.

6 participants