Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

DAOS-10431 build: add ubuntu 22.04 client-only support #8811

Open
wants to merge 1 commit into
base: master
Choose a base branch
from

Conversation

johannlombardi
Copy link
Contributor

This patch migrates Ubuntu support from 20.04 to 22.04 which is the
latest LTS. It also removes support for server-side packages since
Ubuntu support will be limited to the DAOS client going forward.
GHA is also being updated to use 22.04.

To support client-only build, a few extra changes were required:

  • Argobots should not be built/required for client-only build
  • Header files in the object module needed to be split between
    server and client.
  • The enumeration code in the object module turns out to use
    server-side routines. The code has thus been split into two
    file: srv_enum.c (server-specific) and obj_enum.c (generic).
  • The SConscript of the security module has a caching capability
    that breaks the client-only build.

Signed-off-by: Johann Lombardi [email protected]

@johannlombardi johannlombardi requested a review from a team as a code owner April 24, 2022 20:51
Copy link
Collaborator

@daosbuild1 daosbuild1 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Style warning(s) for job https://build.hpdd.intel.com/job/daos-stack/job/daos/job/PR-8811/1/
Please review https://wiki.hpdd.intel.com/display/DC/Coding+Rules

FYI: Errors found in lines not modified in the patch:

site_scons/prereq_tools/base.py:312:
(pylint-consider-using-with) Consider using 'with' for resource-allocating operations

site_scons/prereq_tools/base.py:63:
(pylint-consider-using-with) Consider using 'with' for resource-allocating operations

@daosbuild1
Copy link
Collaborator

@daosbuild1
Copy link
Collaborator

Test stage Build RPM on EL 8 completed with status FAILURE. https://build.hpdd.intel.com//job/daos-stack/job/daos/view/change-requests/job/PR-8811/1/execution/node/378/log

@daosbuild1
Copy link
Collaborator

Test stage Build DEB on Ubuntu 20.04 completed with status FAILURE. https://build.hpdd.intel.com//job/daos-stack/job/daos/view/change-requests/job/PR-8811/1/execution/node/347/log

@daosbuild1
Copy link
Collaborator

Test stage Build RPM on Leap 15 completed with status FAILURE. https://build.hpdd.intel.com//job/daos-stack/job/daos/view/change-requests/job/PR-8811/1/execution/node/375/log

@daosbuild1
Copy link
Collaborator

Test stage Build RPM on CentOS 7 completed with status FAILURE. https://build.hpdd.intel.com//job/daos-stack/job/daos/view/change-requests/job/PR-8811/1/execution/node/381/log

@daosbuild1
Copy link
Collaborator

Test stage Build on CentOS 7 completed with status FAILURE. https://build.hpdd.intel.com//job/daos-stack/job/daos/view/change-requests/job/PR-8811/1/execution/node/397/log

@daosbuild1
Copy link
Collaborator

Test stage Build on Leap 15 with Intel-C and TARGET_PREFIX completed with status FAILURE. https://build.hpdd.intel.com//job/daos-stack/job/daos/view/change-requests/job/PR-8811/1/execution/node/539/log

@daosbuild1 daosbuild1 dismissed their stale review April 24, 2022 21:22

Updated patch

Copy link
Collaborator

@daosbuild1 daosbuild1 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM. No errors found by checkpatch.

FYI: Errors found in lines not modified in the patch:

site_scons/prereq_tools/base.py:312:
(pylint-consider-using-with) Consider using 'with' for resource-allocating operations

site_scons/prereq_tools/base.py:63:
(pylint-consider-using-with) Consider using 'with' for resource-allocating operations

Copy link
Collaborator

@daosbuild1 daosbuild1 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM. No errors found by checkpatch.

FYI: Errors found in lines not modified in the patch:

site_scons/prereq_tools/base.py:312:
(pylint-consider-using-with) Consider using 'with' for resource-allocating operations

site_scons/prereq_tools/base.py:63:
(pylint-consider-using-with) Consider using 'with' for resource-allocating operations

@daosbuild1
Copy link
Collaborator

Test stage Build RPM on EL 8 completed with status FAILURE. https://build.hpdd.intel.com//job/daos-stack/job/daos/view/change-requests/job/PR-8811/3/execution/node/369/log

@daosbuild1
Copy link
Collaborator

Test stage Build DEB on Ubuntu 20.04 completed with status FAILURE. https://build.hpdd.intel.com//job/daos-stack/job/daos/view/change-requests/job/PR-8811/3/execution/node/338/log

@daosbuild1
Copy link
Collaborator

Test stage Build RPM on Leap 15 completed with status FAILURE. https://build.hpdd.intel.com//job/daos-stack/job/daos/view/change-requests/job/PR-8811/3/execution/node/381/log

@daosbuild1
Copy link
Collaborator

Test stage Build RPM on CentOS 7 completed with status FAILURE. https://build.hpdd.intel.com//job/daos-stack/job/daos/view/change-requests/job/PR-8811/3/execution/node/370/log

@daosbuild1
Copy link
Collaborator

Test stage Build on Leap 15 with Intel-C and TARGET_PREFIX completed with status FAILURE. https://build.hpdd.intel.com//job/daos-stack/job/daos/view/change-requests/job/PR-8811/3/execution/node/412/log

@daosbuild1
Copy link
Collaborator

Test stage Build on CentOS 7 completed with status FAILURE. https://build.hpdd.intel.com//job/daos-stack/job/daos/view/change-requests/job/PR-8811/3/execution/node/397/log

Copy link
Collaborator

@daosbuild1 daosbuild1 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM. No errors found by checkpatch.

FYI: Errors found in lines not modified in the patch:

site_scons/prereq_tools/base.py:312:
(pylint-consider-using-with) Consider using 'with' for resource-allocating operations

site_scons/prereq_tools/base.py:63:
(pylint-consider-using-with) Consider using 'with' for resource-allocating operations

@daosbuild1
Copy link
Collaborator

Test stage Build DEB on Ubuntu 20.04 completed with status FAILURE. https://build.hpdd.intel.com//job/daos-stack/job/daos/view/change-requests/job/PR-8811/4/execution/node/337/log

@daosbuild1
Copy link
Collaborator

Test stage Build RPM on EL 8 completed with status FAILURE. https://build.hpdd.intel.com//job/daos-stack/job/daos/view/change-requests/job/PR-8811/4/execution/node/380/log

@daosbuild1
Copy link
Collaborator

Test stage Build RPM on Leap 15 completed with status FAILURE. https://build.hpdd.intel.com//job/daos-stack/job/daos/view/change-requests/job/PR-8811/4/execution/node/369/log

@daosbuild1
Copy link
Collaborator

Test stage Build RPM on CentOS 7 completed with status FAILURE. https://build.hpdd.intel.com//job/daos-stack/job/daos/view/change-requests/job/PR-8811/4/execution/node/366/log

@daosbuild1
Copy link
Collaborator

Test stage Build on Leap 15 with Intel-C and TARGET_PREFIX completed with status FAILURE. https://build.hpdd.intel.com//job/daos-stack/job/daos/view/change-requests/job/PR-8811/4/execution/node/411/log

@daosbuild1
Copy link
Collaborator

Test stage Build on CentOS 7 completed with status FAILURE. https://build.hpdd.intel.com//job/daos-stack/job/daos/view/change-requests/job/PR-8811/4/execution/node/396/log

Copy link
Collaborator

@daosbuild1 daosbuild1 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM. No errors found by checkpatch.

FYI: Errors found in lines not modified in the patch:

site_scons/prereq_tools/base.py:312:
(pylint-consider-using-with) Consider using 'with' for resource-allocating operations

site_scons/prereq_tools/base.py:63:
(pylint-consider-using-with) Consider using 'with' for resource-allocating operations

Copy link
Collaborator

@daosbuild1 daosbuild1 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM. No errors found by checkpatch.

FYI: Errors found in lines not modified in the patch:

site_scons/prereq_tools/base.py:312:
(pylint-consider-using-with) Consider using 'with' for resource-allocating operations

site_scons/prereq_tools/base.py:63:
(pylint-consider-using-with) Consider using 'with' for resource-allocating operations

@daosbuild1
Copy link
Collaborator

Test stage Build DEB on Ubuntu 20.04 completed with status FAILURE. https://build.hpdd.intel.com//job/daos-stack/job/daos/view/change-requests/job/PR-8811/14/execution/node/347/log

@daosbuild1
Copy link
Collaborator

Test stage Build RPM on Leap 15 completed with status FAILURE. https://build.hpdd.intel.com//job/daos-stack/job/daos/view/change-requests/job/PR-8811/14/execution/node/373/log

@daosbuild1
Copy link
Collaborator

Test stage Build RPM on EL 8 completed with status FAILURE. https://build.hpdd.intel.com//job/daos-stack/job/daos/view/change-requests/job/PR-8811/14/execution/node/381/log

@daosbuild1
Copy link
Collaborator

Test stage Build RPM on CentOS 7 completed with status FAILURE. https://build.hpdd.intel.com//job/daos-stack/job/daos/view/change-requests/job/PR-8811/14/execution/node/374/log

Copy link
Collaborator

@daosbuild1 daosbuild1 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Style warning(s) for job https://build.hpdd.intel.com/job/daos-stack/job/daos/job/PR-8811/15/
Please review https://wiki.hpdd.intel.com/display/DC/Coding+Rules

FYI: Errors found in lines not modified in the patch:

src/tests/security/SConscript:4:
(pylint-missing-function-docstring) Missing function or method docstring

src/tests/security/SConscript:10:
(pylint-pointless-string-statement) String statement has no effect

site_scons/prereq_tools/base.py:312:
(pylint-consider-using-with) Consider using 'with' for resource-allocating operations

site_scons/prereq_tools/base.py:63:
(pylint-consider-using-with) Consider using 'with' for resource-allocating operations

@@ -2,6 +2,11 @@
import daos_build

def scons():
if not prereqs.server_requested():
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

(pylint-used-before-assignment) Using variable 'prereqs' before assignment

@daosbuild1
Copy link
Collaborator

@daosbuild1
Copy link
Collaborator

Test stage Build DEB on Ubuntu 20.04 completed with status FAILURE. https://build.hpdd.intel.com//job/daos-stack/job/daos/view/change-requests/job/PR-8811/15/execution/node/348/log

@daosbuild1
Copy link
Collaborator

Test stage Build on CentOS 7 completed with status FAILURE. https://build.hpdd.intel.com//job/daos-stack/job/daos/view/change-requests/job/PR-8811/15/execution/node/429/log

@daosbuild1
Copy link
Collaborator

Test stage Build RPM on EL 8 completed with status FAILURE. https://build.hpdd.intel.com//job/daos-stack/job/daos/view/change-requests/job/PR-8811/15/execution/node/410/log

@daosbuild1
Copy link
Collaborator

Test stage Build RPM on Leap 15 completed with status FAILURE. https://build.hpdd.intel.com//job/daos-stack/job/daos/view/change-requests/job/PR-8811/15/execution/node/413/log

@daosbuild1
Copy link
Collaborator

Test stage Build RPM on CentOS 7 completed with status FAILURE. https://build.hpdd.intel.com//job/daos-stack/job/daos/view/change-requests/job/PR-8811/15/execution/node/407/log

@daosbuild1
Copy link
Collaborator

Test stage Build on Leap 15 with Intel-C and TARGET_PREFIX completed with status FAILURE. https://build.hpdd.intel.com//job/daos-stack/job/daos/view/change-requests/job/PR-8811/15/execution/node/562/log

Copy link
Collaborator

@daosbuild1 daosbuild1 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM. No errors found by checkpatch.

FYI: Errors found in lines not modified in the patch:

src/tests/security/SConscript:6:
(pylint-syntax-error) unindent does not match any outer indentation level (, line 13)

site_scons/prereq_tools/base.py:312:
(pylint-consider-using-with) Consider using 'with' for resource-allocating operations

site_scons/prereq_tools/base.py:63:
(pylint-consider-using-with) Consider using 'with' for resource-allocating operations

@daosbuild1
Copy link
Collaborator

Test stage Build DEB on Ubuntu 20.04 completed with status FAILURE. https://build.hpdd.intel.com//job/daos-stack/job/daos/view/change-requests/job/PR-8811/16/execution/node/328/log

@daosbuild1
Copy link
Collaborator

Test stage Build on CentOS 7 completed with status FAILURE. https://build.hpdd.intel.com//job/daos-stack/job/daos/view/change-requests/job/PR-8811/16/execution/node/427/log

This patch migrates Ubuntu support from 20.04 to 22.04 which is the
latest LTS. It also removes support for server-side packages since
Ubuntu support will be limited to the DAOS client going forward.
GHA is also being updated to use 22.04.

To support client-only build, a few extra changes were required:
- Argobots should not be built/required for client-only build
- Header files in the object module needed to be split between
  server (srv_internal.h) and client (obj_internal.h).
- The enumeration code in the object module turns out to use
  server-side routines. The code has thus been split into two
  file: srv_enum.c (server-specific) and obj_enum.c (generic).
  Some server-side code used between server components has been
  exported by adding a new daos_srv/object.h header file.
- The SConscript of the security module has a caching capability
  that breaks the client-only build.

Signed-off-by: Johann Lombardi <[email protected]>
Copy link
Collaborator

@daosbuild1 daosbuild1 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM. No errors found by checkpatch.

FYI: Errors found in lines not modified in the patch:

site_scons/prereq_tools/base.py:312:
(pylint-consider-using-with) Consider using 'with' for resource-allocating operations

site_scons/prereq_tools/base.py:63:
(pylint-consider-using-with) Consider using 'with' for resource-allocating operations

@daosbuild1
Copy link
Collaborator

Test stage Build DEB on Ubuntu 20.04 completed with status FAILURE. https://build.hpdd.intel.com//job/daos-stack/job/daos/view/change-requests/job/PR-8811/17/execution/node/347/log

@daosbuild1
Copy link
Collaborator

Test stage Build RPM on EL 8 completed with status FAILURE. https://build.hpdd.intel.com//job/daos-stack/job/daos/view/change-requests/job/PR-8811/17/execution/node/381/log

@daosbuild1
Copy link
Collaborator

Test stage Build RPM on Leap 15 completed with status FAILURE. https://build.hpdd.intel.com//job/daos-stack/job/daos/view/change-requests/job/PR-8811/17/execution/node/375/log

@daosbuild1
Copy link
Collaborator

Test stage Build RPM on CentOS 7 completed with status FAILURE. https://build.hpdd.intel.com//job/daos-stack/job/daos/view/change-requests/job/PR-8811/17/execution/node/359/log

@@ -16,11 +16,19 @@ jobs:
runs-on: ubuntu-20.04
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

22.04?

@johannlombardi johannlombardi requested a review from a team as a code owner July 24, 2022 21:17
Copy link
Contributor

@jolivier23 jolivier23 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I got notified because you modified a SConscript. It needs to be updated due to conflicts. If it's not ready for review, please make it a draft PR.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Development

Successfully merging this pull request may close these issues.

4 participants