Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

DPL: trigger runtime error in case of duplicate processor names #13963

Open
wants to merge 3 commits into
base: dev
Choose a base branch
from

Conversation

ehellbar
Copy link
Collaborator

@ehellbar ehellbar commented Feb 13, 2025

Adding processors to the workflow if they have the same name as an already added processor but come from a different executable. This will trigger a runtime error in the MATERIALISE_WORKFLOW state in

WorkflowParsingState WorkflowHelpers::verifyWorkflow(const o2::framework::WorkflowSpec& workflow)

@ehellbar ehellbar requested a review from a team as a code owner February 13, 2025 16:04
Copy link
Contributor

REQUEST FOR PRODUCTION RELEASES:
To request your PR to be included in production software, please add the corresponding labels called "async-" to your PR. Add the labels directly (if you have the permissions) or add a comment of the form (note that labels are separated by a ",")

+async-label <label1>, <label2>, !<label3> ...

This will add <label1> and <label2> and removes <label3>.

The following labels are available
async-2023-pbpb-apass4
async-2023-pp-apass4
async-2024-pp-apass1
async-2022-pp-apass7
async-2024-pp-cpass0
async-2024-PbPb-apass1
async-2024-ppRef-apass1

davidrohr
davidrohr previously approved these changes Feb 13, 2025
Copy link
Collaborator

@davidrohr davidrohr left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Great, thx, though didn't verify that it actually works.

@ehellbar
Copy link
Collaborator Author

I checked it with two workflows and one of the dummy workflows where I changed the name of one processor to match one of the other workflows. I got the error whenever I included the dummy workflow, and never without it.

@@ -2959,7 +2959,11 @@ int doMain(int argc, char** argv, o2::framework::WorkflowSpec const& workflow,
for (auto& dp : importedWorkflow) {
auto found = std::find_if(physicalWorkflow.begin(), physicalWorkflow.end(),
[&name = dp.name](DataProcessorSpec const& spec) { return spec.name == name; });
if (found == physicalWorkflow.end()) {
// also checking the workflow for processors with the same name but from a different executable,
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Why two find_if statements?

Copy link
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

good point :)

@alibuild
Copy link
Collaborator

alibuild commented Feb 14, 2025

Error while checking build/O2/fullCI for 419b9db at 2025-02-17 14:54:

## sw/BUILD/O2-latest/log
c++: error: unrecognized command-line option '--rtlib=compiler-rt'
c++: error: unrecognized command-line option '--rtlib=compiler-rt'


## sw/BUILD/O2Physics-latest/log
Error in cling::AutoLoadingVisitor::InsertIntoAutoLoadingState:
Error in cling::AutoLoadingVisitor::InsertIntoAutoLoadingState:
Error in cling::AutoLoadingVisitor::InsertIntoAutoLoadingState:
Error in cling::AutoLoadingVisitor::InsertIntoAutoLoadingState:
Error in cling::AutoLoadingVisitor::InsertIntoAutoLoadingState:
Error in cling::AutoLoadingVisitor::InsertIntoAutoLoadingState:
Error in cling::AutoLoadingVisitor::InsertIntoAutoLoadingState:
Error in cling::AutoLoadingVisitor::InsertIntoAutoLoadingState:
Error in cling::AutoLoadingVisitor::InsertIntoAutoLoadingState:
Error in cling::AutoLoadingVisitor::InsertIntoAutoLoadingState:
Error in cling::AutoLoadingVisitor::InsertIntoAutoLoadingState:
Error in cling::AutoLoadingVisitor::InsertIntoAutoLoadingState:
Error in cling::AutoLoadingVisitor::InsertIntoAutoLoadingState:
Error in cling::AutoLoadingVisitor::InsertIntoAutoLoadingState:
Error in cling::AutoLoadingVisitor::InsertIntoAutoLoadingState:
Error in cling::AutoLoadingVisitor::InsertIntoAutoLoadingState:
Error in cling::AutoLoadingVisitor::InsertIntoAutoLoadingState:
Error in cling::AutoLoadingVisitor::InsertIntoAutoLoadingState:


## sw/BUILD/O2-full-system-test-latest/log
command /sw/slc8_x86-64/O2/13963-slc8_x86-64-local1/prodtests/full-system-test/dpl-workflow.sh had nonzero exit code 1
[ERROR] invalid workflow in o2-its-reco-workflow: No matching output found for ITS/CLUSTERSROF/0 as requested by data processor "its-tracker". Candidates:
[ERROR] -DPL/ENUM/1301969186
[ERROR] -CPV/RAWDATA
[ERROR] -CTP/RAWDATA
[ERROR] -EMC/RAWDATA
[ERROR] -FDD/RAWDATA
[ERROR] -FLP/DISTSUBTIMEFRAME/0
[ERROR] -FLP/DISTSUBTIMEFRAME/52443
[ERROR] -FT0/RAWDATA
[ERROR] -FV0/RAWDATA
[ERROR] -HMP/RAWDATA
[ERROR] -ITS/RAWDATA
[ERROR] -MCH/RAWDATA
[ERROR] -MFT/RAWDATA
[ERROR] -MID/RAWDATA
[ERROR] -PHS/RAWDATA
[ERROR] -TOF/RAWDATA
[ERROR] -TPC/RAWDATA
[ERROR] -TRD/RAWDATA
[ERROR] -ZDC/RAWDATA
[ERROR] -CPV/CPV_BadMap/0
[0 more errors; see full log]

Full log here.

@alibuild
Copy link
Collaborator

Error while checking build/O2/fullCI_slc9 for 419b9db at 2025-02-14 21:42:

## sw/BUILD/O2Physics-latest/log
Error in cling::AutoLoadingVisitor::InsertIntoAutoLoadingState:
Error in cling::AutoLoadingVisitor::InsertIntoAutoLoadingState:
Error in cling::AutoLoadingVisitor::InsertIntoAutoLoadingState:
Error in cling::AutoLoadingVisitor::InsertIntoAutoLoadingState:
Error in cling::AutoLoadingVisitor::InsertIntoAutoLoadingState:
Error in cling::AutoLoadingVisitor::InsertIntoAutoLoadingState:
Error in cling::AutoLoadingVisitor::InsertIntoAutoLoadingState:
Error in cling::AutoLoadingVisitor::InsertIntoAutoLoadingState:
Error in cling::AutoLoadingVisitor::InsertIntoAutoLoadingState:
Error in cling::AutoLoadingVisitor::InsertIntoAutoLoadingState:
Error in cling::AutoLoadingVisitor::InsertIntoAutoLoadingState:
Error in cling::AutoLoadingVisitor::InsertIntoAutoLoadingState:
Error in cling::AutoLoadingVisitor::InsertIntoAutoLoadingState:
Error in cling::AutoLoadingVisitor::InsertIntoAutoLoadingState:
Error in cling::AutoLoadingVisitor::InsertIntoAutoLoadingState:
Error in cling::AutoLoadingVisitor::InsertIntoAutoLoadingState:
Error in cling::AutoLoadingVisitor::InsertIntoAutoLoadingState:
Error in cling::AutoLoadingVisitor::InsertIntoAutoLoadingState:


## sw/BUILD/O2-full-system-test-latest/log
command /sw/slc9_x86-64/O2/13963-slc9_x86-64-local1/prodtests/full-system-test/dpl-workflow.sh had nonzero exit code 1
[ERROR] invalid workflow in o2-its-reco-workflow: No matching output found for ITS/CLUSTERSROF/0 as requested by data processor "its-tracker". Candidates:
[ERROR] -DPL/ENUM/1301969186
[ERROR] -CPV/RAWDATA
[ERROR] -CTP/RAWDATA
[ERROR] -EMC/RAWDATA
[ERROR] -FDD/RAWDATA
[ERROR] -FLP/DISTSUBTIMEFRAME/0
[ERROR] -FLP/DISTSUBTIMEFRAME/52443
[ERROR] -FT0/RAWDATA
[ERROR] -FV0/RAWDATA
[ERROR] -HMP/RAWDATA
[ERROR] -ITS/RAWDATA
[ERROR] -MCH/RAWDATA
[ERROR] -MFT/RAWDATA
[ERROR] -MID/RAWDATA
[ERROR] -PHS/RAWDATA
[ERROR] -TOF/RAWDATA
[ERROR] -TPC/RAWDATA
[ERROR] -TRD/RAWDATA
[ERROR] -ZDC/RAWDATA
[ERROR] -CPV/CPV_BadMap/0
[ERROR] -CPV/CPV_Gains/0
[ERROR] -CPV/CPV_Pedestals/0
[ERROR] -CPV/CPV_SimPars/0
[ERROR] -CTP/CTPCONFIG/0
[ERROR] -CTP/OrbitReset/0
[0 more errors; see full log]

Full log here.

@alibuild
Copy link
Collaborator

Error while checking build/O2/fullCI_slc9 for 841b74a at 2025-02-18 19:31:

## sw/BUILD/O2Physics-latest/log
Error in cling::AutoLoadingVisitor::InsertIntoAutoLoadingState:
Error in cling::AutoLoadingVisitor::InsertIntoAutoLoadingState:
Error in cling::AutoLoadingVisitor::InsertIntoAutoLoadingState:
Error in cling::AutoLoadingVisitor::InsertIntoAutoLoadingState:
Error in cling::AutoLoadingVisitor::InsertIntoAutoLoadingState:
Error in cling::AutoLoadingVisitor::InsertIntoAutoLoadingState:
Error in cling::AutoLoadingVisitor::InsertIntoAutoLoadingState:
Error in cling::AutoLoadingVisitor::InsertIntoAutoLoadingState:
Error in cling::AutoLoadingVisitor::InsertIntoAutoLoadingState:
Error in cling::AutoLoadingVisitor::InsertIntoAutoLoadingState:
Error in cling::AutoLoadingVisitor::InsertIntoAutoLoadingState:
Error in cling::AutoLoadingVisitor::InsertIntoAutoLoadingState:
Error in cling::AutoLoadingVisitor::InsertIntoAutoLoadingState:
Error in cling::AutoLoadingVisitor::InsertIntoAutoLoadingState:
Error in cling::AutoLoadingVisitor::InsertIntoAutoLoadingState:
Error in cling::AutoLoadingVisitor::InsertIntoAutoLoadingState:
Error in cling::AutoLoadingVisitor::InsertIntoAutoLoadingState:
Error in cling::AutoLoadingVisitor::InsertIntoAutoLoadingState:


## sw/BUILD/O2-full-system-test-latest/log
command /sw/slc9_x86-64/O2/13963-slc9_x86-64-local1/prodtests/full-system-test/dpl-workflow.sh had nonzero exit code 1
[ERROR] invalid workflow in o2-its-reco-workflow: No matching output found for ITS/CLUSTERSROF/0 as requested by data processor "its-tracker". Candidates:
[ERROR] -DPL/ENUM/1301969186
[ERROR] -CPV/RAWDATA
[ERROR] -CTP/RAWDATA
[ERROR] -EMC/RAWDATA
[ERROR] -FDD/RAWDATA
[ERROR] -FLP/DISTSUBTIMEFRAME/0
[ERROR] -FLP/DISTSUBTIMEFRAME/52443
[ERROR] -FT0/RAWDATA
[ERROR] -FV0/RAWDATA
[ERROR] -HMP/RAWDATA
[ERROR] -ITS/RAWDATA
[ERROR] -MCH/RAWDATA
[ERROR] -MFT/RAWDATA
[ERROR] -MID/RAWDATA
[ERROR] -PHS/RAWDATA
[ERROR] -TOF/RAWDATA
[ERROR] -TPC/RAWDATA
[ERROR] -TRD/RAWDATA
[ERROR] -ZDC/RAWDATA
[ERROR] -CPV/CPV_BadMap/0
[ERROR] -CPV/CPV_Gains/0
[ERROR] -CPV/CPV_Pedestals/0
[ERROR] -CPV/CPV_SimPars/0
[ERROR] -CTP/CTPCONFIG/0
[ERROR] -CTP/OrbitReset/0
[0 more errors; see full log]

Full log here.

@alibuild
Copy link
Collaborator

Error while checking build/O2/fullCI for 841b74a at 2025-02-18 21:48:

## sw/BUILD/O2-latest/log
c++: error: unrecognized command-line option '--rtlib=compiler-rt'
c++: error: unrecognized command-line option '--rtlib=compiler-rt'


## sw/BUILD/O2Physics-latest/log
Error in cling::AutoLoadingVisitor::InsertIntoAutoLoadingState:
Error in cling::AutoLoadingVisitor::InsertIntoAutoLoadingState:
Error in cling::AutoLoadingVisitor::InsertIntoAutoLoadingState:
Error in cling::AutoLoadingVisitor::InsertIntoAutoLoadingState:
Error in cling::AutoLoadingVisitor::InsertIntoAutoLoadingState:
Error in cling::AutoLoadingVisitor::InsertIntoAutoLoadingState:
Error in cling::AutoLoadingVisitor::InsertIntoAutoLoadingState:
Error in cling::AutoLoadingVisitor::InsertIntoAutoLoadingState:
Error in cling::AutoLoadingVisitor::InsertIntoAutoLoadingState:
Error in cling::AutoLoadingVisitor::InsertIntoAutoLoadingState:
Error in cling::AutoLoadingVisitor::InsertIntoAutoLoadingState:
Error in cling::AutoLoadingVisitor::InsertIntoAutoLoadingState:
Error in cling::AutoLoadingVisitor::InsertIntoAutoLoadingState:
Error in cling::AutoLoadingVisitor::InsertIntoAutoLoadingState:
Error in cling::AutoLoadingVisitor::InsertIntoAutoLoadingState:
Error in cling::AutoLoadingVisitor::InsertIntoAutoLoadingState:
Error in cling::AutoLoadingVisitor::InsertIntoAutoLoadingState:
Error in cling::AutoLoadingVisitor::InsertIntoAutoLoadingState:


## sw/BUILD/O2-full-system-test-latest/log
command /sw/slc8_x86-64/O2/13963-slc8_x86-64-local1/prodtests/full-system-test/dpl-workflow.sh had nonzero exit code 1
[ERROR] invalid workflow in o2-its-reco-workflow: No matching output found for ITS/CLUSTERSROF/0 as requested by data processor "its-tracker". Candidates:
[ERROR] -DPL/ENUM/1301969186
[ERROR] -CPV/RAWDATA
[ERROR] -CTP/RAWDATA
[ERROR] -EMC/RAWDATA
[ERROR] -FDD/RAWDATA
[ERROR] -FLP/DISTSUBTIMEFRAME/0
[ERROR] -FLP/DISTSUBTIMEFRAME/52443
[ERROR] -FT0/RAWDATA
[ERROR] -FV0/RAWDATA
[ERROR] -HMP/RAWDATA
[ERROR] -ITS/RAWDATA
[ERROR] -MCH/RAWDATA
[ERROR] -MFT/RAWDATA
[ERROR] -MID/RAWDATA
[ERROR] -PHS/RAWDATA
[ERROR] -TOF/RAWDATA
[ERROR] -TPC/RAWDATA
[ERROR] -TRD/RAWDATA
[ERROR] -ZDC/RAWDATA
[ERROR] -CPV/CPV_BadMap/0
[0 more errors; see full log]

Full log here.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Development

Successfully merging this pull request may close these issues.

4 participants