Failed to migrate dataset from prod to int instance

[amaltaro]

Yuyi,

I was investigating why one of our WMCore testing templates was failing to go through, and I just noticed that the dataset from the production DBS instance has not been migrated to the int instance yet. Here is how I just checked:

>>> from dbs.apis.dbsClient import DbsApi
>>> dbsApi = DbsApi(url = 'https://cmsweb-testbed.cern.ch/dbs/int/global/DBSMigrate/')
>>> dbsUrl = 'https://cmsweb.cern.ch/dbs/prod/global/DBSReader'
>>> dataset = '/RelValZEE_14/CMSSW_11_1_0_pre4-110X_mcRun3_2021_realistic_v8-v1/GEN-SIM'
>>> 
>>> migrateArgs = {'migration_url': dbsUrl, 'migration_input': dataset}
>>> dbsApi.submitMigration(migrateArgs)
{'migration_details': {'migration_status': 9, 'create_by': 'amaltaro', 'migration_url': 'https://cmsweb.cern.ch/dbs/prod/global/DBSReader', 'last_modified_by': 'amaltaro', 'creation_date': 1585835516, 'retry_count': 3, 'migration_input': '/RelValZEE_14/CMSSW_11_1_0_pre4-110X_mcRun3_2021_realistic_v8-v1/GEN-SIM', 'migration_request_id': 210003, 'last_modification_date': 1585835945}, 'migration_report': 'REQUEST ALREADY QUEUED. Migration terminally failed. '}
>>> 

Could you please investigate what the issue is?

Can you please check whether any migration has actually worked since HG2002? I'm concerned with the removal of c-ares in this PR: cms-sw/cmsdist#5438

FYI: @todor-ivanov

[todor-ivanov]

Thanks for tagging me here @amaltaro

[yuyiguo]

Let me check.
Crab had problem with migration from prod to phys03 because a new data tier introduced in prod, but not in phys03 yet.

[yuyiguo]

Alan,
The problem was more complicated than I thought. I wrote to Kate and cc'd you.
Let's wait for Kate to correct the partition error, then I will migration the block.
Yuyi

[yuyiguo]

The migration is done. Please check, Alan.
Let me know if any problems. Otherwise, Please close this tickent.

[amaltaro]

Thanks, Yuyi. Dataset is now available in testbed:
https://cmsweb-testbed.cern.ch/dbs/int/global/DBSReader/filesummaries?dataset=/RelValZEE_14/CMSSW_11_1_0_pre4-110X_mcRun3_2021_realistic_v8-v1/GEN-SIM

Closing the ticket!