December 4, 2018, Tuesday

• Improving API for looping through folders
  • Only define changed parameters or inputs
  • Combine workflowJob/new and workflowJob/run
    • Once this is done, we can use shell script to loop through datasets
      • Call SciApps API to analyze a data set
      • Use jq to parse and get workflow ID
      • Call DE API to attach workflow ID to the data set
      • Then retrieve all metadata from Data Store and push into a MaizeCode database?
      • Call DE API to add metadata into the workflow/job then use de.sciapps.org for enabling search?
        • We can combine STAR and RSEM_quant as one app to optimize transfer
        • We can add QC step to build a workflow (QC --> Trimmomatic --> QC --> STAR_RSEM_quant)
        • Similar for Chipseq, etc
        • We need to enhance SciApps search ability or just add the metadata into the description?
          • Add more search objects?
• Following endpoints are not provided since they are done at the Javascript level
  • API for building a workflow given an array of job ids (SciApps id?)
    • API for adding steps to a workflow?
    • API for removing steps from a workflow?
    • API for replacing steps in a workflow?
  • API for getting mermaid xml given a workflow id
• Following endpoints are postponed since they are simple MySQL queries
  • API for statistics
    • Number of jobs (per user), list is there but not providing counts
    • Number of workflows (per user), list is there but not providing counts
    • Number of times a workflow is executed