Implement job_result_download for experiment service

[veekaybee]

What's changing

We currently download results per job. We'd like to implement all data results downloaded per experiment.

1. We look in the jobs table for all jobs that match a specific experiment id (inference + eval) and
2. return the results as JSON.

In order to make these changes, we need to change the jobs, experiments service, and related API calls.

Provide a clear and concise description of the content changes you're proposing. List all the changes you are making to the content.

• Changing jobs service
• Changing experiment service
• Changing experiment service API calls

If this PR is related to an issue or closes one, please link it here.

See #572

How to test it

Steps to test the changes:

1. Upload dialogsum and run experiment:

#!/bin/bash
if [ "$#" -gt 0 ]; then
    DATA_CSV_PATH="$1"
else
    DATA_CSV_PATH="$HOME/lumigator-datasets/dialogsum/dialogsum.csv"
fi

if [[ -z "${BACKEND_URL}" ]]; then
  BACKEND_URL=http://localhost:8000
fi

echo Connecting to $BACKEND_URL...

DATASET_ID=$(curl -s $BACKEND_URL/api/v1/datasets/ \
  -H 'Accept: application/json' \
  -H 'Content-Type: multipart/form-data' \
  -F 'dataset=@'"$DATA_CSV_PATH"';type=text/csv' \
  -F 'format=job' | jq -r '.id')

EVAL_NAME="test_experiment_bart"
EVAL_DESC="Test experiment (inference + eval) with BART"
EVAL_MODEL="hf://facebook/bart-large-cnn"
EVAL_MAX_SAMPLES="10"

JSON_STRING=$(jq -n \
                --arg name "$EVAL_NAME" \
                --arg desc "$EVAL_DESC" \
                --arg model "$EVAL_MODEL" \
                --arg dataset_id "$DATASET_ID" \
                --arg max_samples "$EVAL_MAX_SAMPLES" \
                '{name: $name, description: $desc, model: $model, dataset: $dataset_id, max_samples: $max_samples}')

echo Connecting to $BACKEND_URL...

echo Starting new experiment...

echo $JSON_STRING

curl -s $BACKEND_URL/api/v1/experiments_new/ \
  -H 'Accept: application/json' \
  -H 'Content-Type: application/json' \
  -d "$JSON_STRING"

3. Once experiment runs, hit the new experiments endpoint to get results:

curl -X 'GET' \
  'http://localhost:8000/api/v1/experiments_new/{yourid}/result/download' \
  -H 'accept: application/json'

You should get URLs for two files:

{
  "id": "65dfc643-b35a-4b0b-8491-3089d2fab944",
  "download_url": "http://localhost:4566/lumigator-storage/jobs/results/test_experiment_bart-evaluation/65dfc643-b35a-4b0b-8491-3089d2fab944/results.json?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=test%2F20250120%2Fus-east-2%2Fs3%2Faws4_request&X-Amz-Date=20250120T211805Z&X-Amz-Expires=3600&X-Amz-SignedHeaders=host&X-Amz-Signature=32b8a08273e6406534ffd7887813006f556b950c60270732a2cbe136bd1cdfa9"
}

Additional notes for reviewers

I already...

• [X ] Tested the changes in a working environment to ensure they work as expected
• Added some tests for any new functionality - would like to address in a follow-up PR
• Updated the documentation (both comments in code and product documentation under /docs)
• Checked if a (backend) DB migration step was required and included it if required

[javiermtorres]

LGTM. Some comments but I'm pre-ok with your responses :)

[veekaybee]

Rebasing based on changes from #657 and #604

[veekaybee]

@aittalam - ready for a re-review, I've incorporated all the changes since the last time this was reviewed and noted a place we might want to be careful

[dpoulopoulos]

Thanks!

[aittalam]

TY Vicki! I think this is ready to merge after syncing with main.
Many thanks for addressing my comments 🙏