Automate connection to RIALTO orgs app for authors.csv file

[peetucket]

Currently the list of authors used in airflow comes a manual export from the rialto-orgs app to a CSV and then importing the CSV.

It may be possible to automate this directly even though rialto-orgs doesn't have an official API by requesting the CSV format by hitting the app with the correct querystring params. Investigate to see if this is possible and comment here.

• create rake task to export authors
• write to a shared endpoint
• schedule rake task

[peetucket]

• Even though there isn't an official API, it is pretty easy to to request a CSV from the authors view by simply requesting it in the URL (along with other querystring parameters that include the filters you need). For example https://sul-rialto-dev.stanford.edu/authors.csv?role_filter[]=faculty will give you all faculty.
• The problem is that the entire app is behind webauth, and so any incoming request will actually become a 302 to webauth
• Maybe we need to move the app out from under webauth? But then we'd need to roll our own authorization system
• Or have some API only endpoints with an API key that are not behind webbauth? Not sure if it's possible to have some routes exempted from the webauth request

[peetucket]

some clues from John in this slack thread about possible solutions in other apps: https://stanfordlib.slack.com/archives/C09M7P91R/p1737589529004669

[lwrubel]

See shared mount already on rialto-airflow-dev for /data for consideration when requesting mounts on new/existing VMs:

https://github.com/sul-dlss/puppet/blob/128182177f74ae9281bbde51f47c63e0f142d725/hieradata/node/sul-rialto-airflow-dev.stanford.edu.yaml#L88

[peetucket]

See https://github.com/sul-dlss/operations-tasks/issues/3953 for ops task to make this mount available on sul-rialto-dev

[peetucket]

Closed by sul-dlss/rialto-orgs#76