Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

feat: backend oracle extract and load #276

Open
wants to merge 52 commits into
base: main
Choose a base branch
from
Open

feat: backend oracle extract and load #276

wants to merge 52 commits into from
+8,106 −63

Conversation

mishraomp
Copy link
Collaborator

@mishraomp mishraomp commented Jan 23, 2025 •
edited
Loading

Done

github-advanced-security[bot]
github-advanced-security bot found potential problems Jan 25, 2025
View reviewed changes
backend-el/Dockerfile Fixed Show fixed Hide fixed
backend-el/Dockerfile Fixed Show fixed Hide fixed
backend-el/Dockerfile.certs Fixed Show fixed Hide fixed
backend-el/Dockerfile.certs Fixed Show fixed Hide fixed
@mishraomp
Copy link
Collaborator Author

mishraomp commented Jan 25, 2025 •
edited
Loading

I have a successful run from local system on this commit with minimal dataset, 60fa78f , fyi @marcellmueller @imsunchips

it is currently pointing to Architecture s3, which will be pointing to rec resources once it is deployed to Openshift.
image

@mishraomp
Copy link
Collaborator Author

mishraomp commented Jan 27, 2025 •
edited
Loading

Sunday night update, pointed to Rec Resources S3 bucket, had a successful run from local with attachments.
created the IAM user in dynamodb, gave s3 full permission manually in the aws console following https://developer.gov.bc.ca/docs/default/component/public-cloud-techdocs/aws/design-build-and-deploy-an-application/iam-user-service/
the IAM user created is fta-rst-el-s3-upload-service-account fyi @marcellmueller @imsunchips
image

@marcellmueller
Copy link
Contributor

Sunday night update, pointed to Rec Resources S3 bucket, had a successful run from local with attachments.

Wow that's awesome, nice work 😎

github-advanced-security[bot]
github-advanced-security bot found potential problems Jan 28, 2025
View reviewed changes
backend-el/Dockerfile Dismissed Show dismissed Hide dismissed
@mishraomp mishraomp mentioned this pull request Jan 28, 2025
Merged
1 task
@mishraomp
chore: remove init container and related charts, add certs to the mai…
66eb2d2 
…n container, it runs as a cronjob and not long running process
@mishraomp
Copy link
Collaborator Author

finally ready for review @marcellmueller

@mishraomp mishraomp marked this pull request as ready for review January 30, 2025 23:10
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@marcellmueller marcellmueller marcellmueller left review comments

@DerekRoberts DerekRoberts DerekRoberts approved these changes

Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.

FTA CSV to S3 Data Refresh Scheduler
3 participants
@mishraomp @marcellmueller @DerekRoberts