forked from airbytehq/airbyte
-
Notifications
You must be signed in to change notification settings - Fork 0
Commit
This commit does not belong to any branch on this repository, and may belong to a fork outside of the repository.
Merge branch 'airbytehq:master' into master
- Loading branch information
Showing
1,488 changed files
with
233,139 additions
and
24,134 deletions.
There are no files selected for viewing
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1,51 @@ | ||
| name: 🤖 [AI Assist] Report an issue using the AI Assist | ||
| description: Use this template when you have a problem creating a connector using the AI Connector Assist. | ||
| labels: [type/bug, area/connector-builder, needs-triage, ai-assist] | ||
| body: | ||
| - type: markdown | ||
| attributes: | ||
| value: > | ||
| <p align="center"> | ||
| <a target="_blank" href="https://airbyte.com"> | ||
| <image> | ||
| <source srcset="https://raw.githubusercontent.com/airbytehq/airbyte/master/.github/octavia-issue-template.svg"> | ||
| <img alt="octavia-welcome" src="https://raw.githubusercontent.com/airbytehq/airbyte/master/.github/octavia-issue-template.svg" width="auto" height="120"> | ||
| </image> | ||
| </a> | ||
| </p> | ||
| - type: markdown | ||
| attributes: | ||
| value: | | ||
| Thanks for taking the time to fill out this bug report... | ||
| Make sure to update this issue with a concise title and provide all information you have to | ||
| help us debug the problem together. | ||
| - type: input | ||
| id: connector-url-link | ||
| attributes: | ||
| label: Connector Documentation URL | ||
| description: Share the documentation URL you used to create the connector. | ||
| validations: | ||
| required: true | ||
| - type: textarea | ||
| id: description | ||
| attributes: | ||
| label: What error are you seeing? | ||
| description: Please give any information you have and steps to reproduce the problem. | ||
| - type: textarea | ||
| id: replicate | ||
| attributes: | ||
| label: How to replicate | ||
| description: Please provide what steps you made so far | ||
| - type: textarea | ||
| id: expect | ||
| attributes: | ||
| label: What do you expect to happen? | ||
| description: What output were you expecting? | ||
| - type: checkboxes | ||
| id: alpha-release | ||
| attributes: | ||
| label: Is this in the Alpha Release? | ||
| description: Are you noticing this issue in the alpha release of AI Assist? | ||
| options: | ||
| - label: Yes, the issue is in the AI Assist Alpha Release. | ||
| required: false |
This file was deleted.
Oops, something went wrong.
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1,148 @@ | ||
| name: Bump versions for connectors in a PR | ||
|
|
||
| on: | ||
| workflow_dispatch: | ||
| inputs: | ||
| pr: | ||
| description: "Pull request number. This PR will be referenced in the changelog line." | ||
| type: number | ||
| required: false | ||
| comment-id: | ||
| description: "Optional. The comment-id of the slash command. Used to update the comment with the status." | ||
| required: false | ||
|
|
||
| type: | ||
| description: "The type of bump to perform. One of 'major', 'minor', or 'patch'." | ||
| required: false | ||
| default: "patch" | ||
|
|
||
| changelog: | ||
| description: "The comment to add to the changelog." | ||
| required: false | ||
| # TODO: We could infer the changelog string from the PR description! | ||
| default: "Bumped automatically in the pull request, please see PR description" | ||
|
|
||
| # These must be declared, but they are unused and ignored. | ||
| # TODO: Infer 'repo' and 'gitref' from PR number on other workflows, so we can remove these. | ||
| repo: | ||
| description: "Repo (Ignored)" | ||
| required: false | ||
| default: "airbytehq/airbyte" | ||
| gitref: | ||
| description: "Ref (Ignored)" | ||
| required: false | ||
|
|
||
| run-name: "Bump connector versions in PR: #${{ github.event.inputs.pr }}" | ||
| concurrency: | ||
| group: ${{ github.workflow }}-${{ github.event.inputs.pr }} | ||
| # Cancel any previous runs on the same branch if they are still in progress | ||
| cancel-in-progress: true | ||
|
|
||
| jobs: | ||
| bump-version: | ||
| name: "Bump version of connectors in this PR" | ||
| runs-on: ubuntu-latest | ||
| steps: | ||
| - name: Get job variables | ||
| id: job-vars | ||
| env: | ||
| GH_TOKEN: ${{ secrets.GITHUB_TOKEN }} | ||
| shell: bash | ||
| run: | | ||
| PR_JSON=$(gh api repos/${{ github.repository }}/pulls/${{ github.event.inputs.pr }}) | ||
| echo "repo=$(echo "$PR_JSON" | jq -r .head.repo.full_name)" >> $GITHUB_OUTPUT | ||
| echo "branch=$(echo "$PR_JSON" | jq -r .head.ref)" >> $GITHUB_OUTPUT | ||
| echo "run-url=https://github.com/$GITHUB_REPOSITORY/actions/runs/$GITHUB_RUN_ID" >> $GITHUB_OUTPUT | ||
| - name: Checkout Airbyte | ||
| uses: actions/checkout@v4 | ||
| with: | ||
| repository: ${{ steps.job-vars.outputs.repo }} | ||
| ref: ${{ steps.job-vars.outputs.branch }} | ||
| fetch-depth: 1 | ||
| # Important that token is a PAT so that CI checks are triggered again. | ||
| # Without this we would be forever waiting on required checks to pass. | ||
| token: ${{ secrets.GH_PAT_APPROVINGTON_OCTAVIA }} | ||
|
|
||
| - name: Append comment with job run link | ||
| # If comment-id is not provided, this will create a new | ||
| # comment with the job run link. | ||
| id: first-comment-action | ||
| uses: peter-evans/create-or-update-comment@v4 | ||
| with: | ||
| comment-id: ${{ github.event.inputs.comment-id }} | ||
| issue-number: ${{ github.event.inputs.pr }} | ||
| body: | | ||
| > Bump Version job started... [Check job output.][1] | ||
| [1]: ${{ steps.job-vars.outputs.run-url }} | ||
| - name: Run airbyte-ci connectors --modified bump-version | ||
| uses: ./.github/actions/run-airbyte-ci | ||
| continue-on-error: true | ||
| with: | ||
| context: "manual" | ||
| gcs_credentials: ${{ secrets.METADATA_SERVICE_PROD_GCS_CREDENTIALS }} | ||
| sentry_dsn: ${{ secrets.SENTRY_AIRBYTE_CI_DSN }} | ||
| github_token: ${{ secrets.GH_PAT_MAINTENANCE_OCTAVIA }} | ||
| subcommand: | | ||
| connectors --modified bump-version \ | ||
| ${{ github.event.inputs.type }} \ | ||
| "${{ github.event.inputs.changelog }}" \ | ||
| --pr-number ${{ github.event.inputs.pr }} | ||
| # This is helpful in the case that we change a previously committed generated file to be ignored by git. | ||
| - name: Remove any files that have been gitignored | ||
| run: git ls-files -i -c --exclude-from=.gitignore | xargs -r git rm --cached | ||
|
|
||
| # Check for changes in git | ||
| - name: Check for changes | ||
| id: git-diff | ||
| run: | | ||
| git diff --quiet && echo "No changes to commit" || echo "::set-output name=changes::true" | ||
| shell: bash | ||
|
|
||
| # Commit changes (if any) | ||
| - name: Commit changes | ||
| id: commit-step | ||
| if: steps.git-diff.outputs.changes == 'true' | ||
| run: | | ||
| git config --global user.name "Octavia Squidington III" | ||
| git config --global user.email "[email protected]" | ||
| git add . | ||
| git commit -m "chore: bump-version ${{ github.event.inputs.bump-type }}" | ||
| echo "sha=$(git rev-parse HEAD)" >> $GITHUB_OUTPUT | ||
| - name: Push changes to '(${{ steps.job-vars.outputs.repo }})' | ||
| if: steps.git-diff.outputs.changes == 'true' | ||
| run: | | ||
| git remote add contributor https://github.com/${{ steps.job-vars.outputs.repo }}.git | ||
| git push contributor HEAD:${{ steps.job-vars.outputs.branch }} | ||
| - name: Append success comment | ||
| uses: peter-evans/create-or-update-comment@v4 | ||
| if: steps.git-diff.outputs.changes == 'true' | ||
| with: | ||
| comment-id: ${{ steps.first-comment-action.outputs.comment-id }} | ||
| reactions: hooray | ||
| body: | | ||
| > ✅ Changes applied successfully. (${{ steps.commit-step.outputs.sha }}) | ||
| - name: Append success comment (no-op) | ||
| uses: peter-evans/create-or-update-comment@v4 | ||
| if: steps.git-diff.outputs.changes != 'true' | ||
| with: | ||
| comment-id: ${{ steps.first-comment-action.outputs.comment-id }} | ||
| reactions: "-1" | ||
| body: | | ||
| > 🔴 Job completed successfully (no changes, this is sus). | ||
| - name: Append failure comment | ||
| uses: peter-evans/create-or-update-comment@v4 | ||
| if: failure() | ||
| with: | ||
| comment-id: ${{ steps.first-comment-action.outputs.comment-id }} | ||
| reactions: confused | ||
| body: | | ||
| > 🔴 Job failed. |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1,64 @@ | ||
| name: Finalize connector rollout | ||
|
|
||
| on: | ||
| repository_dispatch: | ||
| types: [finalize-connector-rollout] | ||
| workflow_dispatch: | ||
| inputs: | ||
| connector_name: | ||
| description: "Connector name" | ||
| required: true | ||
| action: | ||
| description: "Action to perform" | ||
| required: true | ||
| options: ["promote", "rollback"] | ||
| jobs: | ||
| finalize_rollout: | ||
| name: Finalize connector rollout | ||
| runs-on: connector-publish-large | ||
| env: | ||
| ACTION: ${{ github.event_name == 'workflow_dispatch' && github.event.inputs.action || github.event.client_payload.action }} | ||
| steps: | ||
| - name: Check action value | ||
| run: | | ||
| if [[ "${ACTION}" != "promote" && "${ACTION}" != "rollback" ]]; then | ||
| echo "Invalid action: ${ACTION}" | ||
| exit 1 | ||
| fi | ||
| shell: bash | ||
| - name: Checkout Airbyte | ||
| uses: actions/checkout@v4 | ||
| - name: Promote {{ github.event.inputs.connector_name }} release candidate | ||
| id: promote-release-candidate | ||
| if: ${{ env.ACTION == 'promote' }} | ||
| uses: ./.github/actions/run-airbyte-ci | ||
| with: | ||
| context: "manual" | ||
| dagger_cloud_token: ${{ secrets.DAGGER_CLOUD_TOKEN_2 }} | ||
| docker_hub_password: ${{ secrets.DOCKER_HUB_PASSWORD }} | ||
| docker_hub_username: ${{ secrets.DOCKER_HUB_USERNAME }} | ||
| gcp_gsm_credentials: ${{ secrets.GCP_GSM_CREDENTIALS }} | ||
| gcs_credentials: ${{ secrets.METADATA_SERVICE_PROD_GCS_CREDENTIALS }} | ||
| github_token: ${{ secrets.GITHUB_TOKEN }} | ||
| metadata_service_gcs_credentials: ${{ secrets.METADATA_SERVICE_PROD_GCS_CREDENTIALS }} | ||
| sentry_dsn: ${{ secrets.SENTRY_AIRBYTE_CI_DSN }} | ||
| slack_webhook_url: ${{ secrets.PUBLISH_ON_MERGE_SLACK_WEBHOOK }} | ||
| spec_cache_gcs_credentials: ${{ secrets.SPEC_CACHE_SERVICE_ACCOUNT_KEY_PUBLISH }} | ||
| subcommand: "connectors --name=${{ github.event.inputs.connector_name }} publish --promote-release-candidate" | ||
| - name: Rollback {{ github.event.inputs.connector_name }} release candidate | ||
| id: rollback-release-candidate | ||
| if: ${{ env.ACTION == 'rollback' }} | ||
| uses: ./.github/actions/run-airbyte-ci | ||
| with: | ||
| context: "manual" | ||
| dagger_cloud_token: ${{ secrets.DAGGER_CLOUD_TOKEN_2 }} | ||
| docker_hub_password: ${{ secrets.DOCKER_HUB_PASSWORD }} | ||
| docker_hub_username: ${{ secrets.DOCKER_HUB_USERNAME }} | ||
| gcp_gsm_credentials: ${{ secrets.GCP_GSM_CREDENTIALS }} | ||
| gcs_credentials: ${{ secrets.METADATA_SERVICE_PROD_GCS_CREDENTIALS }} | ||
| github_token: ${{ secrets.GITHUB_TOKEN }} | ||
| metadata_service_gcs_credentials: ${{ secrets.METADATA_SERVICE_PROD_GCS_CREDENTIALS }} | ||
| sentry_dsn: ${{ secrets.SENTRY_AIRBYTE_CI_DSN }} | ||
| slack_webhook_url: ${{ secrets.PUBLISH_ON_MERGE_SLACK_WEBHOOK }} | ||
| spec_cache_gcs_credentials: ${{ secrets.SPEC_CACHE_SERVICE_ACCOUNT_KEY_PUBLISH }} | ||
| subcommand: "connectors --name=${{ github.event.inputs.connector_name }} publish --rollback-release-candidate" |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -1,3 +1,12 @@ | ||
| airbyte-integrations/bases/base-normalization/integration_tests/normalization_test_output | ||
| airbyte-ci/connectors/pipelines/tests/test_changelog/result_files | ||
| airbyte-integrations/bases/connector-acceptance-test/unit_tests/data/docs | ||
|
|
||
| # Ignore manifest files in manifest-only connectors | ||
| # This is done due to prettier being overly opinionated on the formatting of quotes | ||
| # Ref: https://github.com/prettier/prettier/issues/973 | ||
| # And it not allowing rule opt outs | ||
| # Ref: https://github.com/prettier/prettier/discussions/13925 | ||
| # Instead we rely on the contribution service to format these files | ||
| # See: https://github.com/airbytehq/airbyte/blob/master/CONTRIBUTING.md#adding-a-new-connector | ||
| airbyte-integrations/connectors/*/manifest.yaml |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1 @@ | ||
| airbyte-integrations/connectors/source-hubspot/.secrets |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Oops, something went wrong.