Skip to content

Commit

Permalink
Merge branch 'main' into tobias/add-target-redshift
Browse files Browse the repository at this point in the history
  • Loading branch information
edgarrmondragon authored Apr 2, 2024
2 parents 3ca2430 + 839b0f1 commit a352bf9
Show file tree
Hide file tree
Showing 5 changed files with 46 additions and 4 deletions.
2 changes: 1 addition & 1 deletion .github/workflows/check-yaml-format.yml
Original file line number Diff line number Diff line change
Expand Up @@ -15,7 +15,7 @@ jobs:

- name: Get changed files in the docs folder
id: changed-files
uses: tj-actions/changed-files@v43.0.1
uses: tj-actions/changed-files@v44.0.0
with:
files: |
_data/**/*.yml
Expand Down
2 changes: 1 addition & 1 deletion .github/workflows/test_dispatcher.yml
Original file line number Diff line number Diff line change
Expand Up @@ -25,7 +25,7 @@ jobs:

- name: Get changed files
id: changed_files
uses: tj-actions/changed-files@v43.0.1
uses: tj-actions/changed-files@v44.0.0
with:
sha: ${{ github.event.pull_request.head.sha }}
json: "true"
Expand Down
4 changes: 2 additions & 2 deletions _data/meltano/extractors/tap-trello/matatika.yml
Original file line number Diff line number Diff line change
Expand Up @@ -81,6 +81,6 @@ settings:
label: Stream Maps
name: stream_maps
settings_group_validation:
- - developer_api_key
- access_token
- - access_token
- developer_api_key
variant: matatika
4 changes: 4 additions & 0 deletions _data/meltano/loaders/target-clickhouse/shaped-ai.yml
Original file line number Diff line number Diff line change
Expand Up @@ -23,6 +23,10 @@ settings:
kind: boolean
label: Add Record Metadata
name: add_record_metadata
- description: Maximum number of rows in each batch.
kind: integer
label: Batch Size Rows
name: batch_size_rows
- description: The cluster to create tables in. This is passed as the `clickhouse_cluster`
argument when creating a table. [documentation](https://clickhouse.com/docs/en/sql-reference/distributed-ddl)
can be found here.
Expand Down
38 changes: 38 additions & 0 deletions _data/meltano/loaders/target-snowflake/meltanolabs.yml
Original file line number Diff line number Diff line change
@@ -1,5 +1,6 @@
capabilities:
- about
- hard-delete
- schema-flattening
- stream-maps
description: Snowflake database loader
Expand Down Expand Up @@ -28,6 +29,10 @@ settings:
label: Add Record Metadata
name: add_record_metadata
value: true
- description: Maximum number of rows in each batch.
kind: integer
label: Batch Size Rows
name: batch_size_rows
- description: Whether to remove batch files after processing.
kind: boolean
label: Clean Up Batch Files
Expand All @@ -41,6 +46,14 @@ settings:
kind: string
label: Default Target Schema
name: default_target_schema
- description: 'One or more LCID locale strings to produce localized output for: https://faker.readthedocs.io/en/master/#localization'
kind: array
label: Faker Config Locale
name: faker_config.locale
- description: 'Value to seed the Faker generator for deterministic output: https://faker.readthedocs.io/en/master/#seeding-the-generator'
kind: string
label: Faker Config Seed
name: faker_config.seed
- description: "'True' to enable schema flattening and automatically expand nested
properties."
kind: boolean
Expand All @@ -50,6 +63,26 @@ settings:
kind: integer
label: Flattening Max Depth
name: flattening_max_depth
- description: Hard delete records.
kind: boolean
label: Hard Delete
name: hard_delete
value: false
- description: The method to use when loading data into the destination. `append-only`
will always write all input records whether that records already exists or not.
`upsert` will update existing records and insert new records. `overwrite` will
delete all existing records and insert all input records.
kind: options
label: Load Method
name: load_method
options:
- label: Append Only
value: append-only
- label: Upsert
value: upsert
- label: Overwrite
value: overwrite
value: append-only
- description: The password for your Snowflake user.
kind: password
label: Password
Expand Down Expand Up @@ -86,6 +119,11 @@ settings:
kind: string
label: User
name: user
- description: Whether to validate the schema of the incoming streams.
kind: boolean
label: Validate Records
name: validate_records
value: true
- description: The initial warehouse for the session.
kind: string
label: Warehouse
Expand Down

0 comments on commit a352bf9

Please sign in to comment.