The target-bigquery Singer target sends data into Google BigQuery data warehouse after it was pulled from a source using a Singer tap.

Standalone usage

Install the package using pip: 

pip install git+https://github.com/adswerve/target-bigquery.git@v0.10.2

For additional instructions, refer to the README in the repository.

Usage with Meltano

Install Meltano, create your Meltano project, and add the target to your project as a loader: 

meltano add loader target-bigquery

For additional instructions, refer to the Meltano-specific documentation for target-bigquery.

Capabilities

Settings

project_id

BigQuery project

dataset_id

BigQuery dataset

location

Dataset location

credentials_path

This is not a real setting, so it should not appear in the config.json JSON schema. The taret will read the GOOGLE_APPLICATION_CREDENTIALS environment variable which should be a fully qualified path to client_secrets.json for your service account.

validate_records

Validate records

add_metadata_columns

Add _time_extracted and _time_loaded metadata columns

replication_method

Replication method, append or truncate

table_prefix

Add prefix to table name

table_suffix

Add suffix to table name

max_cache

Maximum cache size in MB

Looking for help?

If you're having trouble getting target-bigquery to work by itself or with Meltano, look for an existing issue in its repository, file a new issue, or join the Meltano Slack community and ask for help in the #plugins-general channel.

Found an issue on this page?

This page is generated from a YAML file that you can contribute changes to! It is also validated against a JSON Schema used for taps and targets.