Table of Contents
- Alternative variants
- Standalone usage
- Usage with Meltano
- Looking for help?
target-parquet are available. This document describes the
estrategiahq variant, which is recommended for new
Alternative variants are:
Install the package using pip:
pip install git+https://github.com/estrategiahq/target-parquet.git
For additional instructions, refer to the README in the repository.
Usage with Meltano
meltano add --custom loader target-parquet
Check the README and code in the repository for more information on capabilities for this target.
Disable Collection (
A boolean of whether to disable Singer anonymous tracking.
Logging Level (
(Default - INFO) The log level. Can also be set using environment variables.
Destination Path (
(Default - ‘.’) The path to write files out to.
Compression Method (
Compression methods have to be supported by Pyarrow, and currently the compression modes available are - snappy (recommended), zstd, brotli and gzip.
Streams In Separate Folder (
(Default - False) The option to create each stream in a different folder, as these are expected to come in different schema.
File Size (
The number of rows to write per file. The default is to write to a single file.
Looking for help?
If you're having trouble getting
target-parquet to work by itself or with
Meltano, look for an
existing issue in its repository, file a new issue,
join the Meltano Slack community
and ask for help in the