The great_expectations utility helps data teams eliminate pipeline debt, through data testing, documentation, and profiling.
If you haven't already, follow the initial steps of the Getting Started guide:
Installation and configuration
Add the great_expectations utility to your project
Configure the great_expectations settings using
meltano add utility great_expectations
meltano config great_expectations set --interactive
- Create expectations suites and checkpoints!
Add additional database drivers
If you are using Great Expectations to validate data in a database or warehouse, you
might need to install the appropriate drivers. Common options are supported by Great Expectations
as pip extras, and any additional packages you may want can be added too by configuring
pip_url for the
great_expectationsplugin definition in your
pip_urlproperty to include the desired additional extras and packages:
utilities: - name: great_expectations variant: great-expectations pip_url: great_expectations[redshift] awscli
Re-install the plugin:
meltano install utility great_expectations
The next time you run Great Expectations, you will be able to connect to a new type of database, like Redshift in the example.
If you run into any issues, learn how to get help.
CapabilitiesThis plugin currently has no capabilities defined. If you know the capabilities required by this plugin, please contribute!
great_expectations settings that are known to Meltano are documented below. To quickly
find the setting you're looking for, click on any setting name from the list:
You can also list these settings using
meltano config great_expectations list
override these settings or specify additional ones
meltano.yml by adding the
Please consider adding any settings you have defined locally to this definition on MeltanoHub by making a pull request to the YAML file that defines the settings for this plugin.
Great Expectations Home Directory (ge_home)
Configure this setting directly using the following Meltano command:
meltano config great_expectations set ge_home [value]
This page is generated from a YAML file that you can contribute changes to.Edit it on GitHub!
Looking for help?