great_expectations.data_context.store.tuple_store_backend

Module Contents

Classes

TupleStoreBackend(filepath_template=None, filepath_prefix=None, filepath_suffix=None, forbidden_substrings=None, platform_specific_separator=True, fixed_length_key=False, suppress_store_backend_id=False, manually_initialize_store_backend_id: str = ‘’, base_public_path=None, store_name=None)

If filepath_template is provided, the key to this StoreBackend abstract class must be a tuple with

TupleFilesystemStoreBackend(base_directory, filepath_template=None, filepath_prefix=None, filepath_suffix=None, forbidden_substrings=None, platform_specific_separator=True, root_directory=None, fixed_length_key=False, suppress_store_backend_id=False, manually_initialize_store_backend_id: str = ‘’, base_public_path=None, store_name=None)

Uses a local filepath as a store.

TupleS3StoreBackend(bucket, prefix=’’, boto3_options=None, s3_put_options=None, filepath_template=None, filepath_prefix=None, filepath_suffix=None, forbidden_substrings=None, platform_specific_separator=False, fixed_length_key=False, suppress_store_backend_id=False, manually_initialize_store_backend_id: str = ‘’, base_public_path=None, endpoint_url=None, store_name=None)

Uses an S3 bucket as a store.

TupleGCSStoreBackend(bucket, project, prefix=’’, filepath_template=None, filepath_prefix=None, filepath_suffix=None, forbidden_substrings=None, platform_specific_separator=False, fixed_length_key=False, suppress_store_backend_id=False, manually_initialize_store_backend_id: str = ‘’, public_urls=True, base_public_path=None, store_name=None)

Uses a GCS bucket as a store.

TupleAzureBlobStoreBackend(container, connection_string, prefix=’’, filepath_template=None, filepath_prefix=None, filepath_suffix=None, forbidden_substrings=None, platform_specific_separator=False, fixed_length_key=False, suppress_store_backend_id=False, manually_initialize_store_backend_id: str = ‘’, store_name=None)

Uses an Azure Blob as a store.
great_expectations.data_context.store.tuple_store_backend.logger
class great_expectations.data_context.store.tuple_store_backend.TupleStoreBackend(filepath_template=None, filepath_prefix=None, filepath_suffix=None, forbidden_substrings=None, platform_specific_separator=True, fixed_length_key=False, suppress_store_backend_id=False, manually_initialize_store_backend_id: str = '', base_public_path=None, store_name=None)

Bases: great_expectations.data_context.store.store_backend.StoreBackend

If filepath_template is provided, the key to this StoreBackend abstract class must be a tuple with fixed length equal to the number of unique components matching the regex r”{d+}”

For example, in the following template path: expectations/{0}/{1}/{2}/prefix-{2}.json, keys must have three components.

_validate_key(self, key)
_validate_value(self, value)
_convert_key_to_filepath(self, key)
_convert_filepath_to_key(self, filepath)
verify_that_key_to_filepath_operation_is_reversible(self)
property config(self)
class great_expectations.data_context.store.tuple_store_backend.TupleFilesystemStoreBackend(base_directory, filepath_template=None, filepath_prefix=None, filepath_suffix=None, forbidden_substrings=None, platform_specific_separator=True, root_directory=None, fixed_length_key=False, suppress_store_backend_id=False, manually_initialize_store_backend_id: str = '', base_public_path=None, store_name=None)

Bases: great_expectations.data_context.store.tuple_store_backend.TupleStoreBackend

Uses a local filepath as a store.

The key to this StoreBackend must be a tuple with fixed length based on the filepath_template, or a variable-length tuple may be used and returned with an optional filepath_suffix (to be) added. The filepath_template is a string template used to convert the key to a filepath.

_get(self, key)
_set(self, key, value, **kwargs)
_move(self, source_key, dest_key, **kwargs)
list_keys(self, prefix: Tuple = ())
rrmdir(self, mroot, curpath)

recursively removes empty dirs between curpath and mroot inclusive

remove_key(self, key)
get_url_for_key(self, key, protocol=None)
get_public_url_for_key(self, key, protocol=None)
_has_key(self, key)
property config(self)
class great_expectations.data_context.store.tuple_store_backend.TupleS3StoreBackend(bucket, prefix='', boto3_options=None, s3_put_options=None, filepath_template=None, filepath_prefix=None, filepath_suffix=None, forbidden_substrings=None, platform_specific_separator=False, fixed_length_key=False, suppress_store_backend_id=False, manually_initialize_store_backend_id: str = '', base_public_path=None, endpoint_url=None, store_name=None)

Bases: great_expectations.data_context.store.tuple_store_backend.TupleStoreBackend

Uses an S3 bucket as a store.

The key to this StoreBackend must be a tuple with fixed length based on the filepath_template, or a variable-length tuple may be used and returned with an optional filepath_suffix (to be) added. The filepath_template is a string template used to convert the key to a filepath.

_build_s3_object_key(self, key)
_get(self, key)
_set(self, key, value, content_encoding='utf-8', content_type='application/json', **kwargs)
_move(self, source_key, dest_key, **kwargs)
list_keys(self, prefix: Tuple = ())
get_url_for_key(self, key, protocol=None)
get_public_url_for_key(self, key, protocol=None)
remove_key(self, key)
_has_key(self, key)
property boto3_options(self)
_create_client(self)
_create_resource(self)
property config(self)
class great_expectations.data_context.store.tuple_store_backend.TupleGCSStoreBackend(bucket, project, prefix='', filepath_template=None, filepath_prefix=None, filepath_suffix=None, forbidden_substrings=None, platform_specific_separator=False, fixed_length_key=False, suppress_store_backend_id=False, manually_initialize_store_backend_id: str = '', public_urls=True, base_public_path=None, store_name=None)

Bases: great_expectations.data_context.store.tuple_store_backend.TupleStoreBackend

Uses a GCS bucket as a store.

The key to this StoreBackend must be a tuple with fixed length based on the filepath_template, or a variable-length tuple may be used and returned with an optional filepath_suffix (to be) added.

The filepath_template is a string template used to convert the key to a filepath.

_build_gcs_object_key(self, key)
_get(self, key)
_set(self, key, value, content_encoding='utf-8', content_type='application/json', **kwargs)
_move(self, source_key, dest_key, **kwargs)
list_keys(self, prefix: Tuple = ())
get_url_for_key(self, key, protocol=None)
get_public_url_for_key(self, key, protocol=None)
_get_path_url(self, path)
remove_key(self, key)
_has_key(self, key)
class great_expectations.data_context.store.tuple_store_backend.TupleAzureBlobStoreBackend(container, connection_string, prefix='', filepath_template=None, filepath_prefix=None, filepath_suffix=None, forbidden_substrings=None, platform_specific_separator=False, fixed_length_key=False, suppress_store_backend_id=False, manually_initialize_store_backend_id: str = '', store_name=None)

Bases: great_expectations.data_context.store.tuple_store_backend.TupleStoreBackend

Uses an Azure Blob as a store.

The key to this StoreBackend must be a tuple with fixed length based on the filepath_template, or a variable-length tuple may be used and returned with an optional filepath_suffix (to be) added. The filepath_template is a string template used to convert the key to a filepath.

You need to setup the connection string environment variable https://docs.microsoft.com/en-us/azure/storage/blobs/storage-quickstart-blobs-python

_get_container_client(self)
_get(self, key)
_set(self, key, value, content_encoding='utf-8', **kwargs)
list_keys(self, prefix: Tuple = ())
get_url_for_key(self, key, protocol=None)
_has_key(self, key)
_move(self, source_key, dest_key, **kwargs)
remove_key(self, key)
property config(self)