great_expectations.data_context.store.tuple_store_backend
¶
Module Contents¶
Classes¶
|
If filepath_template is provided, the key to this StoreBackend abstract class must be a tuple with |
|
Uses a local filepath as a store. |
|
Uses an S3 bucket as a store. |
|
Uses a GCS bucket as a store. |
|
Uses an Azure Blob as a store. |
-
great_expectations.data_context.store.tuple_store_backend.
logger
¶
-
class
great_expectations.data_context.store.tuple_store_backend.
TupleStoreBackend
(filepath_template=None, filepath_prefix=None, filepath_suffix=None, forbidden_substrings=None, platform_specific_separator=True, fixed_length_key=False, suppress_store_backend_id=False, manually_initialize_store_backend_id: str = '', base_public_path=None, store_name=None)¶ Bases:
great_expectations.data_context.store.store_backend.StoreBackend
If filepath_template is provided, the key to this StoreBackend abstract class must be a tuple with fixed length equal to the number of unique components matching the regex r”{d+}”
For example, in the following template path: expectations/{0}/{1}/{2}/prefix-{2}.json, keys must have three components.
-
_validate_key
(self, key)¶
-
_validate_value
(self, value)¶
-
_convert_key_to_filepath
(self, key)¶
-
_convert_filepath_to_key
(self, filepath)¶
-
verify_that_key_to_filepath_operation_is_reversible
(self)¶
-
property
config
(self)¶
-
-
class
great_expectations.data_context.store.tuple_store_backend.
TupleFilesystemStoreBackend
(base_directory, filepath_template=None, filepath_prefix=None, filepath_suffix=None, forbidden_substrings=None, platform_specific_separator=True, root_directory=None, fixed_length_key=False, suppress_store_backend_id=False, manually_initialize_store_backend_id: str = '', base_public_path=None, store_name=None)¶ Bases:
great_expectations.data_context.store.tuple_store_backend.TupleStoreBackend
Uses a local filepath as a store.
The key to this StoreBackend must be a tuple with fixed length based on the filepath_template, or a variable-length tuple may be used and returned with an optional filepath_suffix (to be) added. The filepath_template is a string template used to convert the key to a filepath.
-
_get
(self, key)¶
-
_set
(self, key, value, **kwargs)¶
-
_move
(self, source_key, dest_key, **kwargs)¶
-
list_keys
(self, prefix: Tuple = ())¶
-
rrmdir
(self, mroot, curpath)¶ recursively removes empty dirs between curpath and mroot inclusive
-
remove_key
(self, key)¶
-
get_url_for_key
(self, key, protocol=None)¶
-
get_public_url_for_key
(self, key, protocol=None)¶
-
_has_key
(self, key)¶
-
property
config
(self)¶
-
-
class
great_expectations.data_context.store.tuple_store_backend.
TupleS3StoreBackend
(bucket, prefix='', boto3_options=None, s3_put_options=None, filepath_template=None, filepath_prefix=None, filepath_suffix=None, forbidden_substrings=None, platform_specific_separator=False, fixed_length_key=False, suppress_store_backend_id=False, manually_initialize_store_backend_id: str = '', base_public_path=None, endpoint_url=None, store_name=None)¶ Bases:
great_expectations.data_context.store.tuple_store_backend.TupleStoreBackend
Uses an S3 bucket as a store.
The key to this StoreBackend must be a tuple with fixed length based on the filepath_template, or a variable-length tuple may be used and returned with an optional filepath_suffix (to be) added. The filepath_template is a string template used to convert the key to a filepath.
-
_build_s3_object_key
(self, key)¶
-
_get
(self, key)¶
-
_set
(self, key, value, content_encoding='utf-8', content_type='application/json', **kwargs)¶
-
_move
(self, source_key, dest_key, **kwargs)¶
-
list_keys
(self, prefix: Tuple = ())¶
-
get_url_for_key
(self, key, protocol=None)¶
-
get_public_url_for_key
(self, key, protocol=None)¶
-
remove_key
(self, key)¶
-
_has_key
(self, key)¶
-
property
boto3_options
(self)¶
-
_create_client
(self)¶
-
_create_resource
(self)¶
-
property
config
(self)¶
-
-
class
great_expectations.data_context.store.tuple_store_backend.
TupleGCSStoreBackend
(bucket, project, prefix='', filepath_template=None, filepath_prefix=None, filepath_suffix=None, forbidden_substrings=None, platform_specific_separator=False, fixed_length_key=False, suppress_store_backend_id=False, manually_initialize_store_backend_id: str = '', public_urls=True, base_public_path=None, store_name=None)¶ Bases:
great_expectations.data_context.store.tuple_store_backend.TupleStoreBackend
Uses a GCS bucket as a store.
The key to this StoreBackend must be a tuple with fixed length based on the filepath_template, or a variable-length tuple may be used and returned with an optional filepath_suffix (to be) added.
The filepath_template is a string template used to convert the key to a filepath.
-
_build_gcs_object_key
(self, key)¶
-
_get
(self, key)¶
-
_set
(self, key, value, content_encoding='utf-8', content_type='application/json', **kwargs)¶
-
_move
(self, source_key, dest_key, **kwargs)¶
-
list_keys
(self, prefix: Tuple = ())¶
-
get_url_for_key
(self, key, protocol=None)¶
-
get_public_url_for_key
(self, key, protocol=None)¶
-
_get_path_url
(self, path)¶
-
remove_key
(self, key)¶
-
_has_key
(self, key)¶
-
-
class
great_expectations.data_context.store.tuple_store_backend.
TupleAzureBlobStoreBackend
(container, connection_string, prefix='', filepath_template=None, filepath_prefix=None, filepath_suffix=None, forbidden_substrings=None, platform_specific_separator=False, fixed_length_key=False, suppress_store_backend_id=False, manually_initialize_store_backend_id: str = '', store_name=None)¶ Bases:
great_expectations.data_context.store.tuple_store_backend.TupleStoreBackend
Uses an Azure Blob as a store.
The key to this StoreBackend must be a tuple with fixed length based on the filepath_template, or a variable-length tuple may be used and returned with an optional filepath_suffix (to be) added. The filepath_template is a string template used to convert the key to a filepath.
You need to setup the connection string environment variable https://docs.microsoft.com/en-us/azure/storage/blobs/storage-quickstart-blobs-python
-
_get_container_client
(self)¶
-
_get
(self, key)¶
-
_set
(self, key, value, content_encoding='utf-8', **kwargs)¶
-
list_keys
(self, prefix: Tuple = ())¶
-
get_url_for_key
(self, key, protocol=None)¶
-
_has_key
(self, key)¶
-
_move
(self, source_key, dest_key, **kwargs)¶
-
remove_key
(self, key)¶
-
property
config
(self)¶
-