mex.extractors.pipeline.checks package

Subpackages

• mex.extractors.pipeline.checks.models package
  • Submodules
  • mex.extractors.pipeline.checks.models.check module
    • AssetCheck
      • AssetCheck.model_computed_fields
      • AssetCheck.model_config
      • AssetCheck.model_fields
      • AssetCheck.rules
    • AssetCheckRule
      • AssetCheckRule.fail_if
      • AssetCheckRule.model_computed_fields
      • AssetCheckRule.model_config
      • AssetCheckRule.model_fields
      • AssetCheckRule.target_type
      • AssetCheckRule.time_frame
      • AssetCheckRule.value
  • Module contents

Submodules

mex.extractors.pipeline.checks.main module

mex.extractors.pipeline.checks.main.check_x_items_more_passed(context: AssetCheckExecutionContext, asset_key: AssetKey, extractor: str, entity_type: str, asset_data: int) → bool

Checks whether latest extracted items nr is exceeding the rule threshold.

Returns bool to AssetCheck.

mex.extractors.pipeline.checks.main.check_yaml_path(extractor: str, entity_type: str) → bool

Checks if there are rules given the extractor and entityType.

Returns a bool.

mex.extractors.pipeline.checks.main.get_historic_count(historic_events: dict[datetime, int], time_frame: datetime) → int

Get count for closest timestamp <= time_frame or next closest > time_frame.

mex.extractors.pipeline.checks.main.get_historical_events(events: list[EventLogRecord]) → dict[datetime, int]

Load all past events and refactor it to a dict.

mex.extractors.pipeline.checks.main.get_rule(rule: str, extractor: str, entity_type: str) → dict[str, Any]

Load rule model from YAML file for given rule type.

mex.extractors.pipeline.checks.main.load_asset_check_from_settings(extractor: str, entity_type: str) → AssetCheck

Load AssetCheck model from YAML for a given extractor and entity type.

mex.extractors.pipeline.checks.main.parse_time_frame(time_frame: str) → timedelta

Parse time frame string into timedelta.

Module contents