All columns anomalies

elementary.all_columns_anomalies

Overview

The all_column_anomalies test applies column-level monitoring and anomaly detection across all table columns, activating monitors based on the column's data type. Customize the test with column_anomalies to specify monitors, and use exclude_prefix or exclude_regexp to skip columns based on naming patterns or regex matches, focusing the test on relevant data.

Default monitors by type:

Opt-in monitors by type:

Test configuration

where {{ parameters }}:

• timestamp_column: column name
• column_anomalies: column monitors list
• exclude_prefix: string
• exclude_regexp: regex
• where_expression: SQL expression
• anomaly_sensitivity: int
• anomaly_direction: [both | spike | drop]
• detection_period:
  • period: [hour | day | week | month]
  • count: int
• training_period:
  • period: [hour | day | week | month]
  • count: int
• time_bucket:
  • period: [hour | day | week | month]
  • count: int
• seasonality: day_of_week
• detection_delay:
  • period: [hour | day | week | month]
  • count: int
• ignore_small_changes:
  • spike_failure_percent_threshold: int
  • drop_failure_percent_threshold: int
• anomaly_exclude_metrics: [SQL expression]

Example