Snowflake Share Data Model

Bigeye is able to share data with customers via Snowflake shares. This document provides an overview of the data model for the Snowflake share schema. The shared schema includes multiple views that expose usage data to Bigeye customers in a structured manner, helping them analyze key metrics related to their data.

Overview

The views within our snowflake share schema are:

  1. DIM_METRIC: Contains information about all metrics used in a customer's Bigeye environment.
  2. DIM_ISSUE: Contains information about all issues including their status, priority, and activity.
  3. DIM_DELTA: Contains information about all deltas used in a customer's Bigeye environment.
  4. DIM_COLLECTION: Contains information about all collections used in a customer's Bigeye environment.
  5. FACT_METRIC_RUN: Contains information about all metric runs in a customer's Bigeye environment.
  6. FACT_DELTA_RUN: Contains information about all delta runs used in a customer's Bigeye environment.
  7. FACT_COLLECTION_METRIC: Contains information about the relationship between collections and metrics within a customer's Bigeye environment.
  8. AGG_WORKSPACE_MONTHLY: Contains aggregated data at the workspace level, providing monthly statistics related to metrics, datasets (tables), deltas, and billable metrics.

View Definitions

DIM_METRIC

The following fields are included in the view:

Field NameDescription
WORKSPACE_IDA unique identifier for the workspace
WORKSPACE_NAMEThe name of the workspace
SOURCE_IDA unique identifier for the data source
SOURCE_NAMEThe name of the data source
SOURCE_WAREHOUSEVENDORType of the source warehouse vendor
SCHEMA_IDA unique identifier for the schema
SCHEMA_NAMEThe name of the schema
DATASET_IDA unique identifier for the dataset (table)
DATASET_NAMEThe name of the dataset (table)
COLUMN_NAMEThe name of the column (if applicable)
METRIC_IDA unique identifier for the metric
METRIC_NAMEThe name of the metric
METRIC_GIVEN_NAMEThe given name for the metric
METRIC_DESCRIPTIONA description of the metric
METRIC_TEMPLATE_IDA unique identifier for the metric template (if applicable)
METRIC_CREATED_BY_IDID of the user who created the metric
METRIC_CREATED_ATTimestamp of when the metric was created
METRIC_FIRST_RUN_ATTimestamp of the metric’s first run
METRIC_UPDATED_BY_IDID of the user who last updated the metric
METRIC_UPDATED_ATTimestamp of the metric’s last update
METRIC_DELTED_BY_IDID of the user who deleted the metric (if applicable)
METRIC_DELETED_ATTimestamp of when the metric was deleted (if applicable)
METRIC_METRIC_CREATION_STATEHow was the metric created
METRIC_CATEGORYThe category the metric falls under
NEW_METRIC_CATEGORYA newly assigned category for the metric
METRIC_TYPEThe type of the metric
METRIC_AGGREGATIONTYPEThe aggregation type for the metric
METRIC_LOOKBACK_TYPEThe type of lookback for the metric
METRIC_INTERVAL_TYPEThe interval type for the metric
METRIC_INTERVAL_VALUEThe interval value for the metric
THRESHOLD_TYPEThe type of threshold applied
THRESHOLD_BOUNDThe boundary for the threshold
THRESHOLD_SENSITIVITYThe sensitivity level of the threshold
METRIC_IS_DEPLOYEDWhether the metric is currently deployed or not
METRIC_IS_DEPLOYED_BIGCONFIGWhether the metric was deployed using bigconfig or not
METRIC_GRAIN_SIZEThe granularity of the metric
METRIC_PARTITIONSTOLOOKBACKThe partition settings for the lookback
METRIC_GROUP_COUNT_TOTALThe total number of metric groups
METRIC_GROUP_COUNT_CRITICALThe number of critical metric groups
METRIC_STATUSThe current status of the metric
IS_MUTEDIndicates if the metric is muted
_LOADED_AT_TSTimestamp of when the table was last loaded

DIM_ISSUE

The following fields are included in the view:

Field NameDescription
WORKSPACE_IDA unique identifier for the workspace
SOURCE_IDA unique identifier for the data source
METRIC_IDA unique identifier for the metric
ISSUE_IDA unique identifier for the issue
ISSUE_CREATED_ATTimestamp when the issue was created
ISSUE_CURRENT_STATUSThe current status of the issue
ISSUE_PRIORITY_SCOREPriority score for the issue
IS_MUTEDIndicates if the issue is muted
FIRST_ACTIVITY_ATTimestamp of the first activity related to the issue
LAST_ACTIVITY_ATTimestamp of the last activity related to the issue
ISSUE_ACKED_ATTimestamp of when the issue was acknowledged
IS_MUTED_BY_ACKWhether the issue is muted by acknowledgment of the issue
ISSUE_MONITORING_ATTimestamp of when the issue started being monitored
ISSUE_CLOSED_ATTimestamp of when the issue was closed
ISSUE_CLOSING_LABELLabel for how the issue was closed (e.g., "Maintain thresholds" or "Adapt thresholds")
IS_AUTO_CLOSEDWhether the issue was automatically closed
CNTD_USERS_INTERACTEDThe count of unique users who interacted with the issue
CNT_COLLECTIONSThe number of collections associated with the issue
CNT_ACTIVITYThe count of user activities associated with the issue
ISSUE_TYPEThe type of the issue (e.g., issue or incident)
IS_INCIDENTIndicates if the issue is an incident
PARENT_ISSUE_IDA reference to the parent issue (if applicable)
IS_ROOT_CAUSEWhether this issue is the root cause
NUM_IMPACTED_OBJECTSThe number of objects impacted by the issue
DESCRIPTIONA description of the issue
_LOADED_AT_TSTimestamp of when the table was last loaded

DIM_DELTA

The following fields are included in the view:

Field NameDescription
DELTA_IDA unique identifier for the delta
DELTA_NAMEThe name of the delta
CREATED_ATTimestamp when the delta was created
CREATED_BY_IDID of the user who created the delta
UPDATED_ATTimestamp when the delta was last updated
UPDATED_BY_IDID of the user who last updated the delta
LAST_RUN_ATTimestamp of when the delta was last run
SOURCE_ROW_COUNTThe row count in the source dataset for the delta
TARGET_ROW_COUNTThe row count in the target dataset for the delta
TOTAL_METRIC_COUNTThe total number of metrics associated with the delta
ALERTING_METRIC_COUNTThe count of metrics triggering alerts for the delta
FAILED_METRIC_COUNTThe number of metrics that failed for the delta
SOURCE_WAREHOUSE_IDThe ID of the source warehouse
SOURCE_SCHEMA_IDThe ID of the source schema
SOURCE_TABLE_IDThe ID of the source table
SOURCE_WAREHOUSE_NAMEThe name of the source warehouse
SOURCE_SCHEMA_NAMEThe name of the source schema
SOURCE_TABLE_NAMEThe name of the source table
TARGET_WAREHOUSE_IDThe ID of the target warehouse
TARGET_SCHEMA_IDThe ID of the target schema
TARGET_TABLE_IDThe ID of the target table
TARGET_WAREHOUSE_NAMEThe name of the target warehouse
TARGET_SCHEMA_NAMEThe name of the target schema
TARGET_TABLE_NAMEThe name of the target table
_LOADED_AT_TSTimestamp of when the table was last loaded

DIM_COLLECTION

The following fields are included in the view:

Field NameDescription
WORKSPACE_IDA unique identifier for the workspace
COLLECTION_IDA unique identifier for the collection
COLLECTION_NAMEThe name of the collection
COLLECTION_DESCRIPTIONA description of the collection
COLLECTION_OWNER_USER_IDThe user ID of the collection owner
COLLECTION_CREATED_BY_USER_IDThe user ID of the person who created the collection
COLLECTION_CREATED_ATTimestamp when the collection was created
COLLECTION_UPDATED_BY_USER_IDThe user ID of the person who last updated the collection
COLLECTION_UPDATED_ATTimestamp when the collection was last updated
COLLECTION_IS_MUTEDWhether the collection is muted
_LOADED_AT_TSTimestamp of when the table was last loaded

FACT_METRIC_RUN

The following fields are included in the view:

Field NameDescription
WORKSPACE_IDA unique identifier for the workspace
WORKSPACE_NAMEThe name of the workspace
SOURCE_IDA unique identifier for the data source
SOURCE_WAREHOUSEVENDORThe type of source warehouse vendor
SCHEMA_IDA unique identifier for the schema
DATASET_IDA unique identifier for the dataset
METRIC_IDA unique identifier for the metric
METRIC_EVENT_IDA unique identifier for the metric event
METRIC_RUN_IDA unique identifier for the metric run
METRIC_RUN_STATUSThe status of the metric run
METRIC_RUN_ATThe timestamp when the metric run occurred
METRIC_RUN_FAILURE_REASONThe reason for any failure in the metric run
METRIC_RUN_GRAIN_STARTThe starting grain for the metric run
METRIC_RUN_GRAIN_ENDThe ending grain for the metric run
THRESHOLD_IS_POST_HOCIndicates whether the threshold is post-hoc
METRIC_STATUSThe status of the metric
METRIC_ACTUAL_VALUEThe actual value of the metric
THRESHOLD_LOWER_CRITThe lower critical threshold value
THRESHOLD_UPPER_CRITThe upper critical threshold value
METRIC_GROUP_COUNT_TOTALThe total group count of the metric
METRIC_GROUP_COUNT_CRITICALThe group count of the metric that is critical
_LOADED_AT_TSTimestamp of when the table was last loaded

FACT_DELTA_RUN

The following fields are included in the view:

Field NameDescription
DELTA_METRIC_RUN_IDA unique identifier for the delta metric run
DELTA_METRIC_IDA unique identifier for the delta metric
DELTA_METRIC_RUN_ATThe timestamp when the delta metric run occurred
DELTA_IDA unique identifier for the delta
DELTA_NAMEThe name of the delta
TOTAL_METRIC_COUNTThe total count of metrics in the delta run
ALERTING_METRIC_COUNTThe count of metrics in the delta run that triggered an alert
FAILED_METRIC_COUNTThe count of metrics that failed in the delta run
METRIC_NAMEThe name of the metric
GROUP_COUNTThe count of groups in the delta run
TOLERANCEThe tolerance value for the delta
USER_SPECIFIEDWhether the delta run was user-specified
SOURCE_TABLE_IDThe identifier for the source table in the delta
SOURCE_VALUEThe value from the source table
SOURCE_ROW_COUNTThe row count in the source table
TARGET_TABLE_IDThe identifier for the target table in the delta
TARGET_VALUEThe value from the target table
TARGET_ROW_COUNTThe row count in the target table
_LOADED_AT_TSTimestamp of when the table was last loaded

FACT_COLLECTION_METRIC

The following fields are included in the view:

Field NameDescription
WORKSPACE_IDThe unique identifier for the workspace where the metric is tracked
COLLECTION_IDThe unique identifier for the collection in the workspace
METRIC_IDThe unique identifier for the metric
_LOADED_AT_TSTimestamp of when the table was last loaded

AGG_WORKSPACE_MONTHLY

The following fields are included in the view:

Field NameDescription
WORKSPACE_IDThe unique identifier for the workspace
WORKSPACE_NAMEThe name of the workspace
METRIC_RUN_MONTHThe month when the metric run occurred
CNT_METRIC_RUNSThe count of metric runs for the given workspace and month
CNTD_METRICSThe count of distinct metrics
CNTD_DATASETSThe count of distinct datasets (tables)
CNTD_DELTASThe count of distinct deltas
CNTD_DELTA_DATASETSThe count of distinct delta datasets
CNT_BILLABLE_METRIC_RUNSThe count of billable metric runs
CNTD_BILLABLE_DATASETSThe count of distinct billable datasets (tables)
_LOADED_AT_TSTimestamp of when the table was last loaded

ERD