Set up Bigeye

Before you can integrate Bigeye with Atlan, you need to map Atlan connections to the corresponding source in Bigeye. This allows for an efficient matching of assets between the two products. Unmapped sources in Bigeye will be ignored for the integration.

Prerequisites

• Admin access to Bigeye
• The qualified name for each Atlan connection that corresponds to a source in Bigeye

Map Atlan connections to Bigeye sources

You need to enable the mapping functionality in Bigeye and update source(s) with the qualified name of a connection.

1. Enable the Atlan Connection ID field for sources in Bigeye under Settings > Advanced Settings > Data Catalogs.

   

2. Retrieve the qualified name of the connection in Atlan. It can be found in the properties tab of the connection object within Atlan. You can find Connections under the Access Control section in the Governance center of the catalog.

   

3. Update Atlan Connection ID field of the source in Bigeye with the qualified name of the connection. If the source connection is agent-based, the update needs to be done via the API (example cURL command below).

   

curl --location 'https://app.bigeye.com/api/v1/sources' \
--header 'Content-Type: application/json' \
--header 'Authorization: apikey <bigeye_personal_api_key>' \
--data '{
  "temporalAgentSecret": "exists",
  "id": <bigeye_source_id>,
  "atlanConnectionId": "default/snowflake/1669038939",
  "workspaceId": <bigeye_workspace_id>
}'

Integrate Bigeye with Atlan

After mapping connections to Bigeye sources, you can create an ingestion workflow in Atlan to fetch data quality metadata. This workflow enriches your existing assets with data quality insights at the table and column level.

Prerequisites

Before you begin, make sure you have:

• At least one Atlan connection mapped to a source in Bigeye
• The Bigeye workspace ID to run against, found under Settings > Workspaces
• A Bigeye Personal API key for a user that has at least Edit access to the workspace above
• The email address associated with the user above
• Bigeye base URL

Create ingestion workflow

1. In the top right of any screen in Atlan, click New and then click New workflow.
2. From the list of packages, select Bigeye and then click Setup Workflow.

Configure credentials

1. Enter the base URL of Bigeye in Host.
2. Enter the email address of the user in Username.
3. Enter the API key in Personal API Key.
4. Click Test Authentication to verify connectivity to Bigeye.
5. After authentication succeeds, click Next at the bottom of the screen.

Verify source mapping and user access

1. Enter the Bigeye workspace ID in Workspace ID.
2. Click Check to verify user permissions and that at least one source contains a connection mapping.