SnapLogic

The SnapLogic connector extracts pipeline metadata from the SnapLogic REST API to build lineage for data movement and transformations within your SnapLogic environment. It supports both cloud-based extraction and local file-based analysis.

Prerequisites

A SnapLogic user with Org Admin rights (required for REST API access)
Network access to the SnapLogic Control Plane
Bigeye workspace with admin access and a Bigeye API key

Configuration Parameters

Create a properties file (for example, snaplogic.properties) with your connection configuration:

Property	Type	Required	Description	Example
`environment.name.N`	String	Yes	Environment identifier used to group projects	`Prod`
`bigeye.host.N`	URL	Yes	Bigeye instance URL	`https://app.bigeye.com`
`bigeye.apikey.N`	String	Yes	Bigeye API key	`bigeye_pak_abc123`
`bigeye.allowed.workspaces.N`	Integer List	Yes	Comma-separated workspace IDs	`123`
`snaplogic.control.plane.N`	String	Yes	Hostname of the SnapLogic Control Plane	`elastic.snaplogic.com`
`snaplogic.project.path.N`	String	Yes	Path to the SnapLogic project	`Partners/Acme`
`snaplogic.hours.N`	Integer	No	Hours of pipeline execution history to analyze (counting backward from now)	`24`
`snaplogic.username.N`	String	Yes	Service account username for the REST API	`[email protected]`
`snaplogic.password.N`	String	Yes	Service account password
`snaplogic.load.from.cloud.N`	Boolean	No	Read projects from SnapLogic cloud. Set to `No` to use local pipeline files instead	`Yes`
`snaplogic.pipeline.location.N`	Path	If not cloud	Path to local SnapLogic pipeline files	`/data/snaplogic/pipelines/`

📝 Note For UAT or EMEA environments, substitute the control plane hostname accordingly (for example, uat.snaplogic.com or emea.snaplogic.com).

Sample Properties File

environment.name.1=SnapLogic Production
bigeye.host.1=https://app.bigeye.com
bigeye.apikey.1=bigeye_pak_acbdefg123456
bigeye.allowed.workspaces.1=123
snaplogic.control.plane.1=elastic.snaplogic.com
snaplogic.project.path.1=Partners/Acme
snaplogic.hours.1=24
[email protected]
snaplogic.password.1=${SNAPLOGIC_PASSWORD}
snaplogic.load.from.cloud.1=Yes

Running the Connector

With the Agent CLI (recommended)

# Install and configure the Lineage Plus agent
./bigeye-agent install

# Add the SnapLogic connector
./bigeye-agent add-connector -c snaplogic

# Run the connector
./bigeye-agent lineage run -c snaplogic

With Docker

docker run --rm \
  -v /path/to/config:/app/config \
  --entrypoint bash bigeyedata/source-connector:latest \
  -c "bigeye-connector run -c snaplogic -p /app/config/snaplogic.properties"