Skip to content
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
258 changes: 258 additions & 0 deletions documentation/docs/mcp/datahub-mcp.mdx
Original file line number Diff line number Diff line change
@@ -0,0 +1,258 @@
---
title: DataHub Extension
description: Add DataHub MCP Server as a goose Extension
---

import Tabs from '@theme/Tabs';
import TabItem from '@theme/TabItem';
import YouTubeShortEmbed from '@site/src/components/YouTubeShortEmbed';
import CLIExtensionInstructions from '@site/src/components/CLIExtensionInstructions';
import GooseDesktopInstaller from '@site/src/components/GooseDesktopInstaller';

<YouTubeShortEmbed videoUrl="https://www.youtube.com/embed/VXRvHIZ3Eww?start=1878" />

This tutorial covers how to add the [DataHub MCP Server](https://github.com/acryldata/mcp-server-datahub) as a goose extension to enable AI-powered data discovery, lineage exploration, and metadata querying across your data ecosystem.

:::tip TLDR
<Tabs groupId="interface">
<TabItem value="ui" label="goose Desktop" default>
[Launch the installer](goose://extension?cmd=uvx&arg=mcp-server-datahub%40latest&id=datahub-mcp&name=DataHub&description=Data%20discovery%20and%20metadata%20platform%20integration&env=DATAHUB_GMS_URL%3DDataHub%20GMS%20URL%20(e.g.%2C%20https%3A%2F%2Fyour-instance.acryl.io%20or%20http%3A%2F%2Flocalhost%3A8080)&env=DATAHUB_GMS_TOKEN%3DDataHub%20Personal%20Access%20Token)
</TabItem>
<TabItem value="cli" label="goose CLI">
**Command**
```sh
uvx mcp-server-datahub@latest
```
</TabItem>
</Tabs>
**Environment Variables**
```
DATAHUB_GMS_URL: <your-datahub-url>
DATAHUB_GMS_TOKEN: <your-datahub-token>
```
:::

## What is DataHub?

[DataHub](https://datahub.com/) is an open-source metadata platform that provides a unified view of your data ecosystem, cataloging datasets, dashboards, pipelines, and more with rich metadata including ownership, lineage, usage statistics, and data quality information.

The DataHub MCP Server enables AI agents to:
- **Find trustworthy data** using natural language search with trust signals like popularity, quality, and lineage
- **Explore data lineage** to understand upstream and downstream dependencies at table and column level
- **Understand business context** through glossaries, domains, data products, and organizational metadata
- **Generate SQL queries** with help from documentation, lineage, and popular query patterns

Learn more: [DataHub MCP Server Guide](https://docs.datahub.com/docs/features/feature-guides/mcp) | [GitHub Repository](https://github.com/acryldata/mcp-server-datahub)

## Prerequisites

Before using the DataHub MCP Server, ensure you have:

- **Python 3.10+** and **[uv](https://docs.astral.sh/uv/#installation)** package manager installed
- A **DataHub instance**: [DataHub Cloud](https://www.datahub.com) or [self-hosted DataHub](https://docs.datahub.com/docs/quickstart)
- A **[Personal Access Token](https://docs.datahub.com/docs/authentication/personal-access-tokens)** from your DataHub instance

## Configuration

:::info
Note that you'll need [uv](https://docs.astral.sh/uv/#installation) installed on your system to run this command, as it uses `uvx`.
:::

<Tabs groupId="interface">
<TabItem value="ui" label="goose Desktop" default>

<GooseDesktopInstaller
extensionId="datahub-mcp"
extensionName="DataHub"
description="Data discovery and metadata platform integration"
type="stdio"
command="uvx"
args={["mcp-server-datahub@latest"]}
timeout={300}
envVars={[
{ name: "DATAHUB_GMS_URL", label: "DataHub GMS URL (e.g., https://your-instance.acryl.io or http://localhost:8080)" },
{ name: "DATAHUB_GMS_TOKEN", label: "DataHub Personal Access Token" }
]}
apiKeyLink="https://docs.datahub.com/docs/authentication/personal-access-tokens"
apiKeyLinkText="DataHub Personal Access Token"
/>

</TabItem>
<TabItem value="cli" label="goose CLI">

<CLIExtensionInstructions
name="DataHub"
description="Data discovery and metadata platform integration"
type="stdio"
command="uvx mcp-server-datahub@latest"
timeout={300}
envVars={[
{ key: "DATAHUB_GMS_URL", value: "https://your-instance.acryl.io" },
{ key: "DATAHUB_GMS_TOKEN", value: "▪▪▪▪▪▪▪▪▪▪▪▪▪▪▪▪▪▪▪▪▪▪▪▪▪▪▪▪▪▪▪▪▪" }
]}
infoNote={
<>
Get your Personal Access Token from{" "}
<a href="https://docs.datahub.com/docs/authentication/personal-access-tokens" target="_blank" rel="noopener noreferrer">
DataHub documentation
</a>. Use your DataHub GMS URL (e.g., https://your-instance.acryl.io for DataHub Cloud or http://localhost:8080 for local instances).
</>
}
/>

</TabItem>
</Tabs>

## Example Usage

### Finding Trustworthy Data

Find datasets related to your project by describing what you need in natural language.

#### goose Prompt

> _Find all datasets related to customer transactions that are owned by the analytics team_

#### goose Output

:::note Desktop

The DataHub extension will search across your data catalog and return relevant datasets with their metadata, including:
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

If possible, an actual example response (or snippet) would go in these :::note blocks (but only h4 or lower if you include formatting)


- Dataset names and descriptions
- Column names, types, descriptions, and labels
- Owners
- Tags, properties, and glossary terms
- Usage statistics
- Data quality status

:::

### Exploring Data Lineage

I want to remove the "timestamp_seconds" column from the customer_orders table. What will break?

#### goose Prompt

> _Show me the upstream lineage for the customer_orders table_

#### goose Output

:::note Desktop

The extension will traverse the lineage graph and show any:

- Source tables and datasets
- Transformation pipelines
- ETL jobs and workflows
- Downstream columns

That would be impacted by removing the column.

:::

### Generating SQL Queries

How do I calculate the number of orders made in the USA last year?

#### goose Prompt

> _What are the most common queries run against the customer_orders dataset?_

#### goose Output

:::note Desktop

The extension will retrieve SQL query history showing:

- Frequently executed queries
- Common join patterns
- Filter conditions
- Aggregation patterns

In addition to column names, types, descriptions, and any labels. This will enable the agent to generate high quality SQL to answer the question.

:::

### Understanding Data Quality & Freshness

Determine whether a dataset is trustworthy before using it.

#### goose Prompt

> _Is the customer_orders table fresh and free of data quality issues?_

#### goose Output

:::note Desktop

The extension will fetch:

- Latest data quality assertions and test results
- Freshness / staleness metrics
- Schema change history
- SLA or SLO metadata
- Owner-provided health status

Allowing the agent to warn the user or confirm data trustworthiness.

:::

## Capabilities

The DataHub MCP Server provides the following tools:

**`search`**

Search DataHub using structured keyword search (/q syntax) with boolean logic, filters, pagination, and optional sorting by usage metrics.

**`get_lineage`**

Retrieve upstream or downstream lineage for any entity (datasets, columns, dashboards, etc.) with filtering, query-within-lineage, pagination, and hop control.

**`get_dataset_queries`**

Fetch real SQL queries referencing a dataset or column—manual or system-generated—to understand usage patterns, joins, filters, and aggregation behavior.

**`get_entities`**

Fetch detailed metadata for one or more entities by URN; supports batch retrieval for efficient inspection of search results.

**`list_schema_fields`**

List schema fields for a dataset with keyword filtering and pagination, useful when search results truncate fields or when exploring large schemas.

**`get_lineage_paths_between`**

Retrieve the exact lineage paths between two assets or columns, including intermediate transformations and SQL query information.

## Resources

- [DataHub MCP Server GitHub](https://github.com/acryldata/mcp-server-datahub)
- [DataHub Documentation](https://docs.datahub.com/docs/)
- [DataHub MCP Server Guide](https://docs.datahub.com/docs/features/feature-guides/mcp)
- [Demo Video](https://youtu.be/VXRvHIZ3Eww?t=1878)

## Troubleshooting

### Connection Issues

If you're having trouble connecting to DataHub:

1. Verify your `DATAHUB_GMS_URL` is correct:
- For DataHub Cloud: `https://your-tenant.acryl.io`
- For local instances: `http://localhost:8080`
- For on-premises: `https://datahub.your-company.com`

2. Confirm your Personal Access Token is valid and has appropriate permissions

3. Check network connectivity and firewall rules

### Installation Issues

If `uvx` is not found:

1. Ensure `uv` is installed: `curl -LsSf https://astral.sh/uv/install.sh | sh`
2. Restart your terminal or source your shell configuration
3. Verify installation: `which uvx`

38 changes: 30 additions & 8 deletions documentation/static/servers.json
Original file line number Diff line number Diff line change
Expand Up @@ -195,6 +195,28 @@
"endorsed": true,
"environmentVariables": []
},
{
"id": "datahub-mcp",
"name": "DataHub",
"description": "Data discovery and metadata platform for exploring datasets, lineage, and queries",
"command": "uvx mcp-server-datahub@latest",
"link": "https://github.com/acryldata/mcp-server-datahub",
"installation_notes": "Install using uvx package manager. Requires Python 3.10+ and uv. Works with both DataHub Cloud and self-hosted DataHub instances.",
"is_builtin": false,
"endorsed": true,
"environmentVariables": [
{
"name": "DATAHUB_GMS_URL",
"description": "DataHub GMS URL (e.g., https://your-instance.acryl.io or http://localhost:8080)",
"required": true
},
{
"name": "DATAHUB_GMS_TOKEN",
"description": "DataHub Personal Access Token for authentication",
"required": true
}
]
},
{
"id": "developer",
"name": "Developer",
Expand Down Expand Up @@ -370,13 +392,13 @@
"required": true
},
{
"name": "MQTT_USERNAME",
"name": "MQTT_USERNAME",
"description": "MQTT username (empty string if no auth required)",
"required": true
},
{
"name": "MQTT_PASSWORD",
"description": "MQTT password (empty string if no auth required)",
"description": "MQTT password (empty string if no auth required)",
"required": true
}
]
Expand Down Expand Up @@ -453,13 +475,13 @@
"is_builtin": false,
"endorsed": true,
"environmentVariables": [
{
"name": "AUTH_HEADER",
"description": "OpenMetadata Personal Access Token",
"required": true
}
{
"name": "AUTH_HEADER",
"description": "OpenMetadata Personal Access Token",
"required": true
}
]
},
},
{
"id": "pdf_read",
"name": "PDF Reader",
Expand Down