Skip to content

Databricks

Coming Soon

Databricks SQL support is under active development. This page describes the planned integration.

Overview

Databricks provides a lakehouse architecture combining data lake flexibility with warehouse performance. Databricks SQL endpoints allow GradientHarbor to query Delta Lake tables using standard SQL.

┌─────────────────┐     ┌──────────────────┐     ┌─────────────────┐
│ GradientHarbor  │────▶│  Databricks SQL  │────▶│   Delta Lake    │
│                 │ SQL │                  │     │   (Parquet +    │
│  AI Agent       │◀────│  Photon Engine   │◀────│    metadata)    │
│  Dashboards     │     │                  │     │                 │
└─────────────────┘     └──────────────────┘     └─────────────────┘

Planned Configuration

FieldDescription
HostDatabricks workspace URL (e.g., dbc-abc123.cloud.databricks.com)
HTTP PathSQL warehouse HTTP path (e.g., /sql/1.0/warehouses/abc123)
Access TokenPersonal access token or service principal token

Why Databricks

  • Photon engine — Vectorized query engine for fast analytics
  • Delta Lake — ACID transactions, schema enforcement, time travel
  • Unity Catalog — Unified governance across tables and models
  • Multi-cloud — Runs on AWS, Azure, and GCP