Databricks
Coming Soon
Databricks SQL support is under active development. This page describes the planned integration.
Overview
Databricks provides a lakehouse architecture combining data lake flexibility with warehouse performance. Databricks SQL endpoints allow GradientHarbor to query Delta Lake tables using standard SQL.
┌─────────────────┐ ┌──────────────────┐ ┌─────────────────┐
│ GradientHarbor │────▶│ Databricks SQL │────▶│ Delta Lake │
│ │ SQL │ │ │ (Parquet + │
│ AI Agent │◀────│ Photon Engine │◀────│ metadata) │
│ Dashboards │ │ │ │ │
└─────────────────┘ └──────────────────┘ └─────────────────┘Planned Configuration
| Field | Description |
|---|---|
| Host | Databricks workspace URL (e.g., dbc-abc123.cloud.databricks.com) |
| HTTP Path | SQL warehouse HTTP path (e.g., /sql/1.0/warehouses/abc123) |
| Access Token | Personal access token or service principal token |
Why Databricks
- Photon engine — Vectorized query engine for fast analytics
- Delta Lake — ACID transactions, schema enforcement, time travel
- Unity Catalog — Unified governance across tables and models
- Multi-cloud — Runs on AWS, Azure, and GCP