dbt-fabricspark Feature Timeline
Source basis:
- Git history from
microsoft/dbt-fabricspark - Release tags and
CHANGELOG.md - Public docs for dbt and Microsoft Fabric capabilities
This timeline tracks major adapter and Fabric-related capabilities added to dbt-fabricspark, focusing on features that reflect either new dbt adapter behavior or new Microsoft Fabric support surfaced through the adapter.
| Year | Year-Month | Feature | Brief Description | Links |
|---|---|---|---|---|
| 2024 | 2024-02 | Repository Bootstrap | Initial public repository setup for the Microsoft Fabric Spark adapter for dbt, including README, licensing, security, and contribution metadata. | Repo |
| 2024 | 2024-03 | Initial Adapter Documentation | Early README and workflow updates established the adapter’s core purpose: running dbt against Microsoft Fabric Spark/Lakehouse via Livy. | README · dbt fabricspark profile |
| 2024 | 2024-04 | Livy Session Startup Reliability | Updated handling for Livy session started state to improve connection stability while waiting for Fabric Spark sessions to become usable. | Fabric Livy API |
| 2024 | 2024-05 | Release Candidate for dbt 1.7 Era | v1.7.0rc1 marked the first tagged pre-release of the adapter, aligning the package for modern dbt adapter packaging and release flow. | Release tag v1.7.0rc1 |
| 2024 | 2024-05 | Fabric Public API Endpoint Adoption | The adapter switched documentation and behavior toward the public Fabric API endpoint, improving consistency for Fabric-native connection setup. | Fabric REST API |
| 2024 | 2024-06 | Lakehouse Shortcut Support | Added support for creating Fabric shortcuts from dbt runs, including API wrapper logic, JSON-based shortcut definitions, existence checks, and recreation on source/target mismatch. | OneLake shortcuts · dbt fabricspark configs |
| 2024 | 2024-06 | Dynamic Table Source Resolution | Added table_source macro support to automatically locate which lakehouse a referenced table lives in, improving multi-lakehouse project ergonomics. | OneLake overview |
| 2024 | 2024-07 | Shortcut Test Coverage | Expanded automated tests around shortcut creation and lifecycle behavior, helping stabilize Fabric-specific object management from dbt. | Repo tests |
| 2024 | 2024-08 | Improved Connection Error Messaging | Added more informative failed-connect diagnostics and refined Livy session creation behavior to make Fabric connection issues easier to debug. | Fabric Livy API |
| 2024 | 2024-11 | Error Checking Hardening | Merged broader error-checking work to make adapter failures clearer and reduce ambiguous runtime issues during session and statement execution. | Repo pull requests |
| 2024 | 2024-12 | Shortcut Configuration Matures | Shortcut support was extended and stabilized, including workflow permission updates and better alignment with Fabric auth and shortcut APIs. | OneLake shortcuts |
| 2025 | 2025-01 | Functional and Parallel Test Expansion | Added unit and functional testing improvements, plus parallel integration test execution, increasing adapter reliability across dbt operations. | Repo tests |
| 2025 | 2025-03 | Spark Configuration Support | Added explicit Spark configuration support in the adapter so dbt sessions can be launched with custom Fabric Spark settings from the profile. | Fabric environment settings · dbt fabricspark profile |
| 2025 | 2025-04 | dbt 1.9 Adapter Alignment | v1.9.0 / v1.9.1 era updates aligned the package with newer dbt adapter expectations and modernized the dev stack using uv and ruff. | Release tags · dbt adapter docs |
| 2026 | 2026-01 | Local Livy Mode | Added livy_mode: local, allowing the adapter to connect to a self-hosted/local Livy endpoint for offline development and testing without Fabric compute. | README · Apache Livy |
| 2026 | 2026-01 | Session Reuse Across Runs | Added reuse_session, session_idle_timeout, and session_id_file so developers can keep Fabric Livy sessions alive across dbt invocations and avoid repeated Spark startup overhead. | README · Fabric Livy API |
| 2026 | 2026-01 | Thread-Safe Livy Session Management | Made Livy session handling thread-safe to reduce duplicate session creation and concurrency issues in multi-threaded dbt execution. | dbt threads config |
| 2026 | 2026-01 | Fabric Notebook Authentication | Added fabric_notebook authentication mode so dbt can run inside a Fabric notebook using notebook credentials instead of external CLI or SPN auth. | README auth modes · Fabric notebooks |
| 2026 | 2026-03 | Duplicate Session Creation Fix | Fixed a race where missing Livy session metadata could trigger duplicate Fabric session creation, improving stability in longer dbt runs. | Fabric Livy API |
| 2026 | 2026-04 | v1.9.3 Stability Release | v1.9.3 delivered a major Fabric-focused stability upgrade: bounded polling timeouts, HTTP 5xx retry with exponential backoff, masked secrets in logs, UUID validation, and thread-safe token refresh. | Release tag v1.9.3 |
| 2026 | 2026-04 | Schema-Enabled Lakehouse Detection | Added automatic detection of schema-enabled Fabric lakehouses via the Fabric REST API (properties.defaultSchema) so the adapter can choose correct two-part vs three-part naming. | README schema detection · Lakehouse overview |
| 2026 | 2026-04 | Lakehouse-Aware Namespace Generation | Fixed dbt schema/database name generation to be aware of Fabric lakehouse type, preventing invalid namespace resolution on schema-enabled and non-schema lakehouses. | README lakehouse with schema |
| 2026 | 2026-04 | Incremental Models on Schema-Enabled Lakehouses | Reworked incremental materialization to use persisted staging views instead of temp views for schema-enabled lakehouses, avoiding Spark REQUIRES_SINGLE_PART_NAMESPACE failures. | README lakehouse with schema · dbt incremental models |
| 2026 | 2026-04 | Snapshot Merge Fix for Qualified Names | Snapshot staging was updated to inherit target database/schema so merge operations work correctly against fully qualified Fabric lakehouse tables. | dbt snapshots |
| 2026 | 2026-04 | insert_overwrite Delta Syntax Fix | Removed Hive-style partition clause emission for insert_overwrite, making incremental writes compatible with Delta Lake behavior in Fabric Spark. | Delta Lake · dbt incremental models |
| 2026 | 2026-04 | View Materialization Replace Logic | Added explicit handling for switching a model from table to view, dropping the existing table before creating the view to avoid relation conflicts. | dbt materializations |
| 2026 | 2026-04 | Fabric Environment Support | Added environmentId support so dbt-created Livy sessions can run with a specific Fabric Environment’s packages, runtime, and Spark settings. | README Fabric Environment support · Fabric environments |
| 2026 | 2026-04 | Integration Tests With and Without Schema | CI was expanded to provision/test both schema-enabled and non-schema lakehouses, increasing confidence across both major Fabric lakehouse modes. | Repo workflows |
| 2026 | 2026-04 | Cross-Lakehouse Writes | Added support for using dbt’s database model config to write different models to different Fabric lakehouses within the same workspace. | README cross-lakehouse writes · dbt database config |
| 2026 | 2026-04 | Materialized Lake Views Support | v1.9.5 added first-class materialized_lake_view materialization for Fabric-native Materialized Lake Views, including partitioning, comments, constraints, on-demand refresh, and schedules. | Release tag v1.9.5 · Materialized Lake Views |
| 2026 | 2026-04 | Automatic CDF Enablement for MLVs | The adapter now enables Change Data Feed automatically on upstream Delta tables when creating Materialized Lake Views. | README materialized lake views · MLV refresh docs |
| 2026 | 2026-04 | Job Scheduler API Integration for MLV Refresh | Added Fabric Job Scheduler API integration for immediate MLV refresh and polling of job status to completion. | Fabric Job Scheduler API |
| 2026 | 2026-04 | Scheduled MLV Refresh Management | Added idempotent create/update/delete schedule support for MLVs using the Fabric REST API with daily, weekly, and cron-style intervals. | Materialized lake view public API |
| 2026 | 2026-04 | Automatic Lakehouse ID Resolution | MLV logic now resolves lakehouse names to lakehouse IDs via the Fabric REST API automatically, avoiding manual ID configuration for refresh scheduling and management. | Fabric REST API |
| 2026 | 2026-04 | Multi-Lakehouse dbt docs generate Support | Removed the redundant assumption that a docs run targets a single database, enabling documentation generation for multi-lakehouse or mixed lakehouse/warehouse Fabric workspaces. | dbt docs |
Notes
- Dates are anchored to the
microsoft/dbt-fabricsparkgit history and release tags visible in the repository. - The repo currently exposes a small number of formal tags (
v1.7.0rc1,v1.9.3,v1.9.4,v1.9.5), so several timeline entries are derived from dated feature commits and the changelog rather than a release-per-feature model. - The strongest Fabric-specific capability waves in the repo are: shortcut support, Fabric Environment support, schema-enabled lakehouse support, cross-lakehouse writes, and Materialized Lake Views.