Note
Access to this page requires authorization. You can try signing in or changing directories.
Access to this page requires authorization. You can try changing directories.
April 24 - 28, 2023
These features and improvements were released with the 2023.16 release of DLT.
Databricks Runtime versions used by this release
Channel:
- CURRENT (default): Databricks Runtime 11.3.10
- PREVIEW: Databricks Runtime 12.2.3
New features and improvements in this release
DLT support for Unity Catalog is in Public Preview. You can use Unity Catalog with your Lakeflow Spark Declarative Pipelines to:
- Define a catalog in Unity Catalog where your pipeline will persist tables.
- Read data from Unity Catalog tables.
- By default, streaming tables require append-only sources. This release introduces the
skipChangeCommitsflag that can be set on a target streaming table to ignore changes in a source streaming table when the source table requires updates or deletes. See Configure a streaming table to ignore changes in a source streaming table
- With this release, the limit for concurrent updates in a workspace is increased to 100. The previous concurrent updates limit was 20.
- DLT is now supported in Azure China regions.
- When you run a pipeline from a notebook, you can now view the event log in the notebook sidebar. See Develop and debug pipelines with a notebook (legacy).
Bug fixes in this release
- This release fixes a bug causing the pipelines list page to crash when the “%” character was entered in the search box.