Databricks on AWS OCF Connector Release Notes

Alation Cloud Service Applies to Alation Cloud Service instances of Alation

Customer Managed Applies to customer-managed instances of Alation

February 28, 2024

Databricks on AWS OCF Connector: Version 2.1.10

Fixed Issues

Data Sampling Fails Due to Void Data Type

Bulk data sampling fails when the Databricks on AWS OCF connector encounters a column with void data type. Now, the connector skips the column with void data type and continues with bulk data sampling and does not error out.

Note

The root cause for this issue is in the Databricks driver that the Databricks on AWS OCF connector uses. Once Databricks on AWS resolves the issue in the driver, you will start viewing the column values in profiling or sampling.

January 31, 2024

Databricks on AWS OCF Connector: Version 2.1.9

Enhancements

Databricks Driver Upgrade

The Databricks driver for the OCF connector is upgraded to the latest version 2.6.34.

January 17, 2024

Databricks on AWS OCF Connector: Version 2.1.8

Fixed Issues

Longer Execution Time for Sampling and Profiling Queries

In AWS Databricks, row count takes longer to execute for custom Sampling queries for views with large tables.

January 03, 2024

Databricks on AWS OCF Connector: Version 2.1.7

Fixed Issues

QLI Fails with Partial Success Status

QLI for AWS Databricks OCF connector fails with a Partial Success status and the following status message: No queries were found to ingest, making the QLI feature unusable.

December 13, 2023

Databricks on AWS OCF Connector: Version 2.1.6

Compatible Alation Version - 2023.1 or higher

Enhancements

Dynamic Profiling and Dynamic Sampling Uses Respective Database Credentials

Dynamic profiling and sampling for Databricks on AWS OCF connector now use the credentials the user provides for their respective databases when retrieving table samples and column profiles for specific tables and columns.

November 22, 2023

Databricks on AWS OCF Connector: Version 2.1.4

Compatible Alation version: 2023.1 or higher

Fixed Issues

Query Log Ingestion Fails for AWS OCF Connector

The Query Log Ingestion (QLI) Preview and ingestion fails due to the Log4j library upgrade after successful datasource connection and metadata extraction.

Preview Error:

QLI Preview failed: The connector responded with the following error message: NA_LOCATION_INFO.

QLI Error:

No queries were found to Ingest.

This issue is resolved.