2023.3 OCF Connectors¶
The tables below provide information on databases, BI tools, and file systems supported with OCF connectors. Click the connector name to go to the corresponding documentation page. For some of the connectors, where the link is not currently available, documentation will be added soon.
RDBMS Connectors¶
Connectors |
Supported Version |
Metadata Extraction (MDE) |
Table Sampling |
Profiling |
Query Log Ingestion (QLI) |
Table Level Lineage |
Column Level Lineage |
Compose |
|---|---|---|---|---|---|---|---|---|
Engine versions 2, 3 |
|
|
|
|
|
|
|
|
Amazon Redshift |
latest |
|
|
|
|
|
|
|
Amazon Redshift Spectrum |
latest |
|
|
|
|
|
|
|
latest |
|
|
|
|
|
|
|
|
latest |
|
|
|
|
|
|
|
|
12.0.2000.8 |
|
|
|
|
|
|
|
|
latest |
|
|
|
|
|
|
|
|
9.1 LTS, 10.4 LTS, 11.x, 12.x |
|
|
|
|
|
|
|
|
9.1 LTS, 10.4 LTS, 11.x, 12.x |
|
|
|
|
|
|
|
|
Databricks on Google Cloud |
9.1 LTS, 10.4 LTS, 11.3 LTS, 12.x |
|
|
|
|
* |
|
|
10.4 LTS, 11.x, 12.x Platforms: AWS, Azure |
|
|
|
|
** |
** |
|
|
10.4 LTS, 11.x, 12.x |
|
|
|
|
|
|
|
|
10.5, 11.1, 11.5 |
|
|
|
|
|
|
|
|
8 |
|
|
|
|
|
|
|
|
EMR Presto |
EMR 6.0, 6.1, 6.2, 6.4, 6.9 |
|
|
|
|
|
|
|
latest |
|
|
|
|
|
|
|
|
5, 6.3, 6.9, 6.22 |
|
|
|
|
|
|
|
|
Hive 2 on CDH |
CDH 6.2, 6.3 |
|
|
|
|
|
|
|
Hive 2 on EMR |
EMR 5.x |
|
|
|
|
|
|
|
Hive 2 on MapR |
MapR 6.1.x |
|
|
|
|
|
|
|
Hive 3 on CDH |
HDP 3.1.4 |
|
|
|
|
|
|
|
Hive 3 on EMR |
EMR 6.0, 6.1, 6.2, 6.4, 6.9 |
|
|
|
|
|
|
|
Hive 3 on CDP |
CDP 7.1.3, 7.1.7 |
|
|
|
|
|
|
|
Hive 3 on Azure HDInsight |
4.0, 5.0 |
|
|
|
|
|
|
|
CDH - 6.3 |
|
|
|
|
|
|
|
|
7.1.3, 7.1.7 |
|
|
|
|
|
|
|
|
MySQL |
5.7, 8.0 |
|
|
|
|
|
|
|
MySQL RDS |
5.7, 8.0 |
|
|
|
|
|
|
|
Oracle |
19c |
|
|
|
|
|
|
|
Oracle RDS |
19c |
|
|
|
|
|
|
|
Oracle E-Business Suite |
EBS 12.2.5 Oracle 11g |
|
|
|
|
|
|
|
PostgreSQL |
11.4, 11.5, 12, 13, 14.1, 14.5, 15.1 |
|
|
|
|
|
|
|
PostgreSQL RDS |
11.4, 11.5, 12, 13, 14.1, 14.5 |
|
|
|
|
|
|
|
PostgreSQL Enterprise |
11, 12, 13, 14.1 |
|
|
|
|
|
|
|
ASE 16.0 |
|
|
|
|
|
|
|
|
n/a |
|
|
|
|
** |
|
|
|
n/a |
|
|
|
|
** |
|
|
|
2.0 |
|
|
|
|
|
|
|
|
16 |
|
|
|
|
|
|
|
|
SAS Base |
9.4 |
|
|
|
|
* |
|
|
SingleStore (former MemSQL) |
7.8.9 |
|
|
|
|
* |
|
|
latest |
|
|
|
|
|
|
|
|
SQL Server |
2014, 2016, 2017, 2019, 2022 |
|
|
|
|
|
|
|
SQL Server RDS |
2014, 2016, 2017, 2019 |
|
|
|
|
|
|
|
SQL Server on Azure VM |
2017, 2019, 2022 |
|
|
|
|
|
|
|
Starburst Enterprise (Trino) |
380-e LTS, 413-e LTS on AWS |
|
|
|
|
*** |
|
|
16.10, 16.20, 17.05 |
|
|
|
|
|
|
|
|
11.1.x, 12.0.1 |
|
|
|
|
|
|
|
|
* Lineage is calculated based on queries ingested from Compose.
** Lineage is calculated using direct lineage extraction.
*** Extraction of view SQL during MDE is not supported. Lineage information is generated from DDL queries ingested during QLI and DDL queries run in Compose.
BI Connectors¶
Connectors |
Supported Version |
Metadata Extraction |
Lineage |
Column Level Lineage |
Access Rules |
SSL |
|---|---|---|---|---|---|---|
Cloud - latest, On-prem - 22.x, 23.x |
|
|
|
|
|
|
Cloud - 2021 On-prem - 11.3.10 |
|
|
|
|
|
|
latest |
|
|
|
|
|
|
Power BI Pro and Premium versions |
|
* |
|
|
|
|
Feb 2022 and earlier versions |
|
|
|
|
|
|
4.2 |
|
|
|
|
|
|
2016, 2017, 2019 |
|
|
|
|
|
|
|
(Tableau Server and Tableau Online) |
Server: 2021.3, 2021.4, 2022.1, 2022.3, 2023.1 Online - latest |
|
|
|
|
|
* Lineage for Dataflows is supported for Alation versions 2023.3.3 or higher.
File System Connectors¶
Connectors |
Supported Version |
Metadata Extraction |
Schema Extraction |
Sampling |
Authentication Methods |
|---|---|---|---|---|---|
latest |
|
* |
** |
Basic, STS |
|
latest |
|
|
|
Basic, SAS |
|
CDH - 6.2, 6.3 CDP - 7.1.3, 7.1.7 |
|
|
|
Basic, SSL, Kerberos |
* Schema extraction is supported only for CSV and Parquet files
** File sampling is supported only for CSV and Parquet files
SSO with Compose¶
Database Type |
Azure AD |
AD FS |
OKTA |
PingFederate |
One Login |
Auth0 |
Snowflake IdP |
|---|---|---|---|---|---|---|---|
Amazon Redshift |
|
|
|
|
|
|
n/a |
Databricks on AWS |
|
|
|
|
|
|
n/a |
Azure Databricks |
|
|
|
|
|
|
n/a |
Azure Synapse Analysis |
|
|
|
|
|
|
n/a |
Azure SQL (SQL DB) |
|
|
|
|
|
|
n/a |
Databricks Unity Catalog (Azure) |
|
|
|
|
|
|
n/a |
Snowflake |
|
|
|
|
|
|
|
What is Different Compared to 2023.1?¶
This table contains the changes compared to the previous release.
Change |
Description |
|---|---|
Databricks on GCP |
Added support for version 12.x |
Looker |
Added support for version 23.x |
Databricks Unity Catalog |
Added support for version 12.x |
Databricks on AWS |
Added support for version 12.x |
Databricks on Azure |
Added support for version 11.x and 12.x |
Databricks Azure on Government Cloud |
Added support for version 11.x and 12.x |
Hive 3 on CDP |
Added support for Azure HDInsight version 5.0 |
Feature support |
Added QLI support for Databricks Unity Catalog |
Feature support |
Added Lineage support for SAP BW and SAP ECC |
Change Log¶
This table contains corrections and updates made between major releases.
Date |
Change |
|---|---|
29/09/23 |
Added new version support for GCP Databricks and Tableau |
06/11/23 |
Added MicroStrategy (BI) and HDFS (File System) connectors |
08/01/23 |
|