2023.1 OCF Connectors¶
Refer to the tables for information on databases, BI tools and file systems supported with OCF connectors. If you find there is no link to the documentation page for a few of the connectors listed, the documentation will be added soon.
RDBMS Connectors¶
Connectors |
Supported Version |
Metadata Extraction (MDE) |
Table Sampling |
Profiling |
Query Log Ingestion |
Table Level Lineage |
Column Level Lineage |
Compose |
|---|---|---|---|---|---|---|---|---|
Engine versions 2, 3 |
|
|
|
|
|
|
|
|
latest |
|
|
|
|
|
|
|
|
latest |
|
|
|
|
|
|
|
|
12.0.2000.8 |
|
|
|
|
|
|
|
|
latest |
|
|
|
|
|
|
|
|
9.1 LTS, 10.4 LTS, 11.x |
|
|
|
|
|
|
|
|
9.1 LTS, 10.4 LTS |
|
|
|
|
|
|
|
|
Databricks GCP |
9.1 LTS, 10.4 LTS, 11.3 LTS |
|
|
|
|
* |
|
|
10.4 LTS, 11.x Platforms: AWS,Azure |
|
|
|
|
|
|
|
|
10.4 LTS |
|
|
|
|
|
|
|
|
10.5, 11.1, 11.5 |
|
|
|
|
|
|
|
|
Denodo |
8 |
|
|
|
|
|
|
|
EMR Presto |
EMR 6.0, 6.1, 6.2, 6.4, 6.9 |
|
|
|
|
|
|
|
latest |
|
|
|
|
|
|
|
|
5, 6.3, 6.9, 6.22 |
|
|
|
|
|
|
|
|
Hive 2 on CDH |
CDH 6.2, 6.3 |
|
|
|
|
|
|
|
Hive 2 on EMR |
EMR 5.x |
|
|
|
|
|
|
|
Hive 2 on MapR |
MapR 6.1.x |
|
|
|
|
|
|
|
Hive 3 on CDH |
HDP 3.1.4 |
|
|
|
|
|
|
|
Hive 3 on EMR |
EMR 6.0, 6.1, 6.2, 6.4, 6.9 |
|
|
|
|
|
|
|
Hive 3 on CDP |
CDP 7.1.3, 7.1.7 |
|
|
|
|
|
|
|
Hive 3 on Azure HDInsight |
4.0 |
|
|
|
|
|
|
|
Impala on CDH |
CDH - 6.3 |
|
|
|
|
|
|
|
Impala on CDP |
7.1.3, 7.1.7 |
|
|
|
|
|
|
|
Oracle 12.1c, 19c DB2 10.x, 11.1 SQL Server 2017, 2019 |
|
|
|
|
|
|
|
|
5.7, 8.0 |
|
|
|
|
|
|
|
|
5.7, 8.0 |
|
|
|
|
|
|
|
|
19c |
|
|
|
|
|
|
|
|
19c |
|
|
|
|
|
|
|
|
10, 11.4, 11.5, 12, 13, 14.1, 14.5, 15.1 |
|
|
|
|
|
|
|
|
10, 11.4, 11.5, 12, 13, 14.1, 14.5 |
|
|
|
|
|
|
|
|
10, 11, 12, 13, 14.1 |
|
|
|
|
|
|
|
|
latest |
|
|
|
|
|
|
|
|
Redshift Spectrum |
latest |
|
|
|
|
|
|
|
ASE 16.0 |
|
|
|
|
|
|
|
|
latest |
|
|
|
|
|
|
|
|
latest |
|
|
|
|
|
|
|
|
2.0 |
|
|
|
|
|
|
|
|
SAS Base |
9.4 |
|
|
|
|
** |
|
|
SingleStore (former MemSQL) |
7.8.9 |
|
|
|
|
** |
|
|
latest |
|
|
|
|
|
|
|
|
2017, 2019, 2022 |
|
|
|
|
|
|
|
|
2014, 2016, 2017, 2019, 2022 |
|
|
|
|
|
|
|
|
2014, 2016, 2017, 2019 |
|
|
|
|
|
|
|
|
16 |
|
|
|
|
|
|
|
|
16.10, 16.20, 17.05 |
|
|
|
|
|
|
|
|
11.1.x, 12.0.1 |
|
|
|
|
|
|
|
* Lineage is calculated based on queries ingested from Compose.
BI Connectors¶
Connectors |
Supported Version |
Metadata Extraction |
Lineage |
Column Level Lineage |
Access Rules |
SSL |
|---|---|---|---|---|---|---|
latest (cloud), 22.x (on-prem) |
|
|
|
|
|
|
latest |
|
|
|
|
|
|
Power BI Pro and Premium versions |
|
* |
|
|
|
|
Feb 2022 and earlier versions |
|
|
|
|
|
|
4.2 |
|
|
|
|
|
|
2016, 2017, 2019 |
|
|
|
|
|
|
|
(Tableau Server and Tableau Online) |
Server: 2021.3, 2021.4, 2022.1, 2022.3 Online - latest |
|
|
|
|
|
* Full Lineage support for Power BI objects, such as reports, tiles, and dashboards. Limited lineage support for datasource and dataset.
File System Connectors¶
Connectors |
Supported Version |
Metadata Extraction |
Schema Extraction |
Sampling |
Authentication Methods |
|---|---|---|---|---|---|
latest |
|
|
|
Basic, SAS |
|
latest |
|
* |
** |
Basic, STS |
* Schema extraction is supported only for CSV and Parquet files
** File sampling is supported only for CSV and Parquet files
SSO with Compose¶
Database Type |
Azure AD |
AD FS |
OKTA |
PingFederate |
One Login |
Auth0 |
Snowflake IdP |
|---|---|---|---|---|---|---|---|
AWS Redshift |
|
|
|
|
|
|
n/a |
AWS Databricks |
|
|
|
|
|
|
n/a |
Azure Databricks |
|
|
|
|
|
|
n/a |
Azure Synapse |
|
|
|
|
|
|
n/a |
Azure SQL (SQL DB) |
|
|
|
|
|
|
n/a |
Databricks Unity Catalog (Azure) |
|
|
|
|
|
|
n/a |
Snowflake |
|
|
|
|
|
|
|
What is Different Compared to 2022.4?¶
This table contains the changes compared to the previous release.
Change |
Description |
|---|---|
Added support for new OCF connectors |
Added Redshift Spectrum, EMR Presto, Databricks GCP, SSRS, Impala on CDP |
PostgreSQL EC2 |
Added support for version 15.1 |
PostgreSQL RDS |
Added support for version 14.5 |
Vertica |
Added support for version 12.0.1 |
SQLServer EC2 |
Added support for version 2022 |
SQLServer On Azure VM |
Added support for version 2022 |
Greenplum |
Added support for version 6.22 |
Tableau Server |
Added support for version 2022.3 |
Hive 3 on EMR |
Added support for version 6.9 |
Athena |
Added support for Engine Version 3 |
Databricks AWS |
Added support for Version 11.x |
Column Level Lineage (CLL) |
Added CLL support for Databricks AWS, Databricks Azure, Azure Government Cloud, PostgreSQL (EC2, RDS and Enterprise), Tableau Server and Tableau Online |
Feature support |
Added QLI support for MySQL RDS, SQL Server RDS, Oracle RDS |
Feature support |
Added Sampling support for Databricks Unity Catalog, Azure Blob Storage |
Feature support |
Added Compose support for Databricks Unity Catalog |
SSO Compose |
Updated SSO Compose support for Databricks Unity Catalog (Azure) |