Medium severitydata source
Power BI Refresh Error:
DF-Delta-InvalidProtocolVersion
What does this error mean?
The ADF Mapping Data Flow Delta Lake connector cannot read the target Delta table because the table's Delta protocol version requires a reader version higher than ADF currently supports.
Common causes
- 1The Delta table was created or last written by Databricks Runtime 12+ or Delta Lake 2.0+, which uses a newer reader version (e.g., reader version 3) that ADF does not yet support
- 2A OPTIMIZE, VACUUM, or table feature command was run on the Delta table that upgraded the protocol to a version ADF cannot read
- 3The Delta table uses a new Delta table feature (e.g., column mapping, deletion vectors) that requires an upgraded reader protocol
How to fix it
- 1Check the Delta table's protocol version by running: DESCRIBE DETAIL your_table in Databricks or a compatible SQL engine — note the minReaderVersion.
- 2If the reader version exceeds what ADF supports (currently reader version 1 and 2 for most operations), consider creating a copy of the table without the advanced features that require the higher protocol version.
- 3Alternatively, if you only need read access from ADF, create a view or an export of the data to Parquet format that ADF can read without protocol version restrictions.
- 4Check the ADF documentation for the current maximum supported Delta Lake reader version before upgrading the table protocol.
Frequently asked questions
Official documentation: https://learn.microsoft.com/en-us/azure/data-factory/data-flow-troubleshoot-guide