How do I fix ADF Pipeline Error 2313?

Open the Spark History UI on the HDInsight cluster and search for the batch ID from the ADF activity output. Collect the full log of the batch job (see Microsoft docs: 'Get the full log of a batch job') for support analysis. Check HDInsight cluster health, recent restarts, scale events and Livy session retention settings. Share the full batch log with HDInsight support to identify why the batch was removed. Once root cause is resolved, rerun the ADF pipeline activity

High severityconfigurationAzure Data Factory →

ADF Pipeline Error:
ADF Pipeline Error 2313

What does this error mean?

The batch ID was not found on the HDInsight Spark cluster — it was deleted before ADF could track completion.

Common causes

1The batch was deleted on the HDInsight Spark cluster before ADF could read its final status
2Cluster restart, scale-down or auto-termination removed the running batch
3Manual cleanup or retention policy on Livy/Spark removed batch metadata
4Transient connectivity loss between ADF and the HDInsight cluster causing the batch reference to become stale

How to fix it

1Open the Spark History UI on the HDInsight cluster and search for the batch ID from the ADF activity output
2Collect the full log of the batch job (see Microsoft docs: 'Get the full log of a batch job') for support analysis
3Check HDInsight cluster health, recent restarts, scale events and Livy session retention settings
4Share the full batch log with HDInsight support to identify why the batch was removed
5Once root cause is resolved, rerun the ADF pipeline activity

Frequently asked questions

What causes ADF Pipeline Error 2313?

Pipeline configuration or connectivity issue

Where can I find more details?

Open Azure Data Factory Monitor, find the failed run, click on the activity, and view the full error output in the Output tab.

Source · learn.microsoft.com/en-us/azure/data-factory/data-factory-troubleshoot-guide#error-code-2313