azure-mgmt-datafactory KeyError: 'run_id' Pipelines_CreateRun

[danidelvalle]

• Package Name: azure-mgmt-datafactory
• Package Version: 10.0.0
• Operating System: Linux-7.0.12-201.fc44.aarch64-aarch64-with-glibc2.36
• Python Version: 3.12.13

Describe the bug
In Apache Airflow, using the apache-airflow-providers-microsoft-azure==13.1.0 a fresh install brought the transitive dependency on azure-mgmt-datafactory with the latest version 10.0.0 published yesterday.

With the version 10.0.0, the create pipeline run fails with KeyError: 'run_id'

Pinning azure-mgmt-datafactory==9.3.0 fixes the problem, therefore there is some kind of regression introduced in v10.

Screenshots
If applicable, add screenshots to help explain your problem.

10.0.0 🚨

9.3.0 ✅

[github-actions]

🎯 Agentic Issue Triage — Needs Manual Review

🏷️ Label Decision

• Candidate labels considered: Mgmt (category) + Data Factory (service) — the issue clearly references azure-mgmt-datafactory, a management-plane package (azure-mgmt-* prefix). The Azure Data Factory service maps directly to the Data Factory service label (confirmed via reference issue #41635 which has Mgmt + Data Factory for the same package).
• Confidence blockers: None — all confidence criteria were met: package is explicitly named, service is unambiguous, category is clear (mgmt-plane), and reference issues align.
• Outcome: Applied Mgmt + Data Factory — prediction was confident.

👥 Owner Routing

• CODEOWNERS scan: Scanned from end of file (line 854) upward. Passed through entries for ARM RBAC, and many other services until reaching the Data Factory entry at line 195.
• Matched entry: # ServiceLabel: %Data Factory at line 195 — the service label matches the predicted label.
• Owners found: None — the matched block contains only # PRLabel: %Data Factory and the path assignment /sdk/datafactory/ @hvermis``. There are no # AzureSdkOwners: or `# ServiceOwners:` comment lines in the block. (`@hvermis` is a CODEOWNERS PR reviewer, not an AzureSdkOwner/ServiceOwner.)
• Outcome: Applied needs-team-triage — matched entry has no AzureSdkOwners or ServiceOwners listed.

Generated by Agentic Triage for issue #47977 · 37.4 AIC · ⌖ 13.8 AIC · ⊞ 9.5K · ◷

[msyyc]

Hi @danidelvalle, there are some by-design breakings in 10.0.0 (changelog is here). Maybe you need update application code. If ok, pls share your code then we could provide help.

NOTE: it will be very convenient to leverage copilot to help update application code when adopting 10.0.0

[danidelvalle]

Thanks @msyyc

We're not using directly this package, but as a dependency of apache-airflow-providers-microsoft-azure. As per the docs the package relies on azure-mgmt-datafactory >=2.0.0, that explains our issue after the latest breaking changes.

I'll submit the issue to apache-airflow-providers-microsoft-azure - thanks for your help!

Edit: already identified -> apache/airflow#69689

[MalteNiederstadt]

Another shortterm fix would be applying a upper version bound to the dependencies of the current 13.5.0 Version.
https://github.com/apache/airflow/blob/main/providers/microsoft/azure/pyproject.toml