Note
Access to this page requires authorization. You can try signing in or changing directories.
Access to this page requires authorization. You can try changing directories.
Warning
End of Support Announcement
- End of support announced for Azure Synapse Runtime for Apache Spark 3.4.
- Azure Synapse Runtime for Apache Spark 3.4 will be deprecated and disabled March 31, 2026.
Azure Synapse Analytics supports multiple runtimes for Apache Spark. This document covers the runtime components and versions for the Azure Synapse Runtime for Apache Spark 3.4.
Component versions
| Component | Version |
|---|---|
| Apache Spark | 3.4.1 |
| Operating System | Mariner 2.0 |
| Java | 11 |
| Scala | 2.12.17 |
| Delta Lake | 2.4.0 |
| Python | 3.10 |
| R | 4.2.2 |
Tip
For up-to-date information, a detailed list of changes, and specific release notes for Spark runtimes, check and subscribe Spark Runtimes Releases and Updates.
Libraries
To check the libraries included in Azure Synapse Runtime for Apache Spark 3.4 for Java/Scala, Python and R go to Azure Synapse Runtime for Apache Spark 3.4 Releases Notes.
Tip
spark.memoryOverheadFactor.preferred: If set to true, Spark will prioritize spark.driver.memoryOverheadFactor and spark.executor.memoryOverheadFactor over the explicit values defined by spark.driver.memoryOverhead and spark.executor.memoryOverhead. When enabled, the overhead is always computed using the factor, and the explicit overhead settings are ignored. The default is false for backward compatibility.