All pull requests

Pull requests

• [SPARK-60764][SQL] Do not embed constraint text in the generated code of DSv2 CheckInvariant

  #59971·dongjoon-hyun opened Oct 30, 2026Member·

  ·

• [SPARK-60763][DOCS] Add migration note for the V2 scan grouping change in Spark 4.2

  #59970·rekbun opened Oct 30, 2026·

  ·

• [SPARK-60762][SQL] Pass ScalaUDF error message parameters to generated code as references

  #59969·dongjoon-hyun opened Oct 30, 2026Member·

  ·

• [SPARK-60760][SQL] Use constant names for lambda variable references in higher-order function codegen

  #59968·dongjoon-hyun opened Oct 30, 2026Member·

  ·

• [SPARK-60761][CONNECT][PYTHON] Allow an empty dict in Spark Connect DataFrame.withColumns

  #59967·hzmsh opened Oct 30, 2026Contributor·

  ·
  1

• [SPARK-60759][SQL] Avoid O(N^2) driver accumulator merge in SQLAppSta…

  #59966·luoyuqinlaura opened Oct 30, 2026·

  ·

• [SPARK-60757][SQL] Do not apply a writer's session settings to the generation expression of a generated column

  #59965·dongjoon-hyun opened Oct 30, 2026Member·

  ·
  1

• [SPARK-60756][SQL] Skip forced kvstore write in SQLAppStatusListener.…

  #59964·luoyuqinlaura opened Oct 30, 2026·

  ·

• [SPARK-60755][SQL] Fix codegen compilation failure of element_at and array index when the result is not nullable

  #59963·dongjoon-hyun opened Oct 30, 2026Member·

  ·

• [SPARK-60754][SQL] Classify JDBC write failures with SQLSTATE

  #59962·linhongliu-db opened Oct 30, 2026Contributor·

  ·
  1

• [SPARK-60753][SQL] Read the columns of native data sources from their Arrow buffers, and their decimals as longs

  #59961·gengliangwang opened Oct 30, 2026Member·

  ·

• [SPARK-60416][SQL][SS][FOLLOWUP] Add more AvailableNow SQL test coverage

  #59960·siying opened Oct 30, 2026Contributor·

  ·

• [SPARK-60748][SQL] Extract shared CREATE VIEW analysis helpers

  #59959·vladanvasi-db opened Oct 30, 2026Contributor·

  ·
  4

• [SPARK-60747][SQL] Add SQL golden tests for persistent CREATE VIEW

  #59958·vladanvasi-db opened Oct 30, 2026Contributor·

  ·
  6

• [SPARK-60744][SQL] Read the right side once with a cursor in the sort-merge ASOF join

  #59957·LukaZdravic opened Oct 30, 2026Contributor·

  ·
  1

• [SPARK-60746][SQL] Raise INTERVAL_ARITHMETIC_OVERFLOW for an overflowing interval division in every evaluation mode

  #59956·MaxGekk opened Oct 30, 2026Member·

  ·
  18

• [SPARK-60743][SQL] Fix make_timestamp silently wrapping an out-of-range seconds value

  #59955·MaxGekk opened Oct 30, 2026Member·

  ·
  20

• [SPARK-60749][SQL] Do not reorder associative operators across different evaluation modes

  #59954·joelrobin18 opened Oct 30, 2026Contributor·

  ·

• [SPARK-60644][SS] Enable incremental state cleanup for dropDuplicates…

  #59953·shenavaa opened Oct 30, 2026·

  ·

• [SPARK-54367][Connect] Close session catalogs when a Spark Connect session is closed

  ai-review-requested
  #59952·MonkeyCanCode opened Oct 30, 2026·

  ·
  1

• [SPARK-60643][PS] Fix drop_duplicates with dotted column names

  #59951·adiranjan25 opened Oct 30, 2026·

  ·

• [SPARK-60741][SQL] Keep the build side's keyed partitioning in the DPP subquery

  #59950·ulysses-you opened Oct 30, 2026Contributor·

  ·
  6

• [SPARK-60608][ML][CONNECT][4.0][FOLLOWUP] Fix MLClassLoadingSuite to expect the wrapped exception on branch-4.0

  #59949·Raviston6296 opened Oct 30, 2026·

  ·
  1

• [SPARK-60735][SQL] Reject a native data source package that a session adds when Spark cannot use it

  #59947·sarutak opened Oct 29, 2026Member·

  ·
  48

• [SPARK-60633][SQL] Do not push a throwable filter condition through an operator ahead of the conditions before it

  #59944·viirya opened Oct 29, 2026Member·

  ·
  20