Xfail test_delta_update_fallback_with_deletion_vectors on [databricks] (

#12141) This PR XFAILs a test that was added as part of #12048 to unblock the CI pipeline It's OK for us to do this because we added the test to ensure we fall back to CPU on DBR 14.3 when writing Deletion vectors. The failure on Spark3.4+ needs further investigation which is why we are not closing the issue contributes to #12123 --------- Signed-off-by: Raza Jafri <[email protected]>
NVIDIA · Feb 15, 2025 · 7199002 · 7199002
1 parent c952867
commit 7199002
Showing 1 changed file with 1 addition and 0 deletions.
diff --git a/integration_tests/src/main/python/delta_lake_update_test.py b/integration_tests/src/main/python/delta_lake_update_test.py
@@ -67,6 +67,7 @@ def checker(data_path, do_update):
 @ignore_order
 @pytest.mark.skipif(is_before_spark_320(), reason="Delta Lake writes are not supported before Spark 3.2.x")
 @pytest.mark.skipif(not supports_delta_lake_deletion_vectors(), reason="Deletion vectors aren't supported")
+@pytest.mark.xfail(condition=not is_databricks143_or_later(), reason="https://github.com/NVIDIA/spark-rapids/issues/12123")
 def test_delta_update_fallback_with_deletion_vectors(spark_tmp_path):
     data_path = spark_tmp_path + "/DELTA_DATA"
     def setup_tables(spark):