You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
We should evaluate whether the batch-size, buffer-size tunables introduced as part of SPARK-50752 have any bearing on spark-rapids's support for Python UDFs.
It doesn't appear that this change affects the code here. These might turn out to be knobs that we might use to tune things on our end. This task has been raised out of an abundance of caution.
The configs in question are:
spark.sql.execution.python.udf.maxRecordsPerBatch
spark.sql.execution.python.udf.buffer.size
The text was updated successfully, but these errors were encountered:
We should evaluate whether the batch-size, buffer-size tunables introduced as part of SPARK-50752 have any bearing on
spark-rapids
's support for Python UDFs.It doesn't appear that this change affects the code here. These might turn out to be knobs that we might use to tune things on our end. This task has been raised out of an abundance of caution.
The configs in question are:
spark.sql.execution.python.udf.maxRecordsPerBatch
spark.sql.execution.python.udf.buffer.size
The text was updated successfully, but these errors were encountered: