Customize fetch-size
- Adds capability to customize fetch-size (fixes
FrameTooLongException
tables with large rows) - Set the
spark.read.fetch.sizeInRows
property to applicable value (defaults to 1000). If you are gettingFrameTooLongException
, reduce this value to a lower number until the issue is resolved.