Skip to content

dfdx/Spark.jl

Folders and files

NameName
Last commit message
Last commit date

Latest commit

62e68c7 · Jul 27, 2022
Jul 25, 2022
May 28, 2022
Jul 27, 2022
May 30, 2022
May 29, 2022
Jul 23, 2022
May 31, 2022
Sep 27, 2021
May 9, 2022
Apr 14, 2016
Jul 25, 2022
Jun 5, 2022

Repository files navigation

Spark.jl

A Julia interface to Apache Spark™

Latest Version Documentation PackageEvaluator Build Status
PkgEval

Spark.jl provides an interface to Apache Spark™ platform, including SQL / DataFrame and Structured Streaming. It closely follows the PySpark API, making it easy to translate existing Python code to Julia.

Spark.jl supports multiple cluster types (in client mode), and can be considered as an analogue to PySpark or RSpark within the Julia ecosystem. It supports running within on-premise installations, as well as hosted instance such as Amazon EMR and Azure HDInsight.

Documentation

Trademarks

Apache®, Apache Spark and Spark are registered trademarks, or trademarks of the Apache Software Foundation in the United States and/or other countries.