apache /spark

Apache Spark - A unified analytics engine for large-scale data processing

★ 44,527⑂ 29,595👁 1,994⑃ 60,266● 133▤ 0
ScalaApache-2.0Created 2014-02-25spark.apache.org/
+12
Daily
+85
Weekly
44,527
stars
29,595
forks
1,994
watchers
60,266
prs
133
issues
0
releases

README

Apache Spark

Spark is a unified analytics engine for large-scale data processing. It provides
high-level APIs in Scala, Java, Python, and R (Deprecated), and an optimized engine that
supports general computation graphs for data analysis. It also supports a
rich set of higher-level tools including Spark SQL for SQL and DataFrames,
pandas API on Spark for pandas workloads, MLlib for machine learning, GraphX for graph processing,
and Structured Streaming for stream processing.

- Official version: 
- Development version: 









 Online Documentation

You can find the latest Spark documentation, including a programming
guide, on the project web page.
This README file only contains basic setup instructions.

 Build Pipeline Status

See the Apache CI dashboard for an overview
of Spark's CI usage.

| Branch     | Status                                                                                                                                                                                                          |
|------------|-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------|
| master     |                                                |
|            |                              |
|            |              |
|            |                                      |
|            |                                      |
|            |                                  |
|            |                            |
|            |                                            |
|            |          |
|            |                                        |
|            |                          |
|            |          |
|            |                  |
|            |                                  |
|            |                            |
|            |  |
|            |                    |
|            |            |
|            |          |
|            |                            |
|            |                            |
|            |                |
|            |                            |
|            |                      |
|            |                  |
|            |                      |
|            |                        |
| branch-4.x |                                  |
|            |                    |
|            |                    |
|            |                    |
|            |                |
|            |                      |
|            |        |
|            |                    |
|            |            |
| branch-4.3 |                                  |
|            |                    |
|            |                    |
|            |                    |
|            |                |
|            |                      |
|            |        |
|            |                    |
|            |            |
| branch-

Top issues

Snapshot: 2026-11-16T09:23:14Z · Data license Apache-2.0 · JSON