Top reasons why you should shift to spark
- Fast, in-memory (100x faster) or disk (2-10x faster). See Daytona GraySort contest and Official Result.
- Usability: rich APIs (Scala, Java, Python), concise, interactive shell
LoC of Spark in comparison with other projects
LoC of Spark core-framework and its integrated libraries
- Well designed, unified: Spark is a general platform and SparkSQL, SparkStreaming, GraphX, MLib are standard libraries included with Spark. These libraries provide a wide range of features that support multiple usages.
- Concrete foundation: Databricks & UC Berkeley AMPLab & Community
- Many adopters: Amazon, Yahoo!, Autodesk, Technicolor, Baidu, Celtra, eBay Inc., IBM Almaden, SamSung SDS, Sonny, …
Leave a Comment