Sublime Text Recommended Theme and Packages
Sublime packages you should have in Sublime Text:
Recent Posts
Sublime Text 3 Shortcuts
Common Used Shortcuts
Most Common Used Jupyter Keyboard Shortcuts
Most common used Jupyter keyboard shortcuts
Terminal Hotkeys and Commands Cheat Sheet
Hotkeys when working with Terminal
Blog Timeline
My blog timeline since it was first created in November 2016.
Spark SQL Internals
This is the continuing post to my previous article Introduction to SparkSQL, intending to understand SparkSQL on a deeper level.
Understand the Shuffle Component in Spark-core
Shuffle is one of the most expensive operations that will affect the performance of the job. Even though Spark tries to avoid shuffling as possible as it can...
Understand the Scheduler Component in Spark-core
Introduction Today, let’s get to understand what’s really happening behind the scene after we submit a Spark job to the cluster. I promise you that there wil...
Apache Spark Modules and their Dependencies
Apache Spark Modules
Apache Spark 1.3 Architecture - Module Spark-core
After spending a significant time in reading the source code in spark-core project, I can briefly draw the architecture showing the relationships and the flo...