Tuning tips for running heavy workloads in Spark 2.0:
- Handle JDBC apps via Thrift Server
- Timeout values for heavy workload
- How to allocate CPUs and memory to Spark jobs
- History Server tuning
- Balance disk IO for temp results and RDDs
- Monitor and tune Spark streaming apps
- And more!