Spark Performance Tuner
2 weeks ago
**Spark Performance Tuner**
- 8-10 years hands-on data engineering experience in a data heavy environment using big data
- Have extensively used Spark for more than 5 years in the end-to-end development of data pipelines
- Hands-on experience in various big data Hadoop tools such as Pig, Splunk, HDFS etc.
- Hands-on experience with Unix scripting, batch, and Cron Jobs.
- Hands-on experience with Python and ideally with (Py)Spark.
- Good communication skills. Able to handle project team and stakeholders.
- Excellent analytic, troubleshooting and impact analysis skills.
- Need good presentation skills, able to convey requirement and issues clearly to business community.
- Palantir or Foundry experience is plus.
- Holding a Bachelors in Computer Science or similar technical field of study
