Job Description

This is a fantastic opportunity for a Senior Data Engineer to work on the global leader in music streaming services, designing & building scalable data pipelines for  the algorithmic music recommendation feature of the streaming service.

This is a Cape Town-based (hybrid working) role.

The CTC on offer for this role is R1,4 – R1,6 million per annum.

THE COMPANY
This US-based software tech & data strategy company is a global leader in software solutions. They are behind some of the most successful tech products in the world, including the world’s largest Music Streaming Service. (Need I say more!).

THE TEAM are responsible for designing and building the technology that serves 100 million songs per day, curated playlists, and a variety of content such as music, videos and exclusive releases. 

THE ROLE
As Senior Data Engineer, you will be at the forefront of data platform development and data systems engineering. You'll work with cutting-edge data engineering tools including Apache Kafka, Apache Spark, and Scala & JAVA programming to optimize the data pipelines that power algorithmic personalization for music recommendations.

You will design and build scalable data pipelines using Spark, develop high-quality code in Java and Scala, modernize & enhance legacy pipelines (ensuring smooth data management and
configuration), utilize Gradle for build automation and dependency management, engage in CI/CD practices to streamline dev processes, and provide mentorship and code reviews for peers to foster a culture of technical excellence.

REQUIREMENTS
8+ Years’ experience as a DATA ENGINEER
Minimum bachelor’s degree in computer science/engineering
Proven experience in data engineering AND platform development
Extensive experience with Apache Spark, Kafka, Airflow, AWS S3, Scala, and Java
Experience with Gradle build automation tools.
Previous experience with complex data algorithms, big data processing, and machine learning models.