Job Description
This is an excellent opportunity for a Python developer to transition into a Data Engineer role, working within a team of experts to build and design robust, scalable solutions for international clients.
100% Remote | R850K – R1M per annum | Based in South Africa
THE COMPANY
This company is a leading global software, data, and AI solutions provider renowned for solving enterprise and city-wide challenges with cutting-edge technology. For the past decade, this company has excelled in designing and deploying advanced AI, data, software, and IoT projects across the telecom, utilities, healthcare, and insurance sectors. This company empowers global enterprises to bridge the gap between their current capabilities and their digital future.
THE ROLE
As a Data Engineer, you are responsible for designing, building, and maintaining scalable data pipelines and infrastructure to support data-intensive applications and analytics solutions. You collaborate closely with data scientists, analysts, and software engineers to ensure efficient data processing, storage, and retrieval for business insights and decision-making.
Leveraging your expertise in data modeling, ETL (Extract, Transform, Load) processes, and big data technologies, you develop robust and reliable data solutions. Key skills and technologies include Python, SQL, Apache Spark, Azure, Data Warehousing, Lakehouse, Big Data, Relational Databases, Data Governance, and Data Quality.
THE REQUIREMENTS
BSc or Mathematics degree or equivalent tertiary education
At least 4 years of experience programming in Python, Java, or Scala, with commercial experience in Azure and other cloud services.
Proficiency in Apache Spark or PySpark is essential.
Key technologies include Python, SQL, Apache Spark, Azure, Data Warehousing, Lakehouse, Big Data, Relational Databases, Data Governance, and Data Quality.
Azure or AWS certifications (advantageous)