Description:
Senior Data Engineer
Sydney, Australia
3 Months (Intially)
$970pd Inc Super
We are seeking a highly skilled and experienced Azure Senior Data Engineer to join a leading insurance business based in Sydney. As an Azure Senior Data Engineer, you will play a critical role in designing and building ETL processes for their data warehouse, utilizing your expertise in Databricks and Python (Pyspark).
Responsibilities:
Designing and building ETL processes for our data warehouse using Databricks and Python.
Leading a team of data engineers and testers, ensuring successful delivery of data products.
Collaborating with stakeholders to understand their data requirements and provide effective solutions.
Managing and optimizing data pipelines for performance, scalability, and reliability.
Ensuring data quality and implementing data governance practices.
Keeping up-to-date with the latest technologies and industry trends in data engineering.
Requirements:
- Significant hands-on experience in ETL design and build for data warehouses.
- Real-world experience in designing and building ETL processes using Databricks and Python (PySpark) (not just theoretical knowledge or certifications).
- Strong people management skills, with experience in leading and mentoring a team of data engineers and testers.
- Excellent stakeholder management and communication skills, with the ability to effectively collaborate with cross-functional teams.
- Preferable experience with Azure and SSIS.
Azure Functions and Azure stack preferred (LogicApps)
Previous experience in the insurance industry is highly desirable.
If you feel your skills and experiences match the above, apply now with most updated CV!