Description:
Description- Be part of a high performing team
- Location: Sydney
- Initial 6 months contract
- Hybrid
The opportunity
The AWS Data Engineer role that involves development activities across the software development lifecycle and production support activities, with technical accountability for our Data Fabric Platform and associated CICD /DevOps systems.
Description of division and business unit
We’re building the new AMP Bank: a fully digital bank with new products, delivered via a mobile app with killer features, to make banking easy for everyday Australians and small businesses. No paperwork. No red tape. No complicated processes or confusing financial chat. Just simple, smart banking; a tap away. The way banking should be. We’ve got the tech. We’ve got the approach. We just need the team to help us take AMP Bank to market and make it the best digital banking experience Australia’s ever seen
About the role:
Proficiency in writing Spark jobs using Python:
- Strong understanding of Apache Spark framework
- Ability to develop efficient PySpark code for data processing and analysis
- Experience with Spark SQL and Data Frames API
Database skills, particularly in SQL:
- Expertise in writing complex SQL queries, including various types of joins (INNER, LEFT, RIGHT, FULL, CROSS)
- Ability to optimize SQL queries for performance
- Understanding of data modeling and schema design
DevOps skills:
- Understanding of CI/CD pipelines for data engineering projects
- Experience with version control systems (e.g., Git)
- Familiarity with infrastructure-as-code practices
- Familiarity with infrastructure-as-code practices (e.g., AWS CloudFormation, AWS CDK)
- Experience with workflow automation tools (e.g., Apache Airflow, AWS Step Functions)
AWS and Glue expertise:
- Proficiency in working with AWS Glue for ETL processes
- Experience with other relevant AWS services (e.g., S3, Redshift, EMR)
- Ability to design and implement data pipelines using AWS Glue
- Understanding of AWS Glue's serverless architecture and its benefits
Modern Data Platforms
- Experience with modern data platforms, including:
- Data lakes (e.g., Amazon S3, lake house architectures using Delta lake or Apache Hudi)
- Data warehouses (e.g., Amazon Redshift)
- Lakehouses (e.g., Delta Lake)
- Familiarity with data cataloging and governance tools
Working at AMP
We are transforming our business. We are looking for people with courage, accountability and integrity who inspire the same in others. If you are comfortable challenging the status-quo and perform at your best in an evolving and complex environment - we need you.
Wellbeing & Benefits
We invest in the health, wellbeing, and development of all our people including our contingent professionals, by offering a range of great benefits to support you be your best, professionally, and personally:
- Finance & investment assistance and opportunities.
- Salary packaging and novated vehicle leases
- Employee Assistance Program – Benestar.
- Access to discounted health and wellbeing initiatives through Medibank.
- Access to a range of discounted offerings via an extra’s benefits program.
- Networking / professional development opportunities and events
We review applications as soon as we receive them and if we find our ideal person, we may close the role earlier than the advertised close date. If you are interested in expanding your skills with AMP as a contingent professional, then please click on the apply link.
Agencies should note that unsolicited resumes will not be accepted for this position and AMP will not pay any fees related to resumes that are submitted directly to hiring managers and not through our approved process. Where appropriate, the AMP Team will work with our preferred panel of agencies to source candidates for roles.