Where

Lead Data Engineer (S)

Recruitment Hive
Sydney Full-day Full-time

Description:

  • Design, build, test and maintain data pipelines to move data between systems
  • NV1 clearance required - 12 + 12 month contract
  • Surry Hills, NSW - Flexible work arrangements

Our client, a large Federal government agency based in Surry Hills, NSW, requires two lead data engineers for 12 + 12 month contracts.

Duties

  • Design: Creating scalable data pipelines that meet project requirements.
  • Maintain: Optimising pipelines for performance and scalability.
  • Monitor: Troubleshooting issues and documenting processes.
  • Collaborate: Working with analysts and data scientists to understand data needs.
  • Automate: Writing scripts to automate repetitive tasks.

Candidates will have:

  • Technical expertise in scripting languages (e.g. AWS Glue, HashiCorp Terraform).
  • Solid understanding of cloud-based architecture relating to data storage and pipelines.
  • Understanding of data processing of streams (e.g. AWS Kinesis).
  • Understanding and being able to implement security and access controls around data pipelines.
  • Experience in data pipeline ETL tools (e.g. AWS Glue, Informatica, DBT, Talend etc).
  • Very good SQL skills.
  • Tertiary qualifications in an ICT related field or applicable industry certifications.

Selection Criteria

Essential criteria

  • Five years' experience working as a Data Pipeline Engineer in a Cloud Computing environment.
  • Demonstrated AWS as it relates to Data Storage, Extraction, Transformation, Data processing frameworks.
  • A proficient understanding of security concepts around the above areas.
  • Experience with Agile development methodologies.

Desirable criteria

  • Experience with GoAnywhere MFT.
  • Experience with Ctrl-M orchestration.
  • Experience with CI/CD automation / GITHub / Bitbucket.

To apply for these lead Data Engineer contract opportunities, please click the Quick Apply button to forward your CV to Andy at the Recruitment Hive.

Please note our internal Job ID is AE 10708 and this RFQ closes on the 16th of April 2025.

2 Apr 2025;   from: uworkin.com

Similar jobs

  • Ambition Australia
  • Sydney
Description: Senior Data Engineer - 12-Month Contract - Sydney $1,100pd Inc Super Rate: $1,100 per day (inclusive of super) Industry: Financial Services Step into an exciting contract role in financial services! We're seeking a Senior Data Engineer to ...
22 days ago
  • Talenza
  • Sydney
Description: Data Engineer - 9-Month Contract Location: Sydney, NSW (Hybrid) Rate: Up to $850/day inc. super Duration: 9 Months | Start: ASAP Industry: Enterprise The Opportunity We're seeking a Data Engineer to join a leading enterprise organisation on a ...
9 days ago
  • Talenza
  • Sydney
Description: Senior Data Engineer - 9-Month Contract Location: Sydney, NSW (Hybrid) Rate: Up to $1,050/day inc. super Duration: 9 Months | Start: ASAP Industry: Enterprise The Opportunity We're looking for a Senior Data Engineer to join a major enterprise ...
9 days ago
  • Atlassian Australia
  • Sydney
Description: Join Atlassian as a Data Engineer Intern to influence product teams and enhance data quality and insights. Your Role Key responsibilities include: Influencing product teams and informing Data Science and Analytics Platform teams. Partnering ...
22 days ago