Where

Big Data Engineer

Robert Half
Melbourne Full-day Full-time

Description:

The Company

Robert Half Technology are working with a leading financial services firm who pride themselves on ethical values. This business offers a flexible working environment with aggressive growth plans which require technical resources to fulfill this mission.

The Role

We are seeking a Senior Data Engineer to join our dynamic team on a 24-month fixed-term contract. You will play a crucial role in designing, building, and maintaining scalable data pipelines and platforms to support our business operations and analytics. This is an excellent opportunity to work on large-scale projects in a fast-paced financial services environment.

Responsibilities:

  • Design, develop, and optimize scalable data pipelines using Databricks and Azure Data Factory (ADF) .
  • Implement robust data solutions leveraging Python and Terraform .
  • Ensure security best practices, including the integration of Azure Key Vault for sensitive data handling.
  • Develop and maintain CI/CD pipelines for automated deployment and testing of data solutions.
  • Collaborate with cross-functional teams, including data scientists, analysts, and business stakeholders, to define data requirements and deliver high-quality solutions.
  • Monitor and troubleshoot data pipelines to ensure reliability and efficiency.

Your Profile

  • Design, develop, and optimize scalable data pipelines using Databricks and Azure Data Factory (ADF).
  • Implement robust data solutions leveraging Python and Terraform.
  • Ensure security best practices, including the integration of Azure Key Vault for sensitive data handling.
  • Develop and maintain CI/CD pipelines for automated deployment and testing of data solutions.
  • Collaborate with cross-functional teams, including data scientists, analysts, and business stakeholders, to define data requirements and deliver high-quality solutions.
  • Monitor and troubleshoot data pipelines to ensure reliability and efficiency.

Apply Today

Please send your resume by clicking on the apply button or for further information, contact Sam Rothery in our Melbourne office on (03) 9691 3661 or email sam.rothery@roberthalf.com.au with your resume.

Reference number: 06810-0013167403SR

By clicking 'apply', you give your express consent that Robert Half may use your personal information to process your job application and to contact you from time to time for future employment opportunities. For further information on how Robert Half processes your personal information and how to access and correct your information, please read the Robert Half privacy notice: https://www.roberthalf.com/au/en/privacy. Please do not submit any sensitive personal data to us in your resume (such as government ID numbers, ethnicity, gender, religion, marital status or trade union membership) as we do not collect your sensitive personal data at this time.

18 Feb 2025;   from: uworkin.com

Similar jobs

  • Robert Half
  • Melbourne
Description: The Company Our client is a technology driven organisation with a focus on building great features and product improvements. They are looking for a Senior Data Engineer who is deeply passionate about implementations, process improvements and ...
23 days ago
  • Launch Recruitment
  • Melbourne
... extension We are seeking a skilled Data Engineer with expertise in Scala and ... . Key Requirements: Proven experience as a Data Engineer, particularly with Scala and Apache ... in graph databases (ArangoDB) and big data processing (Apache Spark, Scala) . The ...
12 days ago
  • Apt Management Services Pty Limited
  • Melbourne
... exciting opportunity available for a Lead Data Engineer in Melbourne, Adelaide, Sydney or ... Data Platform teams. The ideal candidate brings hands-on experience with Big Data ... and Data Lake technologies across both ...
7 days ago
... we are looking for a Senior Data Engineer for our Financial Services client ... but not limited to data orchestration, tooling, data products, reliability services. About ... skills, TDD, unit testing skills Big picture and strategic thinking i.e. Understand ...
23 days ago