Description:
Canstar is Australia’s biggest financial comparison website. For over 30 years, Canstar has been researching and rating financial and consumer products.
We employ over 150 staff with a diverse range of educational and professional backgrounds. We take pride in the cultural and gender diversity of our staff and our ability to offer our people the opportunity to grow and develop their skills as the company grows too.
Overview
As our Data Engineer, you will play a critical role in driving the design, development, and implementation of scalable and high-performance data solutions. This role integrates the strategic foresight of an architect with the hands-on capabilities of an engineer/developer. You will work under the Principal Data Engineer, leading the development of platform strategies, ensuring the performance and scalability of our data systems, and overseeing the practical development and hand-off of these solutions to the business.
Key Responsibilities
- Strategic Planning and Architecture Design Collaborate with the Principal Data Engineer in the design and implementation of data platform strategies aligned with business needs and technology trends. Participate in the architecture design ensuring integration, scalability, and performance. Oversee data platform governance ensuring adherence to architectural standards, compliance, and risk management.
- Development and Implementation Utilise technical skills in SQL, Python and cloud services (AWS, GCP) to develop and maintain scalable data solutions. Write clean, efficient, and well-documented code meeting high standards of quality and performance. Implement robust and scalable data pipelines and architecture solutions.
- Performance Monitoring and Optimisation Oversee data platform performance, scalability, and reliability, implementing optimisations as needed. Identify and address performance bottlenecks to ensure seamless data processing and retrieval.
- Security and Compliance Implement and oversee security best practices to ensure data protection and compliance with industry standards. Collaborate with the compliance team, proactively assessing the organisation’s security position and mitigating risks. Develop and maintain documentation related to security policies, procedures, and compliance measures.
- Collaboration and Leadership Work closely with cross-functional teams including data scientists, analysts, product managers, and other developers to design and implement innovative data solutions. Foster a culture of continuous learning, innovation, and excellence within the team. Provide guidance and mentoring to team members ensuring efficient and effective team operations.
- Data Quality and Reviews Participate in data reviews, providing and receiving constructive feedback to ensure data quality and continuous improvement. Maintain the integrity of the data pipelines through meticulous attention to detail and commitment to best practices.
- Innovation and Continuous Learning Stay up-to-date with emerging technologies, industry trends, and best practices in data engineering. Drive continuous improvement of the data stack and development processes through enthusiasm for learning and innovation.
- Testing and Release Management Develop and manage comprehensive testing policies and oversee all data testing activities. Manage the configuration and deployment of data releases, ensuring smooth and efficient rollout of new features and updates.
- Technology Evaluation Conduct research and evaluate emerging technologies for data platform enhancement and optimisation.
Required Skills & Experience
- Bachelor’s or master’s degree in computer science, software engineering, or a related field (essential).
- Postgraduate qualifications in management (desirable).
- 5 years experience in IT, with a strong background in software architecture and development.
- Expertise in SQL, Python and cloud services (AWS, GCP, Azure).
- Experience with data warehousing solutions such as Redshift, BigQuery, or Snowflake is highly desirable.
- Experience in working with and the handling of Personal Information (PI)
- Strong analytical skills with meticulous attention to detail.
- Excellent written and verbal communication skills.
- Self-motivated, with proven analytical and problem-solving abilities.
- Ability to effectively prioritise and execute tasks in a high-pressure environment.
- Capability to work both independently and in a team-oriented collaborative environment.
How you can join the team
If this sounds like you, and you are up for a fresh challenge with a great company, please click apply now and ensure that your CV and cover letter has been uploaded to your profile.
Recruitment Agencies: We politely ask that you refrain from contacting our People & Culture team or hiring managers directly. Canstar does not accept any unsolicited referrals from recruitment or job placement agencies.