Description:
Job Description – Data Engineer (Scala & Apache Spark, ArangoDB)Location: Melbourne (2 days on-site per week)
Contract: 6-month contract with a high chance of extension
We are seeking a skilled Data Engineer with expertise in Scala and Apache Spark to design, build, and optimize data pipelines. The ideal candidate will have a strong background in ETL processes, data engineering, and pipeline development , along with deep knowledge of ArangoDB and its query language (AQL) . Certification in ArangoDB is highly preferred.
Key Responsibilities:
- Develop and maintain data pipelines using Scala and Apache Spark .
- Work with ArangoDB , optimizing queries and ensuring efficient data storage and retrieval.
- Design and implement ETL processes to support data integration and transformation.
- Collaborate with cross-functional teams to understand business needs and deliver scalable data solutions.
- Ensure data integrity, quality, and performance optimization.
- Troubleshoot issues and provide solutions to improve pipeline efficiency.
- Communicate effectively with stakeholders and contribute to team collaboration.
- Proven experience as a Data Engineer, particularly with Scala and Apache Spark .
- Strong knowledge of ArangoDB and AQL (certification preferred).
- Hands-on experience with ETL processes and data pipeline development.
- Excellent problem-solving skills and attention to detail .
- Strong communication and collaboration skills.
- Ability to work both independently and within a team environment.
This role is best suited for a Data Engineer with a focus on Scala, Apache Spark, and ArangoDB . Unlike other roles that emphasize cloud platforms (AWS/Azure) or broader programming stacks, this position is highly specialized in graph databases (ArangoDB) and big data processing (Apache Spark, Scala) . The ideal candidate should have ETL and data pipeline expertise , with a preference for certified ArangoDB professionals . Strong problem-solving, communication, and teamwork skills are essential.
28 Feb 2025;
from:
uworkin.com