AWS Data Engineer

• This role is available in Canberra, Newcastle, Sydney, Brisbane, Adelaide and Melbourne
• 12 months with 2*12month extension
• Australian citizenship with Baseline clearance mandatory

About the Team
Our client is seeking a dedicated Data Engineer to join our dynamic development team that manages solutions on the AWS Cloud Ecosystem. You will be working with a large group of technical specialists across different areas and will be instrumental in undertaking data integration and building scalable data pipelines to support AI projects.

It is essential that the candidate has experience integrating multiple source data systems with AWS Cloud platforms and developing scalable data pipelines and workflows.

Established domain knowledge with data processing for AI systems and experience with relevant AWS Cloud services is highly desirable


Key Responsibilities:

• Build, maintain, and optimise batch and streaming data pipelines for ingesting, processing, and transforming large volumes of data using AWS services (e.g. S3, Glue, Lambda, Step Functions, Kinesis, Redshift, Athena), ensuring performance, reliability, and cost efficiency.
• Develop, integrate and manage ETL/ELT workflows from multiple source systems (APIs, databases, files, streaming sources)
• Ensure data quality, integrity, and reliability through validation, monitoring, and testing

• 5+ years' experience delivering enterprise data integration and pipeline solutions in AWS
• Hand-on experience building, maintaining and optimising batch and streaming data pipelines for ingesting, processing, and transforming large volumes of data using AWS services (e.g. S3, Glue, Lambda, Step Functions, Kinesis, Redshift, Athena)
• Hand-on experience integrating multiple data source systems with an AWS cloud platform e.g. data lake/warehouse/API
• Hands-on experience with ETL/ELT tools and frameworks
• Strong proficiency with SQL and Python
• Experience with Infrastructure as Code (Terraform/Ansible)
• Experience building and running workloads on Kubernetes.
• Minimum tertiary level qualification in Computer Science, Information Technology or equivalent