Senior Software Engineer - Data Platform

Senior Software Engineer - Data Platform
12 month contract
Full-time onsite work required – Brisbane CBD / Remote applicants will not be considered
Up to $1000 per day (including Superannuation)

We're partnering with a global leader in mining technology to recruit an experienced Senior Software Engineer - Data Platform.

This role sits within a specialist team responsible for the platform that powers large-scale machine telemetry processing across mining operations. Working at the intersection of software engineering, data engineering and data science, you'll help modernise a critical platform that ingests and processes high-frequency machine data from hundreds to thousands of assets in the field.

You'll join a collaborative Brisbane-based team supported by experienced architects, domain experts and data scientists, contributing to the evolution of a cloud-ready, highly scalable platform that enables advanced analytics, predictive modelling and operational optimisation across mining fleets.

What you'll be doing

• Build scalable platforms for high-volume telemetry ingestion
• Develop streaming and batch data pipelines
• Modernise legacy applications into cloud-native platforms
• Build and optimise workloads using Apache Spark, Apache Flink and related technologies
• Design data lake and lakehouse solutions using Delta Lake and similar platforms
• Partner with Data Scientists to operationalise Machine Learning models
• Develop services across Java, Python and Scala
• Deploy containerised applications using Docker and Kubernetes
• Integrate with Kafka, MQTT and event-driven platforms
• Improve the performance, scalability and reliability of data workflows
• Contribute to distributed systems and platform architecture decisions
• Support low-latency processing for real-time analytics and insights
• Assess emerging technologies to enhance platform capability
• Collaborate with architects and SMEs on complex engineering challenges
• Own solutions from design through to production support

What you need to bring

• Strong software engineering experience in backend or data-intensive environments
• Advanced development skills in Java
• Commercial experience with Python and/or Scala
• Experience building large-scale data platforms and pipelines
• Hands-on expertise with Apache Spark, Apache Flink or similar distributed processing frameworks
• Strong understanding of streaming and batch processing architectures
• Experience with Kafka, MQTT or comparable messaging technologies
• Knowledge of modern data lake and lakehouse architectures
• Experience with Delta Lake, Apache Iceberg or equivalent technologies
• Strong experience with Docker and Kubernetes
• Experience designing scalable, distributed systems
• Understanding of cloud-native and container-based architectures
• Experience with PostgreSQL or other enterprise databases
• Proven ability to work effectively within cross-functional teams
• Strong problem-solving, troubleshooting and solution design skills

Bonus points for

• Mining, resources or industrial IoT experience
• Exposure to machine learning operationalisation or MLOps environments
• Experience with event sourcing and CQRS patterns
• Familiarity with Redis, Valkey or distributed caching technologies
• Experience with Trino, DuckDB, Dask, Daft or related data platform technologies
• Prior Data Engineering experience supporting Data Science teams

Important to know

• Full working rights required
• This role will require the successful candidate to work on site in Brisbane full-time 5 days per week.
• Remote applicants will not be considered.  

If you're a hands-on engineer who enjoys building scalable data platforms, working closely with Data Scientists and solving complex streaming data challenges at scale, we'd love to hear from you.

For a confidential discussion or to learn more please reach out to Lakshmi Dhanarajachar on 0419 721 158 or lakshmi.d@clicks.com.au.

#DataEngineering #DataPlatform #SoftwareEngineering #ApacheSpark #ApacheFlink #StreamingData #Kafka #Kubernetes #Java #Python #Scala #MachineLearning #DataScience #BigData #Lakehouse #DeltaLake #Iceberg #MiningTechnology #BrisbaneJobs #TechJobsAU #clicksitrecruitment


If you wish to apply for this position, please submit your resume by clicking the 'Apply Now' button. For further information please contact Amy Watson at Clicks IT Recruitment on +61 429 171 544.
 
At Clicks we embrace diversity, inclusion and equal opportunity. First Nations people are encouraged to apply.
 
We provide reasonable adjustments, including alternate formats to the recruitment process for individuals with a disability. If you
require an adjustment to be made during the recruitment process, please call 1300 254 257 or email adjustments@clicks.com.au