Senior Data Engineer
$1100 per annum
NSW - Other
Contract
per day
My client is looking for a Senior Data Engineer to join a high-impact program focused on enhancing firewall deployment capabilities across complex enterprise environments.
You will be working on an initiative involving millions of NetFlow records, transforming raw network data into actionable insights and deployment-ready formats. This will be a 6 month contract based in Sydney CBD.
Your Duties
- Design and build efficient ETL pipelines in MS SQL to process, transform, and summarise massive volumes of network flow data.
- Contextualise and structure data to support rule creation and object implementation by Python Developers.
- Enrich flows with CMDB, DNS, and VMware data to ensure firewall rules are accurately deployed across the right environments.
- Generate deployment feeds in JSON/CSV formats for CSM and APIC consumption.
- Track data lineage from raw flows to aggregated outputs for audit and traceability.
- Optimise performance of NetFlow tables through indexing, partitioning, and query tuning.
- Automate workflows using Tidal, including retries, alerts, and exception handling.
About you
- Expert-level MS SQL Server skills - T-SQL, window functions, indexing, partitioning, and performance tuning.
- Proven experience in ETL design for large-scale environments and data migration (on-prem to cloud or on-prem to on-prem).
- Strong understanding of data modelling and workflow automation.
- Experience producing controller-ready formats (JSON/CSV) for APIC and CSM.
- Collaborative mindset - able to work closely with developers, network engineers, and security teams.
- Experience with Dask/Spark
Nice to have
- Experience with Dask/Spark for prototyping and data lineage tooling.
- Experience with PowerBI or similar visualisation tooling
Please note, you must be an Australian Citizen/PR
If you are interested, apply now or email
If you wish to apply for this position, please submit your resume by clicking the 'Apply Now' button. For further information please contact Cevina Feng at Clicks IT Recruitment on +61 425 106 599.
At Clicks we embrace diversity, inclusion and equal opportunity. First Nations people are encouraged to apply.
Job Summary
Pay:
$1100 per annum
Location:
NSW - Other
Job Type:
Contract
Specialisation:
Other IT & Telecommunications
Reference ID:
BBBH76864