Senior AI Test Engineer

Senior AI Test Engineer
Initial 6 month contract + Possible extension
Hybrid and Flexible Working / Role based in Carseldine (North Brisbane)

In conjunction with our Queensland State Government client, we're recruiting a Senior AI Test Engineer to support the delivery of a large-scale digital transformation program focused on modernising transactional service platforms. This role sits within a high-performing technology team driving iterative delivery, with a strong emphasis on quality engineering, automation, and emerging technologies including AI and large language models.

You'll play a key role in shaping testing strategy, implementing modern automation frameworks, and ensuring solutions are delivered to a high standard in a fast-paced, delivery-focused environment.

What you'll be doing

• Design, implement and continuously improve testing processes aligned to established frameworks
• Develop automated testing solutions across complex systems, including AI-enabled platforms
• Create and execute test cases (manual and automated) across system, integration and regression levels
• Build automated scenarios to validate AI model accuracy, consistency and decision logic
• Analyse user stories, requirements and use cases to ensure testability and completeness
• Collaborate with cross-functional teams to define acceptance criteria and drive quality outcomes
• Maintain test traceability, documentation and reporting across the delivery lifecycle
• Execute testing strategies aligned to CI/CD practices and delivery pipelines
• Provide clear reporting on test progress, coverage and overall quality metrics
• Contribute to solution design discussions, estimations and implementation decisions

What you need to bring

• Proven experience as a Senior Test Engineer in complex delivery environments
• Strong hands-on expertise in test automation frameworks and tools
• Experience designing and executing end-to-end testing strategies
• Ability to build, manage and maintain scalable automated test suites
• Solid understanding of Agile delivery practices and collaborative team environments
• Experience working with CI/CD pipelines and automated testing integration
• Strong analytical skills with the ability to assess requirements for validity and feasibility
• Excellent communication skills and ability to influence quality outcomes

Bonus points for

• Experience testing AI-enabled systems or working with Large Language Models
• Hands-on experience with Playwright
• Exposure to AWS environments
• Experience using GitHub for version control and CI/CD workflows
• Familiarity with Confluent Kafka
• Experience with Snowflake
• Knowledge of domain-driven design principles

Important to know

• Role is located in Carseldine, North Brisbane
• Hybrid and Flexible working arrangements available

Apply Now