Test Automation Summit Melbourne 2024: Future of QA and AI Testing

30 Jan 2025 Test Automation Summit Melbourne 2024: Future of QA and AI Testing

The Test Automation Summit Melbourne 2024, powered by Testing Mind, was an exceptional gathering of industry leaders, quality engineers, and testing enthusiasts. This event was more than just a conference—it was a journey into the evolving world of software testing, exploring how AI, automation, and cloud technologies are redefining the field.

Whether you’re an experienced quality engineer, a developer looking to integrate testing into your workflows, or an engineering manager aiming to be aware of industry best-practices, this blog is tailored for you. From leveraging AI-driven automation to exploring the power of grey-box testing, the summit’s sessions were rich with actionable knowledge. Here’s an in-depth look at the highlights that made the summit unforgettable.

1. Leading the Way: AI-Driven Test Automation

Presenter: Vaibhav Kavimandan, Standard Chartered Bank

Vaibhav Kavimandan’s opening session was a game-changer, showcasing how Standard Chartered Bank integrates AI-driven test automation to enhance efficiency and scalability. Drawing on his 18 years of experience, Vaibhav highlighted the importance of fostering a culture where testing aligns with organizational goals.

Key Takeaway

• Why AI in Testing?
  Traditional testing methods often rely on manual processes or scripted automation, which are both time-intensive and prone to human error. AI addresses these challenges by:
  • Detecting anomalies that might otherwise go unnoticed.
  • Adapting to code changes dynamically without the need for manual updates.
  • Scaling effortlessly to match the complexity of modern applications.
• AI-Powered Tools and Models:
  Vaibhav demonstrated tools like GPT Models for generating test cases and predicting edge cases, Reinforcement Learning Models to optimise testing priorities, and Self-Healing Automation Tools like Testim and Mabl for reducing maintenance effort.
• Benefits of AI-Driven Testing:
  Faster release cycles, broader test coverage, and reduced costs were key takeaways. Continuous improvement through AI’s learning capabilities makes it indispensable in today’s competitive market.

A detailed diagram of the benefits of AI-Driven Test Automation, as shown below:

2. The AI Revolution in Testing: Present and Future

Presenter: Daniel Lessa, AI Consultant & Quality Engineering Expert

Daniel Lessa’s session offered a visionary roadmap for the future of AI in software testing. With over 23 years of expertise, he introduced the Three Waves of AI in Testing, explaining how each phase brings new possibilities for testers.

The Three Waves of AI in Testing

An overview of ‘The Three Waves of AI in Testing,’ showcasing the evolution of AI technologies in software testing, as shown below:

1. Wave 1: The Co-Pilot Era (Present):
   AI supports human testers by automating repetitive tasks like log analysis and test case generation. Tools like UIPath and RAG Models are central to this era.
2. Wave 2: The Agentic Era (Near Future):
   AI evolves into autonomous agents capable of managing entire workflows with minimal human intervention. Frameworks like LangChain and Microsoft AutoGen will drive this transformation.
3. Wave 3: Full AI Testing (Distant Future):
   AI independently handles planning, execution, and reporting, with natural language interfaces replacing traditional dashboards.

Key Takeaway

Daniel encouraged testers to upskill, focusing on areas like prompt engineering and agentic frameworks, as the industry transitions from human-assisted AI to fully autonomous systems.

3. Auto-Mates: As Friendly as They Get

Presenter: Abdul Aziz, Senior Automation Engineer at PaperCut

Abdul Aziz brought a practical perspective to the summit, sharing how PaperCut revamped its automation framework using Playwright, an open-source tool. His journey of replacing outdated frameworks with modular and maintainable scripts was packed with actionable insights.

Challenges Addressed

• Legacy Tools: Outdated frameworks like Selenium and Groovy resulted in high maintenance costs and debugging challenges.
• Test Suite Ownership: Scripts were scattered across teams, creating inconsistencies.
• Test Data Management: Centralized data storage complicated test adaptability across environments.

The Playwright Solution

• Modular scripts allowed teams to take ownership, aligning test cases with developers.
• Tools like Automates by Playwright that helps in easier linking of test scenarios
• Dynamic test data management ensured adaptability, streamlining processes across environments.

The diagram illustrates how Abdul and his team used modern technologies, including Playwright, to enhance script development, collaboration, and deployment efficiency.

Key Takeaway

PaperCut achieved faster script development, improved collaboration, and reduced overhead, making Playwright a critical tool for their success.

4. Modernizing Automation Testing at Enterprise Scale

Presenter: Bagas Ananta, QA Manager at RMIT University

Bagas Ananta shared how RMIT University modernized its testing strategies, transitioning from Selenium to Playwright while overcoming cultural and technical challenges.

Key Strategies

1. Shift Left Testing: Testing earlier in the development lifecycle to reduce downstream defects.
2. Transition to Playwright: Enhanced debugging, dynamic scripting, and better scalability.
3. Building a Learning Culture: By fostering mentorship programs and celebrating small wins, teams were motivated to embrace change.

Key Takeaway

Modernizing automation testing requires a balance of adopting advanced tools and cultivating a supportive learning culture to ensure long-term success.

5. Harnessing Cloud Skills in Testing

Presenter: Prashant Mohapatra, Principal Quality Engineer at Shine Solutions

Prashant Mohapatra’s session focused on the three pillars of cloud computing—compute, networking, and storage—and their pivotal role in modern testing pipelines.

The Three Pillars of Cloud Computing

1. Compute: Enables scalability for resource-intensive tasks. Prashant’s team used AWS EC2 instances to dynamically scale test environments, reducing execution times.
2. Networking: Cloud networks ensured seamless communication, enabling accurate simulation of real-world conditions like latency and data flow.
3. Storage: Using Amazon S3, his team managed test reports efficiently, implementing lifecycle policies to optimise storage costs.

An illustration showcasing Prashant’s solution to implement the three pillars of cloud computing: compute, storage, and monitoring, using Jenkins, AWS Fargate, and New Relic is below :

Key Takeaway

Prashant underscored the importance of cloud skills, emphasizing how they empower testers to innovate, optimize resources, and deliver faster results.

6. Black-Box Testing is Dead. Long Live Grey-Box Testing!

Presenter: Felix Lawi, Quality Director at ANZ, AKQA

Felix Lawi’s session introduced grey-box testing as the future of software testing, blending black-box and white-box techniques to provide deeper insights and faster resolutions.

Why Grey-Box Testing?

• Faster Defect Resolution: Testers can pinpoint root causes more effectively.
• Enhanced Collaboration: Testers gain a shared language with developers, improving teamwork.

Real-Life Examples

Felix compared traditional black-box bug reports to grey-box reports:

• Black-box reports focus on symptoms, whereas grey-box reports identify root causes, such as specific API failures or misconfigurations.

The following approaches can be implemented to accelerate bug resolution, enhance the skill set of QAs for quicker defect resolution, and facilitate the transition from a traditional QA role to a Full Stack QA role.

Key Takeaway

Grey-box testing is a mindset shift that enables testers to contribute technical insights, making them indispensable in cross-functional teams.

7. Evolving Application Hosting: From Physical Servers to the Cloud

Presenter: Vincent Tang, Systems Performance Product Owner at Thales

Vincent Tang explored how hosting technologies—from physical servers to the cloud—impact scalability, performance, and testing methodologies.

Key Hosting Models

1. Physical Servers: High performance but limited scalability and high upfront costs.
2. Virtual Machines (VMs): More scalable but shared resources can limit performance.
3. Containers: Lightweight and portable, ideal for microservices.
4. Cloud Hosting: Offers rapid scaling and flexibility, perfect for applications with fluctuating demand.

A summary of Vincent’s demonstration on transitioning from physical to cloud-based servers, highlighting their benefits :

Key Takeaway

Vincent shared how organizations adopted hybrid cloud environments to balance security and scalability, enabling efficient performance testing for high-traffic scenarios.

8. Panel Discussion: Testing in an AI-Driven World

The summit concluded with a lively panel discussion, addressing audience questions about the ethical implications of AI in testing, the skills testers need to stay relevant, and the importance of continuous learning.

Beyond the Sessions: Building Connections

Networking at the summit was a highlight, with attendees sharing ideas and success stories. Conversations sparked collaborations, from cloud-based testing initiatives to adopting grey-box practices.

Conclusion

The Test Automation Summit Melbourne 2024 showcased how innovation and collaboration are driving the future of quality engineering. As the event concluded, attendees left inspired to embrace AI, automation, and cloud technologies, ready to tackle the challenges and opportunities ahead.