Innovate QA LogoInnovate QA

Battle of AI Test Tools

Experience the best AI test tools hands-on—and see how they fit into your testing strategy

April 3, 2026AWS Builder Loft, San Francisco

The Battle of AI Test Tools is a live, in-person event hosted by Innovate QA, designed to move beyond demos, slides, and marketing claims—and show how AI testing tools actually perform in real-world conditions.

This is not a traditional conference.

At the core of the event is a live testing battle, where teams use AI-powered testing tools against real products, real workflows, and real constraints. Attendees get a hands-on, front-row view into how these tools behave when the stakes, complexity, and time pressure are real.

Alongside the battle, the event offers parallel tracks for presentations and networking, allowing attendees to shape their own experience:

Participate directly in the testing competition
Attend curated 30-minute talks about future of QA with AI
Network with peers, leaders, and hands-on engineers

Live leaderboard updates, judge commentary, and team insights connect everything together—so even if you're not competing, you're continuously learning from what's happening in the battle.

What Makes This Event Different

Real tools. Real testing. Real constraints.

Experience AI testing tools in authentic scenarios, not controlled demos.

Transparent comparison with clear judging criteria

See how tools perform with objective evaluation and live results.

Practitioner-first learning, not sales pitches

Learn from engineers who use these tools daily in production.

Focused on clarity and outcomes—not hype

Get evidence-based insights to make informed decisions about AI testing.

The Battle of AI Test Tools is built for leaders and practitioners who want to make smarter, more confident decisions about AI in testing—based on evidence, not promises.

Schedule

April 3, 2026 · AWS Builder Loft, San Francisco

8:30 AM(30 min)
breakdiscussion-room

Registration & Breakfast

Check-in, grab your badge, and network over breakfast

9:00 AM(30 min)
welcomeRoom B - Presentation Track

Welcome

Welcome

9:15 AM(30 min)
keynoteRoom B - Presentation Track

The Great Shift Left: When AI Moves Faster Than Your Roadmap

Rashi Agrawal - Hinge Health

9:45 AM(30 min)
keynoteRoom B - Presentation Track

Quality Engineering in the AI Era: From Test Execution to Trust Building

Manju Abraham -

10:00 AM(120 min)
testingRoom A - Testing Arena

Testing Starts

talkRoom B - Presentation Track

Can AI Actually Test Software? Lessons from Real-World Experiments

Deep Barot - ContextQA

discussionDiscussion Room - Table 1

Are We Testing AI… or Is AI Testing Us?

Darrel Farris - mabl

As AI takes a larger role in generating and executing tests, the traditional boundaries of quality ownership are shifting. This discussion explores trust, accountability, and what it means to validate systems when the logic behind tests is no longer fully human-written or understood.

discussionDiscussion Room - Table 2

Flaky Tests vs Flaky AI: Which Problem Is Worse?

Frederick Goris - Donobu

Flaky tests have always been a pain—but AI introduces a new kind of unpredictability. Are we actually reducing instability, or just trading one form of flakiness for another? Let’s explore debugging, reliability, and how teams can build confidence in AI-driven testing.

10:55 AM(40 min)
talkRoom B - Presentation Track

Testing Software That Changes Its Mind: QA in a Non-Deterministic World

Vasusen Patil - Donobu

discussionDiscussion Room - Table 1

What Should Never Be Automated by AI?

Manju Abraham -

AI can generate tests at scale—but should it? This conversation focuses on the boundaries of automation, identifying critical areas where human judgment, domain knowledge, and intuition still play an essential role in ensuring quality.

discussionDiscussion Room - Table 2

How Do You Prove ROI for AI in Testing?

Darrel Farris - mabl

Many teams are adopting AI tools without evolving their overall quality strategy. This discussion challenges whether true transformation requires deeper changes in architecture, test design, and team mindset—not just new technology.

11:45 AM(15 min)
talkRoom B - Presentation Track

Battle Update

12:00 AM(60 min)
breakdiscussion-room

Lunch & Networking

Enjoy lunch and connect with fellow attendees

1:00 PM(15 min)
talkRoom B - Presentation Track

Updates from Judges

1:20 PM(15 min)
testingRoom A - Testing Arena

Testing Continues

talkRoom B - Presentation Track

Darrel Farris - mabl

Developers Are Writing Tests. That's Not the Same as Having Quality

discussionDiscussion Room - Table 1

Will AI Reduce QA Headcount… or Make QA More Critical Than Ever?

Manju Abraham -

AI is reshaping the role of quality engineers. Will it lead to smaller teams, or elevate QA into a more strategic function? Let’s discuss how roles, skills, and expectations are evolving—and what that means for the future of the profession.

discussionDiscussion Room - Table 2

Is Your Test Strategy Ready for AI… or Just Your Tools?

Deep Barot - ContextQA

Adopting AI tools is easy—proving their value is not. This discussion focuses on metrics, measurement, and real-world outcomes. What does success actually look like, and how can teams justify continued investment in AI-driven quality initiatives?

2:00 PM(45 min)
talkRoom B - Presentation Track

AI in the QA Lifecycle - How AI tools can streamline testing processes and introduce autonomous decision-making capabilities

Priyamvada Govil - Amazon

talkdiscussion-room

Networking

3:00 PM(60 min)
talkRoom B - Presentation Track

Selected Team Presentations

4:00 PM(60 min)
talkRoom B - Presentation Track

Awards & Closing Remarks

What Engineers Will Gain

Built expertise and exposure that helps future-proof your QA career as AI becomes part of modern testing practices.

Hands-on exposure to AI test tools in real scenarios, not curated demos or scripted examples.
Practical insight into how AI fits into day-to-day testing workflows, including where it helps and where it breaks down.
A clearer understanding of trade-offs around speed, signal quality, flakiness, and maintenance.
Concrete ideas you can apply immediately to improve test coverage, feedback loops, and reliability.
Peer learning from other engineers and SDETs actively testing and evaluating AI tools.

What Quality Leaders Will Gain

Clear evidence to support or challenge AI adoption decisions before investing budget and organizational trust.
A realistic view of how AI changes roles, ownership, and quality processes across teams.
Guidance on where AI delivers real value—and where it introduces risk in modern SDLCs.
Better framing for executive conversations around ROI, trust, scalability, and governance.

Who Should Attend

QA Leaders

QA Managers and Quality Engineering Leaders

Engineering Leaders

Engineering Managers, Directors, and VPs

QA Engineers

QA and Test Automation Engineers

SDETs

SDETs and Senior Engineers

AI Testing Enthusiasts

Anyone evaluating or adopting AI-driven testing and quality practices

Speakers

Priyamvada Govil

Priyamvada Govil

Sr Quality Engineering Manager

Amazon

AI in the QA Lifecycle - How AI tools can streamline testing processes and introduce autonomous decision-making capabilities

Deep Barot

Deep Barot

CEO

ContextQA

Can AI Actually Test Software? Lessons from Real-World Experiments

Darrel Farris

Darrel Farris

Head of Solutions Engineering

mabl

Manju Abraham

Manju Abraham

Former VP Engineering HPE

Quality Engineering in the AI Era: From Test Execution to Trust Building

Rashi Agrawal

Rashi Agrawal

Head of Agentic AI

Hinge Health

Vasusen Patil

Vasusen Patil

Technical CEO

Donobu

Testing Software That Changes Its Mind: QA in a Non-Deterministic World

Frederick Goris

Frederick Goris

Founding Engineer

Donobu

Testing Software That Changes Its Mind: QA in a Non-Deterministic World

Judges

Walter Zimerman

Walter Zimerman

Sr. Software Developer

Amazon

Tejash Patel

Tejash Patel

Head of Quality Engineering

Amazon

Shripad Deshpande

Shripad Deshpande

Sr. QA Engineering Manager

Meta

Angie Howard

Angie Howard

Senior Manager

Salesforce

Yevheniia Sakvets

Yevheniia Sakvets

QA Manager

Spin

Alvin Sumter

Alvin Sumter

Global Director of Quality Engineering

IHG Hotels & Resorts

Deepali Dixit

Deepali Dixit

Engineering Leader - Quality & Program Management

Global Bridge Venture

Nour Labadi

Nour Labadi

QAE

Amazon

Manoj Mohan

Manoj Mohan

Sr. Director of Engineering

Matrix

Nishadhi Nikalandawatte

Nishadhi Nikalandawatte

Director

Slalom

Ready to Join the Battle?

Don't miss this unique opportunity to experience AI testing tools in action.