High-volume automation shows great promise, but it baffles and frustrates traditional notions of testing and automation.
For HiVAT to succeed, it has to come to terms with how people and organization think about and measure testing. If HiVAT can’t bridge that gulf, it will remain out of the industry mainstream. And lack of acceptance means that it will be hard for HiVAT practitioners to advance their own understanding and effectiveness.
This presentation looks at a recent example of high-volume test automation in Bing. The effort was straightforward and found many interesting issues; the hardest part came in measuring the benefit, extending the approach, and making it useful to the wider community.