Automated Software TestingMagazine - Special 2011 PDF

An AUTOMATED TESTING INSTITUTE Publication - www.automatedtestinginstitute.
com
BEST OPEN SOURCE UNIT AUTOMATED TEST TOOL Sub-Category: C++ Google Test Google C++ Testing Framework Google ATF Automated Testing Framework (ATF) TBD FINALISTS Boost Boost Test Library Dave Abrahams cfix Johannes Passing Sub-Category: Java JUnit David Saff, Erich Gamma, Erik G. H. Meade, Kent Beck FINALISTS TestNG TestNG Cdric Beust UISpec4J UISpec4J Rgis Medina, Pascal Pratmarty SubCategory: .NET NUnit Charlie Poole FINALISTS mbunit MbUnit Johan Appelgren, Jeff Brown, Joey Calisay xUnit.net xUnit.net Brad Wilson, Jim Newkirk Sub-Category: Overall JUnit David Saff, Erich Gamma, Erik G. H. Meade, Kent Beck NUnit Charlie Poole FINALISTS Google Test Google C++ Testing Framework Google TestNG TestNG Cdric Beust BEST OPEN SOURCE FUNCTIONAL AUTOMATED TEST TOOL Sub-Category: Web Selenium Selenium OpenQA TestMaker TestMaker PustToTest FINALISTS Sahi Sahi Tyto Software Watir Watir Bret Pettichord Sub-Category: Java White White Vivek Singh SWTBot SWTBot Ketan Padegaonkar FINALISTS T-Plan Robot T-Plan Robot T-Plan Ltd. Jemmy Jemmy Alexandre (Shura) Iline Sub-Category: Flash/ SPECIAL ISSUE 2011 Flex Flex Monkey Flex Monkey Gorilla Logic FINALISTS Melomel Melomel Ben Johnson TestMaker TestMaker PustToTest Sub-Category: Overall Selenium Selenium OpenQA Flex Monkey Flex Monkey Gorilla Logic FINALISTS TestMaker TestMaker PustToTest T-Plan Robot T-Plan Robot T-Plan Ltd. BEST OPEN SOURCE PERFORMANCE AUTOMATED TEST TOOL Sub-Category: Web JMeter JMeter Apache Software Foundation FINALISTS The Grinder Grinder Philip Aston Hammerora Hammerora Steve Shaw Sub-Category: Web Services/SOA SoapUI SoapUI SmartBear Software FINALISTS JMeter JMeter Apache Software Foundation The Grinder Grinder Philip Aston Sub-Category: Overall JMeter JMeter Apache Software Foundation SoapUI SoapUI SmartBear Software FINALISTS The Grinder Grinder Philip Aston Hammerora Hammerora Steve Shaw BEST COMMERCIAL FUNCTIONAL AUTOMATED TEST TOOL Sub-Category: Web HP QTP QuickTest Professional (HP Functional Tester) Hewlett Packard Test Studio Test Studio Telerik FINALISTS SilkTest SilkTest Micro Focus Rational Functional Tester Rational Functional Tester IBM Sub-Category: Java TestComplete TestComplete SmartBear Software HP QTP QuickTest Professional (HP Functional Tester) Hewlett Packard FINALISTS TestDrive TestDrive Original Software ThoughtWorks Twist ThoughtWorks QA Wizard QA Wizard Seapine Software Sub-Category: .NET Ranorex Ranorex Ranorex GmbH Test Studio Test Studio Telerik FINALISTS Certify Certify Worksoft SilkTest SilkTest Micro Focus Sub-Category: Flash/Flex Ranorex Ranorex GmbH TestDrive TestDrive Original Software FINALISTS RIATest Cogitek Inc eggPlant Testplant Sub-Category: Web Services/SOA SilkTest SilkPerformer for SOA Micro Focus SoapUI SoapUI Pro SmartBear Software learn more about this FINALISTS TestDrive TestDrive Original Software SOATest Parasoft Sub-Category: SAP Certify Certify Workyears ATI Automation Soft FINALISTS HP QTP QuickTest Professional (HP Functional Tester) Hewlett Packard Rational Functional Winners Tester IBM Sub-Category: Overall HP QTP QuickTest Professional (HP Functional Tester Honors Rational Functional Tester) Hewlett Packard TestComplete TestComplete SmartBear Software FINALISTS Rational Functional Tester Rational Functional Tester IBM Ranorex GmbH SilkTest SilkTest Micro Focus BEST COMMERCIAL PERFORMANCE AUTOMATED TEST TOOL Sub-Category: Web/HTTPS LoadRunner LoadRunner Hewlett Packard SilkTest SilkPerformer Micro Focus FINALISTS Rational Performance Tester Rational Performance Tester IBM AQTime AQTime Smart Bear Sub-Category: Web Services/SOA LoadRunner LoadRunner Hewlett Packard SoapUI SoapUI Pro SmartBear Software FINALISTS SilkTest SilkPerformer for SOA Micro Focus SOATest SOATest Parasoft Sub-Category: Overall LoadRunner LoadRunner Hewlett Packard SilkTest SilkPerformer Micro Focus FINALISTS Rational Performance Tester Rational Performance Tester IBM AQTime AQTime Smart Bear BEST AUTOMATED TESTING BOOK AUTHOR(S) Continuous Delivery Continuous Delivery: Reliable Software Releases through Build, Test, and Deployment Automation Jez Humble and David Farley FINALISTS Software Testing With Visual Studio Software Testing with Visual Studio 2010 (Microsoft .NET Development Series) Jeff Levinson Selenium 1.0 Selenium 1.0 Testing Tools: Beginner's Guide David Burns BEST AUTOMATED TESTING Learn more about the PRESENTATION AUTHOR(S) Making Test Automation Work on Agile Projects Lisa Crispin FINALISTS Exploratory wildly successful Test Automation in Bing Harry Robinson Automated Testing in an iOSVerifyati World Eric conference Bariaux BEST AUTOMATED TESTING ARTICLE AUTHOR(S) Developments role in software test Automation Linda Hayes Technical vs. Non-Technical Skills In Test Automation Dorothy Graham FINALISTS Continuous Integration and Automation Eric Pugh Test automation: Business agility requires disposable test assets George Wilson UI Automation Beneath the Presentation Layer Bj Rollison BEST AUTOMATED TESTING BLOG Play Video Clip PRODUCER/ PRIMARY BLOGGER(S) Automated Testing and QA Blog Automated Testing and QA Peter Kartashov FINALISTS SFTA Software Functional Test Automation Mahesh Narayanan Testlabs.com Testlabs.com Testlabs Learn about the trends that will lead into the next year BEST AUTOMATED TESTING FORUM Admin(S) SQAForums SQAForums BetaSoft Inc. One Stop Testing Forum
A utomated . . . . . . . S T
The Winner Is...
oftware
rd
esting
MAGAZINE
Annual ATI Automation Honors

VerifyATI Coverage
K The KIT is Coming
Fall 2012
http://www.testkitconference.com
A utomated S T
oftware esting
Special Edition 2011, Volume 3, Issue 4
Contents
Verify/ATI revisited 32
3
8
rd
Verify/ATI 2011 Coverage

Top 5 Verify/ATI Presentations 34
As ATI gets ready for its TestKIT 2012 conference, we take a moment to look back the Verify/ATI event that we worked to bring the community in 2011. The Verify/ATI 2011 conference was held from September 26 28 in Arlington, VA, and was an event that was hugely successful by all accounts All of the VerifyATI presentation were fantastic. The attendees have spoken, however, and through their evaluations, they have ranked the top 5. Check out the sessions that made the list and gain some insight into why the participants loved them so much..
3rd Annual ATI Automation Honors Coverage

Finalists and Winners Announced
Best Open Source UNIT Automated Test Tool 10 Best Open Source FUNCTIONAL Automated Test Tool 11 Best Open Source PERFORMANCE Automated Test Tool 12 Best Commercial FUNCTIONAL Automated Test Tool 13 Best Commercial PERFORMANCE Automated Test Tool 16 Best Automated Testing Book 17 Best Automated Testing Presentation 17 Best Automated Testing Article 17 Best Automated Testing Blog 18 Best Automated Testing Forum 18
Shifting Trends
Contemporary tool sentiments revealed by the ATI Automation Honors results.
20
These Tools Just Clique
After three years of Honors results, there are some noticeable groupings that the tools consistently fit into. See some of the pictures from the live awards ceremony conducted this year.
26
ATI Automation Honors Live Interview With a Finalist
37
ATI contributor Jeff Perlin interviews Dan Levy, representative of Telerik.
38
Columns & Departments

Editorial
Community Trends How the conference and Honors reflect community trends.
Special Edition 2011
The Automated Software Testing (AST) Magazine is an Automated Testing Institute (ATI) publication. For more information regarding the magazine visit http://www.astmagazine.automatedtestinginstitute.com
www.automatedtestinginstitute.com
Automated Software Testing Magazine
Editorial
Community Trends
by Dion Johnson
We find ourselves at the end of another year, and thus its time for another special issue of the Automated Software Testing magazine. This issue provides a focus on two of the major events of 2011 for the test automation community: The 3rd Annual ATI Automation Honors and the VerifyATI 2011 conference. The content of this issue does more than parrot the results of these events, however, but instead interprets them and relays what these events say about the state of and trends in the test automation. This year marks the third time the ATI Automation Honors have been conducted, and the first time they were held live, which proves its staying power and the interest the community has in the event. Therefore, weve provided the full results in print form to commemorate the accomplishments of the finalists and winners. In addition, having conducted this event for three years allowed for outcomes to be analyzed for the purpose of identification of continuously developing trends, broken trends, and even the absence of trends. Such analysis often provides more useful information than the results of the awards themselves. Thus, the articles entitled Shifting Trends: The ATI Honors Reveal Contemporary Tool Sentiment and These Tools Just Clique shines an analytical light on the results of the awards and what it means to the finalist and the automation community at large. In addition, pictures of the live awards ceremony are provided along with an interview with one of the finalists. AST also shines a light on the conference that ATI conducted in conjunction with the Verify organization aptly called the VerifyATI 2011 conference. Learn more about what the conference offered, along with what sessions the participants liked the most.
Software Test Automation Training

www . training . automatedtestinginstitute . com
4 Automated Software Testing Magazine www.automatedtestinginstitute.com Special Edition 2011
Training Thats Process Focused Yet Hands On
Are You Contributing Content Yet?

The Automated Testing Institute relies heavily on the automated testing community in order to deliver up-to-date and relevant content. Thats why weve made it even easier for you to contribute content directly to the ATI Online Reference! Register and let your voice be heard today!
As a registered user you can submit content directly to the site, providing you with content control and the ability to network with like minded individuals.
Community Comments Box
>> Community Comments Box - This comments box, available on the home page of the site, provides an opportunity for users to post micro comments in real time. >> Announcements & Blog Posts - If you have interesting tool announcements, or you have a concept that youd like to blog about, submit a post directly to the ATI Online Reference today. At ATI, you have a community of individuals that would love to hear what you have to say. Your site profile will include a list of your submitted articles. >> Automation Events - Do you know about a cool automated testing meetup, webinar or conference? Let the rest of us know about it by posting it on the ATI site. Add the date, time and venue so people will know where to go and when to be there.
Announcements & Blog Posts
Automation Events
Learn more today at http//www.about.automatedtestinginstitute.com
Authors and Events

Whos In This Issue?
Daniel Levy is a Solutions Consultant for Teleriks testing tools division, where they are building the next generation of automated testing tools. Daniel has been working in the software industry for over 15 years holding positions from Support Engineer to Director of Technical Services (and a few in between). Through this diverse experience Daniel has gained a true appreciation for the art of testing and of course the productivity gained from test automation. VerifyATI Conference organized by Verify and the Automated Testing Institute and held on September 26-28, 2011 at the Crowne Plaza National Airport Hotel in Arlington, VA, provided a platform for attendees to learn strategies, techniques and best practices from peers and leaders in their field. This conference benefited software test engineers, software test automators, application developers, project managers, product managers, business analysts and security engineers. Learn more about the conference in this issue. ATI Honors Winners are featured in this issue. Open Source, Commercial and other tools and resources get the recognition they deserve!
A utomated S T
oftware esting
Managing Editor Dion Johnson Contributing Editor Edward Torrie Director of Marketing and Events Christine Johnson
A PUBLICATION OF THE AUTOMATED TESTING INSTITUTE
CONTACT US AST Magazine astmagazine@automatedtestinginstitute.com ATI Online Reference contact@automatedtestinginstitute.com
ATI and Partner Events

January 1 2012 TestKIT 2012 Conference Call For Presentations Opens April 1, 2012 4th Annual ATI Automation Honors Awards Nominations Begin Fall 2012 TestKIT 2012 Conference
www.atihonors.automatedtestinginstitute.com
ATI Automation Honors

Celebrating Excellence in the Discipline of Software Test Automation See the Winners Now!
www.atihonors.automatedtestinginstitute.com
3 Annual
rd
BEST OPEN SOURCE UNIT AUTOMATED TEST TOOL Sub-Category: C++ Google Test Google C++ Testing Framework ATF Automated Testing Framework (ATF) Boost Test Library Dave Abrahams cfix Johannes Passing Sub-Category: Java JUnit David Saff, Erich Gamma, Erik G. H. Meade, Kent Beck FINALISTS TestNG TestNG Cdric Beust UISpec4J Rgis Medina, Pascal Pratmarty Sub-Category: .NET NUnit Charlie Poole FINALISTS mbunit MbUnit Johan Appelgren, Jeff Brown, Joey Calisay xUnit.net xUnit.net Brad Wilson, Jim Newkirk SubCategory: Overall JUnit David Saff, Erich Gamma, Erik G. H. Meade, Kent Beck NUnit Charlie Poole FINALISTS Google Test Google C++ Testing Framework Google TestNG TestNG Cdric Beust BEST OPEN SOURCE FUNCTIONAL AUTOMATED TEST TOOL Sub-Category: Web Selenium Selenium OpenQA TestMaker TestMaker PustToTest FINALISTS Sahi Sahi Tyto Software Watir Watir Bret Pettichord Sub-Category: Java White White Vivek Singh SWTBot SWTBot Ketan Padegaonkar FINALISTS T-Plan Robot T-Plan Robot T-Plan Ltd. Jemmy Jemmy Alexandre (Shura) Iline Sub-Category: Flash/Flex Flex Monkey Flex Monkey Gorilla Logic FINALISTS Melomel Melomel Ben Johnson TestMaker TestMaker PustToTest Sub-Category: Overall Selenium Selenium OpenQA Flex Monkey Flex Monkey Gorilla Logic FINALISTS TestMaker TestMaker PustToTest T-Plan Robot T-Plan Robot T-Plan Ltd. BEST OPEN SOURCE PERFORMANCE AUTOMATED TEST TOOL Sub-Category: Web JMeter JMeter Apache Software Foundation FINALISTS The Grinder Grinder Philip Aston Hammerora Hammerora Steve Shaw Sub-Category: Web Services/SOA SoapUI SoapUI SmartBear Software FINALISTS JMeter JMeter Apache Software Foundation The Grinder Grinder Philip Aston Sub-Category: Overall JMeter JMeter Apache Software Foundation SoapUI SoapUI SmartBear Software FINALISTS The Grinder Grinder Philip Aston Hammerora Hammerora Steve Shaw BEST COMMERCIAL FUNCTIONAL AUTOMATED TEST TOOL Sub-Category: Web HP QTP QuickTest Professional (HP Functional Tester) Hewlett Packard Test Studio Test Studio Telerik FINALISTS SilkTest SilkTest Micro Focus Rational Functional Tester Rational Functional Tester IBM Sub-Category: Java TestComplete TestComplete SmartBear Software HP QTP QuickTest Professional (HP Functional Tester) Hewlett Packard FINALISTS TestDrive TestDrive Original Software ThoughtWorks Twist ThoughtWorks QA Wizard QA Wizard Seapine Software Sub-Category: .NET Ranorex Ranorex Ranorex GmbH Test Studio Test Studio Telerik FINALISTS Certify Certify Worksoft SilkTest SilkTest Micro Focus Sub-Category: Flash/ Flex Ranorex Ranorex Ranorex GmbH TestDrive TestDrive Original Software FINALISTS RIATest RIATest Cogitek Inc eggPlant eggPlant Testplant Sub-Category: Web Services/SOA SilkTest SilkPerformer for SOA Micro Focus SoapUI SoapUI Pro SmartBear Software FINALISTS TestDrive TestDrive Original Software SOATest SOATest Parasoft Sub-Category: SAP Certify Certify WorkSoft FINALISTS HP QTP QuickTest Professional (HP Functional Tester) Hewlett Packard Rational Functional Tester Rational Functional Test e r IBM Sub-Category: Overall HP QTP QuickTest Profession a l (HP Functional Tester) Hewlett Packard TestComplete TestComplete SmartBear Software FINALISTS Rational Functional Tester Rational Functional Tester IBM Ranorex Ranorex Ranorex GmbH SilkTest SilkTest Micro Focus BEST COMMERCIAL PERFORMANCE AUTOMATED TEST TOOL Sub-Category: Web/HTTPS LoadRunner LoadRunner Hewlett Packard SilkTest SilkPerformer Micro Focus FINALISTS Rational Performance Tester Rational Performance Tester IBM AQTime AQTime Smart Bear Sub-Category: Web Services/SOA LoadRunner LoadRunner Hewlett Packard SoapUI SoapUI Pro SmartBear Software FINALISTS SilkTest SilkPerformer for SOA Micro Focus SOATest SOATest Parasoft SubCategory: Overall LoadRunner LoadRunner Hewlett Packard SilkTest SilkPerformer Micro Focus FINALISTS Rational Performance Tester Rational Performance Tester IBM AQTime AQTime Smart Bear BEST AUTOMATED TESTING BOOK AUTHOR(S) Continuous Delivery Continuous Delivery: Reliable Software Releases through Build, Test, and Deployment Automation Jez Humble and David Farley FINALISTS Software Testing With Visual Studio Software Testing with Visual Studio 2010 (Microsoft .NET Development Series) Jeff Levinson Selenium 1.0 Selenium 8 Automated Software Testing Magazine www.automatedtestinginstitute.com 1.0 Testing Tools: Beginner's Guide David Burns BEST AUTOMATED TESTING PRESENTATION AUTHOR(S) Making Test Automation Work on Agile Projects Lisa Crispin FINALISTS Exploratory Test Automation in Bing Harry
rd

Awards
BEST OPEN SOURCE UNIT 3rd Annual ATI Automation Honors AUTOMATED TEST TOOL Sub-Category: C++ Google Test Google C++ Testing Framework Google ATF Auto mated Testing Framework (ATF) TBD FINALISTS Boost Boost Test Library Dave Abrahams cfix Johannes Passing Sub-Category: Java JUnit David Saff, Erich Gamma, Erik G. H. Meade, Kent Beck FINALISTS TestNG TestNG Cdric Beust UISpec4J UISpec4J Rgis Medina, Pascal Pratmarty Sub-Category: .NET NUnit Charlie Poole in FINALISTS mbunit MbUnit Johan Appelgren, Jeff Brown, Joey Calisay xUnit.net xUnit.net Brad Wilson, Jim Newkirk Sub-Category: Overall JUnit David Saff, Erich Gamma, Erik G. H. Meade, Kent Beck NUnit Charlie Poole FINALISTS Google Test Google C++ Testing Framework Google TestNG TestNG Cdric Beust BEST OPEN SOURCE FUNCTIONAL AUTOMATED TEST TOOL Sub-Category: Web Selenium Selenium OpenQA TestMak er TestMaker PustToTest FINALISTS Sahi Sahi Tyto Software Watir Watir Bret Pettichord Sub-Category: Java White White Vivek Singh SWTBot SWTBot Ketan Padegaonkar FINALISTS T-Plan Robot T-Plan Robot T-Plan Ltd Jemmy Jemmy Alexandre (Shura) Iline Sub-Category: Flash/Flex Flex Monkey Flex Monkey Gorilla Logic FINALISTS Melomel Melomel Ben Johnson TestMaker TestMaker PustToTest Sub-Category: Overall Selenium Selenium OpenQA Flex Monkey Flex Monkey Gorilla Logic FINALISTS TestMaker TestMaker PustToTest T-Plan Robot T-Plan Robot T-Plan Ltd. BEST OPEN SOURCE PERFORMANCE AUTOMATED TEST TOOL Sub-Category Web JMeter JMeter Apache Software Foundation FINALISTS The Grinder Grinder Philip Aston Hammerora Hammerora Steve Shaw Sub-Category: Web Services/SOA SoapUI SoapUI SmartBear Software FINALISTS JMeter JMeter Apache Software Foundation The Grinder Grinder Philip Aston Sub-Category: Overall JMe ter JMeter Apache Software Foundation SoapUI SoapUI SmartBear Software FINALISTS The Grinder Grinde Philip Aston Hammerora Hammerora Steve Shaw BEST COMMERCIAL FUNCTIONAL AUTOMATED TEST TOOL Sub-Category: Web HP QTP QuickTest Professional (HP Functional Tester) Hewlett Packard Test Studio Test Studio Telerik FINALISTS SilkTest SilkTest Micro Focus Rational Functional Tester Rational Functional Teste IBM Sub-Category: Java TestComplete TestComplete SmartBear Software HP QTP QuickTest Professiona (HP Functional Tester) Hewlett Packard FINALISTS TestDrive TestDrive Original Software ThoughtWorks Twist ThoughtWorks QA Wizard QA Wizard Seapine Software Sub-Category: .NET Ranorex Ranorex Ranorex GmbH Test Studio Test Studio Telerik FINALISTS Certify Certify Worksoft SilkTest SilkTest Micro Focus Sub-Category: Flash/Flex Ranorex Ranorex GmbH TestDrive TestDrive Original Software FINALISTS RIATest Cogitek Inc eggPlant Testplant Sub-Category: Web Services/SOA SilkTest SilkPerformer for SOA Micro Focus SoapU SoapUI Pro SmartBear Software FINALISTS TestDrive TestDrive Original Software SOATest Parasoft Sub-Category: SAP Certify Certify WorkSoft FINALISTS HP QTP QuickTest Professional (HP Functional Tester) Hewlett Packard Rational Functional Tester Rational Functional Tester IBM Sub-Category: Overall HP QTP QuickTest Professional (HP Functional Tester) Hewlett Packard TestComplete TestComplete SmartBear Software FINALISTS Rational Functional Tester Rational Functional Tester IBM Ranorex GmbH SilkTest SilkTest Micro Focus BEST COMMERCIAL PERFORMANCE AUTOMATED TEST TOOL Sub-Category: Web/HTTPS LoadRunner he ATI Automation Honors LoadRunner Hewlett Packard SilkTest SilkPerformer Micro Focus FINALISTS Rational Performance Tester Racelebrate excellence in the tional Performance Tester IBM AQTime AQTime Smart Bear Sub-Category: Web Services/SOA LoadRunner discipline ofSilkTest software test LoadRunner Hewlett Packard SoapUI SoapUI Pro SmartBear Software FINALISTS SilkPerformer for SOA Micro Focus SOATest SOATest Parasoft Sub-Category: Overall LoadRunner LoadRunner Hewlett Packautomation. Nominations are accepted ard SilkTest SilkPerformer Micro Focus FINALISTS Rational Performance Tester u t o mRational a t i o n cPerformance o m m u n i t y , Tester from you, the a IBM AQTime AQTime Smart Bear BEST AUTOMATED TESTING BOOK AUTHOR(S) Continuous Delivery Continuand then the ATI Honors rely on your votes ous Delivery: Reliable Software Releases through Build, Test, and Deployment Automation Jez Humble and to determine who the best of the best David Farley FINALISTS Software Testing With Visual Studio Software Testing with Visual Studio 2010 (Microsoft .NET Development Series) Jeff Levinson Selenium 1.0 Selenium 1.0 Testing Tools: Beginner's Guide really are. Awards are presented in several David Burns BEST AUTOMATED TESTING PRESENTATION AUTHOR(S) Making Test Automation Work on Agile Projects categories from the corporate level down Lisa Crispin FINALISTS Exploratory Test Automation in Bing Harry Robinson Automated Testing in an iOS World to the practitioner role level, resultingtest in Automa a Eric Bariaux BEST AUTOMATED TESTING ARTICLE AUTHOR(S) Developments in software celebration ofDorothy the best and most relevant tion Linda Hayes Technical vs. Non-Technical Skills In Test Automation Graham FINALISTS Continuous Integration and Automation Eric Pugh Test automation: Business agility requires disposable test new releases of tools, and the best print assets George Wilson UI Automation Beneath the Presentation Layer Bj Rollison BEST AUTOMATED TESTING BLOG and online resources. Play Video Clip PRODUCER/PRIMARY BLOGGER(S) Automated Testing and QA Blog Automated Testing and QA Peter Kartashov FINALISTS SFTA Software Functional Test Automation Mahesh Narayanan Testlabs. com Testlabs.com Testlabs BEST AUTOMATED TESTING FORUM Admin(S) SQAForums SQAForums BetaSoft 9 Forum Special Edition 2011 Forum One www.automatedtestinginstitute.com Testing Magazine Inc. One Stop Testing Stop Testing Vyom TechnosoftAutomated Pvt. Ltd Software FINALISTS AdvancedQTP AdvancedQTP Forum SOLMAR Knowledge Networks TekTips TekTips Tecumseh Group
P ioneers
resources in software test automation.
ioneers honoring the best tools and
Best Op
Best Open Source Unit Test Tool
Winner
Runner-up
BEST OPEN SOURCE UNIT AUTOMATED TEST TOOL Sub-Category: C++ Google Test Google C++ Test-B ing Framework Google ATF Automated Testing Framework (ATF) TBD FINALISTS Boost Boost Test Libraryi Dave Abrahams cfix Johannes Passing Sub-Category: Java JUnit David Saff, Erich Gamma, Erik G.D H. Meade, Kent Beck FINALISTS TestNG TestNG Cdric Beust UISpec4J UISpec4J Rgis Medina, PascalH Pratmarty Sub-Category: .NET NUnit Charlie Poole FINALISTS mbunit MbUnit Johan Appelgren, JeffP Brown, Joey Calisay xUnit.net xUnit.net Brad Wilson, Jim Newkirk Sub-Category: Overall JUnit DavidB Saff, Erich Gamma, Erik G. H. Meade, Kent Beck NUnit Charlie Poole FINALISTS Google Test GoogleS C++ Sub-category C++ Testing Framework Google TestNG TestNG Cdric Beust BEST OPEN SOURCE FUNCTIONAL AUTO-C Boost Test TestMaker Google C++ Testing Automated Test cfix TestMaker PustToTestM MATED TEST TOOL Sub-Category: Web Selenium Selenium OpenQA Library Framework Framework FINALISTS Sahi Sahi Tyto Software Watir Watir Bret Pettichord Sub-Category: Java White White VivekF Producer: Dave Producer: Google Producer: N/A Producer: Johannes Singh SWTBot SWTBot Ketan Padegaonkar FINALISTS T-Plan Robot T-Plan Robot T-Plan Ltd. Jemmy Jem-S Abrahams Passing my Alexandre (Shura) Iline Sub-Category: Flash/Flex Flex Monkey Flex Monkey Gorilla Logic FINALISTSm Melomel Melomel Ben Johnson TestMaker TestMaker PustToTest Sub-Category: Overall SeleniumM ATF Selenium OpenQA Flex Monkey Flex Monkey Gorilla Logic FINALISTS TestMaker TestMaker PustToTestS T-Plan Robot T-Plan Robot T-Plan Ltd. BEST OPEN SOURCE PERFORMANCE AUTOMATED TEST TOOL Sub-T Finalist Finalist Category: Web JMeter JMeter Apache Software Foundation FINALISTS The Grinder Grinder PhilipC Aston Hammerora Hammerora Steve Shaw Sub-Category: Web Services/SOA SoapUI SoapUI Smart-A Bear Software FINALISTS JMeter JMeter Apache Software Foundation The Grinder Grinder Philip As-B Java Sub-category ton Sub-Category: Overall JMeter JMeter Apache Software Foundation SoapUI SoapUI SmartBeart UISpec4J JUnit TestNG Software FINALISTS The Grinder Grinder Philip Aston Hammerora Hammerora Steve BEST COM-S Producer: RgisShaw Medina, Producer: David Saff, Erich Gamma, Producer: Cdric Beust MERCIAL FUNCTIONAL AUTOMATED TEST TOOL Sub-Category: Web HP QTP QuickTest Professional (HPM Erik G. H. Meade, Kent Beck Pascal Pratmarty Functional Tester) Hewlett Packard Test Studio Test Studio Telerik FINALISTS SilkTest SilkTest Micro FocusF Rational Functional Tester Rational Functional Tester IBM Sub-Category: Java TestComplete Test-R Complete SmartBear Software HP QTP QuickTest Professional (HP Functional Tester) Hewlett PackardC FINALISTS TestDrive TestDrive Original Software ThoughtWorks Twist ThoughtWorks QA Wizard QA Wiz-F Finalist Finalist ard Seapine Software Sub-Category: .NET Ranorex Ranorex Ranorex GmbH Test Studio Test Studioa Telerik FINALISTS Certify Certify Worksoft SilkTest SilkTest Micro Focus Sub-Category: Flash/Flex RanorexT Ranorex Ranorex GmbH TestDrive TestDrive Original Software FINALISTS RIATest RIATest Cogitek IncR .NET Sub-category eggPlant eggPlant Testplant Sub-Category: Web Services/SOA SilkTest SilkPerformer for SOA Microe xUnit.net NUnitSoapUI Pro SmartBear Software mbUnit Focus SoapUI FINALISTS TestDrive TestDrive Original Software SOATestF Producer: Charlie Poole Producer: Brad Wilson, Producer: Johan Appelgren, SOATest Parasoft Sub-Category: SAP Certify Certify WorkSoft FINALISTS HP QTP QuickTest Profes-S Jim Newkirk Jeff Brown, Joey Calisay sional (HP Functional Tester) Hewlett Packard Rational Functional Tester Rational Functional Tester IBMs Sub-Category: Overall HP QTP QuickTest Professional (HP Functional Tester) Hewlett Packard Test-S Complete TestComplete SmartBear Software FINALISTS Rational Functional Tester Rational FunctionalC Tester IBM Ranorex Ranorex Ranorex GmbH SilkTest SilkTest Micro Focus BEST COMMERCIAL PERFOR-T MANCE AUTOMATED TEST TOOL Sub-Category: Web/HTTPS LoadRunner LoadRunner Finalist Hewlett Pack-M Finalist ard SilkTest SilkPerformer Micro Focus FINALISTS Rational Performance Tester Rational Performancea Tester IBM AQTime AQTime SmartOverall Bear Sub-Category: Web Services/SOA LoadRunner LoadRunnerT Sub-category Hewlett Packard SoapUI SoapUI Pro SmartBear Software FINALISTS SilkTest SilkPerformer for SOA MicroH TestNG Google C++ JUnit SOATest Parasoft NUnit Focus SOATest Sub-Category: OverallTesting LoadRunner LoadRunner Hewlett PackardF Producer: Charlie Producer: Cdric Producer: David Saff, SilkTest SilkPerformer Micro Focus Poole FINALISTS Rational Performance Tester Rational Performance TesterS Framework Beust Erich Gamma, Erik G. H. IBM AQTime AQTime Smart Bear BEST AUTOMATED TESTING BOOK AUTHOR(S) Continuous DeliveryI Producer: Google Meade, Kent Beck Continuous Delivery: Reliable Software Releases through Build, Test, and Deployment Automation JezC Humble and David Farley FINALISTS Software Testing With Visual Studio Software Testing with VisualH Studio 2010 (Microsoft .NET Development Series) Jeff Levinson Selenium 1.0 Selenium 1.0 Testing Tools:S Beginner's Guide David Burns BEST AUTOMATED TESTING PRESENTATION AUTHOR(S) Making Test Au-B Finalist tomation Work on Agile Projects Lisa Crispin FINALISTS Exploratory Test Automation in Bing Harry Rob-t Finalist inson Automated Testing in an iOS World Eric Bariaux BEST AUTOMATED TESTING ARTICLE AUTHOR(S)i Developments role in software test Automation Linda Hayes Technical vs. Non-Technical Skills InD
Winner
Winner
Winner
Runner-up
10 Automated Software Testing Magazine
pen Sou
Best Open Source Functional Test Tool
Winner
Runner-up
BEST OPEN SOURCE UNIT AUTOMATED TEST TOOL Sub-Category: C++ Google Test Google C++ Testing Framework Google ATF Automated Testing Framework (ATF) TBD FINALISTS Boost Boost Test Library Dave Abrahams cfix Johannes Passing Sub-Category: Java JUnit David Saff, Erich Gamma, Erik G. H. Meade, Kent Beck FINALISTS TestNG TestNG Cdric Beust UISpec4J UISpec4J Rgis Medina, Pascal Pratmarty Sub-Category: .NET NUnit Charlie Poole FINALISTS mbunit MbUnit Johan Appelgren, Jeff Brown, Joey Calisay xUnit.net xUnit.net Brad Wilson, Jim Newkirk Sub-Category: Overall JUnit David Saff, Erich Gamma, Erik G. H. Meade, Kent Beck NUnit Charlie Poole FINALISTS Google Test Google Web Sub-category C++ Testing Framework Google TestNG TestNG Cdric Beust BEST OPEN SOURCE FUNCTIONAL AUTOTestMaker Sahi Watir Selenium MATED TEST TOOL Sub-Category: Web Selenium Selenium OpenQA TestMaker TestMaker PustToTest Producer: Tyto Producer: OpenQA Producer: PushToTest Producer: FINALISTS Sahi Sahi Tyto Software Watir Watir Bret Pettichord Sub-Category: Java Bret White White Vivek Software Pettichord Singh SWTBot SWTBot Ketan Padegaonkar FINALISTS T-Plan Robot T-Plan Robot T-Plan Ltd. Jemmy Jemmy Alexandre (Shura) Iline Sub-Category: Flash/Flex Flex Monkey Flex Monkey Gorilla Logic FINALISTS Melomel Melomel Ben Johnson TestMaker TestMaker PustToTest Sub-Category: Overall Selenium Selenium OpenQA Flex Monkey Flex Monkey Gorilla Logic FINALISTS TestMaker TestMaker PustToTest T-Plan Robot T-Plan Robot T-Plan Ltd. BEST OPEN SOURCE PERFORMANCE TEST TOOL SubFinalist AUTOMATED Finalist Category: Web JMeter JMeter Apache Software Foundation FINALISTS The Grinder Grinder Philip Aston Hammerora Hammerora Steve Shaw Sub-Category: Web Services/SOA SoapUI SoapUI SmartBear Software FINALISTS JMeter JMeterJava Apache Software Foundation The Grinder Grinder Philip AsSub-category ton Sub-Category: Overall JMeter JMeter Apache Software Foundation SoapUI SoapUI SmartBear Selenium SWTBot T-Plan Robot Jemmy Software FINALISTS The Grinder Grinder Philip Aston Hammerora Hammerora Steve Shaw BEST COMProducer: T-Plan Producer: OpenQA Producer: Ketan Producer: Alexandre MERCIAL FUNCTIONAL AUTOMATED TEST TOOL Sub-Category: Web HP QTP QuickTest Professional (HP Ltd. Padegaonkar (Shura) Iline Functional Tester) Hewlett Packard Test Studio Test Studio Telerik FINALISTS SilkTest SilkTest Micro Focus Rational Functional Tester Rational Functional Tester IBM Sub-Category: Java TestComplete TestComplete SmartBear Software HP QTP QuickTest Professional (HP Functional Tester) Hewlett Packard FINALISTS TestDrive TestDrive Original Software ThoughtWorks Twist ThoughtWorks QA Wizard QA Wizard Seapine Software Sub-Category: .NET Ranorex Ranorex Ranorex GmbH Test Studio Test Studio Finalist Finalist Telerik FINALISTS Certify Certify Worksoft SilkTest SilkTest Micro Focus Sub-Category: Flash/Flex Ranorex Ranorex Ranorex GmbH TestDrive TestDrive Original Sub-category Software FINALISTS RIATest RIATest Cogitek Inc Flash/Flex eggPlant eggPlant Testplant Sub-Category: Web Services/SOA SilkTest SilkPerformer for SOA Micro TestMaker Flex Monkey Melomel Focus SoapUI SoapUI Pro SmartBear Software FINALISTS TestDrive TestDrive Original Software SOATest Producer: Gorilla Logic Producer: PushToTest Producer: Ben Johnson SOATest Parasoft Sub-Category: SAP Certify Certify WorkSoft FINALISTS HP QTP QuickTest Professional (HP Functional Tester) Hewlett Packard Rational Functional Tester Rational Functional Tester IBM Sub-Category: Overall HP QTP QuickTest Professional (HP Functional Tester) Hewlett Packard TestMelomel Complete TestComplete SmartBear Software FINALISTS Rational Functional Tester Rational Functional Tester IBM Ranorex Ranorex Ranorex GmbH SilkTest SilkTest Micro Focus BEST COMMERCIAL PERFORMANCE AUTOMATED TEST TOOL Sub-Category: Web/HTTPS LoadRunner LoadRunner Finalist Hewlett PackFinalist ard SilkTest SilkPerformer Micro Focus FINALISTS Rational Performance Tester Rational Performance Tester IBM AQTime AQTime Smart Bear Sub-Category: Web Services/SOA LoadRunner LoadRunner Overall Sub-category Hewlett Packard SoapUI SoapUI Pro SmartBear Software FINALISTS SilkTest SilkPerformer for SOA Micro Selenium TestMaker T-Plan Robot Flex Monkey Focus SOATest SOATest Parasoft Sub-Category: Overall LoadRunner LoadRunner Hewlett Packard Producer: PushToTest Producer: T-Plan Ltd. Producer: Gorilla Logic Producer: OpenQA SilkTest SilkPerformer Micro Focus FINALISTS Rational Performance Tester Rational Performance Tester IBM AQTime AQTime Smart Bear BEST AUTOMATED TESTING BOOK AUTHOR(S) Continuous Delivery Continuous Delivery: Reliable Software Releases through Build, Test, and Deployment Automation Jez Humble and David Farley FINALISTS Software Testing With Visual Studio Software Testing with Visual Studio 2010 (Microsoft .NET Development Series) Jeff Levinson Selenium 1.0 Selenium 1.0 Testing Tools: Beginner's Guide David Burns BEST AUTOMATED TESTING PRESENTATION AUTHOR(S) Making Test AuFinalist Finalist tomation Work on Agile Projects Lisa Crispin FINALISTS Exploratory Test Automation in Bing Harry Robinson Automated Testing in an iOS World Eric Bariaux BEST AUTOMATED TESTING ARTICLE AUTHOR(S) Developments role in software test Automation Linda Hayes Technical vs. Non-Technical Skills In
Winner
Runner-up
Winner
Winner
Runner-up
11
Best T
Best Open Source Performance Test Tool
Winner Winner Winner
Runner-up
BEST OPEN SOURCE UNIT AUTOMATED TEST TOOL Sub-Category: C++ Google Test Google C++ Test-B ing Framework Google ATF Automated Testing Framework (ATF) TBD FINALISTS Boost Boost Test Libraryi Dave Abrahams cfix Johannes Passing Sub-Category: Java JUnit David Saff, Erich Gamma, Erik G.D H. Meade, Kent Beck FINALISTS TestNG TestNG Cdric Beust UISpec4J UISpec4J Rgis Medina, PascalH Pratmarty Sub-Category: .NET NUnit Charlie Poole FINALISTS mbunit MbUnit Johan Appelgren, JeffP Brown, Joey Calisay xUnit.net xUnit.net Brad Wilson, Jim Newkirk Sub-Category: Overall JUnit DavidB Saff, Erich Gamma, Erik G. H. Meade, Web Kent Beck NUnit Charlie Poole FINALISTS Google Test GoogleS Sub-category C++ Testing Framework Google TestNG TestNG Cdric Beust BEST OPEN SOURCE FUNCTIONAL AUTO-C Hammerora JMeter The Grinder MATED TEST TOOL Sub-Category: Web Selenium Selenium OpenQA TestMaker TestMaker PustToTestM Producer: Steve Producer: Apache Software Producer: Philip Aston FINALISTS Sahi Sahi Tyto Software Watir Watir Bret Pettichord Sub-Category: Java White White VivekF Shaw T-Plan Ltd. Jemmy Jem-S Foundation Singh SWTBot SWTBot Ketan Padegaonkar FINALISTS T-Plan Robot T-Plan Robot my Alexandre (Shura) Iline Sub-Category: Flash/Flex Flex Monkey Flex Monkey Gorilla Logic FINALISTSm Melomel Melomel Ben Johnson TestMaker TestMaker PustToTest Sub-Category: Overall SeleniumM Selenium OpenQA Flex Monkey Flex Monkey Gorilla Logic FINALISTS TestMaker TestMaker PustToTestS T-Plan Robot T-Plan Robot T-Plan Ltd. BEST OPEN SOURCE PERFORMANCE AUTOMATED TEST TOOL Sub-T Finalist Finalist Category: Web JMeter JMeter Apache Software Foundation FINALISTS The Grinder Grinder PhilipC Aston Hammerora Hammerora Steve Shaw Sub-Category: Web Services/SOA SoapUI SoapUI Smart-A Bear Software FINALISTS JMeter JMeter Apache Software Sub-category Foundation The Grinder Grinder Philip As-B Web Services/SOA ton Sub-Category: Overall JMeter JMeter Apache Software Foundation SoapUI SoapUI SmartBeart The Grinder SoapUI JMeter Software FINALISTS The Grinder Grinder Philip Aston Hammerora Hammerora Steve Producer: PhilipShaw Aston BEST COM-S Producer: SmartBear Software Producer: Apache Software MERCIAL FUNCTIONAL AUTOMATED TEST TOOL Sub-Category: Web HP QTP QuickTest Professional (HPM Foundation Functional Tester) Hewlett Packard Test Studio Test Studio Telerik FINALISTS SilkTest SilkTest Micro FocusF Rational Functional Tester Rational Functional Tester IBM Sub-Category: Java TestComplete Test-R Complete SmartBear Software HP QTP QuickTest Professional (HP Functional Tester) Hewlett PackardC FINALISTS TestDrive TestDrive Original Software ThoughtWorks Twist ThoughtWorks QA Wizard QA Wiz-F Finalist Finalist ard Seapine Software Sub-Category: .NET Ranorex Ranorex Ranorex GmbH Test Studio Test Studioa Telerik FINALISTS Certify Certify Worksoft SilkTest SilkTest Micro Focus Sub-Category: Flash/Flex RanorexT Ranorex Ranorex GmbH TestDrive TestDrive Original Software FINALISTS RIATest RIATest Cogitek IncR Overall Sub-category eggPlant eggPlant Testplant Sub-Category: Web Services/SOA SilkTest SilkPerformer for SOA Microe Hammerora Grinder SoapUI JMeter Focus SoapUI SoapUI Pro SmartBear Software FINALISTS The TestDrive TestDrive Original Software SOATestF Producer: Philip Producer: SmartBear Producer: Steve Apache SOATest Producer: Parasoft Sub-Category: SAP Certify Certify WorkSoft FINALISTS HP QTP QuickTest Profes-S Aston Software Shaw Software Foundation sional (HP Functional Tester) Hewlett Packard Rational Functional Tester Rational Functional Tester IBMs Sub-Category: Overall HP QTP QuickTest Professional (HP Functional Tester) Hewlett Packard Test-S Complete TestComplete SmartBear Software FINALISTS Rational Functional Tester Rational FunctionalC Tester IBM Ranorex Ranorex Ranorex GmbH SilkTest SilkTest Micro Focus BEST COMMERCIAL PERFOR-T MANCE AUTOMATED TEST TOOL Sub-Category: Web/HTTPS LoadRunner LoadRunner Hewlett Pack-M Finalist Finalist ard SilkTest SilkPerformer Micro Focus FINALISTS Rational Performance Tester Rational Performancea Tester IBM AQTime AQTime Smart Bear Sub-Category: Web Services/SOA LoadRunner LoadRunnerT Hewlett Packard SoapUI SoapUI Pro SmartBear Software FINALISTS SilkTest SilkPerformer for SOA MicroH Focus SOATest SOATest Parasoft Sub-Category: Overall LoadRunner LoadRunner Hewlett PackardF SilkTest SilkPerformer Micro Focus FINALISTS Rational Performance Tester Rational Performance TesterS IBM AQTime AQTime Smart Bear BEST AUTOMATED TESTING BOOK AUTHOR(S) Continuous DeliveryI Continuous Delivery: Reliable Software Releases through Build, Test, and Deployment Automation JezC Humble and David Farley FINALISTS Software Testing With Visual Studio Software Testing with VisualH Studio 2010 (Microsoft .NET Development Series) Jeff Levinson Selenium 1.0 Selenium 1.0 Testing Tools:S Beginner's Guide David Burns BEST AUTOMATED TESTING PRESENTATION AUTHOR(S) Making Test Au-B tomation Work on Agile Projects Lisa Crispin FINALISTS Exploratory Test Automation in Bing Harry Rob-t Hammerora inson Automated Testing in an iOS World Eric Bariaux BEST AUTOMATED TESTING ARTICLE AUTHOR(S)i Developments role in software test Automation Linda Hayes Technical vs. Non-Technical Skills InD
Im [delighted] that the Automated Testing Institute recognizes open source.
Steve Shaw
Test To
Best Commercial Functional Test Tool
Winner
Runner-up
BEST OPEN SOURCE UNIT AUTOMATED TEST TOOL Sub-Category: C++ Google Test Google C++ Testing Framework Google ATF Automated Testing Framework (ATF) TBD FINALISTS Boost Boost Test Library Dave Abrahams cfix Johannes Passing Sub-Category: Java JUnit David Saff, Erich Gamma, Erik G. H. Meade, Kent Beck FINALISTS TestNG TestNG Cdric Beust UISpec4J UISpec4J Rgis Medina, Pascal Pratmarty Sub-Category: .NET NUnit Charlie Poole FINALISTS mbunit MbUnit Johan Appelgren, Jeff Brown, Joey Calisay xUnit.net xUnit.net Brad Wilson, Jim Newkirk Sub-Category: Overall JUnit David Saff, Erich Gamma, Erik G. H. Meade, Kent Beck NUnit Charlie Poole FINALISTS Google Test Google Web Sub-category C++ Testing Framework Google TestNG TestNG Cdric Beust BEST OPEN SOURCE FUNCTIONAL AUTOTest Studio SilkTest Rational QuickTest Pro MATED TEST TOOL Sub-Category: Web Selenium Selenium OpenQA TestMaker TestMaker PustToTest (HP Functional Tester) Functional Tester FINALISTSProducer: Sahi Sahi Tyto Software WatirTelerik Watir Bret Pettichord Sub-Category: Java IBM White White Vivek Producer: Micro Hewlett Producer: Producer: Singh SWTBot SWTBot Ketan Padegaonkar FINALISTS T-Plan Robot T-Plan Robot T-Plan Ltd. Jemmy JemFocus Packard my Alexandre (Shura) Iline Sub-Category: Flash/Flex Flex Monkey Flex Monkey Gorilla Logic FINALISTS Melomel Melomel Ben Johnson TestMaker TestMaker PustToTest Sub-Category: Overall Selenium Selenium OpenQA Flex Monkey Flex Monkey Gorilla Logic FINALISTS TestMaker TestMaker PustToTest T-Plan Robot T-Plan Robot T-Plan Ltd. BEST OPEN SOURCE PERFORMANCE AUTOMATED TEST TOOL SubCategory: Web JMeter JMeter Apache Software Foundation FINALISTS The Grinder Grinder Philip Finalist Finalist Aston Hammerora Hammerora Steve Shaw Sub-Category: Web Services/SOA SoapUI SoapUI SmartBear Software FINALISTS JMeter JMeterJava Apache Software Foundation The Grinder Grinder Philip AsSub-category ton Sub-Category: Overall JMeter JMeter Apache Software Foundation SoapUI SoapUI SmartBear TestComplete TestDrive QuickTest Pro Software FINALISTS The Grinder Grinder Philip Aston Hammerora Hammerora Steve Shaw BEST COM(HP Functional Tester) MERCIAL FUNCTIONAL AUTOMATED TEST TOOL Sub-Category: Web HP QTP QuickTest Professional Producer: Original Software (HP Producer: SmartBear Software Producer: Hewlett Packard Functional Tester) Hewlett Packard Test Studio Test Studio Telerik FINALISTS SilkTest SilkTest Micro Focus Rational Functional Tester Rational Functional Tester IBM Sub-Category: Java TestComplete TestComplete SmartBear Software HP QTP QuickTest Professional (HP Functional Tester) Hewlett Packard FINALISTS TestDrive TestDrive Original Software ThoughtWorks Twist ThoughtWorks QA Wizard QA Wizard Seapine Software Sub-Category: .NET Ranorex Ranorex Ranorex GmbH Test Studio Test Studio Telerik FINALISTS Certify Certify Worksoft SilkTest SilkTest Micro Focus Sub-Category: Flash/Flex Ranorex Finalist Ranorex Ranorex GmbH TestDrive TestDrive Original Software FINALISTS RIATest RIATest Cogitek Inc eggPlant eggPlant Testplant Sub-Category: Web Services/SOA SilkTest SilkPerformer for SOA Micro QA Wizard Focus SoapUI SoapUI Twist Pro SmartBear Software FINALISTS TestDrive TestDrive Original Software SOATest Producer: ThoughtWorks Producer: Seapine HP Software SOATest Parasoft Sub-Category: SAP Certify Certify WorkSoft FINALISTS QTP QuickTest Professional (HP Functional Tester) Hewlett Packard Rational Functional Tester Rational Functional Tester IBM Sub-Category: Overall HP QTP QuickTest Professional (HP Functional Tester) Hewlett Packard TestComplete TestComplete SmartBear Software FINALISTS Rational Functional Tester Rational Functional Tester IBM Ranorex Ranorex Ranorex GmbH SilkTest SilkTest Micro Focus BEST COMMERCIAL PERFORMANCE AUTOMATED TEST TOOL Sub-Category: Web/HTTPS LoadRunner LoadRunner Hewlett PackFinalist Finalist ard SilkTest SilkPerformer Micro Focus FINALISTS Rational Performance Tester Rational Performance Tester IBM AQTime AQTime Smart Bear.NET Sub-Category: Web Services/SOA LoadRunner LoadRunner Sub-category Hewlett Packard SoapUI SoapUI Pro SmartBear Software FINALISTS SilkTest SilkPerformer for SOA Micro Ranorex SilkTest Hewlett Packard Test Studio Focus SOATest SOATest Parasoft Sub-Category: Overall Certify LoadRunner LoadRunner Producer: Micro Focus Tester Producer: Worksoft Producer: Telerik Producer: Ranorex SilkTest SilkPerformer Micro Focus FINALISTS Rational Performance Tester Rational Performance GmbH AQTime Smart Bear BEST AUTOMATED TESTING BOOK AUTHOR(S) Continuous Delivery IBM AQTime Continuous Delivery: Reliable Software Releases through Build, Test, and Deployment Automation Jez Humble and David Farley FINALISTS Software Testing With Visual Studio Software Testing with Visual Studio 2010 (Microsoft .NET Development Series) Jeff Levinson Selenium 1.0 Selenium 1.0 Testing Tools: Beginner's Guide David Burns BEST AUTOMATED TESTING PRESENTATION AUTHOR(S) Making Test AuFinalist tomation Work on Agile Projects Lisa Crispin FINALISTS Exploratory Test Automation in Bing Harry RobFinalist inson Automated Testing in an iOS World Eric Bariaux BEST AUTOMATED TESTING ARTICLE AUTHOR(S) Developments role in software test Automation Linda Hayes Technical vs. Non-Technical Skills In
Winner
Runner-up
Winner
Runner-up
13
Best C
Winner
Runner-up
BEST OPEN SOURCE UNIT AUTOMATED TEST TOOL Sub-Category: C++ Google Test Google C++ Test-B ing Framework Google ATF Automated Testing Framework (ATF) TBD FINALISTS Boost Boost Test Libraryi Dave Abrahams cfix Johannes Passing Sub-Category: Java JUnit David Saff, Erich Gamma, Erik G.D H. Meade, Kent Beck FINALISTS TestNG TestNG Cdric Beust UISpec4J UISpec4J Rgis Medina, PascalH Pratmarty Sub-Category: .NET NUnit Charlie Poole FINALISTS mbunit MbUnit Johan Appelgren, JeffP Brown, Joey Calisay xUnit.net xUnit.net Brad Wilson, Jim Newkirk Sub-Category: Overall JUnit DavidB Saff, Erich Gamma, Erik G. H. Meade, Kent Beck NUnit Charlie Poole FINALISTS Google Test GoogleS C++ Testing Framework Google TestNG TestNG Cdric Beust BEST OPEN SOURCE FUNCTIONAL AUTO-C Flash/Flex Sub-category MATED TEST TOOL Sub-Category: Web Selenium Selenium OpenQA TestMaker TestMaker PustToTestM TestDrive RIATest eggPlant Ranorex FINALISTS Sahi Sahi Tyto Software Watir Watir Bret Pettichord Sub-Category: Java White White VivekF Singh SWTBot SWTBot Ketan Padegaonkar FINALISTS T-Plan Robot Cogitek T-Plan Robot T-Plan Ltd. Jemmy Jem-S Producer: Producer: Ranorex Producer: Original Software Producer: Testplant Inc. my Alexandre (Shura) Iline Sub-Category: Flash/Flex Flex Monkey Flex Monkey Gorilla Logic FINALISTSm Melomel Melomel Ben Johnson TestMaker TestMaker PustToTest Sub-Category: Overall SeleniumM Selenium OpenQA Flex Monkey Flex Monkey Gorilla Logic FINALISTS TestMaker TestMaker PustToTestS T-Plan Robot T-Plan Robot T-Plan Ltd. BEST OPEN SOURCE PERFORMANCE AUTOMATED TEST TOOL Sub-T Category: Web JMeter JMeter Apache Software Foundation FINALISTS The Grinder Grinder PhilipC Finalist Finalist Aston Hammerora Hammerora Steve Shaw Sub-Category: Web Services/SOA SoapUI SoapUI Smart-A Bear Software FINALISTS JMeter JMeter Apache Software Foundation The Grinder Grinder Philip As-B ton Sub-Category: Overall JMeter JMeter Apache Software Foundation SoapUI SoapUI SmartBeart Software FINALISTS The Grinder Grinder Philip Aston Hammerora Hammerora Steve Shaw BEST COM-S Web Services/SOA Sub-category MERCIAL FUNCTIONAL AUTOMATED TEST TOOL Sub-Category: Web HP QTP QuickTest Professional (HPM Functional Tester) Hewlettfor Packard Test Studio Test Studio Telerik FINALISTSSOATest SilkTest SilkTest Micro FocusF SilkPerformer SoapUI Pro TestDrive Rational SOA Functional Tester Rational Functional Tester IBM Sub-Category: Java TestComplete Test-R Producer: Original Producer: MicroSoftware Producer: SmartBear Producer: Parasoft Complete SmartBear HP QTP QuickTest Professional (HP Functional Tester) Hewlett PackardC Software Focus Software FINALISTS TestDrive TestDrive Original Software ThoughtWorks Twist ThoughtWorks QA Wizard QA Wiz-F ard Seapine Software Sub-Category: .NET Ranorex Ranorex Ranorex GmbH Test Studio Test Studioa Telerik FINALISTS Certify Certify Worksoft SilkTest SilkTest Micro Focus Sub-Category: Flash/Flex RanorexT Ranorex Ranorex GmbH TestDrive TestDrive Original Software FINALISTS RIATest RIATest Cogitek IncR eggPlant eggPlant Testplant Sub-Category: Web Services/SOA SilkTest SilkPerformer for SOA Microe Finalist Finalist Focus SoapUI SoapUI Pro SmartBear Software FINALISTS TestDrive TestDrive Original Software SOATestF SOATest Parasoft Sub-Category: SAP Certify Certify WorkSoft FINALISTS HP QTP QuickTest Profes-S sional (HP Functional Tester) Hewlett Packard Rational Functional Tester Rational Functional Tester IBM( Sub-Category: Overall HP QTP QuickTest Professional (HP Functional Tester) Hewlett Packard Test-C Complete TestComplete SmartBear Software Rational Functional Tester Rational Functionalp SAPFINALISTS Sub-category Tester IBM Ranorex Ranorex Ranorex GmbH SilkTest SilkTest Micro Focus BEST COMMERCIAL PERFOR-I Rational QuickTest Pro (HPLoadRunner MANCE Certfy AUTOMATED TEST TOOL Sub-Category: Web/HTTPS LoadRunner Hewlett Pack-A Functional Tester) Functional Tester ard SilkTest SilkPerformer Rational PerformanceProducer: Tester Rational PerformanceT Producer: Worksoft Micro Focus FINALISTS IBM Producer: Hewlett Packard Tester IBM AQTime AQTime Smart Bear Sub-Category: Web Services/SOA LoadRunner LoadRunnerA Hewlett Packard SoapUI SoapUI Pro SmartBear Software FINALISTS SilkTest SilkPerformer for SOA MicroP Focus SOATest SOATest Parasoft Sub-Category: Overall LoadRunner LoadRunner Hewlett PackardS SilkTest SilkPerformer Micro Focus FINALISTS Rational Performance Tester Rational Performance TesterS IBM AQTime AQTime Smart Bear BEST AUTOMATED TESTING BOOK AUTHOR(S) Continuous DeliveryT Finalist Finalist Continuous Delivery: Reliable Software Releases through Build, Test, and Deployment Automation Jezo Humble and David Farley FINALISTS Software Testing With Visual Studio Software Testing with Visuala Studio 2010 (Microsoft .NET Development Series) Jeff Levinson Selenium 1.0 Selenium 1.0 Testing Tools:( Beginner's Guide David Burns BEST AUTOMATED TESTING PRESENTATION AUTHOR(S) Making Test Au-G tomation Work on Agile Projects Lisa Crispin FINALISTS Exploratory Test Automation in Bing Harry Rob-o inson Automated Testing in an iOS World Eric Bariaux BEST AUTOMATED TESTING ARTICLE AUTHOR(S)T Developments role in software test Automation Linda Hayes Technical vs. Non-Technical Skills Ini
Winner
Runner-up
Winner
Commerci
Winner
Runner-up
Special Edition 2011 www.automatedtestinginstitute.com Automated Software Testing Magazine 15
BEST OPEN SOURCE UNIT AUTOMATED TEST TOOL Sub-Category: C++ Google Test Google C++ Testing Framework Google ATF Automated Testing Framework (ATF) TBD FINALISTS Boost Boost Test Library Dave Abrahams cfix Johannes Passing Sub-Category: Java JUnit David Saff, Erich Gamma, Erik G. H. Meade, Kent Beck FINALISTS TestNG TestNG Cdric Beust UISpec4J UISpec4J Rgis Medina, Pascal Pratmarty Sub-Category: .NET NUnit Charlie Poole FINALISTS mbunit MbUnit Johan Appelgren, Jeff Brown, Joey Calisay xUnit.net xUnit.net Brad Wilson, Jim Newkirk Sub-Category: Overall JUnit David Saff, Erich Gamma, Erik G. H. Meade, Kent Beck NUnit Charlie Poole FINALISTS Google Test Google C++ Testing Framework Google TestNG TestNG Cdric Beust BEST OPEN SOURCE FUNCTIONAL AUTOMATED TEST TOOL Sub-Category: Web Selenium Selenium OpenQA TestMaker TestMaker PustToTest FINALISTS Sahi Sahi Tyto Software Watir Watir Bret Pettichord Sub-Category: Java White White Vivek Singh SWTBot SWTBot Ketan Padegaonkar FINALISTS T-Plan Robot T-Plan Robot T-Plan Ltd. Jemmy Jemmy Alexandre (Shura) Iline Sub-Category: Flash/Flex Flex Monkey Flex Monkey Gorilla Logic FINALISTS Melomel Melomel Ben Johnson TestMaker TestMaker PustToTest Sub-Category: Overall Selenium Selenium OpenQA Flex Monkey Flex Monkey Gorilla Logic FINALISTS TestMaker TestMaker PustToTest T-Plan Robot T-Plan Robot T-Plan Ltd. BEST OPEN SOURCE PERFORMANCE AUTOMATED TEST TOOL SubCategory: Web JMeter JMeter Apache Software Foundation FINALISTS The Grinder Grinder Philip Overall Sub-category Aston Hammerora Hammerora Steve Shaw Sub-Category: Web Services/SOA SoapUI SoapUI SmartBear Software FINALISTS JMeter JMeter Apache Software Foundation The Grinder Grinder Philip AsQuickTest Pro Rational TestComplete ton Sub-Category: Overall JMeter JMeter Apache Software Foundation SoapUI SoapUI SmartBear (HP Functional Tester) Functional Tester Software FINALISTS The Grinder Grinder Philip Aston Hammerora Hammerora Steve Shaw BEST COMProducer: IBM Producer: Hewlett Packard Producer: SmartBear MERCIAL FUNCTIONAL AUTOMATED TEST TOOL Sub-Category: Web HP QTP QuickTest Professional (HP Software Functional Tester) Hewlett Packard Test Studio Test Studio Telerik FINALISTS SilkTest SilkTest Micro Focus Rational Functional Tester Rational Functional Tester IBM Sub-Category: Java TestComplete TestComplete SmartBear Software HP QTP QuickTest Professional (HP Functional Tester) Hewlett Packard FINALISTS TestDrive TestDrive Original Software ThoughtWorks Twist ThoughtWorks QA Wizard QA Wizard Seapine Software Sub-Category: .NET Ranorex Ranorex Ranorex GmbH Test Studio Test Studio Finalist Telerik FINALISTS Certify Certify Worksoft SilkTest SilkTest Micro Focus Sub-Category: Flash/Flex Ranorex Ranorex Ranorex GmbH TestDrive TestDrive Original Software FINALISTS RIATest RIATest Cogitek Inc eggPlant eggPlant Testplant Sub-Category: Web Services/SOA SilkTest SilkPerformer for SOA Micro Focus SoapUI SoapUI Pro SmartBear Software FINALISTS TestDrive TestDrive Original Software SOATest SOATest Parasoft Sub-Category: FINALISTS HP QTP QuickTest Professional Ranorex SAP Certify Certify WorkSoft SilkTest Producer: Ranorex GmbH Producer: Micro Focus (HP Functional Tester) Hewlett Packard Rational Functional Tester Rational Functional Tester IBM SubCategory: Overall HP QTP QuickTest Professional (HP Functional Tester) Hewlett Packard TestComplete TestComplete SmartBear Software FINALISTS Rational Functional Tester Rational Functional Tester IBM Ranorex Ranorex Ranorex GmbH SilkTest SilkTest Micro Focus BEST COMMERCIAL PERFORMANCE AUTOMATED TEST TOOL Sub-Category: Web/HTTPS LoadRunner LoadRunner Hewlett Packard SilkTest SilkPerformer Micro Focus FINALISTS Rational Performance Tester Rational Performance Tester IBM Finalist Finalist AQTime AQTime Smart Bear Sub-Category: Web Services/SOA LoadRunner LoadRunner Hewlett Packard SoapUI SoapUI Pro SmartBear Software FINALISTS SilkTest SilkPerformer for SOA Micro Focus SOATest SOATest Parasoft Sub-Category: Overall LoadRunner LoadRunner Hewlett Packard SilkTest SilkPerformer Micro Focus FINALISTS Rational Performance Tester Rational Performance Tester IBM AQTime AQTime Smart Bear BEST AUTOMATED TESTING BOOK AUTHOR(S) Continuous Delivery Continuous Delivery: Reliable Software Releases through Build, Test, and Deployment Automation Jez Humble and David Farley FINALISTS Software Testing With Visual Studio Software Testing with Visual Studio 2010 (Microsoft .NET Development Series) Jeff Levinson Selenium 1.0 Selenium 1.0 Testing Tools: Beginner's Guide David Burns BEST AUTOMATED TESTING PRESENTATION AUTHOR(S) Making Test Automation Work on Agile Projects Lisa Crispin FINALISTS Exploratory Test Automation in Bing Harry Robinson Automated Testing in an iOS World Eric Bariaux BEST AUTOMATED TESTING ARTICLE AUTHOR(S) Developments role in software test Automation Linda Hayes Technical vs. Non-Technical Skills In Test Automation Doro-
Best C
Best Commercial Performance Test Tool
Winner
Runner-up
BEST OPEN SOURCE UNIT AUTOMATED TEST TOOL Sub-Category: C++ Google Test Google C++ Testing Framework Google ATF Automated Testing Framework (ATF) TBD FINALISTS Boost Boost Test Library Dave Abrahams cfix Johannes Passing Sub-Category: Java JUnit David Saff, Erich Gamma, Erik G. H. Meade, Kent Beck FINALISTS TestNG TestNG Cdric Beust UISpec4J UISpec4J Rgis Medina, Pascal Pratmarty Sub-Category: .NET NUnit Charlie Poole FINALISTS mbunit MbUnit Johan Appelgren, Jeff Brown, Joey Calisay xUnit.net xUnit.net Brad Wilson, Jim Newkirk Sub-Category: Overall JUnit David Saff, Erich Gamma, Erik G. H. Meade, Kent Beck NUnit Charlie Poole FINALISTS Google Test Google Web/HTTPS Sub-category C++ Testing Framework Google TestNG TestNG Cdric Beust BEST OPEN SOURCE FUNCTIONAL AUTOAQTime Rational LoadRunner SilkPerformer MATED TEST TOOL Sub-Category: Web Selenium Selenium OpenQA TestMaker TestMaker PustToTest Performance FINALISTSProducer: Sahi Sahi Tyto Software Watir Watir Bret Pettichord Sub-Category: Java White White Vivek Hewlett Producer: Micro Focus Producer: SmartBear IBM Singh SWTBot SWTBot Ketan Padegaonkar FINALISTS T-Plan Robot T-Plan Robot T-Plan Ltd. Jemmy JemPackard GmbH Software my Alexandre (Shura) Iline Sub-Category: Flash/Flex Flex Monkey Flex Monkey Gorilla Logic FINALISTS Melomel Melomel Ben Johnson TestMaker TestMaker PustToTest Sub-Category: Overall Selenium Selenium OpenQA Flex Monkey Flex Monkey Gorilla Logic FINALISTS TestMaker TestMaker PustToTest T-Plan Robot T-Plan Robot T-Plan Ltd. BEST OPEN SOURCE PERFORMANCE AUTOMATED TEST TOOL SubCategory: Web JMeter JMeter Apache Software Foundation FINALISTS The Grinder Grinder Philip Finalist Finalist Aston Hammerora Hammerora Steve Shaw Sub-Category: Web Services/SOA SoapUI SoapUI SmartBear Software FINALISTS JMeter JMeter Apache Software Foundation The Grinder Grinder Philip AsWeb Services/SOA Sub-category ton Sub-Category: Overall JMeter JMeter Apache Software Foundation SoapUI SoapUI SmartBear LoadRunner SilkPerformer SOATest SoapUI Pro Software FINALISTS The Grinder Grinder Philip Aston Hammerora Hammerora Steve Shaw BEST COMfor SOA MERCIAL FUNCTIONAL AUTOMATED TEST TOOL Sub-Category: Web HP QTP QuickTest Professional (HP Producer: Micro Producer: Hewlett Producer: SmartBear Producer: Parasoft Functional Tester) Hewlett Packard Test Studio Test Studio Telerik FINALISTS SilkTest SilkTest Micro Focus Focus Packard Software Rational Functional Tester Rational Functional Tester IBM Sub-Category: Java TestComplete TestComplete SmartBear Software HP QTP QuickTest Professional (HP Functional Tester) Hewlett Packard FINALISTS TestDrive TestDrive Original Software ThoughtWorks Twist ThoughtWorks QA Wizard QA Wizard Seapine Software Sub-Category: .NET Ranorex Ranorex Ranorex GmbH Test Studio Test Studio Telerik FINALISTS Certify Certify Worksoft SilkTest SilkTest Micro Focus Sub-Category: Flash/Flex Ranorex Finalist Finalist Ranorex Ranorex GmbH TestDrive TestDrive Original Software FINALISTS RIATest RIATest Cogitek Inc eggPlant eggPlant Testplant Sub-Category: Web Services/SOA SilkTest SilkPerformer for SOA Micro Overall Sub-category Focus SoapUI SoapUI Pro SmartBear Software FINALISTS TestDrive TestDrive Original Software SOATest Rational SilkPerformer SOATest LoadRunner Parasoft Sub-Category: SAP Certify Certify WorkSoft FINALISTSAQTime HP QTP QuickTest ProfesFunctional sional (HP Functional Tester) Hewlett Packard Rational Functional Tester Rational Functional Tester IBM Producer: SmartBear Producer: Micro Focus Producer: Hewlett Tester Sub-Category: Functional Tester) Hewlett Packard TestSoftware Packard Overall HP QTP QuickTest Professional (HP Producer: IBM Complete TestComplete SmartBear Software FINALISTS Rational Functional Tester Rational Functional Tester IBM Ranorex Ranorex Ranorex GmbH SilkTest SilkTest Micro Focus BEST COMMERCIAL PERFORMANCE AUTOMATED TEST TOOL Sub-Category: Web/HTTPS LoadRunner LoadRunner Hewlett Packard SilkTest SilkPerformer Micro Focus FINALISTS Rational Performance Tester Rational Performance Finalist Finalist LoadRunner Finalist Tester IBM AQTime AQTime Smart Bear Sub-Category: Web Services/SOA LoadRunner Hewlett Packard SoapUI SoapUI Pro SmartBear Software FINALISTS SilkTest SilkPerformer for SOA Micro Focus SOATest SOATest Parasoft Sub-Category: Overall LoadRunner LoadRunner Hewlett Packard SilkTest SilkPerformer Micro Focus FINALISTS Rational Performance Tester Rational Performance Tester IBM AQTime AQTime Smart Bear BEST AUTOMATED TESTING BOOK AUTHOR(S) Continuous Delivery Continuous Delivery: Reliable Software Releases through Build, Test, and Deployment Automation Jez Humble and David Farley FINALISTS Software Testing With Visual Studio Software Testing with Visual Studio 2010 (Microsoft .NET Development Series) Jeff Levinson Selenium 1.0 Selenium 1.0 Testing Tools: Beginner's Guide David Burns BEST AUTOMATED TESTING PRESENTATION AUTHOR(S) Making Test Automation Work on Agile Projects Lisa Crispin FINALISTS Exploratory Test Automation in Bing Harry Robinson Automated Testing in an iOS World Eric Bariaux BEST AUTOMATED TESTING ARTICLE AUTHOR(S) LoadRunnerSkills In Developments role in software test Automation Linda Hayes Technical vs. Non-Technical
Winner
Runner-up
Winner
Id like to thank ATI and the automation community for your recognition.
www.automatedtestinginstitute.com Special Edition 2011
Architect
Communi
Best Automation Communication Resources
Winner Winner Winner
Runner-up
-BEST OPEN SOURCE UNIT AUTOMATED TEST TOOL Sub-Category: C++ Google Test Google C++ Testying Framework Google ATF Automated Testing Framework (ATF) TBD FINALISTS Boost Boost Test Library .Dave Abrahams cfix Johannes Passing Sub-Category: Java JUnit David Saff, Erich Gamma, Erik G. lH. Meade, Kent Beck FINALISTS TestNG TestNG Cdric Beust UISpec4J UISpec4J Rgis Medina, Pascal fPratmarty Sub-Category: .NET NUnit Charlie Poole FINALISTS mbunit MbUnit Johan Appelgren, Jeff dBrown, Joey Calisay xUnit.net xUnit.net Brad Wilson, Jim Newkirk Sub-Category: Overall JUnit David eSaff, Erich Gamma, Erik G. H. Meade, Kent Beck NUnit Charlie Poole Book FINALISTS Google Test Google Best Automated Testing -C++ Testing Framework Google TestNG TestNG Cdric Beust BEST OPEN SOURCE FUNCTIONAL AUTOSelenium 1.0 Testing Continuous Delivery: Web Selenium Software Testing tMATED TEST TOOL Sub-Category: Selenium OpenQA TestMaker TestMaker PustToTest Tools: Beginners Reliable Software Releases with Visual Studio kFINALISTS Sahi Sahi Tyto Software Watir Watir Bret Pettichord.NET Sub-Category: Java White White Vivek Guide through Build, Test, and 2010 (Microsoft -Singh SWTBot SWTBot Ketan Padegaonkar FINALISTS T-Plan Robot T-Plan Robot T-Plan Ltd. Jemmy JemDeployment Automation Development Series) Smy Alexandre (Shura) Sub-Category: Flash/Flex Flex Monkey Flex Monkey Gorilla Logic FINALISTS Author(s): David Author(s): Jez Iline Humble and Author(s): Jeff Levinson mMelomel Melomel Ben Johnson TestMaker TestMaker PustToTest Sub-Category: Overall Selenium Burns David Farley tSelenium OpenQA Flex Monkey Flex Monkey Gorilla Logic FINALISTS TestMaker TestMaker PustToTest -T-Plan Robot T-Plan Robot T-Plan Ltd. BEST OPEN SOURCE PERFORMANCE AUTOMATED TEST TOOL SubpCategory: Web JMeter JMeter Apache Software Foundation FINALISTS The Grinder Grinder Philip -Aston Hammerora Hammerora Steve Shaw Sub-Category: Web Services/SOA SoapUI SoapUI Smart-Bear Software FINALISTS JMeter JMeter Apache Software Foundation The Grinder Grinder Philip Asrton Sub-Category: Overall JMeter JMeter Apache Software Foundation Finalist SoapUI SoapUI SmartBear Finalist -Software FINALISTS The Grinder Grinder Philip Aston Hammerora Hammerora Steve Shaw BEST COMPMERCIAL FUNCTIONAL AUTOMATED TEST TOOL Sub-Category: Web HP QTP QuickTest Professional (HP Best Packard Automated Testing Presentation sFunctional Tester) Hewlett Test Studio Test Studio Telerik FINALISTS SilkTest SilkTest Micro Focus Testing TestMaking Test Exploratory Test -Rational Functional Tester Rational Functional Tester IBM Sub-Category:Automated Java TestComplete in an iOS World Work HP on QTP QuickTest Automation in (HP Functional Tester) Hewlett Packard dComplete Automation SmartBear Software Professional Agile Projects Bing -FINALISTS TestDrive TestDrive Original Software ThoughtWorks Twist ThoughtWorks QA Wizard QA WizAuthor: Eric Bariaux Author: Lisa Crispin Harry Robinson oard Seapine Software Sub-Category: .NET Author: Ranorex Ranorex Ranorex GmbH Test Studio Test Studio xTelerik FINALISTS Certify Certify Worksoft SilkTest SilkTest Micro Focus Sub-Category: Flash/Flex Ranorex cRanorex Ranorex GmbH TestDrive TestDrive Original Software FINALISTS RIATest RIATest Cogitek Inc Finalist Finalist oeggPlant eggPlant Testplant Sub-Category: Web Services/SOA SilkTest SilkPerformer for SOA Micro tFocus SoapUI SoapUI Pro SmartBear Software FINALISTS TestDrive TestDrive Original Software SOATest -SOATest Parasoft Sub-Category: SAP Certify Certify WorkSoft FINALISTS HP QTP QuickTest ProfesBest Automated Testing Article Msional (HP Functional Tester) Hewlett Packard Rational Functional Tester Rational Functional Tester IBM Developments Continuous Technical vs. Non-Sub-Category: Overall HP QTP QuickTest Professional (HP Functional Tester) Hewlett Packard Testrole in software Integration and Technical Skills In lComplete TestComplete SmartBear Software FINALISTS Rational Functional Tester Rational Functional test Automation Automation Test Automation -Tester IBM Author(s): Ranorex Linda Ranorex Ranorex GmbH SilkTest SilkTest Micro Focus BEST COMMERCIAL Author(s): Eric Pugh PERFORHayes Author(s): Dorothy Graham -MANCE AUTOMATED TEST TOOL Sub-Category: Web/HTTPS LoadRunner LoadRunner Hewlett Packeard SilkTest SilkPerformer Micro Focus FINALISTS Rational Performance Tester Rational Performance rTester IBM AQTime AQTime Smart Bear Sub-Category: Web Services/SOA LoadRunner LoadRunner Finalist oHewlett Packard SoapUI SoapUI Pro SmartBear Software FINALISTS SilkTest SilkPerformer for SOA Micro dFocus SOATest SOATest Parasoft Sub-Category: Overall LoadRunner LoadRunner Hewlett Packard rSilkTest SilkPerformer Micro Focus FINALISTS Rational Performance Tester Rational Performance Tester Test automation: UI Automation yIBM AQTime AQTime Smart Bear BEST AUTOMATED TESTING BOOK AUTHOR(S) Continuous Delivery Business agility Beneath the requires disposable zContinuous Delivery: Reliable Software Releases through Build,Presentation Test, and Deployment Layer Automation Jez test assets lHumble and David Farley FINALISTS Software Testing With Visual Studio Software Testing with Visual Bj Rollison Author(s): George Wilson :Studio 2010 (Microsoft .NET Development Series) Jeff Levinson Author(s): Selenium 1.0 Selenium 1.0 Testing Tools: -Beginner's Guide David Burns BEST AUTOMATED TESTING PRESENTATION AUTHOR(S) Making Test Au-tomation Work on Agile Projects Lisa Crispin FINALISTS Exploratory Test Automation in Bing Harry RobFinalist Finalist )inson Automated Testing in an iOS World Eric Bariaux BEST AUTOMATED TESTING ARTICLE AUTHOR(S) nDevelopments role in software test Automation Linda Hayes Technical vs. Non-Technical Skills In
Online
Winner Winner
Runner-up
18 Automated Software Testing Magazine www.automatedtestinginstitute.com
BEST OPEN SOURCE UNIT AUTOMATED TEST TOOL Sub-Category: C++ Google Test Google C++ Testing Framework Google ATF Automated Testing Framework (ATF) TBD FINALISTS Boost Boost Test Library Dave Abrahams cfix Johannes Passing Sub-Category: Java JUnit David Saff, Erich Gamma, Erik G. H. Meade, Kent Beck FINALISTS TestNG TestNG Cdric Beust UISpec4J UISpec4J Rgis Medina, Pascal Pratmarty Sub-Category: .NET NUnit Charlie Poole FINALISTS mbunit MbUnit Johan Appelgren, Jeff Brown, Joey Calisay xUnit.net xUnit.net Brad Wilson, Jim Newkirk Sub-Category: Overall JUnit David Saff, Erich Gamma, ErikBest G. H. Meade, Kent Beck NUnit Charlie Poole FINALISTS Google Test Google Automated Testing Blog C++ Testing Framework Google TestNG TestNG Cdric Beust BEST OPEN SOURCE FUNCTIONAL AUTOTestlabs.com Automated Testing Web Selenium Software MATED TEST TOOL Sub-Category: Selenium OpenQA TestMaker TestMaker PustToTest and QA Functional Test FINALISTS Sahi Sahi Tyto Software Watir Watir Bret Pettichord Sub-Category: Java White White Vivek Automation Singh SWTBot SWTBot Ketan Padegaonkar FINALISTS T-Plan Robot T-PlanProducer: Robot T-Plan Jemmy JemPhilip Ltd. Aston Producer: Mahesh Narayanan Producer: Peter Kartashov my Alexandre (Shura) Iline Sub-Category: Flash/Flex Flex Monkey Flex Monkey Gorilla Logic FINALISTS Melomel Melomel Ben Johnson TestMaker TestMaker PustToTest Sub-Category: Overall Selenium Selenium OpenQA Flex Monkey Flex Monkey Gorilla Logic FINALISTS TestMaker TestMaker PustToTest Finalist TEST TOOL SubFinalist T-Plan Robot T-Plan Robot T-Plan Ltd. BEST OPEN SOURCE PERFORMANCE AUTOMATED Category: Web JMeter JMeter Apache Software Foundation FINALISTS The Grinder Grinder Philip Aston Hammerora Hammerora Steve Shaw Sub-Category: Web Services/SOA SoapUI SoapUI SmartBear Software FINALISTS JMeter JMeter Apache Software Foundation The Grinder Grinder Philip Aston Sub-Category: Overall JMeter JMeter Apache Software Foundation SoapUI SoapUI SmartBear Best automated Testing forum Software FINALISTS The Grinder Grinder Philip Aston Hammerora Hammerora Steve Shaw BEST COMTekTips AdvancedQTP One Stop Testing SQAForums MERCIAL FUNCTIONAL AUTOMATED TEST TOOL Sub-Category: Web HP QTP QuickTest Professional (HP Forum Functional Tester) Hewlett Packard Test Studio Test Studio TelerikSOLMAR FINALISTS SilkTest SilkTest Micro Focus Producer: Producer: Vyom Producer: Tecumseh Producer: BetaSoft Inc. Rational Functional Tester Rational Functional Tester IBM Sub-Category: Technosoft Pvt. Ltd Knowledge Networks Java Group TestComplete TestComplete SmartBear Software HP QTP QuickTest Professional (HP Functional Tester) Hewlett Packard FINALISTS TestDrive TestDrive Original Software ThoughtWorks Twist ThoughtWorks QA Wizard QA Wizard Seapine Software Sub-Category: .NET Ranorex Ranorex Ranorex GmbH Test Studio Test Studio Telerik FINALISTS Certify Certify Worksoft SilkTest SilkTest Micro Focus Sub-Category: Flash/Flex Ranorex Finalist Finalist Ranorex Ranorex GmbH TestDrive TestDrive Original Software FINALISTS RIATest RIATest Cogitek Inc eggPlant eggPlant Testplant Sub-Category: Web Services/SOA SilkTest SilkPerformer for SOA Micro Focus SoapUI SoapUI Pro SmartBear Software FINALISTS TestDrive TestDrive Original Software SOATest SOATest Parasoft Sub-Category: SAP Certify Certify WorkSoft FINALISTS HP QTP QuickTest Professional (HP Functional Tester) Hewlett Packard Rational Functional Tester Rational Functional Tester IBM Sub-Category: Overall HP QTP QuickTest Professional (HP Functional Tester) Hewlett Packard TestComplete TestComplete SmartBear Software FINALISTS Rational Functional Tester Rational Functional Tester IBM Ranorex Ranorex Ranorex GmbH SilkTest SilkTest Micro Focus BEST COMMERCIAL PERFORMANCE AUTOMATED TEST TOOL Sub-Category: Web/HTTPS LoadRunner LoadRunner Hewlett Packard SilkTest SilkPerformer Micro Focus FINALISTS Rational Performance Tester Rational Performance Tester IBM AQTime AQTime Smart Bear Sub-Category: Web Services/SOA LoadRunner LoadRunner Hewlett Packard SoapUI SoapUI Pro SmartBear Software FINALISTS SilkTest SilkPerformer for SOA Micro Focus SOATest SOATest Parasoft Sub-Category: Overall LoadRunner LoadRunner Hewlett Packard SilkTest SilkPerformer Micro Focus FINALISTS Rational Performance Tester Rational Performance Tester IBM AQTime AQTime Smart Bear BEST AUTOMATED TESTING BOOK AUTHOR(S) Continuous Delivery Continuous Delivery: Reliable Software Releases through Build, Test, and Deployment Automation Jez Humble and David Farley FINALISTS Software Testing With Visual Studio Software Testing with Visual Studio 2010 (Microsoft .NET Development Series) Jeff Levinson Selenium 1.0 Selenium 1.0 Testing Tools: Beginner's Guide David Burns BEST AUTOMATED TESTING PRESENTATION AUTHOR(S) Making Test Automation Work on Agile Projects Lisa Crispin FINALISTS Exploratory Test Automation in Bing Harry RobSQAForums inson Automated Testing in an iOS World Eric Bariaux BEST AUTOMATED TESTING ARTICLE AUTHOR(S) Developments role in software test Automation Linda Hayes Technical vs. Non-Technical Skills In
Best Automation Online Resources
Thank you ATI for your recognition and this award. Its great having SQAForums recognized by the software testing industry.
Aj Alhait
y . l f d e t k S m t p r P s d o x c o t M l e r o d r y z l : ) n
For more information, visit http://www.networking.automatedtestinginstitute.com

S hifting
QTP
the ATI Honors reveal comtem

QUickTest Professional (HP Functional Tester) QuickTest Professional (QTP) did pretty well in the 3rd Annual ATI Automation Honors Awards. It made its way into four of the seven Best Commercial Functional Automated Test Tool categories: Web, Java, SAP and Overall. It was voted the winner in both the Web and Overall categories, while being named the runner up on the Java category. Unfortunately, for a tool as popular as QTP, the biggest story is probably not what it won, but rather what it did not win. SmartBears Test Complete bested QTP in the Java category, while Worksoft Certify took the honor in the SAP category. These results seem to tell a very interesting story. While the commercial market as a whole has been taking a hit from open source offerings, HP has in the past been considered the go-to option for those that sought a more robust solution than those offered by open source tools. The fact that HP lost in two major subcategories suggests that this trend is changing. While HP still has a firm handle on the automated test tool market when it comes to comprehensive solutions - evidenced by its multiple nominations and victory in the Overall category - the losses in the tool-specific subcategories suggest that the automation community is moving away from the sledge hammer approach of selecting a tool simply because it is good in multiple categories.
Tren
This years ATI Automation Honors Awards have come and named a new crop of winners. From the results, some important automated test tool trends can be inferred. This article identifies some of these trends
nds
Shifting Trends
mporary tool sentiment

SoapUI
SoapUI SoapUI is no stranger to the ATI Automation Honors awards. The tool was a st nd finalist in the 1 Annual awards, 2 Annual awards and now the 3rd Annual awards. Each of the first two years, the same thing happened to them... JMeter. Each year, SoapUI shared one or more categories with JMeter and each year, JMeter walked home with the victories. SoapUI was the proverbial bridesmaid that was never able to be the bride. Well, that has now come to an end as SoapUI earns its first Honors victory this year. With a victory in the Best Open Source Performance Test Tool Web Services/SOA subcateogy, SoapUI broke its second place streak, and finally bested JMeter; at least in one category. JMeter still won the honor in the Web subcategory and the Overall subcategory, so they still remain dominant, but the victory received by SoapUI is a definite message from the automated testing community that things are changing. SoapUI is not only making moves in the open source categories, but also makes its first appearance in the commercial categories with its commercial counterpart SoapUI Pro. SoapUI Pro was named the runner up in Web Services/SOA subcategory of the Best Commercial Functional Automated Test Tool and the Best Commercial Performance Automated Test Tool categories this year. It appears that all of the community outreach that eviware began and is now continued by SmartBear is paying off.
21
Watir
Watir Watir has again made it into the ATI Automation Honors, but it seems to be coming in very quietly. It has consistently shared a category with Selenium, which is a juggernaut in the Best Open Source Functional Automated Test Tool Web subcategory. Therefore, it is understandable that it hasnt been able to take the honor in that category. Even though it hasnt been a favorite to win, Watir was typically considered a viable alternative to Selenium. This trend seems to be changing, however. The vote tally for Watir has been steadily in decline, and Sahi has emerged as the alternative, based on its Runner-up status behind Selenium.
Perf
Commercial Performance Testing The automated testing community is clear on what its favorite commercial automated test tool is. It has been LoadRunner for years. LoadRunner has dominated all commercial performance tool subcategories like no other tool in any other category, and this trend doesnt seem as though it will change anytime soon. What the community seems a little unsure about, however, is what it would pick as its alternative to LoadRunner. Each year, the tools that come in second to LoadRunner are different. It has either been Micro Focus SilkPerformer, SmartBears AQTime or IBMs Rational Performance Tester. This fluctuation only serves the purpose of revealing that while LoadRunner is the clear current favorite, there is plenty of room for another tool to come along and be a game changer in the commercial performance tool market.
K The KIT is Coming
If you thought ATIs 2011 event was good, wait until you see 2012.
We have 203 guests online
25
l o o T e s e h T e u q i l C
The ATI Honors Awards, now in its third year, has become a standard destination for those seeking to begin a tool search with a finite list of tools. This fini list of tools has over time begun take on a life of its own, with t members of this list coalescing i distinct groups, cliques even. Thes cliques are reminiscent of those that form among school age students. Let's examine these cliques.
t s u J ls
N e w K i ds
Test Tool category introduced Telerik Test Studio and ThoughtWorks Twist. Melomel in the Flash/Flex subcategory and Twist in the Java subcategory did not take the top prize in their respective categories. Telerik Test Studio faired a little better, however, by being named runner up in both of its subcategories: Web and .NET, behind QTP and Ranorex, respectively.
Cool Kids
h ite to the into se e
Do you remember the group of kids from school that seemed to have everything working Melomel in their favor? These kids were smart, funny, popular, good at sports and anything else you could think of. They just had it all together. The tools in this group fit into this mold. JUnit, Selenium, JMeter and LoadRunner are nominated year after year, and like clockwork these tools are voted best in their respective categories. JUnit, Selenium and JMeter have proven to be staples in the Best Open Source Unit, Functional and Performance categories, respectively. LoadRunner has proven to be the most dominate tool of all, however, as it has consistently won every subcategory of the Each year, the automation community Best Commercial Performance Automated nominates a new crop of tools that make the Test category. finals, and this year is no different. Among this years new class are Hammerora, Melomel, Telerik Test Studio and ThoughtWorks Twist. Hammerora made it into the Best Open Source Performance Automated Test Tools Web and Overall subcategories. Making this list put it in good company with community favorites SoapUI and JMeter. It didnt win in either subcategory, but it definitely made the most of the exposure by submitting a video for the live awards ceremony. The Best Open Source Functional Automated Test Tool category saw Melomel enter the fold as a finalist, while the Best Commercial Functional Automated
Performance Test Tool categories, respectively, but like cfix, they continue to release updated There is definitely something to be said versions each year and get put into the finals for dependability. Every school has a group by a faithful following. of people that are not necessarily the most The commercial contribution to the popular, but are well liked by many and are Yearbook Committee includes Rational considered to be dependable. These people Functional Tester, Rational Performance Tester, often serve in groups such as the Yearbook AQTime and QuickTest Professional (QTP Committee. The ATI Honors has its Yearbook aka HP Functional Tester). QTP is obviously Committee tools that are well liked the most successful tool and can depended on to be among the RFT in this group, but failed finalists. Sometimes these tools win, to make the 2nd annual sometimes they dont, but they will awards due to not offering almost certainly be around. The open an eligible release. Upon source category Yearbook tools reentering the awards this include NUnit, cfix, RPT year, QTP failed to sweep Watir and The Grinder. all Functional categories NUnit consistently in which it was nominated makes the Unit as many expected Test Tool .NET it to. QTP is a very subcategory popular tool with a and Overall huge share in the c a t e g o r y. test tool market, While it however, is usually and it has victorious been very in the .NET successful subcategory, NUnit in the ATI fails to even come Honors. close to topping JUnit The other in the Overall category. tools have not been nearly as In the first annual awards, successful, but continue cfix finished as a runner up in the Best Open Source Unit Test Tool category, to remain competitive. RFT often shares a but hasnt come close to victory since. It has category with QTP and has not yet been able proven staying power, however, as it continues to claim the top prize. It was even bested this to put out updated versions and continues to year by new comer Test Studio in the Web make it into the finals. subcategory. AQTime has had a similar fate Watir and The Grinder have never won in the Performance category, which has been the top prize in the Functional Test Tool and totally dominated by LoadRunner.
Y e ar b oo k C o m m i t tee
T h e R i v al s
Each school has its epic rivalries. It could be two kids fighting to be the head cheerleader or jockeying for the starting quarterback position. Rivalries also come in the form of kids battling for the student In the commercial functional automated body counsel presidency. test tool realm, Certify and TestComplete In these rivalries, one side typically have been teaming up against QTP for beats and/or has a higher degree of success years. TestComplete took home a top than the other side, but what makes the prize last year, but that was during QTPs rivalry compelling is the elevated level absence due to ineligibility. This year of competition and the fact that the with QTP back (with the new name: HP losing side is constantly fighting for the Functional Tester), it was expected to be a respect they feel they deserve, and wont dominant force. Certify and TestComplete stop until they get it. A n o t h e r won victories over QTP, however, in the compelling aspect of t h e s e SAP and Java categories, respectively, they are tools to be rivalries is that the l o s i n g to prove that QTP remained at side leaves you with t h e reckoned with. the top of the impression that their heap, however, day in the sun is fast with multiple approaching. subcategory The Automation nominations Honors rivals include and multiple SoapUI, Certify and wins, including a win in TestComplete. SoapUI the Overall is the rival of JMeter, subcategory, one of the Cool but its rivals Kids, and SoapUI are working has been the Runnerto supplant it as up to JMeter for years. the top functional Finally, this year, tool. however, SoapUI put
a crack in JMeters dominance by winning the Best Open Source Performance Web Services/SOA subcategory over JMeter,. JMeter still won the Web subcategory and Overall subcategory to remain dominant, but SoapUI is definitely on the move.
29
Software Test Automation Training

www . training . automatedtestinginstitute . com Software Test Automation Foundations Automated Test Development & Scripting Designing an Automated Test Framework Advanced Automated Test Framework Development Virtual Courses Automated Test Development & Scripting Designing an Automated Test Framework Advanced Automated Test Framework Development
Training Thats Process Focused Yet Hands On
Public Courses
Come participate in a set of test automation courses that address both fundamental and advanced concepts from a theoretical and hands on perspective. These courses focus on topics such as test scripting concepts, automated framework creation, ROI calculations and more. In addition, these courses may be used to prepare for the TABOK Certification exam.
Public and Virtual Training Available

K The KIT is Coming
Fall 2012
31
VerifyATI revisited
parts: tutorials and core conference sessions and several keynote sessions. First, the conference offered full-day training sessions. Then, the core conference package offered a variety of track sessions organized into the following six tracks: Test Automation (TA) Testing Techniques (TT) Automated Tools & Implementation (AT) Agile, Environment & Methodologies (AG) Performance Testing & Security (PS) Virtualization & The Cloud (VC)
he Verify/ATI 2011 conference was held from September 26 28 in Arlington, VA, and was a collaborative effort between an organization known as Verify and the Automated Testing Institute (ATI). The result was an event that was hugely successful by all accounts (we may be a little biased, though). The Verify/ATI took elements from previous events held by Verify and combined them with ATIs style, quality and focus on all things test automation to produce an event that rivals any other testing conference currently being conducted. This assertion is supported by the strength of the schedule, stature of the participants, and the overall structure of the event. The conferences content was delivered in three distinct
While two-thirds of the tracks TA, AT, PS, VC were distinctly focused on test automation, all tracks
tools. Virtualization & The Cloud, much like the PS track, is also inherently related to tools in the fact that the cloud is an abstracted layer of hardware and software in which to conduct computing activities. The Testing Techniques and Agile, Environments & Methodologies address more general testing activities and approaches for testing, but are not totally exempt from test automation topics.
From the highly informative keynote sessions, forum discussions and the first ever live ATI Automation Honors awards ceremony, this conference was the complete package.
offered content that addressed contemporary practical test automation concepts and approaches in one form or another. The Test Automation track, the first that is wholly dedicated to test automation, focuses on important concepts associated with the successful implementation of test automation. The second test automation centered track Automated Tools & Implementation has a more technical bend as it focuses on specific tools and how those tools may be built and/or used. The third test automation specific track was the Performance Testing & Security track. This track obviously focused on load/performance testing and security concepts, which may often be applied through manual means, but are typically applied through the use of
With four tracks dedicated to test automation and tools, though, there was an abundance of content for test automation practitioners to choose from, content that was delivered by high-profile professionals including Linda Hayes, Dorothy Graham, Bob Galen, Ole Lensmar, Elfriede Dustin, Dion Johnson and Dan Bartow to name a few. In addition to the tutorials and concurrent sessions, there were plenty of other offerings that rounded out the event nicely. From the highly informative keynote sessions, forum discussions and the first ever live ATI Automation Honors awards ceremony, this conference was the complete package.
Automated Software Testing Magazine 33
5
5
Top
the sessions that made the list and gain some insight into why the participants loved them so much.
A
1
ll of the VerifyATI presentation were fantastic. The attendees have spoken, however, and through their evaluations, they have ranked the top 5. Check out
Getting it Right the First Time: How Evaluate a Test Automation Tool
to
Presentations
VerifyATI
Nick Olivo of SmartBear offered a presentation entitled Getting it Right ick the First Time: How to Evaluate a Test Automation Tool. In this presentation, Olivo provided a set of guidelines for performing a thorough evaluation of automated testing software. He offered key questions to ask when performing an automated test evaluation such as, Presenter: Nick Olivo Is the test application Title: Getting it Right the First Time: obfuscated?, How How to Evaluate a Test Automation Tool does the tool handle Track: Automated Tools & Implementation errors?, How big is the user community, and Does the tool have a scripting component? He also offered a warning about the ideological extremes in test automation. There are those that think of automation as a silver bullet and then there are those that say automation is snake oil. Olivo suggested that these two attitudes can really hurt your automation efforts if you dont address them early in your automation implementation.
There are those that think of automation as a silver bullet and then there are those that say automation is snake oil. Olivo suggested that these two attitudes can really hurt your automation efforts if you dont address them early in your automation implementation.
Production
Performance from and for the Cloud
Testing
The Role of Testers and Automators in Test Automation
Test
Performance and cloud computing were already hot an topics, but Dan Bartow came to our conference and made it even hotter. He framed the discussion in a pitch perfect way by first explaining the fact that d i f f e r e n t organizations Presenter: Dan Bartow place different Title: Production Performance Testing definitions on From and for the Cloud performance Track: Performance Testing & Security testing, a point that he chalks up to the fact theres typically no clear owner in the enterprise for performance of a site. Responsibility, he explains, is shared between software development, marketing and IT. IT focuses on performance from a capacity perspective, marketing from a page response time perspective (using products such as Keynote and Gomez receive alerts if the site is down or pages are loading slowly), and software development (who usually focuses on testing before the go-live date).
There is a view that testers must orothy be technical (i.e. have programming skills), especially if they are involved in test automation. Dorothy Graham takes umbrage with that assertion, because, while she believes technical skills are a positive for Presenter: Dorothy Graham testers to have, Title: The Role of Testers and Test they are not a Automators in Test Automation prerequisite.
Bartow then goes on to explain the varying views that people have on cloud computing. He indicates that his mother-in-law thinks that cloud computing is a place for her to store her pictures; a view that originates from commercials on TV. Software engineers, Bartow says, think of cloud computing as infrastructure-asa-service, software-as-a-service or platform-as-aservice. Then upon providing the three basic tenants of cloud computing - accessibility, affordability and availability - he delves into defining these terms, identifying key cloud tools and talks about how to implement a cloud-based infrastructure.
Graham supports her stance in this presentation by describing the skills associated with testers in contrast to the skills associated with being an test automator. Those working directly with the automated test tool do need to be technical, according to Graham. They need to be able to effectively use test tools for designing testware as well as developing and debugging automated tests. Automators also aid testers in analyzing results, and providing utilities that aid in otherwise testing activities. Graham also discussed how these skills do not necessarily need to reside in someone who is also a manual tester. Testers not directly working with the automated tools will employ the skills of defining test objectives, designing the test, determining what tests should be automated, identifying what tests should be executed at which times, and then running the automated tests. In addition, they analyze the test results following a run. Graham further drives home the point by repeating a borrowed assertion that if you make a tester an automator, you may in fact lose a good tester and gain a poor programmer.
Track: Test Automation
He indicates that his mother-in-law thinks that cloud computing is a place for her to store her pictures.
Practical Threat Modeling - Getting

QA to Engage Early In The Development Process
CPUT: Combinatorial-Based Prioritization for User-Session-Based Testing of Web Applications
Edward
Presenter: Edward Bonver Title: Practical Threat Modeling Getting QA to Engage Early In The Development Process
Internal security consultant, Edward Bonver, offers some live security guidance as he delivers his presentation on threat modeling, and reveals how QA can participate more in activities that go beyond functional testing of binaries.
Bonver defined threat modeling as the process of Track: Performance Testing & Security assessing and documenting a systems security risks, ranking those risks and coming up with risk mitigations. Bonver began with a house analogy that is fairly common place in the realm of security testing. He asked attendees to identify points of entry in a house that a burgler may use. After naming places such as doors, windows and chimney, the attendees were surprised as Bonver revealed images of a ventilation system, someone punching through the wall and breaking through the ceiling. He impressed upon the participants the importance of thinking beyond the obvious when performing threat modeling. Next, Bonver goes a little more in-depth by discussing the different components of the threat modeling process, which included: drawing a threat model diagram, analyzing the model, calculating risks using the Common Vulnerability Scoring System (CVSS) and adding plan mitigations.
Sreedevi Sampath of the University of Maryland B a l t i m o r e County (UMBC) provides some of his university knowledge to the conference attendees in the area of prioritization. Sampath revealed test prioritization Presenter: Sreedevi Sampath to be a regression Title: CPUT: Combinatorial-Based testing technique Prioritization for User-Session-Based where tests are Testing of Web Applications ordered for Track: Automated Tools & Implementation execution in a manner best suited for quickly finding bugs in the application. He revealed the role that test case prioritization plays in software maintenance and regression testing, where a large number of tests accumulate over time from previous versions of the system, particularly as it relates to user-session-based testing of web applications, where field usage data is logged and converted into test cases. Sampath goes on to explain the test prioritization criteria which includes combinatorial-based criteria and count-based criteria. Then he spends the remainder of the presentation describing the make-up and use of the CPUT tool for effectively combinatorial-based prioritization for user-session based testing of web applications.
He indicates that his mother-in-law thinks that cloud computing is a place for her to store her pictures.
ATI Automation Honors Live D

orothy
The ATI Honors were held live at the VerifyATI 2011 conference this year, and with that, many test automation notables came out to participate. Below are images of some of some of the live and virtual speeches offered by nominees and winners.
1
2
Ole Lensmar of SmartBear live acceptance speech for Honors winner SoapUI. Ole said it came as a surprise, but thanked the user community Nick Olivo of SmartBear live acceptance speech for Honors winner TestComplete. After thanking the end-user community he also thanked the academy. Very funny, Nick! Aj Alhait of Betasoft, Inc. virtual acceptance speech for Honors winner SQAforums. He says its great to have SQAForums reccognized by the community.
Steve Shaws virtual speech in response to Hammerora nomination. He says hes delighted that ATI is recognizing open source tools, and honored to be nominated. George Mackintosh of Test Plant responses virtually to eggPlant nomination. He says hes delighted to have been short-listed.
5 6
LoadRunner architect virtual acceptance speech for Honors winner LoadRunner. He thanks ATI and the community for the recognition. Special Edition 2011 www.automatedtestinginstitute.com Automated Software Testing Magazine 37
Dan Levy speaks abou

Dan
Levy
Interview with a
Speaks With
Jeff
Perlin
later, satisfied I made a wonderful decision. What is it about software testing, and most particularly automated software testing that you find most challenging and rewarding? The rewarding part is easy to answer automation is fun for me. I enjoy being able to tap into my creative side to craft tests that will be reused for years to come. Its also rewarding to be part of a team that is changing the landscape of test automation the definition of rewarding (for me) is hearing customers make statements such as How did I not know about this tool before? and Do you have any idea how much better my life just got? I think many of the challenges are in the planning of test cases its critical to understand that this is a tool that can help automate good test cases and improve software quality. This tool can also automate bad test cases (bad input= bad output) while this should be obvious, thats not always the case. We recently brought on board a testing evangelist, Jim Holmes who is traveling the globe evangelizing testing best practices, its a real win for one
Interview
Frequent ATI contibutor Jeff Perlin speaks with Daniel Levy of Telerik about the company and its award winning TestStudio tool.
Perlin
Id like to start off by asking you about your background, and how you ultimately ended up working for Telerik as a Solutions Consulting for their testing division? Ive been in the software industry for about 15 years, holding a variety of positions from Technical Support Engineer to Director of Technical Services. Prior to joining Telerik in June 2010, I wore many hats as the Director of Technical Services for a medium sized SaaS company. My responsibilities spread the gamut from Product Management to Testing and just about everything in between. During my tenure, we implemented many of the ASP.NET AJAX controls from Telerik and were very impressed with both the product and level of service we received from Telerik. When I decided to take my career to the next level, my resume went to just 3 companies that I personally sought out and here I am today, 16 months
Perlin
Levy
Levy
ut Telerik
Finalist
Levy
Honors Winner
of the biggest challenges we face. Several automated functional regression testing tools were pretty well-established and had a dedicated user base prior to the introduction of Test Studio (formerly WebUI Test Studio). Investing time and energy introducing a new automated testing tool seems pretty risky. What were the catalysts that made Telerik decide to enter an already well-entrenched tool market? I can understand that at first glance, this could be viewed as risky, but its important to understand that Test Studio was created because there was a clear need for innovation in the testing industry. Prior to the release of Test Studio, quality professionals would have no choice but to settle with the existing tools available these were tools that at the time could not test basic web 2.0 sites that were AJAX / JavaScript heavy and to date do not handle web technologies and RIA (rich internet applications) as elegantly as Test Studio. When you analyzed the available tools on the market what were some of the shortcomings you had identified, and what was your strategy to overcome them?
Perlin
As I just touched on, AJAX and JavaScript heavy web applications were being overlooked. We saw a window of opportunity to displace some of the legacy testing solutions. Another shortcoming in the testing market was the ability to craft powerful scripts without the need to write code. We set out to make an automation solution that was incredibly powerful, yet easy enough for manual testers to pick up and be immediately productive. This is an important concept since many corporations have adopted an agile approach to software development. The transition to agile was / is particularly concerning to manual testers who see many of the existing tools available and wonder what a non-coders place is within their transitioning agile team. What was your approach for mapping out a plan to design and introduce a new tool? Did you pulse the automated test engineering community to help form this strategy? We analyzed what we did and didnt like about the state of the automated testing industry and determined that the existing tools were expensive and too complicated. So we tackled both of these. A Test Studio license comes with two different versions of the tool (the standard and developers edition). What made you decide to take this approach? This approach is all about collaboration By allowing testers to work in an environment that is most comfortable to them, and giving developers the option to remain within their IDE everyone is more productive.
Automated Software Testing Magazine 39
Perlin
Levy
Levy
Perlin
Perlin
Levy
Lets say you have an edge-case scenario that requires a small amount of scripting your test team can craft the test case in the stand-alone edition of Test Studio, then pass the project via source control to a developer who never needs to leave Visual Studio to put the finishing touches on the test case. This approach will keep the test in a maintainable state for the test team. Its a win-win situation that fosters collaboration between testers and developers, an important fundamental in agile development. Currently the tool is designed to test webbased and WPF applications. Are there any plans to expand capabilities in the future which will enable Test Studio to interact well with other popular technologies? Without getting into too much detail, I can confidently say YES. Our team is hard at work developing for new technologies with the same level of innovation that the testing marketing is so eager to have. We are very excited about whats to come with Test Studio, I truly wish I could share the details dont worry though; the wait will not be long! Test Studio is one on of the few tools that truly allow test engineers with no coding experience to design effective automated tests that do not have the common maintenance problems associated with other tools that have Record & Playback functionality available. Was this one of the main goals that Telerik had in mind when initially planning out the tool? Yes indeed We set out to make the tool that is easy to use for non-technical manual testers, yet provides the power and flexibility that seasoned automation engineers can appreciate. At the end of the day, productivity is boosted significantly thus ROI is realized faster. Test Studio recently added performance testing capabilities to the latest version. Being that this is newly added functionality, what are some of the plans to expand upon these capabilities? For example, the current version provides useful information, but does not have the capability to simulate load. Will this be addressed? Great question! Load testing is indeed coming. Before bringing load testing to the market, we first wanted to build a solid foundation that allows you to take a functional test and quickly gather detailed
performance data on. Now that this has been tackled, its time for load testing can be added into. What are some of the other enhancements that Telerik has included in its roadmap for future Test Studio versions? Again, I have to refrain to disclosing too much, but think big, think easy to use, and think end-toend testing solution. Its just been announced that Test Studio has won 2nd place in a number of categories at this years Automated Software Testing Instituted Honors. Thoughts on this? While we are honored to have received 2nd place, we are driven to succeed, we are innovating and we are getting the word out. Our users love what we are doing and I hope by this time next year, you will be asking us our thoughts on a first place clean sweep.
Perlin
Levy
Perlin
Perlin
Levy
Levy
Perlin
Perlin Levy
Any closing comments?
Jeff, I really appreciate you taking the time to talk to me today. Id encourage anyone reading this to take a look at Test Studio we have a free, fully supported 30-day trial try it out and let us know what you think!
Levy
Contribute Content Today

Community Comments Box Announcements & Blog Posts
Perlin
Automation Events
Levy
Learn more today at

http//www.about.automatedtestinginstitute.com
http://www.googleautomation.com
We have 203 guests online
43
K The KIT is Coming
Fall 2012

Automated Software TestingMagazine - Special 2011 PDF

Uploaded by

Document Information

Original Title

Copyright

Available Formats

Share this document

Share or Embed Document

Sharing Options

Did you find this document useful?

Is this content inappropriate?

Copyright:

Available Formats

Automated Software TestingMagazine - Special 2011 PDF

Uploaded by

Copyright:

Available Formats

An AUTOMATED TESTING INSTITUTE Publication - www.automatedtestinginstitute.

The Winner Is...

Annual ATI Automation Honors

K The KIT is Coming

Verify/ATI 2011 Coverage

Annual ATI Automation Honors

3rd Annual ATI Automation Honors Coverage

Contemporary tool sentiments revealed by the ATI Automation Honors results.

These Tools Just Clique

ATI Automation Honors Live Interview With a Finalist

ATI contributor Jeff Perlin interviews Dan Levy, representative of Telerik.

Columns & Departments

Automated Software Testing Magazine

Software Test Automation Training

Training Thats Process Focused Yet Hands On

Are You Contributing Content Yet?

Community Comments Box

Announcements & Blog Posts

Learn more today at http//www.about.automatedtestinginstitute.com

Authors and Events

CONTACT US AST Magazine astmagazine@automatedtestinginstitute.com ATI Online Reference contact@automatedtestinginstitute.com

ATI and Partner Events

Automated Software Testing Magazine

Special Edition 2011

ATI Automation Honors

Special Edition 2011

Automated Software Testing Magazine

Annual ATI Automation Honors

ioneers honoring the best tools and

10 Automated Software Testing Magazine

Special Edition 2011

Special Edition 2011

Automated Software Testing Magazine

Im [delighted] that the Automated Testing Institute recognizes open source.

12 Automated Software Testing Magazine

Special Edition 2011

Automated Software Testing Magazine

14 Automated Software Testing Magazine

Special Edition 2011

16 Automated Software Testing Magazine

Best Automation Online Resources

Special Edition 2011

For more information, visit http://www.networking.automatedtestinginstitute.com

the ATI Honors reveal comtem

20 Automated Software Testing Magazine

Special Edition 2011

mporary tool sentiment

Special Edition 2011

Automated Software Testing Magazine

K The KIT is Coming

24 Automated Software Testing Magazine

Special Edition 2011

We have 203 guests online

Special Edition 2011

Automated Software Testing Magazine

h ite to the into se e

28 Automated Software Testing Magazine

Special Edition 2011

Special Edition 2011

Automated Software Testing Magazine

Software Test Automation Training

Training Thats Process Focused Yet Hands On

30 Automated Software Testing Magazine