Functional Testing Tools

The need for acceptance testing has become too important to our product and is now included in our automated build environment (more info on automated build environment here). While Test Driven Development (TDD) does produce good quality on the specification of the requirement from the component side, it doesn’t adequately target “how the system” should act from the end user perspective. There’s a lot of UI specific tests that need to be performed on the views to ensure that the correct functionality is doing what it was intended to do. In an agile development environment, like Extreme Programming, these black box system tests are known as functional tests which tests the validity of a user story; as opposed to unit test which tests the verification of a specification (written TDD test-first style in our office, which helps but are still from the point of view of the developer). On the other hand, functional tests can be written by testers, business analyst or the developers, but since they are from the perspective of the end user, or subject matter expert, they are best written (or at least specified) by the business analyst. During the teams research we wanted to find a tool that can be integrated into our environment as well as easy enough for a business analyst to write.

Here’s a resource to the 4 testing quadrants as identified by Janet Gregory. Image taken from http://agilevancouver.ca/sites/agilevancouver/files/speakerslides/Vancouver-Quadrants.pdf

agile testing quandrants

 

 

Here’s a list of functional testing tools identified by Gerard Meszaros and added to by others in the industry . These functional testing tools focus mainly on the 2nd Quadrant above.

The one I am currently trying out iTest2, basically uses Watir under the hood but includes a nice IDE (actively being developed) and an abstraction on top of Watir called RWebSpec. It’s easy enough for the business users to add functional tests (especially if they’re using the recorder), but complex enough for when the developers/testers need to access to the COM interfaces which gets at the browser’s document object model, DOM, without need for directly interfacing with the UI. So far this tool is starting to prove itself but we’ll need more time to see if it is the most effective one out there.

Things still left to do:

  • Include functional tests as part of our story breakdown planning and estimating process (Example here and they can act as requirements artifacts/documentation).
  • Try out StoryTeller as a solution to automated acceptance testing in .NET.
  • Assess how we’re doing in the 4 testing quadrants (above), then alleviate any shortfalls.
  • Figure out how the database gets loaded with information from our functional tests and how tests can be independent from each other (test servers, scripts).
  • Move to a better functional testing as compared to plain old record/playback because it can become cumbersome to maintain.
  • Stay on top of software testing as the advancements in this area are changing daily http://www.testingreflections.com/

18 thoughts on “Functional Testing Tools

  1. I feel strongly about it and love learning more on this topic. If possible, as you gain expertise, would you mind updating your blog with more information? It is extremely helpful for me.
    I am very enjoyed for this side. Its a nice topic. It help me very much to solve some problems. Its opportunity are so fantastic and working style so speedy. I think it may be help all of you. Thanks.UGG Outlet
    UGGS Outlet
    UGG Boots Sale UK

  2. where Sarah ボッテガヴェネタ バッグ Sarah was found on Sunday by a chanel brooch a SWAT team. The girl was bound <h3>ferrari watches</3h> bound and gagged
    in Hoffman’s basement in chanel財布 in rural Mount Vernon, Ohio.Barber said he <h2>ボッテガヴェネタ バッグ</2h> he believed the victims were killed in chanel財布 in their blood-splattered
    house in Howard, Ohio, グッチ トートバッグ Ohio, about 10 miles from where Hoffman <h2>replica tiffany jewellery</2h> Hoffman lived. The sheriff said Sarah was トート バッグ 通販 was also at
    home at the time, ferrari watches time, but wouldn’t say whether she witnessed imitation rolex watch witnessed the killings.Hoffman is a 31-year-old drifter replica tiffany jewellery drifter who had

  3. It’s possible to get the story about custom essay and about this good post in our world. But before people order the custom essays, they have to detect the reliable essay writing service.

  4. All the time, different guys, which need the buying term papers essays, don’t actually know the best way to find it. But it will be possible to buy custom essay at the experienced persuasive essay writing service. This is a common option for some people.

  5. University studying process requires perfect writing skills, but, college students, which don’t have time can destroy their career. Therefore, to buy the definition essay at the narrative essay writing service could be a good solution.

  6. Selecting buy dissertation service and just the custom thesis, some people can’t discover a kind of the best example thesis just about this good post.

  7. I can be sure that custom term papers at the essay writing service include no grammar errors. Moreover, I can trust academic papers writing companies because my fellow are employed by them!

  8. Whenever you buy at wholesale prices blossoms, an individual instantaneously acquire several benefits. One profit is price. As stated, you don’t need to to think about spending a fortune UGG Roxy about blossoms your current for the UGG Elsey Boots special occasion. After you acquire from suppliers merchandise, anyone normally achieve lower price. This is true for plants because it is almost anything different. An additional is that your bouquets tend to be new and also energetic. There’s no better Lacoste Belts provide than a good, colorful, and radiant bride’s bouquet regarding wholesale cut bouquets sent to from a respected service provider * particularly MBT FUABA Shoes when you do St Louis Cardinals Caps have a large selection to choose from.

Comments are closed.