Tanja Vos

Open Universiteit and
Universitat Politècnica de València

‘Testing without requirements?’

Good requirements are the basis for high quality software. However, in industrial practice, the availability of decent requirements are still more an exception than common practice. One of the activities, the quality of which depends highly on requirements, is testing. Testing software systems without requirements can lead to unstructured testing that cannot give good insights into the quality of the System Under Test (SUT). We propose a completely different way of testing, that starts from having no requirements documented and will build up a test-suite and requirements while we test. For this we will present TESTAR, a tool for automated testing at the user interface level. TESTAR is different from existing approaches for testing at the user interface in that it does not need scripts nor does it generate scripts. TESTAR just tests on the fly looking for faults. TESTAR has predefined oracles that can automatically test general-purpose system requirements. To make TESTAR test specific requirements we need to refine these oracles and direct the tests. This can be done incrementally while we are already testing! In the keynote we will describe this approach and explain the future need of a test tool that learns itself what the best strategy is for testing.


Prof. Dr. Tanja Vos is a full professor at the Open University (Netherlands) and an associate professor at the Universitat Politècnica de València (Spain). For over 20 years she has been teaching and researching in the area of software testing. She has worked with many companies on automated testing projects in an industrial setting. She is currently project lead for the approach for automated testing at the Graphical User Interface level. Tanja has successfully coordinated EU-funded projects (FITTEST, EvoTest) related to software testing and has been involved in various Erasmus and Leonardo initiatives that try to help business understand academia an vice versa. She started the Software Testing Innovation Alliance in Spain and is now involved in the European Alliance. She is also part of the dutch consortium of the ITEA TESTOMAT project that started this year. A project that will research and develop the coming three years the next level of test automation.