Enhancing the Testability of Web Services

Enhancing the Testability of Web Services

Daniel Brenner (University of Mannheim, Germany), Barbara Paech (University of Heidelberg, Germany), Matthias Merdes (Heidelberg Mobil International GmbH, Germany) and Rainer Malaka (University of Bremen, Germany)
Copyright: © 2009 |Pages: 22
DOI: 10.4018/978-1-60566-042-4.ch010
OnDemand PDF Download:


For the foreseeable future, testing will remain the mainstay of software quality assurance and measurement in all areas of software development, including Web services and service-oriented systems. In general, however, testing Web services is much more challenging than testing normal software applications, not because they are inherently more complex, but because of the limited control and access that users of Web services have over their development and deployment. Whereas the developers of normal applications, by definition, have full control over their application until release time, and thus, can subject them to all kinds of tests in various combinations (e.g., integration testing, system testing, regression testing, acceptance testing, etc.), users of Web services can often only test them at run-time after they have already been deployed and put into service. Moreover, users of Web services often have to share access to them with other concurrent users. In order to effectively test Web services under these conditions special measures and approaches need to be taken to enhance their testability. Right from the early phases of development, the testability of services needs to be taken into account and “designed into” services. In this chapter we consider these issues and with the aid of a case study we present a methodology that can be used to enhance the testability of Web services.
Chapter Preview


Service-oriented development is based on the idea of building new software applications using software “services,” often built and deployed by third party organizations. It therefore assumes a fundamental separation of concerns between service developers, who create and offer services with no knowledge of specific applications to which they may be put, and service users, who assemble new applications which use the services available on the Internet or in a company’s Intranet.

Since they are themselves software applications, services are typically developed and tested using the same basic practices and techniques used to develop normal software applications, and as a result, they can be expected to exhibit the same levels and variations in quality found in the general population of software applications. However, in service-oriented development, the quality of a service-based application is not just based on the inherent quality of the services it uses, it is also dependent on whether they are used or assembled in the correct way. A system assembled from perfectly correct services may still function incorrectly if it uses the services in a different way to that intended; in other words, if the system’s understanding of its contract with a service is different to the service provider’s.

This problem exists in all component-based approaches whenever a new application is created from prefabricated parts. However, the situation is more acute in service-based development because service users have much less access to, and control over, their components than in regular component-oriented development approaches using such technologies as EJB, SPRING, or .NET. If the developers are creating all of their own components in-house, they can test larger assemblies of components while the development process is underway (integration testing). And even when some of the components are purchased from a third party, once the first version of the system has been completed they can still often test the full system under controlled conditions in the development/test environment (system testing). Finally, once a traditional component-based system has been delivered to the customer, it can be further tested in the customer’s target environment to determine whether it fulfils the customer’s needs (acceptance testing) before being made accessible to end users.

In general, none of these traditional testing activities can be carried out in the normal way when developing a service-oriented system, however. First, the final collection of “components” that make up an application is typically not known until deployment-time, making full integration and system testing in the traditional form impossible. Second, many of the “components” may already provide services to other users, and cannot be shut down even temporarily to participate in traditional testing activities in a controlled environment. A new application will often have to share its components with other applications and cannot assume that these will cooperate while it is in testing mode.

Although subtle, these differences have a fundamental impact on the role and goals of testing in the system development process. Because services are in effect independent, multiuser systems in their own right, new applications have to test them at run-time in a way that combines acceptance testing with integration and system testing. In other words, tests of “components” by applications can no longer be regarded as a pure verification exercise, as has traditionally been the case, but must also include an element of “validation” (Boehm, 1984). An application that is connected to a new service at run-time needs to determine whether the service does the “right thing,” just as much as it needs to determine whether it does that thing “right.”

Building services so that they can be tested in this way requires changes to the way they are traditionally designed and the way that tests are carried out. The purpose of this chapter is to discuss these changes and to present a methodology intended to improve the testability of services. Testability characterizes how easy it is to test a system based on the information provided by it (Voas & Miller, 1995). In the next section we discuss some of the main issues involved in testing services, and describe the basic principles behind the approach. In Section 2 we explain how the basic functionality of services can be modelled in a practical way using UML, and then in Section 0 we explain how services can be extended to enhance their testability. In the following three sections we then consider how to use these enhanced services to design and apply run-time tests. Finally, in Section 0 we round up with some concluding remarks.

Complete Chapter List

Search this Book:
Table of Contents
Torbjørn Skramstad
Khaled M. Khan
Khaled M. Khan
Chapter 1
Ghita Kouadri Mostefaoui
The ultimate effectiveness in terms of quality achievements should be a key concern of systems built from Web services. To this end, in this chapter... Sample PDF
The Development, Testing, and Deployment of a Web Services Infrastructure for Distributed Healthcare Delivery, Research, and Training
Chapter 2
Abdelghani Benharref, Mohamed Adel Serhani, Mohamed Salem, Rachida Dssouli
Web services are a new breed of applications that endorse large support from main vendors from industry as well as academia. As the Web services... Sample PDF
Multi-Tier Framework for Management of Web Services' Quality
Chapter 3
Krishna Ratakonda
In this chapter we present an overview of research and development efforts across several different technical communities aimed at enabling... Sample PDF
Quality Models for Multimedia Delivery in a Services Oriented Architecture
Chapter 4
Julio Fernández Vilas
Several open issues in Web services architecture are being solved by using different kinds of solutions. Standard high-availability techniques based... Sample PDF
Virtual Web Services: Extension Architecture to Alleviate Open Problems in Web Services Technology
Chapter 5
Witold Abramowicz
The following chapter focuses on the problem of the proper definition of non-functional properties and methods that may be applied in order to... Sample PDF
Profiling of Web Services to Measure and Verify their Non-Functional Properties
Chapter 6
Kyriakos Kritikos
As the Web service (WS) paradigm gains popularity for its promise to transform the way business is conducted, the number of deployed WSs grows with... Sample PDF
Enhancing the Web Service Description and Discovery Processes with QoS
Chapter 7
Michael C. Jaeger, Matthias Werner
This chapter presents the definition of relevant terminology and a conceptual model of the basic terms. The chapter starts with the presentation of... Sample PDF
Web Services Dependability
Chapter 8
Frederic Montagut, Refik Molva, Silvan Tecumseh Golega
Composite applications leveraging the functionalities offered by Web services are today the underpinnings of enterprise computing. However, current... Sample PDF
Transactional Composite Applications
Chapter 9
Enrico Pontelli, Tran Cao Son, Chitta Baral
This chapter presents a comprehensive logic programming framework designed to support intelligent composition of Web services. The underlying model... Sample PDF
A Logic Programming Based Framework for Intelligent Web Service Composition
Chapter 10
Daniel Brenner, Barbara Paech, Matthias Merdes, Rainer Malaka
For the foreseeable future, testing will remain the mainstay of software quality assurance and measurement in all areas of software development... Sample PDF
Enhancing the Testability of Web Services
Chapter 11
Ghita Kouadri Mostefaoui, Zakaria Maamar, Nanjangud C. Narendra
This chapter presents our research initiative known as aspect-oriented framework for Web services (AoF4WS). This initiative looks into the role of... Sample PDF
Aspect-Oriented Framework for Web Services (AoF4WS): Introduction and Two Example Case Studies
Chapter 12
Ty Mey Eap, Marek Hatala, Dragan Gaševic, Nima Kaviani, Ratko Spasojevic
The lack of intrinsic and user control in the identity management of today Internet security hampers the research in the area of Semantic Web and... Sample PDF
Open Security Framework for Unleashing Semantic Web Services
Chapter 13
Vishal Dwivedi
This chapter underlines the importance of security service level agreements (SLAs) for Web services. As Web services are increasingly incorporated... Sample PDF
Providing Web Services Security SLA Guarantees: Issues and Approaches
Chapter 14
Fatih Oguz
This chapter describes a research study with an objective to explore and describe decision factors related to technology adoption. The study... Sample PDF
Adoption of Web Services in Digital Libraries: An Exploratory Study
Chapter 15
Bijoy Majumdar
Change is the only constant, and this concept holds good for services too. Service maintenance is the most tedious and longest phase of service... Sample PDF
Service Evolution and Maintainability
Chapter 16
Pauline Ratnasingam
This chapter aims to examine the extent of Web services usage and quality, applying the balanced scorecard methodology in a small business firm as... Sample PDF
The Role of Web Services: A Balance Scorecard Perspective
About the Contributors