Showing papers on "Cloud testing published in 2006"

Realistic load testing of Web applications

Abstract: We present a new approach for performing load testing of Web applications by simulating realistic user behaviour with stochastic form-oriented analysis models. Realism in the simulation of user behaviour is necessary in order to achieve valid testing results. In contrast to many other user models, Web site navigation and time delay are modelled stochastically. The models can be constructed from sample data and can take into account effects of session history on user behaviour and the existence of different categories of users. The approach is implemented in an existing architecture modelling and performance evaluation tool and is integrated with existing methods for forward and reverse engineering.

The deployment production line

Abstract: Testing and deployment can be a difficult and time-consuming process in complex environments comprising application servers, messaging infrastructure and interfaces to external systems. We have seen deployments take several days, even in cases where teams have used automated builds to ensure their code is fully tested. In this paper we describe principles and practices which allow new environments to be created, configured and deployed to at the click of a button. We show how to fully automate your testing and deployment process using a multi-stage automated workflow. Using this "deployment production line", it is possible to deploy fully tested code into production environments quickly and with full confidence that you can fall back to a previous version easily should a problem occur.

A Framework for Service-Oriented Testing of Web Services

Abstract: Testing Web Services (WS) application systems is difficult and expensive. It imposes great challenges to existing testing methods, techniques and tools. This paper analyses the problems in testing WS applications and proposes a service oriented framework to solve the problems. It enables collaborations between various parties involved in the development of WS applications via service request and service providing. It also enables special testing services to be provided as WS to perform testing tasks on behalf of their customers. The key technical issues of the approach are discussed.

Performance Measurements of Web Services-Based Applications

Abstract: Testing of Web services is very different when compared with desktop software testing. Scalability and performance are the most important characteristics for evaluating a Web service application. In this paper, the methodology for testing the scalability and performance of a specific Web services application is presented, and the results of the testing are analyzed

Testing web applications

Abstract: Traditional testing techniques are not adequate for web-based applications, since they miss their additional features such as their multi-tier nature, hyperlink-based structure, and event-driven feature. Limited work has been done on testing web applications. In this paper, we propose new techniques for white box testing of web applications developed in the .NET environment with emphasis on their event-driven feature. We extend recent work on modeling of web applications by enhancing previous dependence graphs and proposing an event-based dependence graph model. We apply data flow testing techniques to these dependence graphs and propose an event flow testing technique. Also, we present a few coverage testing approaches for web applications. Further, we propose mutation testing operators for evaluating the adequacy of web application tests.

Model driven benchmark generation for web services

Abstract: Web services solutions are being increasingly adopted in enterprise systems. However, ensuring the quality of service of Web services applications remains a costly and complicated performance engineering task. Some of the new challenges include limited controls over consumers of a service, unforeseeable operational scenarios and vastly different XML payloads. These challenges make existing manual performance analysis and benchmarking methods difficult to use effectively. This paper describes an approach for generating customized benchmark suites for Web services applications from a software architecture description following a Model Driven Architecture (MDA) approach. We have provided a performance-tailored version of the UML 2.0 Testing Profile so architects can model a flexible and reusable load testing architecture, including test data, in a standards compatible way. We extended our MDABench [27] tool to provide a Web service performance testing "cartridge" associated with the tailored testing profile. A load testing suite and automatic performance measurement infrastructure are generated using the new cartridge. Best practices in Web service testing are embodied in the cartridge and inherited by the generated code. This greatly reduces the effort needed for Web service performance benchmarking while being fully MDA compatible. We illustrate the approach using a case study on the Apache Axis platform.

A Multi-Agent Framework for Testing Distributed Systems

Abstract: Software testing is a very expensive and time consuming process. It can account for up to 50% of the total cost of the software development. Distributed systems make software testing a daunting task. The research described in this paper investigates a novel multi-agent framework for testing 3-tier distributed systems. This paper describes the framework architecture as well as the communication mechanism among agents in the architecture. Web-based application is examined as a case study to validate the proposed framework. The framework is considered as a step forward to automate testing for distributed systems in order to enhance their reliability within an acceptable range of cost and time.

A Tool to Support Automated Testing for Web Application Scenario

Abstract: Web applications are becoming increasingly complex and important for companies. Their development, including analysis, design, and testing, needs to be approached by means of support tools. There are some tools provided to support analysis and design. However, few tools are provided to directly support the software testing on Web-based applications. In this paper, a software tool, named WASATT (Web application scenario automated testing tool), is proposed to support the automated testing for scenario of Web-based applications. Testers can create or ask analyst to create extended activity diagram model, which extends the semantics of UML standard activity diagram and can precisely express functional scenario of web applications. Then the extended activity diagram model can be transformed to testing code based on HttpUnit by WASATT. The tool can elevate the automated level of functional testing for Web applications.

An Abstract Model for Testing MVC and Workflow Based Web Applications

Abstract: In this paper, we examine the classes of faults found in web applications that use development frameworks based on the MVC design pattern and the workflow paradigm. Our findings reveal opportunities to adapt state-based and code-based testing methodologies to test these faults. To support our proposed testing methodology, we propose an abstract workflow graph model and show, using an example, how state-based testing as well as structural-based testing methodologies can be applied to test MVC and workflow-based web applications.

Cost-effective techniques for user-session-based testing of web applications

Abstract: Increased use of web-based applications by businesses, government and consumers to perform their daily operations has led to the need for reliable, well-tested web applications. A short time to market, large user community, demand for con tinuous availability, and frequent updates motivate automated cost-effective testing strategies. One promising approach to testing the functionality of web applications leverages user-session data collected by web servers. This approach, called user-session-based testing, avoids the problem of generating artificial test cases by capturing real user interactions---rather than tester interactions---and utilizing the user sessions as representative of user behavior. The user sessions provide test data not anticipated during initial stages of testing. User-session-based testing focuses testing on parts of the application frequently used by the user. However, test preparation and execution quickly become impractical with a large number of captured sessions, which is typical in a frequently used application. This dissertation presents automated cost-effective testing strategies for web-based applications developed by applying a mathematical technique called concept analysis (with varying input parameters) to cluster user-session data. The proposed testing strategies are applicable in the beta/maintenance testing phases of the lifecycle of the application. The proposed strategies are particularly useful in the absence of traditional testing requirements and specifications. The research applies concept analysis to cluster user sessions. To avoid processing large user session data sets, a set of heuristics for test suite selection are applied and incremental test suite update is performed on-the-fly in the presence of an evolving application and evolving user sessions. The clustering techniques and selection heuristics are motivated by analyzing user sessions. User sessions are also analyzed to understand the longitudinal usage of the application which assists in focusing maintenance efforts. In addition, an automated testing framework to effectively test web applications is developed. The effectiveness of the reduced suites is evaluated with several empirical studies to determine their program coverage and fault detection effectiveness.

Evolution of Agent-Oriented Distributed Model for Software Testing: Layered Approach.

Abstract: As new requirements arise, on one hand, from the increasing complexity of modern software systems and, on the other hand, from the distribution of today’s information economies, it has been recognized that the modularity and reusability provided by existing techniques and approaches are insufficient. Although, each paradigm has its own contribution in the software engineering field on the support of their proficiencies, due to the exceptional growth of the software industry, researchers continue to strive for more efficient and powerful techniques. Agents are being advocated as a next generation model for engineering complex and distributed systems. They facilitate the automated software testing by virtue of their highlevel decomposition, independency and parallel activation. Here, we address a set of more specific characteristics of agentbased approach (modularity, independency and parallel activation) and its efficacy in software testing. In this paper, we did not only describe the claims for agent-based approach in software testing, but also developed a multi-agent system for software testing with agent qualities. The multi-agent system illustrated here is on the basis of few basic operational realworld testing techniques, as an attempt to describe how to practice Agent-Oriented Software Testing (AOST) which has not previously done.

A Practical Approach of Web System Testing

Abstract: The process of testing software system is gaining more importance every day [6]. Software applications are growing in size and complexity quickly. It makes more necessary to dispose techniques to assure quality of the systems and that the result satisfied initial specifications [1].

A Distributed Approach for Testing Timed Systems

Abstract: During the development of complex systems, testing is an important step. Sometimes it takes a long time and requires a lot of resources. In addition, the complexity of such step increases if the systems handle time constraints. In this paper we present a solution to reduce the complexity of testing these timed systems. We suggest a distributed algorithm for testing these systems. Then we present an implementation of this algorithm on the JXTA environment. We analyze a large number of experiments on different systems. That has shown the efficiency of this approach.

Using Grid Computing for Distributed Software Testing.

Abstract: Grid computing, which is characterized by largescale sharing and collaboration of dynamic resources, has quickly become a mainstream technology in distributed computing. In this article, we present a grid-based software testing framework, which takes advantage of the large-scale and cost-efficient computational grid resources as a software testing testbed to support automated large-scale and complicated software test. Within this test framework, a dynamic bag-of-tasks model is used to manage test suites on the grid. Grid workflow is used to accommodate various test units within the software test task. Overall, we expect that the grid-based unit test framework can significantly reduce test cost in complex software systems and accelerate the software testing process.

Performance prediction method of Web application based on combined stress testing

Abstract: Predicting performance of Web application is a vital guidance for both QoS of Web application and configuration of server.A new approach based on combined stress testing was presented.While running a series of load testing on client-side,resource consuming on the server was also performed.Then the performance model was established and make prediction.Comparing with conventional load testing, this experimental results on a typical Web application system were showed the feasibility,accuracy and efficiency of this method.

The Research of Web Services Testing

Abstract: Web services(WS) is a new distributed computing technology.The technology allows applications to be run in different platform and programming language-independent manner.With the development of technology,WS is applied extensively and new testing technology is needed to make WS highly reliable and run effectively.However because the WS adopted new system structure and the core protocol,WS testing is different from in the former traditional software testing or the network protocol testing,so it is necessary to study its method and technology.The paper analyzed WS testing and classified testing technologies on WS according to different purposes.Furthermore,it showed a kind of performance process of WS testing.

Research on Web Service Testing

Abstract: As an evolutionary technology,Web services poses new challenges for software testingWeb service testing need to be adaptive to distributed coordinated environmentTo ensure the quality of Web services,services need to be verified and validated at different levels including infrastructure,unit and integration,from different perspectives inclu- ding functionality,performance,reliability,security,etcThe paper analyzes the issues of web service testing and gives an overview of testing techniques on SOAP protocol verification,WSDL extension,and model-based verification tech- niques of composite service specificationIt finally discusses future research and practice on Web service testing

Testing Automation for system core kJava applications

Abstract: The paper includes brief review of the main general problems of the testing automation for kJava applications. Existing approaches in the target area are reviewed. The differences between common kJava applications and system core kJava applications described. Demonstrated the necessity for the new testing automation solution for system core kJava applications. Use of internal structure of kJava implementation to create test automation system is described. The result is the test toolkit adapted for testing system core kJava applications. The results of using new method are shown.

Traffic capacity testing a web environment with transaction based tools.

Abstract: A common server configuration that has emerged for supporting Web based applications is the Web Server, Application Server, and Database Server arrangement. This paper discusses a specific traffic capacity testing experience with this server combination for a Windows environment using a transaction oriented load generator instead of a traditional virtual user script based tool. Both challenges encountered and insights gained are described.

A framework for Web Applications Testing through Object-Oriented approach and XUnit tools

Abstract: Nowadays Web applications quality, reliability and dependability are important factors because software glitches could block entire businesses and cause major embarrassment. Web applications are complex and heterogeneous software, based on several components, often written in many different languages and potentially distributed over the Web. Thus, testing Web applications may be a complex task. This paper presents the OO-based framework used in our WAAT project (Web Applications Analysis and Testing) to test traditional Web applications composed of Web documents, objects and server components (e.g., applications written in HTML, Javascript, PHP4/5, etc.). Our Web testing model named OTMW (OO Testing Model of WAAT project) is inspired by the conventional category partition testing method applied to Web software through the use of a reverse engineered OO model used to describe the architecture of existing applications. OTMW tests Web software using three different layers of test: unit, integration and system testing. This paper describes the set of techniques used by OTMW in every testing layer. To achieve this result this paper describes the OO model used (based on UML class and state diagrams) and it defines the reverse engineering techniques used to analyze software and to describe them through the model. Moreover, the paper proposes a method to identify software units and sequences of units to test applications components and their interactions. Furthermore, it describes an approach to define test cases using the reverse engineered models with a technique based on the subdivision of input data in classes of equivalence. Finally, this paper presents tools used to perform some empirical experiments to evaluate the power, effectiveness and flexibility of the OTMW approach.