Combinatorial Testing (CT) is a systematic way of sampling input parameters of the software under test (SUT). A t-way combinatorial test set can exercise all behaviors of the SUT caused by interactions between t input parameters or less. Although combinatorial testing can provide fault detection capability, it is often desirable to isolate the input combinations that cause failures. Isolating these failure-inducing combinations aids developers in understanding the causes of failures. Previous work directly uses classification tree analysis on the results of combinatorial testing to model the failure inducing combinations. But in many scenarios, the effectiveness of classification depends upon whether the analyzed test set is sufficient for classification. In addition, generating combinatorial tests for more-than-6-way combination is generally expensive. To address these issues, we propose an approach that uses existing combinatorial testing results to generate additional tests that enhance the effectiveness of classification. In addition, our approach also includes a technique to reduce the complexity of the resulting classification tree so that developers can understand the nature of failure-inducing combinations. We present the preliminary results of our approach applied on the TCAS benchmark.
This paper presents an automatic technique for generating maintainable regression unit tests for programs. We found previous test generation techniques inadequate for two main reasons. First. they were designed for and evaluated upon libraries rather than applications. Second, they were designed to find bugs rather than to create maintainable regression test suites: the test suites that they generated were brittle and hard to understand. This paper presents a suite of techniques that address these problems by enhancing an existing unit test generation system. In experiments using an industrial system, the generated tests achieved good coverage and mutation kill score, were readable by the product's developers, and required few edits as the system under test evolved. While our evaluation is in the context of one test generator, we are aware of many research systems that suffer similar limitations, so our approach and observations are more generally relevant.
Industrial robots have been widely used in manufacturing plants to handle various jobs such as palletizing, machine tending, and arc welding. Before real commissioning, the entire robot application system needs to be simulated in a virtual system to ensure safety and to improve development efficiency. Due to the requirements on robots to complete various jobs, multiple robot application simulation systems are on demand to satisfy the corresponding simulation requirements. Based on our experiences on developing various simulation systems, we propose an architecture for robot application simulation systems. This paper presents our years of industrial practices with such an architecture. These practices are collected and summarized from the development of several robot application simulation systems in the last five years and have been proved to be effective.
A Gram-positive, facultatively anaerobic, endospore-forming and rod-shaped bacterium was isolated from soil samples and designated strain LQQ. This organism strongly quenches the acylhomoserine lactone quorum-sensing signal. The LQQ strain exhibits phenotypic characteristics consistent with its classification in the genus Bacillus. It is positive in catalase and no special growth factor is needed. It uses glucose as sole carbon source. The DNA G + C content is 39.8 mol %. The closest relatives based on the 16S rRNA gene sequence are Bacillus anthracis, Bacillus thuringiensis, and Brevibacillus brevis (syn. Bacillus brevis) with the similarity of 96.5%. The DNA–DNA hybridization data indicates a low level of genomic relatedness with the relative type strains of Bacillus thuringiensis (6.1%), Bacillus anthracis (10.5%) and Brevibacillus brevis (8.7%). On the basis of the phenotypic and phylogenetic data together with the genomic distinctiveness, the LQQ strain represents a novel species of the genus Bacillus, for which the name Bacillus marcorestinctum sp. nov. is proposed. The type strain is LQQT.
User-input validators play an essential role in guarding a web application against application-level attacks. Hence, the security of the web application can be compromised by defective validators. To detect defects in validators, testing is one of the most commonly used methodologies. Testing can be performed by manually writing test inputs and oracles, but this manual process is often labor-intensive and ineffective. On the other hand, automated test generators cannot generate test oracles in the absence of specifications, which are often not available in practice. To address this issue in testing validators, we propose a novel approach, called MiTV, that applies Multiple-implementation Testing for Validators, i.e., comparin gthe behavior of a validator under test with other validators of the same type. These other validators of the same type can be collected from either open or proprietary source code repositories. To show the effectiveness of MiTV, we applied MiTV on 53 different validators (of 6 common types) for web applications. Our results show that MiTV detected real defects in 70% of the validators.
User-input-validation (UIV) is the first barricade that protects web applications from application-level attacks. Most UIV test tools cannot detect semantics-related vulnerabilities in validators, such as filling a five-digit number to a field that accepts a year. To address this issue, we propose a new approach to generate test inputs for UIV based on the analysis of client-side information. In particular, we use input-field information to generate valid inputs, and then perturb valid inputs to generate invalid test inputs. We conducted an empirical study to evaluate our approach. The empirical result shows that, in comparison to existing vulnerability scanners, our approach is more effective than existing vulnerability scanners in finding semantics-related vulnerabilities of UIV for web applications.
Notice of Retraction After careful and considered review of the content of this paper by a duly constituted expert committee, this paper has been found to be in violation of IEEE's Publication Principles. We hereby retract the content of this paper. Reasonable effort should be made to remove all past references to this paper. The presenting author of this paper has the option to appeal this decision by contacting TPII@ieee.org. There are different characters in interdependence between members in a marketing channel, which express total interdependence and asymmetry independence. They respectively act on relational behavior between members in a marketing channel, and create different outcomes. The empirical results show that total interdependence has a positive effect on relationship performance, that is, conflict decreases and satisfactions increase, and that asymmetry independence has a reverse effect.
Test coverage such as branch coverage is commonly measured to assess the sufficiency of test inputs. To reduce tedious manual efforts in generating high-covering test inputs, various automated techniques have been proposed. Some recent effective techniques include Dynamic Symbolic Execution (DSE) based on path exploration. However, these existing DSE techniques cannot generate high-covering test inputs for programs using complex regular expressions due to large exploration space; these complex regular expressions are commonly used for input validation and information extraction. To address this issue, we propose an approach, named Reggae, to reduce the exploration space of DSE in test generation. In our evaluation, we apply Reggae on various input-validation programs that use complex regular expressions. Empirical results show that Reggae helps a test-generation tool generate test inputs to achieve 79% branch coverage of validators, improved from 29% achieved without the help of Reggae.
There are different characters in interdependence between members in a marketing channel, which express total interdependence and asymmetry independence. They respectively act on relational behavior between members in a marketing channel, and create different outcomes. But environment uncertainty, which includes environment diversity and environment dynamism, moderates above relationships. The empirical results show that under the situation of environment uncertainty the effect of total interdependence and asymmetry independence on relationship performance make changes.
There are different characters in interdependence between members in a marketing channel, which express total interdependence and asymmetry independence. They respectively act on relational behavior between members in a marketing channel, and create different outcomes. The empirical results show that total interdependence has a positive effect on relationship performance, that is, conflict decreases and satisfactions increase, and that asymmetry independence has a reverse effect.
Many Web applications enhance their security via access-control systems. XACML is a standardized policy language, which has been widely used in access-control systems. In an XACML-based access-control system, policies, requests, and responses are written in XACML. An XACML implementation implements XACML functionalities to validate XACML requests against XACML policies. To ensure the quality of an XACML-based access-control system, we need an effective means to test whether the XACML implementation correctly implements XACML functionalities. The test inputs of an XACML implementation are XACML policies and requests. The test outputs are XACML responses. This paper proposes an approach to detect defects in XACML implementations via observing the behaviors of different XACML implementations for the same test inputs. As XACML has been widely used, we can collect different XACML implementations, and test them with the same XACML polices and requests to observe whether the different implementations produce different responses. Based on the analysis of different responses, we can detect defects in different XACML implementations. We show the feasibility of the proposed approach with a preliminary study on three XACML implementations.
The invalidated input is one of the most critical web application security flaws. However, testing the user input validation function is an intellectual and labor intensive task. We are developing a model driven framework to help testers to accomplish this job in visual view with guidance. This paper reports our on-going work. A meta-model of Web application for user input validation testing is defined. Based on the meta-model, by analyzing HTML files, a light weight method is given to create the model. Our evaluation shows that the proposed method can comprehensively model Web applications, and accurately identify the purpose of input points, which are very important for the test case generation in the future.
In model driven web application testing, the whole test process is driven and described by the test model which is based on test metamodel. In order to assure the quality of test model transformation and repository, metamodel based testing must be done. Firstly, the metamodel concept is introduced and the characteristic of metamodel based testing is investigated. Secondly, several test coverage criteria are proposed based on metamodel structure. Thirdly, a test cases generation method is proposed according to the test coverage criteria and a case study which comes from our test model repository testing project is given to illustrate the method. To conclude this paper, the validity and adequacy of the generated test case is analyzed, and the implementation is presented.
Web applications have become complex and crucial in many fields. In order to assure their quality, a high demand for systematic methodologies of Web application testing is emerging. In this paper, a methodology of model-driven testing (MDT) for Web application is presented. Model is the core of this method. Web application model is built to describe the system under testing. Test case models are generated based-on the Web application model. Test deployment model and test control model are designed to describe the environment and process of test execution. The test engine executes test cases based-on the test deployment and control model automatically. After that, testing results are reflected to test case models. A framework is designed for supporting this methodology. In order to get better extensibility and flexibility, it is loose-coupled by a modeler and a tester. The modeler enables developers to design meta-models, and is responsible for creating, visualizing and saving models. The tester takes in charge of recovering the tested Web application model, generating test cases, and executing test
Aim at the characteristic of Web application test data, this paper propose a method of Web test data generation and maintenance based on DataPool. Based on the formal definition of DataPool and demonstrably describe its semantic, it offer different test data generation method corresponding to input type of Web browser in DataPool editor view, and offer diversified maintenance function. In DataPool browser view, it implement data selector with single and batch mode.
模型驱动的Web应用测试的第一步是建立被测Web应用的模型,作为生成测试用例的基础.但是,通常Web应用开发过程中相关文档较少,所以为在工程实践中应用模型驱动的Web应用测试,需要逆向建立被测Web应用模型.而逆向建立被测Web应用模型的基础之一是网页抓取技术(Web Crawler).本文首先介绍了网页抓取技术及其研究现状;然后分析了模型驱动的Web应用测试对网页抓取技术的需求;在阐述系统设计、实现之后,进行了总结与展望.
Web application userinterface (UI) should helpusers use its functions efficiently andconveniently. A friendly UIalso needs to offer user a configurable and customizable environment. After some popular systems UI is studied, based on the project of inner mongolia agriculture technology integrated information service platform (NMLPT), a series of methods and principles forthe design and implementation of highly usable and customizable web application UI are introduced. In addition, The information architecture design on improving usability of web application are presented.
介绍了面向对象度量技术,给出针对Java语言的McCabe,Halstead和WMC复杂度的定义,提出了一种新的面向Java语言的度量工具的实现方法,并且通过实例分析说明利用该工具度量Java程序,某些度量值高的模块逻辑复杂、工作量大、易错且难维护,从而引导测试人员重点测试这些模块,同时也使开发人员关注它们,仔细检查程序逻辑,进行合理优化,使整个程序的复杂度降低.确凿实验数据表明,软件度量对改进软件质量具有很大实用价值.本工具采用以下度量标准度量Java程序:针对继承复杂性的DIT(Depth of Inheritance Tree)和NOC(Number Of Children)复杂度;针对模块复杂性的McCabe度量法、Halstead软件科学度量和WMC(Weighted Methods per Class)复杂度;针对类间耦合性、聚集性的RFC(Response for a Class)度量法.每种复杂度从不同方面、不同层次度量Java程序,从而有效全面的评价软件质量,揭示可能隐藏的错误.
本文基于模型驱动测试的思想,提出一种Web应用测试模型WANM(Web Application Navigation Model),用于支持测试用例的设计与自动执行.基于WANM设计的测试用例的描述参照U2TP(UML2.0 Testing Profile)标准,使得测试建模、测试用例生成以及测试执行既紧密联系又相互独立,有助于提高测试的充分性与效率.
IEEE nomenclature and criterion of software engineering defines that Metric is the quantificational measurement of a system,component,or a degree with any specifically attribute.In order to assist such quantificational measurement,a Java-oriented measuring tool was designed.Firstly a series of definition of algorithms of measurement for Java was given.Then the paper discussed how to implement these algorithms by a layered architecture.The measurement tool designed by this way was extensible.It can help to improve the quality of programs.