In this paper, a method is studied to build a reliability test system on WebApp based on TTCN-3 test suite. The model-based method is used to generate test case automatically and use data equivalence partition to choose test data. Markov chain usage model (MCUM) is used to describe the expected usage of system under test (SUT), and the data structure in the data pool is designed to organize test data used in reliability test cases. TTCN-3 reliability test model is developed in order to model the reliability test system. We developed two transform algorithms, the first of which is able to transform SUT model (MCUM and the data pool) into TTCN-3 reliability test model, and the second one can generate TTCN-3 test script from the test model. We also developed a test generation framework, which supports the automatic generation progress. A case system is generated using the test generation framework from given MCUM and the data pool. A case is studied to test a Web-based management information system then calculate the reliability factor.

In this paper, a distributed testing execution system is designed, which provides a mechanism of node communication, test script deployment, test scheduling, executor-driving and test result collection in distributed environment. A workload model is established, by which testers can describe the performance testing requirement. A performance testing framework is given, which simulates user behaviors in real environment based on virtual users so as to generate workload from the system under test (SUT). It can control the execution of virtual users by TTCN-3 standard interface. After executing the performance testing, test report is generated by extracting log. A method of generating performance test-case is studied by reusing functional test scripts. By executing performance testing on an online bookstore, this paper demonstrates the availability of the method of reusing TTCN-3 functional test scripts and the capability of distributed performance testing system that had been established.

The reverse engineering based on TTCN-3 test systems can help testers grasp the system design from higher levels, and it also can test the consistence between test design and test implementation, which is of great significance and important value for test system maintenance, expansion and evaluation. Aimed at the comprehensibility, reusability and maintainability, the thesis presents the technology of finding dynamic test configuration model and data model based on TTCN-3 Test System which can help testers and maintainers to verify the test implement. Then the test system meta-model is designed. This thesis also introduced the reverse model discovery system framework. Finally, the algorithms of extracting data model are described.

Welcome to the WIT Press eLibrary - the home of the Transactions of the Wessex Institute collection, providing on-line access to papers presented at the Institute's prestigious international conferences and from its State-of-the-Art in Science & Engineering publications.

The test configuration and data play an important role in a test system. Test configuration is used to describe the number of test components in a test system, and the connecting relationship between test components. Aimed at the comprehensibility, reusability and maintainability, the paper presents the test configuration models for the legacy code developed by TTCN-3. It can also help testers and maintainers to verify the test implement, etc. First, the paper introduces the algorithm to discover the static test configuration model and its features based on TTCN-3 test systems. Then, the paper builds the algorithms to discover the dynamic test configuration models.

As the test system grows in size and the testers change, the management and maintenance of the huge test systems have become more and more difficult. Therefore the reverse engineering based on TTCN-3 test systems can help testers grasp the system design from higher levels, and can test the consistence between test design and test implementation, which is of great significance and important value for test system maintenance, expansion and evaluation. This thesis presents the reverse model recovery for the legacy code developed by TTCN-3. It can also help tester and maintainers to verify the test implement. Then the test system meta-model is designed. This thesis also introduced the technologies of the discovery of invocation model and data model based on the reverse model discovery system framework. Finally, the algorithms of extracting invocation model and partitioning data model are described.

Aimed at the comprehensibility, reusability and maintainability, the thesis presents the reverse model recovery for the legacy code developed by TTCN-3. It can also help tester and maintainers to verify the test implement, etc. First, the thesis introduces reverse model and its features based on TTCN-3 test systems. Then, the thesis builds the framework on Eclipse platform using the plug-in mechanism. Here the thesis reuses and expands the core parser in TRex project for the reverse engineering analyzer.

This paper presents the design of generic codec for testing Web application. Codec is a necessary part of TTCN-3 test system which transfers from TTCN-3 template data and SUT (the system under test) input data, and from SUT output data to TTCN-3 template data. The generic codec needs to transform TTCN-3 template into URL request string, analyzing the Web page, and then extract the Web page. Because of conscious of the Web pages with large volume of data and noise data, the multi-level parsing and composition strategy has been presented in this paper. Experiments show that the strategy works well and could save much codec development effort.

Aimed at the comprehensibility, reusability and maintainability, the thesis presents the reverse model recovery for the legacy code developed by TTCN-3. It can also help tester and maintainers to verify the test implement, etc. The thesis introduces the discovery of static test configuration model and data model based on the reverse model discovery system framework.

Codec is a necessary part of TTCN-3 test system which transfers TTCN-3 template data to SUT input data,and SUT output data to TTCN-3 template data.This paper presented the design of generic codec for testing Web application.The generic codec needs to transform TTCN-3 template into URL request string,and extract Web page content to transform into TTCN-3 template.Conscious of the Web pages with large volume of data and noise data,this paper presented the multi-level parsing and composition strategy.Experiments show that the strategy works well,and could save much codec development effort.

In this thesis, the traditional reverse method is applied to TTCN-3 test systems. The discovery system of inverse model is designed, and the discovery technology of test configuration models is also discussed. When reverse analyzing the test system based on TTCN-2, the test configuration information can be obtained from two aspects, namely static and dynamic. Then the discovery algorithm related to the areas is developed. The abstract model describing the test systems will be extracted. The reverse engineering based on TTCN-3 test systems can help testers grasp the system design from higher levels, and can test the consistence between test design and test implementation, which is of great significance and important value for test system maintenance, expansion and evaluation.

The test configuration and data play an important role in a test system based on Web application. Test configuration is used to describe the number of test components in a test system based on Web application, and the connecting relationship between test components. Aimed at the comprehensibility, reusability and maintainability, the paper presents the test configuration models for the legacy code developed by TTCN-3 based on Web application. It can also help testers and maintainers to verify the test implement, etc. First, the paper introduces the algorithm to discovery the static test configuration model and its features based on TTCN-3 test systems. Then, the paper builds the algorithms to discover the dynamic test configuration models.

To actualize double evidence accommodation, the curricula must be recomposed on the basis of professional features. Then the courses, teaching contents and requirement should be connected with occupation standard. That is, it is the mainline that the post capacity must meet the demands of the occupation standard. The curricula must overlay knowledge and skills of the occupation. The industry-academic collaboration must be strengthened. At last, the all-in-one curricula will be constructed which is integrated theory with practice and merged with multi-examination.

Aimed at the comprehensibility, reusability and maintainability, the thesis presents the reverse model recovery for the legacy code developed by TTCN-3. It can also help tester and maintainers to verify the test implement, etc. The thesis introduces the discovery of invocation model and dynamic test configuration model based on the reverse model discovery system framework.

Due to the dynamic execution of object-oriented programs,the object states cannot be described and analyzed properly by use of traditional test methods.Doing so will affect the accuracy of fault localization in the object-oriented programs.On the basis of the concept of a pattern,the lifetime behavior model(LBM) was proposed to describe the behavioral characteristics of objects by using sequence patterns.Also,as the behavioral patterns of a class were constituted of LBM,the behavioral patterns of a program were defined on the basis of the behavioral patterns of classes.Next,the framework of finding suspicious patterns in a program was designed;this framework involved preparing data,extracting patterns,and finding abnormal behaviors.The standard of extracting patterns was defined and the mining algorithms of finding patterns were described.Lastly,the methods of finding suspicious patterns whose length was equal and larger than 2 were put forward.These methods can be utilized in research on fault localization,and they gain the rate of 0.761 in precision and 0.737 in recall on average as indicated by the experimental data.Satisfactory results have been achieved with these methods.

故障定位的目的是帮助程序员寻找引发失效的原因或故障位置,以加快调试过程.故障和失效间的关系往往非常复杂,难以直接描述故障到失效的转化.最新的研究多采用差异分析的方法,基于可疑模式,构建故障推理贝叶斯网络,其节点由可疑模式及组成可疑模式方法的调用者构成;定义了贝叶斯网络的构建算法、各个相关概率的定义及BBN中各个边的条件概率计算公式.提出基于该BBN的推理算法,推理得到包含故障的模块,并计算得到每个模块包含故障的概率.提出了评价方法,详细设计了参数调整与定位性能的关系实验和定位结果分析实验.实验数据表明,该故障定位方法取得了平均0.761的定准率和0.737的定全率,定位结果良好,具有较高的实用价值.

Several variance analysis methods that are used in fault localization based on program behaviors were analyzed and compared. None of these methods takes into account the features of object-oriented programs, thus, could not be used accurately in fault localization in object-oriented programs. The present study proposed that when doing variance analysis, object behaviors could be described by using the object life behavior model; then a behavior model of the object-oriented program was constructed based on the model; the similarity of program behaviors was described by using the sequence pattern. Based on the variance analysis of program behaviors, the method of finding suspicious patterns of object-oriented programs was proposed. The model of finding suspicious patterns was also constructed. This model consisted of preparing data, extracting patterns, and finding suspicious patterns. The standard for pattern extracting was defined and the mining algorithms of finding patterns were also described. At last, the method of finding suspicious patterns based on variance analysis and its implementation procedure were depicted in detail. This method has been used in the research of fault localization and has been very effective. This work is supported by the National Natural Science Foundation of China under grant No. 60603039.

The execution of web applications always involves many levels (Operating system, Java virtual machine, Web server, Database server, application itself). Each level can produce its corresponding logs, which record the information of the level's running state and history. Based on the multi-level logs generated by the running web systems, this paper proposes a comprehensive method to evaluate and analyze the online web applications' performance. The advantages of this method are that we can not only use it in the testing stage, but also we can discover the online web applications' performance problems not found in the performance testing stage, and can analyze the reasons of the problems effectively. Case study shows that it is an effective method for performance evaluation and analysis.

Fault localization techniques help programmers find out the locations and the causes of the faults and accelerate the debugging process. The relation between the fault and the failure is usually complicated, making it hard to deduce how a fault causes the failure. Analysis of variance is broadly used in many correlative researches. In this paper, a Bayesian belief network (BBN) for fault reasoning was constructed based on the suspicious pattern, whose nodes consist of the suspicious pattern and the callers of the methods that constitute the suspicious pattern. The constructing algorithm of the BBN, the correlative probabilities, and the formula for the conditional probabilities of each arc of the BBN were defined. A reasoning algorithm based on the BBN was proposed, through which the faulty module can be found and the probability for each module containing the fault can be calculated. An evaluation method was proposed. Experiments were executed to evaluation this fault localization technique. The data demonstrated that this technique could achieve an average accuracy of 0.761 and an average recall of 0.737. This fault localization technique is very effective and has high practical value.

In software testing organizations, an effective knowledge management of testing process is the key to improve the quality of software testing.Knowledge management has different features in software testing.In this paper, a knowledge management model was proposed towards software testing process, which is based on building the site of knowledge sharing.It emphasizes the idea of closely contacting knowledge service and software testing and will promote the research of knowledge management technology.Simultaneously many key technologies are discussed, such as knowledge representation, knowledge map and etc.At last, an application instance based on this model is given in the project of QESuite2.0.