The network of faults: a complex network approach to prioritize test cases for regression testing

详细信息    查看全文

• 作者：Imrul Kayes ; Shafinaz Islam…
• 关键词：Software testing ; Regression testing ; Test ; case prioritization
• 刊名：Innovations in Systems and Software Engineering
• 出版年：2015
• 出版时间：December 2015
• 年：2015
• 卷：11
• 期：4
• 页码：261-275
• 全文大小：2,059 KB
• 参考文献：1.Leung HKN, White L (1989) Insights into regression testing [software testing]. In: Proceedings of conference on software maintenance, pp 60-9
  2.Yoo S, Harman M (2012) Regression testing minimization, selection and prioritization: a survey. Softw Test Verif Reliab 22:67-20CrossRef
  3.Kayes I (2011) Agile testing: introducing PRAT as a metric of testing quality in scrum. ACM SIGSOFT Softw Eng Notes 36:1-CrossRef
  4.Kayes I, Sarker M, Chakareski J (2013) On measuring test quality in scrum: an empirical study. arXiv:-310.-545
  5.Beizer B (2003) Software testing techniques. Dreamtech Press, India
  6.Malishevsky AG, Ruthruff JR, Rothermel G, Elbaum S (2006) Cost-cognizant test case prioritization. Department of Computer Science and Engineering, University of Nebraska-Lincoln, Technical Report
  7.Hamlet D, Maybee J (2000) The engineering of software: a technical guide for the individual, 1st edn. Addison-Wesley Longman Publishing Co., Inc., Boston In:
  8.Elbaum S, Malishevsky A, Rothermel G (2002) Test case prioritization: a family of empirical studies. IEEE Trans Softw Eng 28:159-82CrossRef
  9.Rothermel G, Untch R, Chu C, Harrold M (1999) Test case prioritization: an empirical study. In: Proceedings of IEEE international conference on software maintenance (ICSM-9), pp 179-88
  10.Rothermel G, Untch R, Chu C, Harrold M (2001) Prioritizing test cases for regression testing. IEEE Trans Softw Eng 27:929-48CrossRef
  11.Elbaum S, Malishevsky AG, Rothermel G (2000) Prioritizing test cases for regression testing. In: Proceedings of the 2000 ACM SIGSOFT international symposium on software testing and analysis (ISSTA-0). ACM, New York, pp 102-12
  12.Srikanth H, Williams L, Osborne J (2005) System test case prioritization of new and regression test cases. In: Proceedings of international symposium on empirical software engineering
  13.Krishnamoorthi R, Sahaaya Arul Mary S (2009) Factor oriented requirement coverage based system test case prioritization of new and regression test cases. Inf Softw Technol 51:799-08CrossRef
  14.Zhang L, Hou SS, Guo C, Xie T, Mei H (2009) Time-aware test-case prioritization using integer linear programming. In: Proceedings of the eighteenth international symposium on software testing and analysis (ISSTA-9). ACM, New York, pp 213-24
  15.Walcott KR, Soffa ML, Kapfhammer GM, Roos RS (2006) Timeaware test suite prioritization. In: Proceedings of the international symposium on software testing and analysis (ISSTA-6). ACM, New York, pp 1-2
  16.Alspaugh S, Walcott KR, Belanich M, Kapfhammer GM, Soffa ML (2007) Efficient time-aware prioritization with knapsack solvers. In: Proceedings of the 1st ACM international workshop on empirical assessment of software engineering languages and technologies (WEASELTech-7): held in conjunction with the 22nd IEEE/ACM international conference on automated software engineering (ASE-7). ACM, New York, pp 13-8
  17.Huang CY, Lin CT (2006) Software reliability analysis by considering fault dependency and debugging time lag. IEEE Trans Reliab 55:436-50CrossRef
  18.Neumann PG (1990) Cause of AT&T network failure. Risks Dig 9:62
  19.Slabodkin G (1998) Software glitches leave navy smart ship dead in the water. Gov Comput News 13:33727-1
  20.Oppenheimer D, Ganapathi A, Patterson DA (2003) Why do internet services fail, and what can be done about it? In: USENIX symposium on internet technologies and systems, vol 67, Seattle
  21.Kayes M (2011) Test case prioritization for regression testing based on fault dependency. In: Proceedings of 3rd international conference on electronics computer technology (ICECT-1), vol 5, pp 48-2
  22.Rooney P (2002) Microsoft’s CEO: 80-20 rule applies to bugs, not just features. http://?www.?crn.?com/?news/?security/-8821726/?microsofts-ceo-80-20-rule-applies-to-bugs-not-just-features.?htm . Accessed 25 Nov 2014
  23.Kayes I, Qian X, Skvoretz J, Iamnitchi A (2012) How influential are you: detecting influential bloggers in a blogging community. In: Proceedings of the 4th international conference on social informatics. Springer, Berlin, pp 29-2
  24.Kayes I, Zuo X, Wang D, Chakareski J (2014) To blog or not to blog: characterizing and predicting retention in community blogs. In: Proceedings of the international conference on social computing (SocialCom-4), vol 7. ACM, New York, pp 1-:8
  25.Kayes I, Zuo X, Wang D, Chakareski J (2014) Did you blog yesterday? Retention in community blogs. In: Proceedings of the international conference on social computing (SocialCom-4). ACM, New York, pp 16:1-6:2
  26.Freeman L (1977) A set of measures of centrality based upon betweenness. Sociometry 40:35-1CrossRef
  27.Newman MEJ (2010) Networks: an introduction. Oxford University Press, USACrossRef
  28.Brandes U (2008) On variants of shortest-path betweenness centrality and their generic computation. Soc Netw 30:136-45CrossRef
  29.Bonacich P (1972) Factoring and weighting appro
• 作者单位：Imrul Kayes (1)
  Shafinaz Islam (2)
  Jacob Chakareski (3)
  
  1. Computer Science and Engineering, University of South Florida, Tampa, FL, USA
  2. Electrical and Electronic Engineering, Rajshahi University of Engineering & Technology, Rajshahi, Bangladesh
  3. Electrical and Computer Engineering, University of Alabama, Tuscaloosa, AL, USA
  
• 刊物类别：Computer Science
• 刊物主题：Software Engineering
  Computing Methodologies
  Computer Applications
  
• 出版者：Springer London
• ISSN：1614-5054

文摘

Regression testing is performed to provide confidence that changes in a part of software do not affect other parts of the software. An execution of all existing test cases is the best way to re-establish this confidence. However, regression testing is an expensive process—there might be insufficient resources (e.g., time, workforce) to allow for the re-execution of all test cases. Regression test prioritization techniques attempt to re-order a regression test suite based on some criteria so that highest priority test cases are executed earlier. In this study, we prioritize test cases for regression testing based on the dependency network of faults. In software testing, it is common that some faults are the consequences of other faults (leading faults). Dependent faults can be removed if and only if the leading faults have been removed. Our goal is to prioritize test cases so that test cases that have exposed the leading faults in the system testing phase, are executed first in regression testing. The leading faults are modeled as the most central faults in the fault dependency network. We present ComReg, a test-case prioritization technique based on the dependency network of faults. We model a fault dependency network as a directed graph and identify leading faults to prioritize test cases for regression testing. We use a centrality aggregation technique which considers six network representative centrality metrics to identify leading faults in the fault dependency network. We also discuss the use of fault communities to select an arbitrary percentage of the test cases from a prioritized regression test suite. We conduct a case study that evaluates the effectiveness and applicability of the proposed method. We obtain a fault dependency network from the development of a vocabulary learning software. We found that the fault network is a small-world graph with distinguishable community structure. The leading faults are common in all centralities and a re-ordering of test cases is feasible for regression testing based on those leading faults. Our method outperforms traditional regression testing prioritization techniques in detecting fault dependencies. Our modeling of the network of faults provides insights into the requirement of recognizing fault dependencies while re-ordering regression test suites for both research and practice. The dependency model needs further evaluation and improvement considering relevant resources (e.g., man-hours). Keywords Software testing Regression testing Test-case prioritization