Article

Article title INVESTIGATION OF DEPENDENCE OF THE TEST CASE OPTIMALITY (EFFECTIVENESS) ON VARIOUS INDICATORS
Authors A. S. Artyukhova
Section SECTION V. COMPUTING SYSTEM AND PROGRAMMING
Month, Year 04, 2018 @en
Index UDC 004.023
DOI
Abstract Currently, the process of software testing is a time-consuming and costly in terms of resources and time allocated for this development phase. Programs complexity is strongly growing up, so the process of their verification will complicate. The development of the methods that allow optimizing that stage is an actual task. A possible solution to the problem is the creation of an optimizing method of the verification process, based on the applying the most optimal and effective tests for software verification. In this regard, an important task is to investigate the dependence of the test case optimality (effectiveness) on various indicators, thus, the solution of the problem will save resources and time in the development of software. The paper is devoted to finding and investigating the dependence of the test optimality on the influence of various indicators. The article considers such signs as: x(1) – test-case average execution time , x(2) – а number of runs of the test x(3) – test case severity, x(4) i– test case complexity, x(5) – a number of related bugs that is the number of previously detected defects associated with the test-case. Accounting and analysis of dependencies between the described above parameters of the test and influence of test on the defect detection process in the developing software system provide additional information for verification process optimization. To solve the above issues the correlation-regression and variance analysis have been carried out. The paper contains the mathematical expressions of the required dependencies. The results of influence modeling of these indicators on the optimality of tests from the test set are presented. The nature of the found mathematical expressions is described. The dependencies of the test case optimality on its parameters obtained in the research allow making the transition from verification of a concrete software system to whole classes of software products and systems in future, that is unification and formalization of the verification process.

Download PDF

Keywords Verification; optimization; software systems; correlation analysis.
References 1. Krispin L., Gregori D. Gibkoe testirovanie: prakticheskoe rukovodstvo dlya testirovshchikov PO i gibkiлh komand [Agile Testing. A practical guide for testers and agile teams]. Moscow: OOO «I D. Vil'yams», 2010, 464 p.
2. Dastin E., Reshka D., Pol D. Avtomatizirovannoe testirovanie programmnogo obespecheniya [Automated software testing], Vnedrenie, Upravlenie, Ekspluatatsiya [Introduction, Management and Performance]. Moscow: LORI, 2003, 588 p.
3. Blek R. Klyuchevye protsessy testirovaniya. Planirovanie, podgotovka, provedenie, sovershenstvovanie [Critical Testing Processes: Plan, Prepare, Perform, Perfect]. Moscow: LORI, 2006, 544 p.
4. Kalinina V.N., Solov'ev V.I. Komp'yuternyy praktikum po prikladnoy statistike i osnovam ekonometriki: ucheb. posobie dlya studentov vuzov [Computer workshop on applied statistics and basics of econometrics: textbook for University students]. Moscow: Vega-Info, 2010, 140 p.
5. Dubrova T.A. Statisticheskie metody prognozirovaniya v ekonomike: ucheb. posobie [Statistical methods of forecasting in the economy: a textbook]. Moscow: Moskovskiy gosudarstvennyy universitet ekonomiki, statistiki i informatiki, 2004, 136 p.
6. Shashkov V.B. Prikladnoy regressionnyy analiz. Mnogofaktornaya regressiya: ucheb. posobiye [Applied regression analysis. Multivariate regression: a textbook]. Orenburg: GOU VPO OGU, 2003, 363 p.
7. Buryakova N.A., Chernov A.V. Klassifikaciya chastichno formalizovannykh i formal'nykh modeley i metodov verifikacii programmnogo obespecheniya [Classification of partially formalized and formal models and methods of software verification], Inzhenernyy vestnik dona [Engineering Bulletin of the Don], 2010, No. 4.
8. Artyukhova A.S. Problemy avtomatizatsii testirovaniya i podkhody k ikh resheniyu [Problems of test automation and approaches to their solution], Nauchnoe periodicheskoe izdanie “CETERIS PARIBUS” [Scientific periodical “CETERIS PARIBUS”]. Moscow: EFIR, 2016, No. 10, pp. 5-11. Available at: http://elibrary.ru/item.asp?id=27218935.
9. Mayers G., Badzhett T., Sandler K. Iskusstvo testirovaniya program [The art of software testing]. 3 ed. Moscow: Dialektika, 2012, 272 p.
10. Zhu H., Hall P.A.V., May J.H.R. Software Unit Test Coverage and Adequacy, ACM Computing Surveys, 1997, Vol. 29 (4), pp. 366-427.
11. Watts S.H. Introduction to the Personal Software Process. Addison-Wesley Professional, 1996, 278 p.
12. Kaner S., Folk D, Nguen E.K. Testirovanie programmnogo obespecheniya. Fundamental'nye kontseptsii menedzhmenta biznes-prilozheniy [Software testing. Fundamental concepts of business application management]. Kiev: DiaSoft, 2001, 544 p.
13. Artyukhova A.S. Test coverage criteria completeness study in genetetic algorithm for test generation, Nauchnoe periodicheskoe izdanie “CETERIS PARIBUS” [Scientific periodical “CETERIS PARIBUS”]. Moscow: EFIR, 2016, No. 11, pp. 4-8. Available at: http://efir-msk.ru/sbornik/CR-1-2016.pdf.
14. Kureychik V.M., Rodzin S.I. Komp'yuternyy sintez programmnykh agentov i artefaktov [Computer synthesis of software agents and artifacts], Programmnye produkty i sistemy [Software products and systems], 2004, No. 1, pp. 23-27.
15. Kureychik V.V., Rodzin S.I., Rodzina L.S. Mobil'noe obuchenie: kontekstnaya adaptatsiya i stsenarnyy podhod [Mobile learning: contextual adaptation and scenario approach], Otkrytoe obrazovanie [Open education], 2013, No. 4 (99), pp. 75-82.
16. Artyukhova A.S. Problemy proektirovaniya web-interfeysa sredstvami geneticheskogo programmirovaniya [Problems of web-interface design by means of genetic programming], Nauchnoe periodicheskoe izdanie “IN SITU” [Scientific periodical "in SITU"]. Moscow: EFIR, 2016, No. 11, pp. 17-20. Available at: http://efir-msk.ru/sbornik/IS-11-2016.pdf.
17. Rodzin S., Rodzina L. Theory of Bioinspired Search for Optimal Solutions and its Application for the Processing of Problem-Oriented Knowledge, 8th IEEE International Conference on Application of Informatioand Communication Technologies, AICT 2014 - Conference Proceedings 8. 2014, pp. 7035930.
18. Kadashev D.V., Kuznetsov A.A. Sistema raspredelennogo unit-testirovaniya «Testing GRID» [System of the distributed unit-testing "testing GRID"], Vestnik NGU [Vestnik NSU], 2007, Vol. 5, Issue 1, pp. 20-27.
19. IEEE Guide to Software Engineering Body of Knowledge, SWEBOK, 2004.
20. Bek K. Ekstremal'noe programmirovanie: razrabotka cherez testirovanie. Biblioteka programmista [Extreme programming: test-driven development. Programmer's library]. Saint Petersburg: Piter, 2003, 224 p.

Comments are closed.