Article

Article title ANALYSIS OF SOME APPROACHES TO QUANTITATIVE EVALUATION OF SOFTWARE RELIABILITY
Authors V.A. Baliberdin, A.M. Belevtsev, O.A. Stepanov
Section SECTION III. INFORMATION TECHNOLOGY, APPLIED INFORMATION SYSTEMS AND NETWORKS
Month, Year 11, 2015 @en
Index UDC 681.142
DOI
Abstract The article is the extension of the subject matter of the authors published before. The emphasis is on the construction of quantitative evaluation of software reliability factors (subcharacteristics) such as maturity, fault tolerance, recoverability, availability on the level of proper measures. The corresponding factors are identified in international standards documentations. Substantial analysis of ISO/IEC 25023 approaches to quantitative evaluation of software reliability measures are performed based on peculiar features of special purpose automated systems meant for field use. As for the internal for maturity it is stressed that the ISO/IEC 25023 suggestion is characterized by significant errors in estimating the mean faultless time for software. The main reason is that the intensity of failures is declining as software faults are found and operation time growing. Such the effects must be taken into account. In view of fault tolerance importance for automated systems under consideration it is reasonable to increase the number internal measures including process restoration means for entrance errors, incorrect actions of the operator and so on. As a result some refinements for the choice of measures to estimate software reliability factors as well as for constructing the corresponding methods to calculate quantitative values of measures are proposed. To go into details it is recommended that the maturity internal measure calculation procedure must depend of software faults elimination process. The most promising in this attitude is the approach based on calculation the number of experiments till finding the fault when testing software. The approach is developed by one of the authors of the article.

Download PDF

Keywords Software; reliability; maturity; fault tolerance; recoverability; availability; measures.
References 1. Balyberdin V.A., Belevtsev A.M., Stepanov O.A. Voprosy otsenki i obespecheniya nadezhnosti programmnykh sredstv ASU spetsial'nogo naznacheniya [On special purpose automated systems software reliability estimation and maintenance], Izvestiya YuFU. Tekhnicheskie nauki [Izvestiya SFedU. Engineering Sciences], 2014, No. 4 (154), pp. 115-120.
2. Balyberdin V.A., Belevtsev A.M., Stepanov O.A. Analiz osnovnykh protsessov obespecheniya nadezhnosti programmnykh sredstv ASU spetsial'nogo naznacheniya [Analysis of basic software reliability controle processes for special purpose computer systems], Izvestiya YuFU. Tekhnicheskie nauki [Izvestiya SFedU. Engineering Sciences], 2015, No. 3 (164), pp. 62-70.
3. ISO/IEC 9126. Software Engineering – Software Product Quality. PDTR, 2002-2004.
4. ISO/IEC 14598. Information Technology – Software Product Evaluation, 1998-2000.
5. ISO/IEC 250nn. Systems and Software Engineering. Systems and Software Quality Requirements and Evaluation, 2005-2013.
6. GOST 28806-90. Kachestvo programmnykh sredstv [State Standard 28806-90. Quality software]. Moscow: Gosstandart, 1991.
7. GOST R ISO/MEK 9126-93. Informatsionnaya tekhnologiya. Otsenka programmnoy produktsii. Kharakteristiki kachestva i rukovodstvo po ikh primeneniyu [State Standard R ISO/MEK 9126-93. Information technology. Evaluation of software products. Quality characteristics and guidelines for their use]. Moscow: Gosstandart Rossii, 1993.
8. Lipaev V.V. Protsessy i standarty zhiznennogo tsikla slozhnykh programmnykh sredstv. Spravochnik [Processes and standards life cycle of complex software facilities. Guide]. Moscow: SINTEG, 2006, 260 p.
9. Stepanov O.A., Shumilo D.A. Metod otsenki programmnykh sredstv ASUV po rezul'tatam testirovaniya [Assessment method software tools acsv on the test results], Materialy vserossiyskoy konferentsii «Sovremennye tendentsii razvitiya teorii i praktiki upravleniya v sistemakh spetsial'nogo naznacheniya» [Materials of all-Russian conference "Modern tendencies of development of theory and practice of control systems of special purpose"]. Moscow: Sistemprom, 2014, pp. 11-14.
10. Balyberdin V.A., Stepanov O.A. Shumilo D.A. K otsenke nadezhnosti programmnykh sredstv ASUV. Aktual'nye problemy zashchity i bezopasnosti [To assess the reliability of software acsv. Actual problems of protection and safety], Trudy 14-y Vserossiyskoy nauchnoprakticheskoy konferentsii. Vooruzhenie i voennaya tekhnika [Proceedings of 14-th all-Russian interdisciplinary scientific-practical conference. Weapons and military equipment]. St. Petersburg, 2011, Vol. 1, pp. 603-608.
11. Balyberdin V.A., Belevtsev A.M., Stepanov O.A. Nekotorye problemnye voprosy upravleniya nadezhnost'yu programmnykh sredstv [Some problematic issues of reliability management software], Tezisy doklada na Vserossiyskoy konferentsii po upravleniyu kachestvom [Theses of the report at national conference on quality management]. Moscow: MATI, 2014, pp. 136-140.
12. Balyberdin V.A., Belevtsev A.M., Stepanov O.A. Analiz i obshchaya otsenka osnovnykh protsessov upravleniya nadezhnost'yu programmnykh sredstv spetsializirovannykh ASU [The analysis and a General evaluation of the main processes of reliability management software specialized ACS], Izbrannye nauchnye trudy. 14-ya Mezhdunarodnaya konferentsiya «Upravlenie kachestvom» [Selected scientific works. 14-th international conference "quality Management"]. Moscow: MATI, 2015, pp. 77-81.
13. Balyberdin V.A., Belevtsev A.M., Stepanov O.A. Optimizatsiya informatsionnykh protsessov v avtomatizirovannykh sistemakh s raspredelennoy obrabotkoy dannykh [Optimization of information processes in the automated systems with distributed data processing]. Moscow, 2002, 280 p.
14. Balyberdin V.A., Stepanov O.A., Ivanov V.V. Metody, modeli i algoritmy ratsional'nogo postroeniya informatsionnykh tekhnologiy v ASU [Methods, models and algorithms for the best tion in developing information technologies in automated control systems]. Moscow: 3 TsNII MO RF, 2012, 264 p.
15. Balyberdin V.A., Belevtsev A.M., Benderskiy G.P. Prikladnye metody otsenki i vybora resheniy v strategicheskikh zadachakh innovatsionnogo menedzhmenta [Applied methods of assessment and selection solutions in the strategic tasks of innovation management]. Moscow: Dashkov, 2013, 240 p.
16. Polonnikov R.I., Nikandrov A.V. Metody otsenki pokazateley nadezhnosti programmnogo obespecheniya [Methods for evaluating reliability of software]. St. Petersburg: Politekhnika, 1992, 78 p.
17. Vasilenko N.V., Makarov V.A. Modeli otsenki nadezhnosti programmnogo obespecheniya [Evaluation model of software reliability], Vestnik Novgorodskogo gosudarstvennogo universiteta [Vestnik of Yaroslav the Wise Novgorod State University], 2004, No. 28, pp. 126-132.
18. Lipaev V.V. Nadezhnost' i funktsional'naya bezopasnost' kompleksov programm real'nogo vremeni [Reliability and functional safety of complex real-time systems]. Moscow: ISP RAN, 2013, 176 p.
19. Lipaev V.V. Funktsional'naya bezopasnost' programmnykh sredstv [Software facilities functional security]. Moscow: SINTEG, 2004, 348 p.
20. Stepanchenko I.V. Metody testirovaniya programmnogo obespecheniya [Methods of software testing]. Volgograd: RPK Politekhnik, 2006, 76 p.
21. Balyberdin V.A., Penkin O.M., Polunin A.I. Problemnye voprosy sozdaniya i vnedreniya novykh informatsionnykh tekhnologiy v avtomatizirovannykh sistemakh voennogo naznacheniya [Problem questions of creation and introduction of new information technologies in automated military systems]. Moscow: Sektsiya voenno-tekhnicheskikh problem Rossiyskoy inzhenernoy akademii, 2001, 144 p.

Comments are closed.