Article

Article title DEVELOPMENT OF REQUIREMENTS TO AUTOMATIZATION TOOLS OF MESSAGE ANALYSIS PROCEDURE
Authors A.K. Melnikov
Section SECTION I. PRINCIPLES OF THE ARCHITECTURE OF SUPERCOMPUTERS
Month, Year 12, 2016 @en
Index UDC 004.382.2
DOI 10.18522/2311-3103-2016-12-616
Abstract In the paper we consider the procedure, which we developed for message analysis and which provides detection of messages with some meaning. The procedure is based on a generalized statistical method of analysis (GSMA), which with the help of statistical fitting criteria with equiprobable distribution provides selection of messages from the messages flow that have distribution of frequencies of their symbols occurrence close to equiprobable distribution. In our opinion, effectiveness of the GSMA application is the minimum number of messages with equiprobable distribution of symbols, which are taken for messages with non-equiprobable distribution of symbols. In total, the base of effective application of the GSMA and the procedure of message analysis is the use of statistics probability distribution corresponding to the parameters of the analyzed message in the used statistical fitting criterion. To keep the highest effectiveness of the message analysis procedure, various kinds of statistics probability distribution, such as exact, -exact and limit distributions which provide matching between the parameters of statistics probability distribution and the parameters of the analyzed message, are used in the GSMA. Besides, we present methods for calculation of the corresponding kinds of statistics probability distribution, and analyze computational complexity of these methods and boundary parameter values these methods can be used for. On the base of analysis of algorithmic properties of a generalized statistical method of message analysis we have developed requirements to a programming language for software implementation of the message analysis procedure, and requirements to computer facilities for message practical analysis using the developed software implementation of the procedure. Analysis of the developed requirements proved that it is possible to use the set description language SET@L as a programming language for software implementation of the message analysis procedure. Also, we have compared the characteristics of the programming language SET@L with the characteristics of the programming languages Cryptol and COLAMO to check their correspondence to the requirements of the algorithmic features of the GSMA. We have analyzed definitions and program structures of the language SET@L, owing to which the declared requirements can be fulfilled. According to the study of algorithmic features and computational complexity of the message analysis procedure we can conclude that it is necessary to use high-performance FPGA-based hybrid computer systems for practical message analysis.

Download PDF

Keywords Statistical criterion; probability distribution; procedure of analysis; software implementation; programming language; computer systems; FPGA; performance; computational complexity.
References 1. Mel'nikov A.K., Ronzhin A.F. Obobshchennyy statisticheskiy metod analiza tekstov, osnovannyy na raschete raspredeleniy veroyatnosti znacheniy statistik [A generalized statistical method of analyzing texts based on the calculation of probability distributions of values of statistics], Informatika i ee primeneniya [Informatics and its applications], 2016, Vol. 10, Issue 4 (in press). ISSN 1992-2264.
2. Kramer G. Matematicheskie metody statistiki [Mathematical methods of statistics]. Moscow: Mir, 1975, 648 p.
3. Pearson K. On the criterion that a given system of deviations from the probable in the case of a correlated system of variables in such that it can be reasonably supposed to have arisen from random sampling, Philosophical Magazine. Series 5, 1900, Vol. 50, No. 302, pp. 157-175.
4. Neyman F., Pearson E.S. On the use and interpretation of certain test criteria for purposes of statistical inference, Biometrika, 1928, Vol. 20-A, pp. 175-240, 264-299.
5. Smith P.F., Rae D.S., Manderscheid R.W., Silbergeld S. Exact and approximate distributions of the chi-squared statistic for equiprobability, Commun. Statist., 1979, Vol. B 8 (2), No. 1,
pp. 131-149.
6. Fisher R.A. Statisticheskie metody dlya issledovateley [Statistical methods for researchers]. Moscow: Gosstatizdat, 1958, 73 p.
7. Kendall M.G., St'yuart A. Teoriya raspredeleniy [The theory of distributions]. Moscow: Nauka, 1966, 302 p.
8. Rekonfiguriruemye mul'tikonveyernye vychislitel'nye struktury [Multiconference reconfigurable computing structure]. 2nd ed., pererab., dop., ed. by I.A. Kalyaeva. Rostov-on-Don: Izd-vo YuNTs RAN 2009, 344 p. ISBN 978-5-902982-61-6.
9. Guzik V.F., Kalyaev I.A., Levin I.I. Rekonfiguriruemye vychislitel'nye sistemy: ucheb. posobie [Reconfigurable computing systems: the textbook], ed. by I.A. Kalyaeva. Taganrog: Izd-vo YuFU, 2016, 472 p. ISBN 978-5-9275-1918-7.
10. Available at: http://www.galois.com/technology/communications_security/cryptol.
11. Levin I.I., Dordopulo A.I., Gudkov V.A. Programmirovanie rekonfiguriruemykh vychislitel'nykh uzlov na yazyke COLAMO: ucheb. posobie [Programming reconfigurable computational nodes in the language COLAMO: a training manual]. 2nd ed. Taganrog: Izd-vo YuFU, 2016, 114 p.
12. Levin I.I., Mel'nikov A.K. Metody upravleniya gibridnymi vysokoproizvoditel'nymi vychislitel'nymi kompleksami [Methods of management of hybrid high performance computing systems], Superkomp'yuternye tekhnologii (SKT-2014): Materialy 3-y Vserossiyskoy nauchno-tekhnicheskoy konferentsii [Supercomputer technologies (SCT-2014): Materials of the 3rd all-Russian scientific-technical conference]: in 2 vol. Vol. 1. Rostov-on-Donu. Izd-vo YuFU, 2014, pp. 55-60. ISBN 978-9275-1283-6.
13. Levin I.I., Mel'nikov A.K. Upravlenie gibridnymi vychislitel'nymi sistemami na yazyke SET@L [Control hybrid computer systems in the language of SET@L,] Materiály XI mezinárodní vědecko-praktická konference «Aktuální vymoženosti vědy – 2015» Díl 7. Moderní informační technologie [Materials XI international scientific-practical conference "Actual conveniences of science – 2015" Episode 7. The modern information technology]. Praha: Publishing House «Education and Science», 2015, 96 p., pp. 23-28. ISSN 978-966-8736-05-6.
14. Levin I.I., Dordopulo A.I., Gudkov V.A., Gulenok A.A., Bovkun A.V. Programmirovanie vychislitel'nykh sistem gibridnogo tipa na yazyke vysokogo urovnya COLAMO: ucheb. posobie dlya vuzov [Programming the computing system of the hybrid type for high level language COLAMO: proc. the manual for high schools.]. Rostov-on-Don: Izd-vo YuFU, 2016, 92 p.
15. Dordopulo Alexey Igorevich, Kovalenko Vasiliy Borisovich, Gudkov Viacheslav Aiexandrovich, Slasten Liubov Mikhailovna. Porting of parallel applications to reconfigurable computer systems with various architectures and configurations, 2016 Sth International Conference on Informatics Electronics and Vision (ICIEV) Year: 2016, pp. 1122-1127. DOI: 10.1109/ICIEV.2016.7760174.
16. Dordopulo A.I., Levin I.I., Kalyaev I.A., Gudkov V.A., Gulenok A.A. Resursonezavisimoe programmirovanie vychislitel'nykh sistem gibridnogo tipa na yazyke programmirovaniya COLAMO [Resourcesavesize programming computing systems hybrid programming language COLAMO], Superkomp'yuternye dni v Rossii. 26-27 sentyabrya 2016 g., Moskva, Rossiya [Supercomputing in Russia. September 26-27, 2016, Moscow, Russia], pp. 1087-1098.
17. Levin I.I., Dordopulo A.I., Kalyaev I.A., Doronchenko Yu.I., Raskladkin M.K. Sovremennye i perspektivnye vysokoproizvoditel'nye vychislitel'nye sistemy s rekonfiguriruemoy arkhitekturoy [Modern and perspective high performance computer systems with reconfigurable architecture], Vestnik Yuzhno-Ural'skogo gosudarstvennogo universiteta. Seriya Vychislitel'naya matematika i informatika [Vestnik of the South Ural state University. A series of Computational mathematics and Informatics], 2015, Vol. 4. No. 3, pp. 24-37. ISSN: 2410-7034.
18. Levin I.I., Dordopulo A.I. Programmirovanie perspektivnykh vychislitel'nykh sistem s rekonfiguriruemoy arkhitekturoy na yazyke COLAMO [Programming perspective computer systems with reconfigurable architecture on the COLAMO language], Materialy XI Mezhdunarodnoy nauchnoy i prakticheskoy konferentsii «Sovremennaya evropeyskaya nauka (Modern european science - 2015)», 30 iyunya – 7 iyulya 2015, Sheffild, Angliya [Materials of XI International scientific and practical conference "Modern European science (Modern european science - 2015)", 30 June – 7 July 2015, Sheffield, England], pp. 3-9. ISBN 978-966-8736-05-6.
19. Levin I.I., Doronchenko Yu.I., Mel'nikov A.K. Effektivnaya realizatsiya algoritmov s glubokimi tsiklami na rekonfiguriruemykh vychislitel'nykh sistemakh [Efficient implementation of algo-rithms with a deep cycle for reconfigurable computing systems], Materialy XI Mezhdunarodnoy nauchnoy i prakticheskoy konferentsii «Sovremennaya evropeyskaya nauka (Modern european science - 2015)», 30 iyunya – 7 iyulya 2015, Sheffild, Angliya [proceedings of the XI International scientific and practical conference "Modern European science (Modern european science - 2015)", 30 June – 7 July 2015, Sheffield, England], pp. 10-14. ISBN 978-966-8736-05-6.
20. Levin I.I., Dordopulo A.I., Kalyaev I.A., Gudkov V.A., Gulenok A.A. Programmirovanie vychislitel'nykh sistem gibridnogo tipa na osnove metoda reduktsii proizvoditel'nosti [Pro-gramming the computing system of the hybrid type based on the method of reduction perfor-mance], Trudy Mezhdunarodnoy nauchnoy konferentsii «Parallel'nye vychislitel'nye tekhnologii (PaVT’2016)», g. Arkhangel'sk, 28 marta – 1 aprelya 2016 g. [Proceedings of International scientific conference "Parallel computational technologies (PCT' '2016)", Arkhangelsk, March 28 – April 1, 2016]. Chelyabinsk: Izdatel'skiy tsentr YuUrGU, 2016,
pp. 131-140. ISBN 978-5-696-04663-1.

Comments are closed.