Software of Information-Measurement System for Standardless Diagnostic of Composite Materials

This article is devoted to software realization via NI LabVIEW 2011 for system of the standardless diagnostic of technical objects. The solution requires methods that are fast and efficient in diagnostics, adapted for usage condition changes, oriented for wide set of objects under control and without changes in the main software structure. The structure and main modules of developed software is represented in the article. Developed software advantages are in its architecture flexibility, high performance and reliability of data signal processing, human-engineered interface. The software of standardless diagnostics system is based on neural network classifier which provides flexible and stable knowledge base about possible classes of defects, performs effective operations with high dimensional data vectors, adapts its architecture for solving new tasks and provides the high reliability of control. The classifier based on hybrid neural network, ART-2 and Fuzzy-ART neural networks for classification of defects in honeycomb panels were introduced and investigated. Described classifier during the training can automatically change its settings, reaching the highest reliability of the control, detect and classify subsurface defects in honeycomb panels with high reliability and accuracy, as well as defects that are located on the back side of the cladding with plottage larger than 2 cm2 and thickness of composite panel equal to 12.8 mm. The reliability of the nondestructive testing via specified classifier is more than 95%. Results of the developed special software practical usage for honeycomb panels’ technical state classification were represented


Introduction
There are many methods and systems to diagnosis and classify the technical state of objects under control (OUC) [1][2][3][4]. However, their usage does not allow perfo rm high quality of standardless diagnostics of products that have complicated structure: composite material products, blades of gas tu rb in e eng ines, band age o f elect ric lo co mot ive wheelset, etc. St andard less d iagnostics o f such o b jects should b e p erfo rmed with methods wh ich wou ld allow accumulate ret rieved in formation about new defects, expand existed base of defects and increase d iagnostics system precis ion without restart ing (but in runt ime). The other problem is the high number of info rmative parameters that describe the technical state of object under control. In such cases the number of dimensions of the features space (that used for decision rules making) is high. It is difficu lt to use statistical methods for these purposes, because the analysis of high dimensional probability distribution functions should be performed. It results in significant usage of hardware and time resources.
Nowadays the developing of standardless diagnostics methods for controlling the technical state of products with complicated structure is actual problem. There are many researches devoted to problems of information-measuring systems construction and such issues as improvement of efficiency, accuracy, noise immunity, reliability, performan ce, and software poly mo rphism of these systems [5][6][7][8]. The solution requires methods that are fast and efficient in OUC diagnostics, adapted for usage condition changes, oriented for wide set of OUC and without changes in the main software structure [5]. Software of such diagnostics system must include next two blocks: • Diagnostics block. Its function is to find the parts with defects (anomalies) and/or to fo rm studying samples for classification problems. Tasks of this block could be divided on three groups: a. indicating diagnostics characteristics for d ifferent OUCs states (valid or invalid); b. forming learning samp les for every object state; c. decision rule making based on input vector of diagnostics characteristics analysis.
• Classification block. There are three groups of its functions: a. indicating diagnostics characteristics for d ifferent OUCs states (damage levels, defect types, etc.); b. forming features space and separating hyperplanes; c. classifying input in formative signals using different classification methods.
There is a lot of publications [19][20][21][22][23] in which the questions of efficient NN applying fo r tasks of objects under control state and defects determin ing, signal registration and classification, cluster analysis, etc. are discussed. For selection an optimal structure of NN that will be used as a part of info rmational-measuring system fo r nondestructive testing, it was investigated a set of such popular neural network arch itectures as Kohonen NN [25], mult ilayer perceptron [26], special hybrid NN [9,10], NN of adaptive resonance theory (ART nets), A RT-2 net [17,27,28] and Fuzzy-A RT [18,29]. As the result of analysis of these architectures the decision to use as the classifier core the ART-2, Fu zzy-ART and the hybrid neural network (which based on Kohonen NN and mu ltilayer perceptron) was made. All these neural networks allo w retrieve the highest control reliability during diagnostics of products from co mposite materials [17,18].

Problem Solving
For solving described problems authors have developed special informat ion-measurement system (software and some modules of hard ware) for standardless diagnostics of co mposite m aterials. Th e soft wa re of sta nd ardles s diagnosti cs system is based on neural network classifier which provides flexible and stable knowledge base about possible classes of defects, performs effect ive operations with high dimensional data vectors, adapts its architecture for solving new tasks and provides the high reliability of control. Neural networks also provide the invariance of system usage, efficient input data processing, analysis and classification without dependence on diagnostics and data collecting methods.
There are different software packages such as MathLab [30], NeuroSolution[31], NeuroPro[32], STATISTICA [33] and others that provide the ability to work with mathematical apparatus of neural networks. These packages could be used for solving the wide verity of problems. But in other hand they restrict the available NN architecture usage and do not allo w performing adjustment on neuron level, creating add-ons and developing new learning and functional algorith ms of NN. So me arch itectures of neural networks are absent in such software packages. Based on this fact software development of the nondestructive testing system was performed by authors in NI Lab VIEW 2011 development environment. Th is environment provides graphical programming language G and does not restrict the NN model implementation. NI Lab VIEW [34,35] allows developing new learning and functional NN algorith ms, creating new types of NN or merg ing/joining existing nets in one functional system. Also it is possible to use existing programming modules and DLLs. Lab VIEW 2011 environment performs parallel execution of algorithms which increases the performance of created nondestructive testing system software.
The nondestructive testing system software is developed by authors like a set of independent modules because of the need to solve the problem of standardless diagnostics for different object under control types with usage of only one system with possible minor changes for each specific task (difference could be in changing few existing functions or including new one for specific d iagnostics tasks). It allows connecting and integrating created earlier libraries and modules (wh ich were developed with high level languages) in the system core without its significant changes. This approach permits adding new or excluding unnecessary functionality, performing fast reconfigurat ion, modernizat io n, adaptation, etc. without any complexity.
Developed system for OUC technical state diagnostics is oriented on work with standard devices for retrieving init ial informat ion (defectoscopes) as well as with specialized data retriev ing devices (for specific tasks and OUC) which based on analog-digital converters (ADC). This is achieved by using generalized input-output module (I/O Module) which is developed by authors and interacts with defectoscopes or with specialized data retrieving systems. In the developed standardless diagnostics system structure ( Fig. 2) there are t wo main parts: hardware (includes a set of sensors, data acquisition unit and I/O Module) and software.

Hardware Part
The system's hardware part consists next blocks: • Set of sensors -init ial physical parameter transformers into electric signal; • Data acquisition unit -data acquisition platform cDAQ or cRIO (National Instruments) with set of ADC and specialized modules or specialized defectoscope that is used for experimental data acquisition; • I/O Module -interacts with defectoscopes or with specialized data retrieving systems and transmits data for subsequent data processing.
In case of use cDA Q p latform ( Fig. 1) co mmun ication with PC is performed via USB 2.0 interface. Channel capacity is equal to 3.2Mb/s. A set of ADC modules varies depending on specific tasks (required number of channels, sampling rate, dynamic range of input signal, etc). In the developed system the ADC NI 9215 is used. It has 4 simu ltaneously sampled analog inputs, 100 kS/s, ± 10V dynamic range, 16-bit resolution and 40 to 70 °C operating range. Like a physical method for detecting initial informat ion about object under control (detect defects of composite materials) the method of lo w-velocity impact [36] has been used. The method of low-velocity impact is based on measuring parameters of impact on the object under control. At the mo ment when firing-pin with a kinetic energy A affects on the object under control an impulse of shock interaction force arises. This impulse is characterized by an amp litude, duration, waveshape and brings rich information about technical state of object under control. The main part of information about technical state of OUC is concentrated in signal waveshape. The method of low-velocity impact is effective for diagnostics of fatigue damage, bundle defects, lin k breaks, defects which begin to born and also crack-like defects with millimeter size etc.

Software Part
Interaction between I/O Module and PC, informat ion stream organizat ion, data processing algorithms realization and displaying the result was implemented by authors in software part of the system (mathemat ical support, dataware and I/O Module software). The software architecture is displayed on Fig.3.
There are next main modules of system software: • ADC control module. This module includes units for configuring ADC parameters (sampling rate, dynamic range of input signals, number of ADC channels, synchronization source, etc.).
• System's reg ime control modu le. It is used for configuring such parameters of the system regime like the input data source (defectoscope, ADC or physical/optical data storage), system regime, etc.
• Data storages interaction control module. It allows reading/writ ing data fro m/to data storage. It also forms array or subarray of necessary informat ive parameters for importing them to other diagnostics systems or for creating reports. In case when read ing operation is performed this module fo rms the array fro m the stored data and represents it in required format.
• Reporting facilities and system output control modules.
These modules perform data transformation to convenient user-friendly format in case of data displaying or to required data storage format in case of data saving. Also it is possible to display or save on storage parameters of neural networks which are used in the system.
• Control module for system database. It allows read/write set of formed classes during system work as well as their additional specific parameters.
• Control module for neural networks. It allows user to choose the type of neural network that will be used for data processing and classification and setup its parameters. This module contains units which perform class forming of OUC, finding new classes, anomalies, and converting the neural network output to user-friendly format.
• Data buffer control module. This module writes retrieved data from A DC or defectoscope to array which further could be processed or saved for processing in future by current or another diagnostics system.
• Data processing module. It allows choosing the necessary diagnostics characteristics which the most informat ive for current case and use them instead the full set of characteristics. In some cases the data vectors of small dimension size could be used. For efficient diagnostics system work the input data should be preprocessed to in specific way. That's why in this module the necessary algorith ms are executed. Fig. 4 illustrates the interface of developed system. It contains control elements for ADC setting up, preparing and normalizing input data, choosing neural network type, choosing the NN learning algorith m and other parameters of NN. System user interface also contains elements for saving detected data signals, loading data form physical or optical storages, saving system output reports, etc.
The system allows: • input signal visualization; • detecting input signals informat ive parameters; • performing input signal preprocessing; • performing input data cluster analysis; • determin ing and building separating hyperplanes; • classifying the state of OUC and displaying the characteristics of its class; • saving the values of selected informative parameters; creating decision rule; • converting obtained results to user-friendly format.

Neural Network Classifier
Input data processing and signal classification is perform ed with usage of artificial neural networks. They are used due to fact that in the problems of nondestructive testing the NN allows to determine (classify) retrieved informat ive signals with high reliability and perfo rm co rrect classification of new signals which were not previously presented to neural network during train ing. The usage of neural networks guaranties the high noise immun ity, increases the reliability of control and entire system performance and decreases the system software and hardware costs.
The work of NN classifier wh ich based on Kohonen NN (Kohonen layer) and mu ltilayer perceptron could be described in such way. Firstly the mu ltid imensional array which describe system input signal co mes to classifier input fro m defectoscope, ADC or file stored on data storage. Ne xt this array is processed by Kohonen layer (it forms classes and training samples for mult ilayer perceptron training). Formed by Kohonen layer classes and samples are used for setting up the weights of mult ilayer perceptron. Classificati on is performed by the mult ilayer perceptron. The special observing unit determines appearance of new or abnormal objects which do not belong to any of the existent in the NN memo ry classes. In the case of such appearance the new class is formed in the system memo ry which corresponds for appeared object and the NN classifier performs reconfiguration. As a result there is no necessary to form the huge set of predefined etalon defects for system init ial configuring. Ho wever the system reconfiguring during new class appearance requires additional time resources.
After retriev ing fro m NN the information about defect class the system generates report about the result of nondestructive testing in the user-friendly format. It is stored on the data storage or displayed to operator.
The Kohonen layer is used due to ability to perfo rm cluster analysis and forming in itial training samples for mult ilayer perceptron training. The result of Kohonen layer work is a set of possible classes (defects of object under control). Ne xt this set could be used for initial mult ilayer perceptron training. In contrast to the classical realization of Kohonen NN or Kohonen maps in which due to different class sizes every class is described by several neurons, in the developed system the other approach is used. Every class has its own center and orbit which determines the variance of the objects in this class and specifies the size of class. Thus the informat ion about class (center and size) is contained only in one neuron from Kohonen layer. The Kohonen layer training is performed by WTA (winner takes all) method [37]. Each neuron in Kohonen layer determines the distance from new input object to class center, to class orbit and the quotient of these two values. Such algorithm allows define object class exactly. The lack of this approach is in concentrated NN me mo ry, i.e. informat ion about one class is stored in one neuron and in case of its crash informat ion about entire class will be lost. This lack could be resolved by using additional copying of NN parameters. However this copying needs less memo ry then approach with several neurons for one class but in cases of NN damage guaranties its reliability.
For defect classifying of objects from co mposite materials the multilayer perceptron with three layers and multip le numbers of neurons in each layer was implemented. The number of neurons in output layer depends on the number of possible object under control classes. The number of neurons in hidden layers depends on the complexity of separating hyperplanes for features spaces separation.
Every layer performs nonlinear transformation of the linear co mb ination of input layer signal (output signal of previous layer) and its weights. Based on mult ilayer perceptron classifier allows solving the wide set of classification problems with different comp lexity and has high reliability of control and classification.
For mult ilayer perceptron training backpropagation algorith m [37] was used. Train ing set for this purposes was created by Kohonen layer in the train of the cluster analysis of reg istered data. Program listing of module which performs Kohonen layer training is shown in Fig. 6a. There are t wo main blocks in this module: 1) Distance finder block -evaluates value of the d istance function. This value is used for calculating degree of similarity of the input vector and etalon vector in neural network's memo ry. Distance finder block imp lements the following distance functions: Euclidean, squared Euclidean distance, Manhattan distance, Chebyshev distance, Mahalanobis distance, Jeffries-Matusita distance etc. In more details this part of software is described in [24].  2) Transformation b lock -transforms input vector in way that is needed for implementation of the "convex combination" algorith m [38]. Method of convex co mbination provides most optimal distribution of classes centers density.
For mult ilayer perceptron train ing it was developed program module wh ich imp lemented some variety of gradient methods (Fig. 6b).
For neural network train ing it is possible to choose back propagation algorithm or one of its modifications (resilient propagation -RProp, second order algorith ms, training with mo ments etc.). Program module for mu ltilayer perceptron training performs sequential iterative process of developed neural network training using one of training algorith ms, allo ws visualizing an error function of multilayer perceptron training. Train ing process stops if value of error function is lower than some specified threshold value. Program listing of module wh ich imp le ments multilayer perceptron is presented in Fig. 7.
ART neural network [39] is a vector classifier wh ich contains two layers of neurons (bottom-up layer or comparison layer and top-down layer or recognition layer). The algorith m of the ART neural networks which are used in developed software for signals classification is shown on Fig.  5.
During the classification process, the input signal is processing according to the weights of the neurons in comparison layer of an A RT-network. The signal is then fed to a recognition layer where the competitive search of the one single winning neuron (the neuron with an active output signal) is performed. Winner neuron is a neuron whose weight vector lies closest to the input vector (signal). This neuron, that becomes active under the influence of the input signal, corresponds to a particular class (pattern), wh ich was formed in the memory of neural network and could include an input signal. On the next stage a feedback signal fro m the winner neuron in the recognition layer comes back together with weights of an appropriate neuron to the comparison layer In the co mparison layer input signal is checked for compliance with the pattern in the network memory. If this pattern does not correspond to the input signal, the activity of the winner neuron in the recognition layer must be suppressed and the search phase for the new winner neuron (pattern) in the network memo ry should be performed again but without suppressed neuron. The algorithm is repeated until correct pattern is found or all neurons in the recognition layer are suppressed. If all neurons in the recognition layer are suppressed, then it means that the input signal belongs to the new pattern. This new pattern was not registered by neural network earlier and it didn't similar to any of the previously registered patterns, stored in the network memo ry. In this case, the neural network will generate a new class and will provide a new neuron in the recognition layer. If during the search phase correct pattern (appropriate neuron with the corresponding weights) is found in the recognition layer, then the search phase stops and neural network generates as its output a signal that corresponds to one of the existing classes. Weights of the winning neuron in the recognition layer will be adapted according to appropriate network teaching rules [17,18,[27][28][29]. So desired signal pattern in network memo ry will in mo re general form describe the group of signals which belong to the appropriate class.
For information signal processing the ART-2 and Fuzzy-A RT neural networks were used. Classificat ion of defects via the ART-2 and Fu zzy -ART neural networks is performed by analyzing changes of the registered signals shape, forming in the memory of neural network desired informat ive signal patterns which correspond to non-defect parts of controlled samp les and comparing registered signals with generated patterns.
Program listing of modules which realized ART-2 and Fuzzy-A RT neural networks is shown on Fig. 9.

Experimental Part
For the developed software testing were used samples of honeycomb panels which were provided by the state enterprise "Antonov" and were used in the manufacture of aircraft models "An": Two samp les (S1 and S2) of honeycomb panels fro m wings of aircraft type An-70 (Fig. 8a, 8b) of the material ELUR-P-0.1 and honeycomb filler PSP-1-2.5-45 with 10 mm o f thickness with artificially formed defects. The following types of defects were under control: peeling skin on the inside of the filler cladding (Fig. 10a, 10b); control was made fro m the outside of the cladding; One sample (S3) of the co mposite panel of alu minu m alloy sheet gluing and sealing "viksint" which is used on the aircraft An-140 ( Fig. 8c) with artificial defects like as delamination of the sealant. Control was made fro m the outside of the cladding (Fig. 10c). Areas of defects under control were div ided on the points with distance between each point equal 2 mm. Scanning was performed with a d iscrete step equal 2 mm in the direction indicated in Fig. 10. The numbers near the borders of areas with defects mean number of scanning points, were area with defect is begun and ended. The developed software has been tested for the detection and diagnosis of defects in described samples of co mposite materials. Thus, the diagnosis of defects in described samples of honeycomb panels with artificial defects and signals processing was performed v ia three groups of methods: 1) Analyzing the amp litude and duration of the registered signals in individual and co mplex (by grouping these two parameters to the aggregate feature space) way, and constructing between different object states (defect -without defects) separating hyperplanes via a hybrid neural network [4,5].
2) Statistical analysis of the registered signals, which includes spectral transformation of informat ion signals and subsequent analysis of the spectral densities using chi-square distribution.
3) Analyzing the change of the registered signals shape via neural networks of adaptive resonance theory (ART-2 and Fuzzy-A RT) [17,18], because changes of signals shape allow with high reliability detect defects presence in honeycomb panels and classify its type. For the nondestructive testing of described samples for each sample and each area (without defect and with different defects) 250 realizations of the informat ive signals were obtained (Fig. 11). During the control process registered signals were given one by one in a casual order to the neural network entrance. After an appropriate signal was given to system, it was removed fro m input samples collection. This After the classifier has formed its data base the verification of the nondestructive testing reliability v ia described software has been performed. For these purposes for each area 100 new signals were obtained and given to the neural network for classification. Obtained results of the nondestructive testing reliability of products fro m co mposite materials using described signal processing methods are presented on Fig. 12.
Obtained results shows that the decision rule based on spectral transformation of information signals and subsequent statistical analysis of the spectral densities using chi-square distribution as well as the decision rule based on separating hyperplanes constructed in the coordinate system amp litude-duration via hybrid neural network failed to detect defects with plottage less then 2 cm 2 (defect 3 on the samp le 1 and defect 2 on the sample 2). During control the sample 3 amp litude peaks are located on counts 7-12 and 20-23 that corresponds to areas with largest defects (defect 1 with plottage 5 cm 2 and defect 2 with plottage 2 cm 2 ). However, due to the low information content of signal's duration values, it is impossible to determine the presence of defects 1-3 with plottage 5, 2 and 1 cm 2 , respectively in the sample 3 using for signal processing groups of methods 1 and 2. At the same time using the amplitude and duration of the data signals as informative parameters during control defects with plottage greater then 5 cm 2 (defect 1 on the sample 1 and sample 2) it was obtained reliability of the control about 90 %. Using spectral transformation and subsequent statistical analysis during control the same defects it was obtained reliability of the control about 90-93%.
Usage of ART-2 and Fuzzy-A RT neural networks for the registered information signals processing during the control of honeycomb panels allo ws to determine bounds of defective areas 1 and 2 with plottage 5 and 2 cm 2 respectively on the sample 1 and a defective area 1 with plottage 5 cm 2 on the sample 2. Also, unlike the groups of methods 1 and 2, classifier based on ART-2 and Fu zzy-ART neural networks has detected bounds of the defective areas with plottage 2 cm 2 (defect 3 on the sample 1 and defect 2 on the sample 2). Also, with this classifier bounds of the two of three defective areas on the sample 3 were successfully detected (defect 1 and defect 2 with plottage 5 and 2 cm 2 respectively). So, it could be extended that usage of classifier based on ART-2 and Fuzzy-A RT neural networks in nondestructive testing of honeycomb panels allows to detect defects with plottage greater then 2 cm 2 which is difficult or impossible with most currently used methods of diagnosis. The reliability of control via described classifier is over then 95%.

Conclusions
Special software of nondestructive testing system was developed by authors. This software allows obtain mo re informat ion about the technical state of comp lex objects under control, perform classificat ion of possible defects and detect appearance of anomalies in material structure. Devel oped software increases the reliab ility of the object's technical state classification, reduces timetable and computational burden for data signal processing and decision making.
For signal processing in developed software classifier based on hybrid neural network and neural network of adaptive resonance theory (ART-2 and Fu zzy-ART) is used. It allows provide non-linear separation and classification of objects by a set of diagnostic parameters, detect co mplex relationship between the damage degree of an object under control and informative parameters values. Described classifier during the train ing can automat ically change its settings, reaching the highest reliab ility of the control, detect and classify subsurface defects in honeycomb panels with high reliability and accuracy, as well as defects that are located on the back side of the cladding with plottage larger than 2 cm 2 and thickness of composite panel equal to 12.8 mm. The reliability of the nondestructive testing via specified classifier is more than 95%.
Developed software advantages are in its architecture flexib ility, high performance and reliab ility of data signal processing, human-engineered interface. At the moment developed software is in pilot testing and used at the department of info rmation-measuring systems of the National Aviat ion University for the experimental data processing obtained during the nondestructive testing of composite materials.