Research on the Natural Language Recognition Method Based on Cluster Analysis Using Neural Network

Institute of Data Science, City University of Macau, Macau 999078, China High School Attached to Capital Normal University, Beijing 100048, China Institute of Computer Technology and Information Security, Southern Federal University, Rostov-on-Don, Russia Al-Nahrain University, Al-Nahrain Nano-renewable Energy Research Center, Baghdad, Iraq Department of Computer Science, College of Computers and Information Systems, Umm Al-Qura University, Makkah, Saudi Arabia Department of Computer Science, College of Computers and Information Technology, Taif University, P.O.Box 11099, Taif 21944, Saudi Arabia Department of Information Technology, College of Computers and Information Technology, Taif University, Taif, Saudi Arabia


Introduction
Clustering is a fundamental approach that explores data mining, image analysis, and various other pattern recognition methods for grouping the data into clusters. Natural language processing also deals with the introduction of clustering phenomenon utilizing the various aspects of deep learning [1]. e previous studies demonstrated the utilization of artificial intelligence [2,3] methods in order to refine it to form structured knowledge using the primitive knowledge of human natural language. is link is called knowledge extraction. At present, in terms of natural language processing theory and technology, there are mainly formal language processing methods, semantic-based natural language understanding methods, and research on grammar inference. In terms of formal language processing, people have achieved many mature results, especially the processing technology of unrelated grammar, and the compilation principal technology based on the derivation tree and automata theory has penetrated into various related fields of computer research. However, the formal language understanding mechanism requires a high degree of consistency in language expression and lacks flexibility, so it is lacking in the adaptability of natural language processing [4].
So far, there is still a lack of effective methodology for the determination of engineering characteristics in intelligent systems and realizing the function of knowledge extraction. In fact, the understanding of natural language is a formal matching process, and this understanding can be reduced to a cluster recognition process [5][6][7]. e basic block diagram of the natural language processing method using the cluster recognition approach is depicted in Figure 1.
For intelligent systems for engineering applications, the natural language concepts mainly involve knowledge concepts in a limited field and limited sentence expressions, showing obvious clustering characteristics in sentence structure. erefore, the natural language vectorization method is adopted [8]. First, the natural language is vectorized, and then the adaptive neural network is used to cluster the vectors in the hyperspace of the obtained sentence vector. After the recognition processing, each group in the same cluster set is recognized. Sentences will have similar or the same way of understanding, which can alleviate the contradiction between the variability of natural language and the strictness of formal language recognition [9]. In addition, it is necessary to establish a dynamic update mechanism of the knowledge system, which can not only automatically create a structured knowledge system but also can dynamically structure and maintain the knowledge system in the intelligent system. According to the inclusive relationship between the various knowledge objects involved in natural language, structural modeling methods can be used to dynamically generate knowledge objects, their structure, and the relationship between them (such as the derived relationship between objects). Based on this knowledge structure generation mechanism, as long as a new knowledge description (such as natural sentences) appears, the system can describe the augmented knowledge. e collection is automatically reconstructed, and then an updated knowledge system is obtained.
is article proposes a dynamic knowledge extraction method based on sentence clustering recognition. e work provides a novel research framework of the dynamic knowledge extraction method while considering the conversion process from natural language processing to object-oriented knowledge system. In this work, sentence vectorization is studied, some basic definitions and a judgment theorem are given, and the postprocessing of sentence element attribute vectors is discussed. e credibility of sentence recognition results is achieved using the concept of prereliability while utilizing the ART2 network and MATLAB analysis. e article proposes a new method of structural modeling for the generation of structured derivation relationship, thus completing the natural language knowledge extraction process of the object-oriented knowledge system. e application example of mechanical CAD is considered in this work which uses the background throughout the text, demonstrates the specific implementation of the example, and confirms the effectiveness of the proposed method. e rest of the article is arranged as follows: Section 2 discusses the review of the existing state-of-the-art work in the literature. Section 3 presents the research foundation of the knowledge dynamic extraction method followed by the statement clustering recognition based on neural network in Section 4. Section 5 provides the intermediate code generation and Section 6 analyzes the results of dynamic generation of object-oriented knowledge structure followed by the concluding remarks in Section 7.

Literature Review
Wang et al. considered the data of the P2P network loan platform as a reference and selected 24 typical P2P network loan platforms as the sample of empirical research in order to construct the comprehensive evaluation index system. Secondly, using factor analysis and cluster analysis, the comprehensive score and grade division of 24 P2P network loan platforms are given. Finally, according to the research results, some reasonable suggestions are put forward to provide a reference for investors to choose platform and platform business model optimization [10]. Sun et al. took the carrying capacity of resources and environment, the existing development density, and the development potential as the leading factors, combined with the development advantage and development orientation of Xuzhou, and established the evaluation index system of each region of Xuzhou. Using SPSS software, the whole Xuzhou city is divided into the development core area, the key development area, the optimization development area, and the restricted development area. Finally, the author put forward a way to optimize the allocation of land resources in Xuzhou so as to promote the industrial structure adjustment and economic development of Xuzhou [11]. Ran et al. compared the clustering results and algorithm efficiency of different clustering algorithms for a small number of load datasets and then compared the clustering results and clustering efficiency of these algorithms for a large number of load datasets. e results show that the partition-based analysis algorithm has a good clustering effect on load datasets. e user behavior patterns are divided into eight categories: bimodal, wind-avoiding, stationary, single-peak stable, single-peak, back-peak, fluctuating, and forward; finally, according to the results of cluster analysis, the single-peak type and single-peak stability are selected and double peak type and large power consumption customers are adjustable users. Different fault peak control schemes are formulated for this type of users, and the economic benefits brought by different control schemes are compared [12].
A variety of language processing methods have been developed for the search and classification of texts and to acquire dynamic connection knowledge within them [13]. Pimm et al. [14] presented an approach for automated analysis of linguistic features highlighting various aspects of challenges in this field. Tanguy et al. [15] proposed an application of natural language processing in the classification of aviation safety data. is method provides a way to analyze the text for the quantification of key elements in aviation incidents. Subramanian and Rao [16] developed a method for the categorization of different flight safety event categories for the extraction of textual narratives for time-series forecast of various incidents related to it. e clustering analysis has significantly been used for exploring the context of aviation for the prediction of accidental risk [17,18]. Natural language processing has also found its applications in various domains of predictive operation in the airline industry for classification and pattern recognition [19,20]. e literature has presented the usage of natural language processing in multiple domains, therefore encouraging its usage in dynamic knowledge extraction and clustering recognition. e utilization of natural language processing to object-oriented knowledge has also shown various manifold possibilities for investigation. e literature suggests that the previous studies utilizing the neural network platforms largely focus on the typical clustering perspective of the networks. However, this article utilizes dynamic knowledge for addressing the challenges of natural language processing in the object-oriented knowledge system. A credible sentence clustering recognition method is presented in this work that uses the concept of prereliability while utilizing the ART2 network and MAT-LAB analysis.

Research Framework.
e basic steps and functions of knowledge extraction based on sentence clustering recognition are as follows: directly input the Chinese natural language in a human-computer interaction environment. en, use the background thesaurus and Chinese word segmentation algorithm to segment the initial sentence into keywords and punctuation. e sequence of sentence elements is composed of symbols and the vector expression of sentences is obtained through the nonmonotonic sentence vectorization method based on sentence elements. In view of the randomness of natural language, the pattern recognition function of the neural network is used to analyze sentence clustering [21][22][23]. In turn, various static and dynamic knowledge structures are obtained, and finally, the structural modeling method is used to generate an object-oriented knowledge system based on the mutually inclusive relationship between static knowledge structures. e dynamic knowledge that has been obtained is filled into the object body so as to realize the knowledge dynamic extraction of sentence clustering recognition. e overall framework of this research is shown in Figure 2.

Related Definitions and eorems
Definition 1. Sentence element (the smallest logical unit of a sentence): a sentence through word segmentation consists of a series of words and punctuation marks.
To complete, use Li to represent the words or punctuation in the sequence and define Li as a sentence element. Such a sentence can be expressed as L 1 ⟶L 2 ⟶. . .⟶L n . e sentence element is the smallest unit of the logical meaning of the sentence, which is the grammatical analysis and semantic analysis. e smallest segmentation is the primitive of "meaningful sentences." e attributes of the sentence element: the attribute x of the sentence element L reflects the possible functional categories of the sentence element in the sentence, and it is the functional description of the sentence element [24][25][26].
e attribute set of the sentence element: the attribute set of the definition sentence element L is X � {x 1 , x 2 , . . ., x m }. e sentence element attribute set reflects all the sentence elements in the sentence possible functional categories; it is a description of all the functions of the sentence element.

Definition 4.
e certainty of the attributes of a sentence element: the certainty of the attribute of a sentence element CF is a fuzzy measure of the effect of each attribute of a sentence element in a sentence, which satisfies the following expression: Mathematical Problems in Engineering 3 Definition 5. e attribute support of sentence element x is given by the following expression: (2) Definition 6. e certainty of sentence element attribute support CF is given by the following: Among them, x ∈ x. Theorem 1. e sufficient conditions for the judgment of sentence ambiguity are as follows: (1) In the sentence element sequence corresponding to the sentence, the number of elements with the attribute support of a sentence element is greater than 1. (2) ere is a sentence element attribute support set. e degree of certainty CF is less than the fuzzy level value Κ.

Postprocessing of Sentence Element Attribute
Vector. e method of sentence vectorization has been introduced in detail in the literature. e basic step is to divide a sentence into a sequence of several sentence elements through a word segmentation algorithm and then use a nonmonotonic optimal part-of-speech analysis model to determine each sentence subjected to the functional attributes of the element. Obviously, the dimension of the sentence element attribute vector obtained in this way is equal to the length of the sentence element sequence generated by the word segmentation, but some elements in this vector can also be combined to a certain extent [27][28][29]. Sentences are a kind of division. Layer structure, under different granularities, in the same sentence can present different content. Generally speaking, the more granular the level of analysis of the sentence, the richer the content of the sentence and the more accurate the understanding of the sentence. Sentence element postprocessing determines at which granular level the sentence is to be recognized and analyzed, that is, to extract the main components of the sentence and remove the secondary components. At the same time, the sentence element postprocessing can also remove the natural language. At a certain level of granularity, the function is equivalent, resulting in repeated ingredients.
e following are a few typical postprocessing rules: (1) Combine the "{adverb} + adjective" component in the vector corresponding to the parallel modification to make it an abstract "{adverb} + adjective" modifier component, that is, a subvector in the sentence vector. (2) Put multiple nonrestrictive attributive clauses after the commas in the vector are merged into an abstract nonrestrictive attributive subvector. (3) Multiple nouns are combined as attributive components and abstracted into a modifier subvector. e following is an application example with mechanical CAD as the background. is example will run through the full text to illustrate the specific implementation of the method in this article. Suppose there are the following two sentences a and b, which are regarded as standard sample sentences [30][31][32].
According to the word segmentation algorithm, their respective sentence element sequences can be obtained as follows:   Mathematical Problems in Engineering Among them, "if," "then," and "only if" are keywords retrieved from the background thesaurus.
Set the quantized value of the abstract relational operator to 1, the quantized value of the logical operator is 2, the quantized value of the keyword "if" is 3, the quantized value of the keyword "then" is 4, and the quantized value of the comma is 5. e quantized value of the period is 6, the quantized value of the comma is 7, the quantized value of the general noun is 8, the quantized value of the keyword "only if" is 9, the quantized value of the keyword " � " is 10, rhe quantized value of the keyword ">" is 11, the quantized value of the keyword "<"is 12, etc. Based on this, the vectorized result of the sample sentence a, b is as follows: Statement a: 3 2 8 2 8 2 10 2 8 2 4 2 8 2 8 2 10 2 8 2 6 (a-2). Statement b: 8 2 8 2 10 2 8 2 9 2 8 2 8 2 10 2 8 2 6 Here is a sentence to be processed: Statement c: if the model of the milling machine is small, its feed type is desktop feed, and its table width is greater than 80.0, then the motor type of the continuously variable motor is "Z2 2 61," and its motor _ j is equal to 0.56, its motor power is 5.5, its maximum motor speed is equal to 1000, and its minimum motor speed is equal to 10. (c-0).

Selection and Design of Neural
Network. e sentence element attribute vector obtained in the previous section Y � (X 1 , X 2 , X 3 , . . . , X n ) represents a point in n-dimensional space, for a set of M sentence element attribute vector In other words, it is the mapping result of the initial natural sentence to this n-dimensional vector space. Regarding these points as pattern samples, the patterns with the same category or some similar characteristics are also relatively close in the n-dimensional space. ese points are in the space and the clusters are distributed in clusters. To determine the location and distribution of each cluster, you first need to determine the typical samples of the cluster and treat them as the center of each cluster. ese typical samples may be one of the sample sets, or it may be a vector calculated from each cluster sample and located at the center of each sample group [33,34].
is article uses Carpenter and Grossberg's adaptive resonance network ART2 and Kohonen learning method to measure the Euclidean distance of each point in n-dimensional space. As long as any mode is located in a hypersphere with a certain radius near the center of a cluster, it is considered to have the mode characteristics of this cluster; that is, each vector point in the same cluster has the same sentence function structure.

Definition 7.
e prereliability PT is a function of dst, which satisfies the following conditions: e smaller the distance from the sentence vector to the center of the cluster, the higher its prereliability. When the sentence vector is outside the critical cluster radius, its prereliability is negative; that is, it is not credible. e form can be linear or nonlinear, depending on the actual situation. Obviously, prereliability is a measure of sentence recognition results.

e Effect of ART2 Network on Sentence Recognition.
Continue to use the example in the previous section. Among them, three sentence vectors (c-2), (a-2), and (b-2) are not equal, but in this simpler example, it can be seen that (c-2) and (a-2) have greater similarities. Accordingly, MATLAB is used to write an ART2 network simulation program, which clusters the input sentence vector and graphics function to convert the sentence into dimensional space. e problem of clustering recognition in dimensional space is represented by a plane diagram (see  corresponding to the number of adaptive learning times 400, 600, 800, and 1000, respectively), which is the projection result of this highdimensional problem on a hyperplane. In the figures, the two asterisks on the left represent sentences (a-2) and (c-2), the asterisk on the right represents sentences (b-2), and the two circles represent the adaptive output pass vector of the ART2 network. ey also indicate that the center of each cluster under the current adaptive learning times can be known from the above figures. rough cluster recognition, it is found that (c-2) and (a-2) belong to the same cluster set, so you can follow the semantic model of sentence a used to construct the semantic model of sentence c, which is also consistent with the result of direct observation.
In addition, we also used the ART2 network to recognize sentences with vector dimensions. Figure 7 shows the recognition effect with the vector dimension and the number of neural network output nodes as independent variables. In actual processing, the sentences with different vector dimensions are expanded to 20 dimensions and recognized by the ART2 network. erefore, the vector dimension in Mathematical Problems in Engineering Figure 7 actually refers to the effective vector dimension before the expansion transformation. From the surface characteristics shown in Figure 7, the following can be seen: (1) In the case of a certain vector dimension, the fewer the number of output nodes of the neural network, the slower the recognition speed of the network; conversely, the more the number of output nodes of the neural network, the faster the recognition speed of the network. (2) When the number of network output nodes is constant, the number of iterations identified by the neural network is basically proportional to the vector dimension.
(3) When the number of spatial clusters is much larger than the number of network output nodes, the recognition effect of the ART2 network gradually deteriorates. Based on this, the following conclusions can be drawn: in order to ensure the recognition effect of the ART2 network on sentences (including recognition accuracy and recognition speed), the   network must have a sufficient number of output nodes, generally not less than the number of standard sentence samples.

Intermediate Code Generation
Intermediate code generation is based on the result of sentence recognition by the ART2 network, converting each sentence after clustering into knowledge form and generating a knowledge expression form that can be recognized by subsequent processing. Here is a "conjunctive" form of rule knowledge expression; the details give the intermediate code generation method. Regarding the intermediate code generation method of other forms of statements, similar promotion can be made according to the specific situation.

Width-First Method of Intermediate Code Generation.
e sentence is regarded as a tree structure, the sentence elements belonging to the main sentence component are located close to the root node of the tree structure, and the sentence elements belonging to the secondary sentence component are located far away from the root node of the tree structure.
is can be based on intelligence and the breadth-first method in the search generates the corresponding intermediate code structure while traversing the sentence structure tree. e specific steps are as follows: Step 1. Construct the structure tree of the sentence corresponding to the "sample vector" in the cluster, and set N as the depth of the structure tree.
Step 2. Construct the intermediate code framework corresponding to the sentence structure tree corresponding to the "sample vector" in the cluster.
Step 3. Set the level depth pointer n � 0.
Step 4. According to the sentence elements of the nth layer in the sample sentence structure tree, according to certain rules, extract the corresponding sentence elements of the currently processed sentence (nonsample sentence), and put them into the corresponding unit of the sample intermediate code framework obtained in Step 2.
Step 5. n plus 1. If n < N, then return to Step 4; otherwise, go to Step 6. End.

Width-First Code Generation
Method Based on Conjunctive Rules. In an intelligent system, the "conjunctive" form of the rule structure is shown in Figure 8. e intermediate code generation method for conjunctive rules is given as follows: Step 1. Construct a structure tree of sample sentences expressing conjunctive rules.
Step 2. Construct the intermediate code framework corresponding to the conjunctive rule sample sentence structure tree.
Step 3. Read the uppermost sentence elements "if" and "then" in the processed nonsample sentences, and put them into the uppermost unit of the intermediate code framework.
Step 4. Read the sentence elements of each expression object in the processed sentence and put them into the sublevel unit of the intermediate code framework.
Step 5. Read the sentence elements of each attribute in the processed sentence and put them into the lower unit of the corresponding object sentence element of the intermediate code frame.
Continue to use the previous example, first construct the structure tree of sample sentences a and b, as shown in Figures 9 and 10.
According to the result of the ART2 pattern recognition, the recognized sentence c and the sample sentence a belong to the same cluster set. erefore, the semantic structure of sentence c can be constructed by the breadth-first method according to the structure tree of sentence a, and the structure tree is shown in Figure 11.

Postreliability.
For a sentence clustering set, if the sample vector is set to be the cluster center, then there are two situations that may occur through the width-first method generated by the above code: (1) For nonsample sentences with previous reliability less than 1, the structure tree is different from the structure tree of sample sentences; that is, there may be nodes that are not filled. (2) Of course, there may also be cases where the content of nonsample sentences is richer than that of sample sentences. In this case, the width-first method will cause part of the semantics to be lost. For the former case, the definition of posterior reliability is given as follows.

Definition 8. Postreliability AT � q(i).
Here, q(i) is the weight of the node i actually filled in the structure tree obtained by the width-first method for the nonsample sentence. Let the weight of the node i of the structure tree of the sample sentence be q (i), then the sum of the weights of each node of the tree is obviously 1, that is, q(i) � 1. For nonsample sentences, the sum of the weights of each node actually filled by the structure tree obtained according to the width-first method should satisfy q(i) ≤ 1. It can be seen that postreliability is a final evaluation index for the credibility of sentence recognition and semantic model construction. For nonsample sentences with prereliability of 1, the final postreliability must also be 1. For sentences with high prereliability, the corresponding postreliability will also be higher in a statistical sense. erefore, the prereliability and postreliability are both beliefs about sentence recognition and semantic model construction incomplete matching methods and degree measurement.

Dynamic Generation of Object-Oriented
Knowledge Structure

Conventions of the Object Model.
e object is used as the basic constituent unit of the knowledge system, and the object is composed of attributes, rules, and methods.
(1) Attribute: an attribute is a combination of attribute name, attribute type, attribute value, and operation type, which reflects the static knowledge structure of the object. e attribute type can be numeric, Boolean, string, or multimedia information; of course, it can also be an object. (2) Rules: they reflect the dynamic knowledge of different attributes in the contact object or the same object. In actual use, the main purpose of the rules is to provide a basis for filling in some unknown object attributes according to known conditions, thus reflecting links between static knowledge structures. (3) Method: it embodies the steps taken by humans to solve specific problems. It finally achieves specific functions by alternately calling rule inference engines and various numerical calculation tools.
Definition 10. Object reachability relationship. Suppose two objects OBJ1and OBJ2; for each attribute Attr2j ∈ OBJ2 in OBJ2, there exists an Attr 1i ∈ OBJ1, which satisfies Attr2 j � A ttr 1i. It is said that OBJ1 can reach OBJ2 (that is, the attributes of OB J1 include the attributes of OBJ2).

6.2.
Steps to Structure Object-Oriented Knowledge. For using our new structural modeling method to further structure object-oriented knowledge, the steps are as follows: Step 1. Read each object structure generated by the intermediate code. Step 2. According to the static knowledge containment relationship between the objects, use the structural modeling method to find the inheritance relationship between the objects and then obtain the derived object architecture. e decomposition steps are as follows: 2.1. First, according to the static structure of the object, construct the system reachability matrix according to Definition 10. 2.2. Find the strongly connected subset of the system. Each object in the same strongly connected subset has the same static knowledge structure, but their dynamic knowledge is generally different. 2.3. Pick any element from each strongly connected subset to characterize the subset it is in, which constitutes a reduced system of the original system. 2.4. Perform area division, if and only if there is an inheritance relationship between objects in the same area. 2.5. Find the skeleton matrix of the reduced system. 2.6. From the element a ij � 1, which is 1 in the skeleton matrix, determine that element j is the parent of element i, thereby generating the inheritance system of the object. Now, it is still explained by the example in mechanical CAD; suppose the milling machine is represented by x1; the continuously variable motor is represented by x2; the model is "small," and the milling machine whose feed type is "table feed" is a milling machine 1. It is expressed by x3; the model is "medium," the feed type is "table feed," and the milling machine whose worktable width is less than 2500. 0 is milling machine 2. It is expressed by x4; the model is "small," the feed type is "table feed," and the milling machine with a worktable width greater than 800. 0 is milling machine three, which is represented by x5; because of the different parameters of the continuously variable motor, there are motor one, motor two, and motor three, represented by x6, x7, and x8, respectively. ey form system S � {x1, x2, x3, x4, x5, x6,  x7, x8); for convenience, use subscripts instead of elements; that is, S � {1, 2, 3, 4, 5, 6, 7, 8}. In terms of statistics and the mutually inclusive relationship between its static knowledge structures, the reachable matrix of S is obtained as follows: Among the row vectors of compositionRe ∩ R T e , there is no row vector that is not equal to the other and has more than one component of 1. According to the literature inference 1, this result indicates that there is no strong connected subset in the system.

Validation of the Object-Oriented Knowledge-Based
System against Other Methods. For the validation of the object-oriented knowledge-based system presented in this article, various other methods have been reviewed in the literature. Some of the methods are compared in Table 1 to the technique presented in this article for the verification of the proposed approach.
is tabular comparison reveals the effectiveness of the presented method evaluating its credibility for sentence recognition and semantic model construction. is method utilizes structural modeling in order to create a link between natural language processing and the object-oriented knowledge system [56][57][58][59][60].

Conclusion
is article proposes a method of dynamic knowledge extraction based on sentence clustering recognition and neural networking. e proposed system is based on the clustering phenomenon of natural language in the engineering field and accomplishes the requirements for the dynamic update of the knowledge system. e credibility of the sentence clustering recognition method is demonstrated using the concept of prereliability while utilizing the Carpenter and Grossberg adaptive resonance neural network ART2 and Kohonen learning method. e work presented in this article establishes a research framework of knowledge dynamic extraction, which demonstrates the conversion process from natural language documents to object-oriented knowledge system. e conversion of the knowledge form of each sentence after clustering is done utilizing the breadth-first method of intermediate code generation. It was analyzed from the compilation of the ART2 neural network program that in order to ensure the recognition effect of ART2 network on sentence (including recognition accuracy and recognition speed), the network must have sufficient output. e number of nodes should generally be no less than the  Table 1: Comparative analysis of presented object-oriented knowledge-based system.

Clustering algorithm Outcomes
Yang et al. [45] Centroid update k-means Well known neural network-based clustering method but a limited amount of data is utilized Kilinc and Uysal [46] Soft clustering Utilized the nonparametric clustering approach, which reduces model complication Hsu and Lin [47] k-means Robust outcomes are obtained using the combination of k-means and feature attribute engineering

Method presented in this article
Carpenter and Grossberg's adaptive resonance neural network ART2 and Kohonen learning method Established a knowledge dynamic extraction framework for conversion of natural language to the object-oriented knowledge system number of standard sentence samples. is work proves the effectiveness of the proposed method through an application example. e concepts of prereliability and postreliability are defined in this work to measure and evaluate the credibility of sentence recognition and semantic model construction. e structural modeling method is used to generate structured derivation relationships, thereby completing the knowledge extraction process from natural language processing to object-oriented knowledge systems.

Data Availability
All data are available within the manuscript.

Conflicts of Interest
e authors declare that they have no conflicts of interest.