RETRACTED

This article has been retracted by Hindawi following an investigation undertaken by the publisher [1]. This investigation has uncovered evidence of one or more of the following indicators of systematic manipulation of the publication process:

(1)Discrepancies in scope(2)Discrepancies in the description of the research reported(3)Discrepancies between the availability of data and the research described(4)Inappropriate citations(5)Incoherent, meaningless and/or irrelevant content included in the article(6)Peer-review manipulation

The presence of these indicators undermines our confidence in the integrity of the article’s content and we cannot, therefore, vouch for its reliability. Please note that this notice is intended solely to alert readers that the content of this article is unreliable. We have not investigated whether authors were aware of or involved in the systematic manipulation of the publication process.

Wiley and Hindawi regrets that the usual quality checks did not identify these issues before publication and have since put additional measures in place to safeguard research integrity.

We wish to credit our own Research Integrity and Research Publishing teams and anonymous and named external researchers and research integrity experts for contributing to this investigation.

The corresponding author, as the representative of all authors, has been given the opportunity to register their agreement or disagreement to this retraction. We have kept a record of any response received.

Mathematical Problems in Engineering
Volume 2021 (2021), Article ID 9963524, 13 pages
https://doi.org/10.1155/2021/9963524

Research Article

Sports Video Augmented Reality Real-Time Image Analysis of Mobile Devices

Hui Wang,¹ Meng Wang,² and Peng Zhao¹

¹School of Physical Education, Hanjiang Normal University, Shiyan 442000, Hubei, China
²College of Transportation, Jilin University, Changchun, Jilin 130012, China

Correspondence should be addressed to Meng Wang; mengw19@mails.jlu.edu.cn

Received 12 March 2021; Revised 22 April 2021; Accepted 17 May 2021; Published 9 June 2021

Academic Editor: Sang-Bing Tsai

Copyright © 2021 Hui Wang et al. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

Abstract.

Sports video is loved by the audience because of its unique charm, so it has high research value and application value to analyze and study the video data of competition. Based on the background of football match, this paper studies the football detection and tracking algorithm in football game video and analyzes the real-time image of real-time mobile devices in sports video augmented reality. Firstly, the image is preprocessed by image graying, image denoising, image binarization, and so on. Secondly, Hough transform is used to locate and detect football, and according to the characteristics of football, Hough transform is improved. Based on the good performance of SIFT algorithm in feature matching, a football tracking algorithm based on SIFT feature matching is proposed, which matches the detected football with the sample football. The simulation results show that the improved Hough transform can effectively detect football and has good antijamming performance. And the designed football tracking algorithm based on SIFT feature matching can accurately track the football trajectory; therefore, the football detection and tracking algorithm designed in this paper is suitable for real-time football monitoring and tracking.

1. Introduction

Nowadays, more and more people accept various kinds of information in the form of multimedia data, which requires the storage and analysis of various multimedia data. Because the most important way for humans to perceive and understand the world is vision, visual information is the most important information in multimedia data, which contains the largest amount of information. In multimedia data, visual information is represented as image data and video data. The analysis and processing of image and video data is a hot issue in real-time image analysis of augmented reality mobile devices. In most cases, the moving target in a video sequence is the most concerning part of human eyes. In fact, the biggest feature of video image is that it has rich original data, strong correlation between adjacent near frames, and dynamic time-varying mode in time domain, which makes moving objects easy to detect, segment, and recognize. Compared with static images, the greatest advantage of image sequence and video is to capture motion information.

The object detection and tracking algorithm of video image began in the middle of the 20th century. At that time, people began to study the computer representation of object image and developed optical character recognition (OCR) system, license plate recognition system in fixed scene, and so on. By the end of the 20th century, face detection, vehicle detection, and aviation military target detection have become popular research fields.

At present, many national departments and scholars have done a lot of research on motion target analysis and its technology. In 1997, the Defense Advanced Research Projects Agency of the United States established the Visual Surveillance and Monitoring (VSAM) system, which was led by Carnegie Mellon University Robot and participated by Sarnoff Company and so on [1]. The system can be used for battlefield situation analysis, safety monitoring in important places, and monitoring of refugee flow. From 1998 to 2002, a system named ADVISOR was developed and studied by the French National Institute of Computer Science and Control, the University of Reading, and the University of Kingston in the United Kingdom under the support of the IST (Information Society Technology) research institute. The system improves the management level of public transport network by establishing an intelligent monitoring system and guarantees personal and property safety [2]. In addition, there are also Maryland University real-time visual monitoring system W4 [3], the video surveillance technology project AVITRACK, and the intelligent embedded system ObjectVideo, which are jointly studied by the European Union and Austria. It also shows that, with the development of society, the demand for sport target analysis is higher and higher.

Video moving object analysis system can be widely used in public safety protection, such as regional monitoring, terrain matching, urban safety, and traffic management. However, in reality, the background is most complex and changeable, such as the brightness change of light, the movement of objects in the background, or the existence of objects similar to the characteristics of the target, shadow problem, target occlusion, and so on. All these have brought some difficulties to the accurate detection and tracking of the target.

In modern life, sports video is a kind of important video loved by the majority of the audience, which occupies a large proportion in the existing television programs and the Internet. With the continuous improvement of people’s quality of life and the rapid progress of science and technology, all aspects of sports video requirements are also rising. For example, in the aspect of watching sports matches, now this passive, flat viewing mode will gradually fail to meet the demands of television viewers. Broadcasters need to add various visual special effects to meet the visual requirements of the audience. In many sports competitions, football matches have the largest number of spectators and the highest degree of concern. Therefore, detecting, extracting, locating, and tracking the moving objects in football matches video have very high practical value and practical significance.

Target extraction and tracking in video is a hotspot in image and video processing. The technology applied covers many fields of image processing analysis and computer vision. Generally speaking, a video scene is composed of background and target, in which target is an important part of video sequence and contains important information. Therefore, fast and effective segmentation of objects in video and tracking of interesting objects are the basis of subsequent video image analysis.

The core of augmented reality mobile devices is to realize the seamless integration of virtual objects (3D models, videos, images, audio, etc.) and real scenes. How to make the virtual objects and real scenes reach an agreement on time, location, and illumination is a technical difficulty. In recent years, with the continuous improvement of hardware and software of mobile devices, augmented reality technology can be applied to mobile devices. However, mobile devices are usually limited by memory, computing power, communication speed, hardware architecture, and other aspects. How to research the technology suitable for mobile devices on the original basis has become a research hotspot in the field of augmented reality.

In the past two decades, researchers have done a lot of research on video analysis and processing and put forward many valuable theories and methods. Sports video has a certain structure and regularity. The analysis and research of sports video have high theoretical value and wide application value, which makes sports video attracted the attention of many scholars [4–6]. In the analysis and processing of football video, players and football are two very important goals. In many applications, it is urgent to detect and track players and football, such as event detection, tactical analysis, automatic summary generation, and target-based video compression. As a hot issue in video and sequence image processing, detection and tracking has always attracted the attention of researchers. In recent years, many famous universities and research institutes at home and abroad have made in-depth research on football video analysis and processing technology and put forward some effective methods for football video target detection and tracking.

It is a very challenging task to detect and track football effectively in football videos. The main reasons include the following: (1) In football videos, the number of pixels occupied by football targets is small. (2) The position and direction of the camera are always changing, so the football movement in football video includes the movement of the ball itself and the movement of the camera. (3) Because of the influence of the light and the speed of the ball, the color, size, and shape of the football will change, so it is difficult to build an effective model to detect and track the ball. (4) When soccer is tied to the ground or shielded by players, it is more difficult to detect and track [7–10].

In this paper, the detection and tracking of football is studied, and an algorithm of football detection and tracking in football matches video is proposed, which can in real time analyze football matches video images. The work of this paper is as follows:

(1)The image is preprocessed by image grayscale, image denoising, and image binarization, and an improved median filtering method is proposed.(2)Hough transform is used to locate and detect football, and according to the characteristics of football, Hough transform is improved.(3)Based on the good performance of SIFT algorithm in feature matching, a football tracking algorithm based on SIFT feature matching is proposed, which matches the detected football with the sample football.

2. Proposed Method

2.1. Image Preprocessing

2.1.1. Image Denoising

In video image processing, the main noise comes from image sensors. There are two kinds of noises from image sensors: salt-and-pepper noise and Gauss noise [11, 12]. In order to eliminate sensor noise, there are two kinds of mean filtering [13] and median filtering [14]. In this paper, an improved median filtering method is used to denoise the system from the point of view of real-time performance and detection effect.

For the traditional median filtering algorithm, if the number of pixels in the sliding window is n, each window needs to be compared times, and the time complexity is . In general filtering algorithm, the window needs to be sorted once every time it moves. If image size is , the time complexity of the whole algorithm is .

In this paper, an improved median filtering algorithm is used to improve the real-time performance of soccer video processing, in which the time complexity of each sliding window is , and the overall time complexity is , which meets the real-time requirements of volleyball video detection.

For illustrative purposes, the pixels in the window are defined as , respectively, as shown in Table 1.

Table 1: Pixel sort order.

Zeroth columns
First columns
Second columns

Zeroth lines

First lines

Second lines

The process of implementation of the algorithm is as follows: first, the maximum, median, and minimum values in each column are calculated, and the maximum, median, and minimum groups can be obtained. The calculation process is as follows:

 Max group: , , . Middle-value group: , , . Minimum group: , , .

It is concluded that the maximum value and the minimum value in the maximum value group and the minimum value group must be the maximum and minimum values of the nine-pixel values, the maximum value in the median group is at least 5 pixels, and the minimum value is less than 5 pixels. If the median in the maximum group is at least 5 pixels, and the median in the minimum group is less than 5 pixels, then

and with this algorithm, the number of median calculations is nearly twice as much as that of the traditional algorithm, and it is very suitable for image smoothing in video sequence.

2.1.2. Image Binarization

Among many image segmentation methods, binarization is a simple and effective method. The purpose of binarization of image [15–17] is to separate the moving object from the background in the image and to provide the basis for the subsequent classification, detection, and recognition. Set the input image as and the output image as ; then,

where represents the threshold of binary processing. In actual processing, the background is represented by 255 and the moving object is represented by 0. The process of binarization is relatively simple, and the key problem is the selection method of binarization. In this paper, the OTSU algorithm is used to improve the selection of binarization image threshold.

2.2. Research on Soccer Location Detection

Hough transform essentially transforms the spatial domain of an image into a parametric space and describes the curve of an image in a parametric form satisfied by most of the pixels. In the process of geometric image detection, standard Hough transform (SHT) requires the following steps to achieve detection [18–21]:

(1)Allocate buffer: the process is to allocate the parameter buffer to prepare the mapping.(2)Parameter space transformation: the feature points are scanned, and each feature point satisfying a specific relationship corresponds to the parameter space.(3)Accumulation and storage: the image parameters satisfying the specific relationship are accumulated and stored, and the pixels satisfying the specific relationship in the image space are added together.(4)The location of the largest point on the plane of the location parameter, which is the parameter of the image on the original image.

The equation of known circle is

where is the center of a circle and r is the radius. The formula represents the equation of the circle. Because it is in the image space, the point is regarded as an unknown number, and the center and radius r are regarded as known numbers. If the image in image space coordinate system is mapped to three-dimensional parametric space , the equation of circle in parametric space is as follows:

In the parameter space, the known and unknown parameters are reversed, the coordinate information of the feature points becomes known, and the corresponding center and radius r are unknown. After transformation, each effective feature point in the image space corresponds to a cone in the parameter space one by one. Different points on the same circle in the image space correspond to the same point of intersection of cones in the parameter space. This process records the number of repeated points with the same parameters by initializing a three-dimensional accumulator in the parameter space. The expression is as follows:

where represents a three-dimensional accumulator, counting every three-element array and accumulating the results. By setting a threshold, when the value of the accumulator exceeds the threshold, the point is considered to be the center coordinate of the circle in the image space.

After preprocessing the video frame, the Hough transform is realized. However, directly using SHT to perform loop detection on an image requires mapping the pixels of the entire image into the parameter space and then making judgments point by point, which affects the efficiency and accuracy of the algorithm. Therefore, the basic idea of this paper is to replace multiple loops with multidimensional arrays while reducing the dimensionality of the accumulator. At this point, we need to know the radius of the circle to be detected; that is, the circle radius r must fall in the range of . It is known that, in the image space, the circle can have the following parameter expression:

Symbol is the angle between the point and the line of the point and the x-axis. The corresponding point in the image space is mapped to the parameter space, and the formula of the circle is as follows:

The specific steps for improvement are as follows:

(1)After the image is preprocessed, the initial Hough array matrix in the pixel space is used to set the initial variables, and according to the actual position of the circle, it is determined that its radius is , and the step length is .(2)According to the parametric formula (5), the value of calculation is set as a nonnegative integer, and the valid value is recorded to determine the index value of the Hough array.(3)Hough arrays are constructed according to Hough index values, which are mainly realized by accumulators. At this time, the number of layers of the arrays is .(4)In the Hough array, the layer with the largest accumulative value is found, which corresponds to the circle with the largest number of pixels in the image space, and the corresponding radius of the array is the radius r of the circle.(5)The center of the circle is obtained. The mean value of all the in the maximum value layer is the center of the circle.

2.3. Research on Soccer Tracking Algorithm

In this paper, based on the good performance of SIFT algorithm in feature matching, a football tracking algorithm based on SIFT feature matching is proposed, which matches the detected football with the sample football. Firstly, SIFT feature points need to be extracted. The details are as follows:

2.3.1. Detection of Extreme Points in Scale Space

In scale space, the concept of local extreme contains two meanings: one is image space extreme; that is, the extreme points are local extreme points in 9 points of neighborhood on the same level; the other is scale-space extreme, that is, the local extreme points of 27 points in the neighborhood of the point and its corresponding points in two adjacent layers. To sum up, the extraction steps of scale-space extreme points are as follows.

Step 1. The input image is convoluted with the Gauss function to generate the corresponding scale space , which is represented by a Gauss pyramid.

Step 2. Subtract the two adjacent layers of the Gauss Pyramid to generate the Gauss differential Pyramid .

Step 3. In the Gaussian difference pyramid, the maximum or minimum point in the neighborhood of the same layer and the neighborhood of the adjacent layer is detected.

2.3.2. Precise Location of Key Points

The image data stored by computer are discrete pixel value, but the extreme point of discrete data may not be the extreme point of real continuous space. Therefore, it is necessary to fit the DOG function in scale space with a three-dimensional quadratic curve, so that the extremum points can be accurately located at subpixel level. For a general differentiable function, the extreme point is the point whose first derivative is 0. So the Taylor expansion of Gauss difference function DOG in scale space is as follows:

Solve the derivative, and let ; then, the maximum point obtained in the image row, column, and scale of the three directions offset is

Since the DOG function is expanded at the origin of the extreme point , the range of offset in three directions is found to be between 0 and 1. Formula (5) is substituted into formula (4):

Lowe’s experiment shows that, for the extreme point of , it is considered as an unstable candidate with low contrast and is eliminated.

In order to obtain stable subpixel accurate positioning coordinates of key points, the following positioning criteria are adopted in this paper:

(1)If the three components of (i.e., the offset in the row, column, and scale directions of the image) are less than 0.5, then the point is regarded as the extreme point, and the noninteger coordinate value after the offset is taken as the precise positioning coordinate of the key point.(2)If a component is greater than or equal to 0.5, it means that the real extreme point is closer to the detection point of another integer; then the coordinates of the extreme point in this direction are moved to an integer coordinate value in the offset direction.(3)Repeat the above operations (Taylor expansion and offset calculation) until the offset of a detection point is found to satisfy three component values less than 0.5. The number of repeated operations is not greater than 5; otherwise, it is considered unstable.

For two-dimensional discrete data images, the key points of the Hessian matrix are

The derivative is estimated by the difference between adjacent sampling points; that is,

 , , represents the size of the pixel value at coordinate .

is a larger eigenvalue of and is a smaller eigenvalue. For the two-order matrix , the trace of the matrix is

The determinant of the matrix is

In order to avoid directly calculating these eigenvalues, we only consider the ratio between them to represent the ratio of the principal curvature of the extreme point. Let ; then,

It can be seen that the upper form reaches the minimum when the eigenvalues of and are equal and increases with the increase of . So the intensity of the edge response can be expressed by the size of formula 10. The larger the value, the stronger the edge response. Lowe recommends that the value of be 10. When the Hessian matrix of the extreme point satisfies , the extreme point is retained; otherwise, it is considered to be the extreme value of the edge response which is easy to be affected by noise and so on.

2.3.3. Key Point Assignment

The direction of the feature points will be used in the key point descriptor, so the characteristics of the feature points need to be described. We assign a direction to each feature point. The gradient direction distribution of the neighborhood pixels of the key points is used to assign direction parameters to each key point, so that the operator has rotation invariance.

Formulas (11) and (12) are the formulas for the modulus and direction of gradient at . The scale used by L is the scale of each key point.

In practical calculation, when the direction is the weight and the gradient is the weight value, for the convenience of calculation and statistics, we use 0.5 as the dividing line to take integers to both sides of the radian direction angle which exists in decimal form. For example, 1.25 takes 1 and 2.75 takes 3. With this method, the angles can be grouped into 8 arrays of 0–7, and the corresponding gradient values can be added up as the important data for subsequent calculation and matching.

2.3.4. Generating Key Points Descriptors

After obtaining the local feature points, the key step is to use the local feature points to describe the information of the surrounding area, which can reduce the impact of the key points by perspective, rotation, illumination, and so on. By assigning the direction of the key points, we have been able to get the main direction of the key points. Then we rotate the region to the main direction within a certain radius with the key point as the center of the circle, so that the key point has rotation invariance. When describing, the region is divided into subregions. In each subregion, the gradient histogram of 8 directions is used to make statistics. From this, a descriptor of dimension is formed. We call this descriptor of 128 dimensions a SIFT descriptor.

After extracting SIFT feature points, in order to determine whether a sample in the tracking sample set is the same target as the football detected in the current frame, this paper uses the matching degree of the two to measure, that is, matching degree. Assuming that the tracking sample has SIFT feature points and the target detected in the frame image has SIFT feature points. The matching point pair of the SIFT features is , and the matching degree rate is calculated according to the following formula:

According to whether the matching degree is greater than the matching threshold , the current detection target and the corresponding sample are tracked for the same target. Dice similarity coefficient calculation formula is as follows:

Video coefficient calculation formula is as follows:

VOE coefficient calculation formula is as follows:

RVD coefficient calculation formula is as follows:

When Dice, Jaccard, and SEN are close to 1, it means that the segmentation result is closer to the expert annotated image; when RVD and VOE are close to 0, it means that the segmentation error is small or there is basically no segmentation error. Among them, Dice is used to express the similarity between the network segmentation map and the expert's annotation map, and it is a very important segmentation image evaluation coefficient.

3. Experiments

In this paper, SIFT algorithm is used to track football, but now there are many SIFT algorithm derivatives, whose performance is not inferior to SIFT algorithm, such as PCA-SIFT, GLOH, and SURF. In this paper, the performance comparison of four algorithms is given, and the reason why SIFT algorithm is chosen to track football is explained by comparison. The performance comparison results are shown in Table 2.

Table 2: Performance comparison of four algorithms.

SIFT algorithm
PCA-SIFT algorithm
GLOH algorithm
SURF algorithm

Antiscale
Good
Preferably
Good
Commonly

Antirotation
Good
Preferably
Good
Commonly

Antilight
Commonly
Preferably
Commonly
Good

Antiaffine
Preferably
Preferably
Preferably
Commonly

Time efficiency
Commonly
Commonly
Commonly
Good

Universality
Good
Commonly
Commonly
Good

Because the projection matrix of each generation descriptor must have a set of representative and similar image learning in advance, the generated projection rectangle is only valid for the same type of image key descriptor. As a result, the applicability of PCA-SIFT is far less than that of SIFT algorithm, and the formation of SIFT descriptor has nothing to do with image type, which is suitable for almost all images and easy to form and develop. In GLOH algorithm, because it also uses PCA technology to reduce the dimension of the feature vector, it also needs to obtain the projection matrix through representative image learning in advance. The function of the algorithm is not strong. The time efficiency of sift-sift is slightly better than that of PCA-SIFT. In the implementation of SURF algorithm, integral image and box filter are used to approximate the Gauss Laplace transform, which leads to the loss of image details. As a result, the uniqueness of the descriptor of the neighborhood information of the interest point is much worse than that of the SIFT descriptor, which leads to the poor matching effect and the processing ability of the complex scene cannot meet the requirements. Based on the above analysis, SIFT algorithm is applied to real-time video tracking of football match.

4. Discussion

Before the simulation experiment in this paper, we need to preprocess the video frame object to enhance the image feature information. Firstly, the image is grayed, and the result is shown in Figure 1, where Figure 1(a) is the original image and Figure 1(b) is the result of graying. From Figure 1, we can see that the image information is basically preserved, but the image is dimensionality reduced from three dimensions to two dimensions.

(a)

(b)

Figure 1: Grayscale processing. (a) Original image. (b) Grayscale image.

As shown in Table 3, in this paper, we improve the traditional median filter processing, effectively save processing time, and enhance the processing results. It is helpful for image detection and tracking in the later stage of football. In this paper, we simulate and analyze the gray image with Gauss noise. The original pixels, probability output, pixel prediction, and output pixels of the three colors of red, blue, and yellow are, respectively, given in the table. It can be seen that the probability of yellow is the highest at 92%, while the original pixels, predicted pixels, and output pixels of yellow are the lowest at 280, 8%, and 390, respectively.

Table 3: Gaussian noise simulation and analysis of grayscale images.

Color
Raw pixels
Probability output (%)
Pixel prediction (%)
Output pixel

Red
290
85
15
450

Blue
310
77
23
420

Yellow
280
92
8
390

As can be seen from Figure 2, the improved median filter noise processing proposed can effectively restore the gray image information. Avoid noise effects during processing.

Figure 2: Comparison of video effects after image processing.

As can be seen from Table 4, the data information is blurred after adding Gauss noise, which is disadvantageous to the subsequent image processing. Although the traditional median filter has a certain effect on noise filtering with Gauss noise image, the effect is not obvious.

Table 4: The traditional median filter processing.

Median
Filtering
Denoise
Dimensions
A-treatment

Grayscale
48.5
76.1
112.7
99.2
66.3

Processing
56.8
71.4
67.3
86.3
92.6

Simulate
91.2
89.8
88.6
76.7
63.4

Tracking
63.2
49.3
99.6
49.3
32.3

Football
82.4
49.3
91.3
39.5
91.3

As can be seen from Table 5, we use the traditional median filter to denoise and the improved median filter to denoise. The results are shown in Figure 3. Figure 3(a) is the grayscale image, Figure 3(b) is the image after adding Gauss noise, Figure 3(c) is the result of traditional median filtering, and Figure 3(d) is the result of improved median filtering in this paper.

Table 5: Comparison of denoising effects between traditional median filter and improved median filter.

Number
Clear (%)
Carry out (%)
Accurate prediction (%)
Reliable

A
92
80
94
Y

B
89
76
72
N

C
75
74
84
Y

D
88
79
90
Y

(a)

(b)

(c)

(d)

Figure 3: Filtering processing of grayscale image. (a) Grayscale image, (b) adding Gauss noise, (c) traditional median filtering processing, and (d) improved median filtering processing.

Image binarization processing results are shown in Figure 3. It can be seen that the image after the binarization process has less data calculation and the sensitive area of the image is obviously prominent. This shows that reducing the gray level of the entire image to a two-valued dimension can greatly simplify the subsequent feature extraction algorithm. The results are shown in Figure 4.

(a)

(b)

Figure 4: Binary processing after filtering. (a) Filtered result graph. (b) Binary processing result graph.

After the preprocessing results, first of all, the football detection is simulated to illustrate the performance of the proposed football detection algorithm. In this paper, Hough transform is used to detect the location of football. According to the characteristics of football, Hough transform is improved. The Hough transform before and after the improvement is used to detect football. The number of times is 100. The average comparison of the results is shown in Table 6.

Table 6: Comparison of test results before and after Hough improvement.

Football radius
Average accuracy rate (%)
Average detection time (s)

Standard Hough
11
90.1
4.1

Improved Hough
11
93.5
1.5

As can be seen from Figure 5, based on the good performance of SIFT algorithm in feature matching, a football tracking algorithm based on SIFT feature matching is proposed, which matches the detected football with the sample football. The football tracking algorithm designed in this paper is compared with other methods such as optical flow method and background modeling method. As can be seen from Table 7, the football tracking in video is 100 times and the average is obtained.

Figure 5: Comparison of class algorithms HTCL and OEA.

Table 7: Comparison and analysis of several tracking methods.

Football radius
Average tracking accuracy (%)
Average tracking time (s)

Optical flow
11
86.7
0.78

Background modeling method
11
88.1
1.25

Method of this paper
11
92.9
0.21

As can be seen from Figure 6, the tracking accuracy is 6.2% higher than that of the optical flow method and 4.8% higher than that of the background modeling method. As shown in Table 8, the tracking time is 0.57 s shorter than that of the optical flow method and 1.04 s shorter than that of the background modeling method.

Figure 6: The performance of the proposed football detection algorithm.

Table 8: The influence of redundant information in video on computational efficiency.

Item
Algorithm proposed
Method proposed
Verified
Subsets
Video sequence

1
48.5
76.1
112.7
99.2
75.9

2
56.8
71.4
67.3
86.3
75.2

3
91.2
89.8
88.6
76.7
79.8

4
83
84.9
75.7
40
84.4

5
60
30
20
76.1
20

6
84.8
84
83.6
79.2
82.2

As shown in Figure 7, in order to verify the effectiveness of the algorithm proposed in this paper, the method proposed in this paper is verified on the data set. As shown in Table 9, the data set contains a total of two subsets, each of which contains a training video sequence and a test video sequence.

Figure 7: Test video sequence contains one or more abnormal events.

Table 9: Judge abnormalities in the region of interest in the video.

Pic2
Genomic
Descriptive
Radiologist
Imaging

Lipoma
4.3
2.4
2
2.82
2.92

Diversity impact
2.5
4.4
2
4.18
4.3

L-conditions
3.5
1.8
3
5.45
5.41

Tumor
4.5
2.8
2
4.83
5.44

Treatment
2.9
2.98
3.45
1.2
3.38

As shown in Figure 8, the shooting scene this time is on the campus walkway, and the training video sequence is shown in Table 10, All events are normal events, each test video sequence contains one or more abnormal events, and frame level and pixel level are provided.

Figure 8: Incorporating appearance features to further improve the scope.

Table 10: Test results of each method on UsED2 subset.

Item
Late relapse
Patient survival rate
Early relapse patients
Lipoma patients
Ablation therapy

Early
4.3
2.4
2
3.7
3.4

Timely
2.5
4.4
2
5.6
6.5

Improve
3.5
1.8
3
6.4
3.4

Effective
4.5
2.8
5
4.3
9.2

Predict
5.9
2.6
6.4
1.9
3.7

Relapse
3.8
4.6
2.6
9.2
6.21

The test results are shown in Figure 10, and the histogram is drawn as shown in Figure 9. Combining Figures 10 and 9, we can see that the soccer tracking algorithm based on SIFT feature matching in this paper is superior to the existing optical flow method and background modeling method in both tracking accuracy and tracking time.

(a)

(b)

Figure 9: Bar graph of comparative analysis of several tracking methods.

Figure 10: Test results of each method on the subset.

5. Conclusions

With the rapid development of multimedia information, the research on video data processing has higher theoretical significance and commercial value. This paper takes the most watched football video among sports videos as the analysis object. The football detection and tracking algorithm in football video is studied, and the football video image is analyzed in real time. In order to achieve enhanced display of mobile devices based on real-time image analysis, this paper designs a football detection method based on improved Hough changes and a method based on SIFT features after preprocessing the image gray image denoising and image binarization. In the simulation experiment, image preprocessing, football detection, and football tracking were analyzed, respectively. The results show the effectiveness and superiority of the improved Hough change football detection method and the football tracking algorithm based on SIFT feature matching. This also shows that the proposed football detection and tracking algorithm is suitable for real-time football monitoring and tracking [22].

Data Availability

No data were used to support this study.

Conflicts of Interest

The authors declare that they do not have conflicts of interest.

References

Y. Lu and S. An, “Research on sports video detection technology motion 3 D reconstruction based on hidden Markov model,” Cluster Computing, vol. 23, no. 3, pp. 1899–1909, 2020.

M. Qi, Y. Wang, A. Li, and J. Luo, “Sports video captioning via attentive motion representation and group relationship modeling,” IEEE Transactions on Circuits and Systems for Video Technology, vol. 30, no. 8, pp. 2617–2633, 2020.

H. Okajima, S. Hashitsume, R. Oishi, and T. Miyahara, “Reconstruction of sports competition video using fixed camera based on receding horizon strategy,” Transactions of the Society of Instrument and Control Engineers, vol. 55, no. 2, pp. 135–143, 2019.

P. J. C. Adachi and T. Willoughby, “Does playing sports video games predict increased involvement in real-life sports over several years among older adolescents and emerging adults?” Journal of Youth & Adolescence, vol. 45, no. 2, pp. 1–11, 2016.

S. Liu, J. Chen, C.-H. Chang, and Y. Ai, “A new accurate and fast homography computation algorithm for sports and traffic video analysis,” IEEE Transactions on Circuits and Systems for Video Technology, vol. 28, no. 10, pp. 2993–3006, 2018.

C. X. Guo, K. Sartipi, R. C. Dutoit et al., “Resource-aware large-scale cooperative three-dimensional mapping using multiple mobile devices,” IEEE Transactions on Robotics, vol. 34, no. 5, pp. 1349–1369, 2018.

M. Hirsch, C. Mateos, and A. Zunino, “Augmenting computing capabilities at the edge by jointly exploiting mobile devices: a survey,” Future Generation Computer Systems, vol. 88, pp. 644–662, 2018.

A. R. G. Harwood and A. J. Revell, “Interactive flow simulation using tegra-powered mobile devices,” Advances in Engineering Software, vol. 115, pp. 363–373, 2018.

D. Liang, Y. Liu, Q. Huang, and W. Gao, “A scheme for ball detection and tracking in broadcast soccer video,” Advances in Multimedia Information Processing—PCM 2005, vol. 3767, no. 2, pp. 864–875, 2005.

X. Qian, H. Wang, G. Liu, and X. Hou, “HMM based soccer video event detection using enhanced mid-level semantic,” Multimedia Tools and Applications, vol. 60, no. 1, pp. 233–255, 2012.

Y. Yin, Q. Li, L. Xie, S. Yi, E. Novak, and S. Lu, “CamK: camera-based keystroke detection and localization for small mobile devices,” IEEE Transactions on Mobile Computing, vol. 17, no. 10, pp. 2236–2251, 2018.

D. Wang, S. Huang, G. Feng, and S. Wang, “Perceptual differential energy watermarking for H.264/AVC,” Multimedia Tools and Applications, vol. 60, no. 3, pp. 537–550, 2012.

S. Deivalakshmi and P. Palanisamy, “Removal of high density salt and pepper noise through improved tolerance based selective arithmetic mean filtering with wavelet thresholding,” AEU—International Journal of Electronics and Communications, vol. 70, no. 6, pp. 757–776, 2016.

S. Gan, S. Wang, Y. Chen, X. Chen, and K. Xiang, “Separation of simultaneous sources using a structural-oriented median filter in the flattened dimension,” Computers & Geosciences, vol. 86, pp. 46–54, 2016.

J. Lee, S. Kang, J. Lee, D. Shin, D. Han, and H.-J. Yoo, “The hardware and algorithm co-design for energy-efficient DNN processor on edge/mobile devices,” IEEE Transactions on Circuits and Systems I: Regular Papers, vol. 67, no. 10, pp. 3458–3470, 2020.

K. Mullan and J. Wajcman, “Have mobile devices changed working patterns in the 21st century? a time-diary analysis of work extension in the UK,” Work, Employment and Society, vol. 33, no. 1, pp. 3–20, 2019.

S. Roy, D. Bhattacharyya, S. K. Bandyopadhyay, and T.-H. Kim, “An improved brain MR image binarization method as a preprocessing for abnormality detection and features extraction,” Frontiers of Computer Science, vol. 11, no. 4, pp. 717–727, 2017.

E. Ozturk, “Students’ expectations from mobile devices for mobile learning,” International Journal of Mobile Communications, vol. 17, no. 4, pp. 409–421, 2019.

B. Philip Townsend, “Enhancing professional learning through mobile devices for pre-service teachers in remote communities: an aboriginal and torres strait islander example,” International Journal of Mobile and Blended Learning, vol. 10, no. 4, pp. 13–31, 2018.

Y. Liu, “Study on vehicle accident avoidance system using kinect depth sensor along with notifications on mobile devices,” International Journal of Computational Intelligence Research, vol. 14, no. 11, pp. 941–949, 2018.

D. Paor, “Using mobile devices to facilitate student questioning in a large undergraduate science class,” International Journal of Mobile & Blended Learning, vol. 10, no. 1, pp. 1–14, 2018.

J. M. Jimenez, J. R. Diaz, J. Lloret, and O. Romero, “MHCP: multimedia hybrid cloud computing protocol and architecture for mobile devices,” IEEE Network, vol. 33, no. 1, pp. 106–112, 2019.