Computer-Aided Color Aesthetic Evaluation Method Based on the Combination of Form and Color

This paper presents a newmethod of color aesthetic evaluation based on the combination of form and color. According to the human visual physiological and psychological characteristics, this paper first proposes a new form-color field theory for the coupled formcolor aesthetic evaluation based on the psychophysical field theory and the Moon and Spencer model. Second, it builds a coupled form-color topological graph for describing their interaction and develops a strength calculation algorithm for color harmony based on the new form-color field theory. Finally, it develops an aesthetic measure evaluation model for coupled form-color fields to evaluate the new theory.The experiment results show that the new coupled form-color aesthetic evaluationmethod is useful and can be integrated into an intelligent evaluation process for color design scheme.


Introduction
Nowadays, the functional aspects of many consumer products used in daily life are fully matured.For products with similar functions, their visual images become an important factor in a consumer's shopping decision-making process when deciding which particular product to purchase.The overall image perception of a product's style is generally induced by its form and color.The coupled form-color perception on a product plays a crucial role in today's increasingly competitive marketplace.Therefore, having a desirable product style is very important for product design, and in turn having aesthetic evaluations on product styles is very necessary in a product design process.
In order to evaluate the aesthetic of each form and color, many researchers have studied a lot of examples to analyze what kind of form and color is beautiful.Sato and Oda [1] studied the importance of color and shape to aesthetic evaluation by experiments.The analysis indicated that the aesthetic evaluation of colored shape was influenced by both the color and shape components and the shape component had stronger influence on that of the colored shape though color has the first impressions in the aesthetic evaluation of product design.At the same time, color harmony is one of the most important indicators in the aesthetic evaluation of color.
Aesthetic measure of form and color design has enormous significance in art and design.While the basic mechanisms of color perception have been extensively studied, the semantic and aesthetic aspects of color are still poorly understood.There is a long trail of research into color aesthetic [2][3][4][5].Ou et al. [6] tested the relationship between color harmony and single-color associations and colorcombination association by color experiment and established a model of color association and harmony.But the models of color associations and harmony lack consideration of other design elements, such as shape, texture, and product functionality; therefore, it may only apply to specific layout designs or specific industry sectors.In a later study [7], the same authors studied the rule of the three factors of hue (), chroma (), and lightness () of color effect on the color harmony.However, the model was developed using uniform color patches placed side by side and the test data set was also based on uniform color patches with a medium gray background.Therefore, this model may be not applicable to all possible color combination types, shapes, textures, and background colors.Furthermore, this model is limited to combinations of two colors.
Tsai and Chou [8] used a 3D model of the flask rendered with arbitrary colors by adjusting the RGB parameter values at random to study and develop an automatic design support method based on the principles of aesthetic measurement, gray theory, and genetic algorithms, respectively, and to generate and evaluate color-design candidates.However, the design support system is limited to two-color designs and a single-color association scale.In another study of computeraided product color design with artificial intelligence [9], Tsai et al. established the relationship between multicolored products and their images and introduced a method using gray theory, aesthetic measurement, and a genetic algorithm to generate and evaluate color-design candidates automatically.However, this study did not cover the color harmony affected by the coupling of form and color.
Kimura et al. [10] have investigated the effect of the similarity of affective meanings on harmony between shape and color, and they have revealed the factor determining the harmony.
Form and color appear always together in product design and both of them have the important influence in color aesthetic evaluation; therefore, this paper will focus on the study of the calculation method of aesthetic measure based on the coupling of color and form.The main contributions of this paper are as follows: (1) proposing the aesthetic evaluation method and theory for a multi-color-form coupled field; (2) developing a form-color topological graph based on morphology topology to represent their relationships and realizing the visual expression and calculation of form and color; (3) achieving the harmony intensity evaluation of a coupled form-color field ranging from being qualitative to being quantitative based on the theory of psychophysical field.Its flowchart for color aesthetic measure evaluation is shown in Figure 1.

The Theoretical Foundation of Coupling Form and Color Aesthetic Evaluation Together
2.1.The Color Aesthetic Measure Theory.G. Birkhoff has given the principle of unity-in-multiplicity, a definite quantitative formulation.The aesthetic measure  of an object may be defined by the general equation Accordingly, the aesthetic measurement method proposed by Moon and Spencer (MS) [11] is used to evaluate the overall color harmony image of a product rendered with two different colors.This measure is defined as follows: in which  is the aesthetic measure of a color,  is the number of orders, and  is the complexity.Consider   = ℎ  + V  +   .Any two colors of a color scheme form a color logarithm,   is the reconcile factor of the color logarithm, and ℎ  , V  , and   are the reconcile factor of hue, value, and chroma. = 1, 2, . . .,  is the serial number of colors,  is the number of all the color logarithms,   is the number of colors,  ℎ is the number of color logarithms with different hue,  V is the number of color logarithms with different value, and   is the number of color logarithms with different chroma.The harmonic aesthetic feeling between the different colors can be concluded through the calculation of .
However, the MS aesthetic measure model is based on the theory of two-dimensional harmonics [7] and it is not clear how to apply it to the harmony evaluation problem with more than three colors, such as (a), (b), and (c) shown in Figure 2; according to the theory of MS, there is no difference in the aesthetics of those color graphics, but there are large differences in human's visual feeling because of the different form and relative positions of those color graphics.The reason is that form is not evaluated in the aesthetic measure as a factor coupled with color.
Therefore, in this paper, form is taken into account in the aesthetic evaluation process as an important factor based on the MS color harmony theory and we put forward a coupled form-color field aesthetic measure evaluation method according to the theory of psychophysical field.

The Concept of a Form-Color Field.
Gestalt psychology is an important foundation to the cognitive and visual computing theory [12].Koffka introduced the concept of "psycho-physical field" based on this theory and pointed out that the visual field has the characteristics of physical fields [13].Physical field reveals the nature and laws of many psychological phenomena and provides an important foundation for the quantitative research of image.
In this paper, we introduce the concept of color block and form-color field based on the theory of psychophysical field.Definition 1.A color block is an independent area with a certain shape which is composed of one color.For example, A, B, C, D, and E are five color blocks in the color image shown in Figure 3. Definition 2. Form-color field is the mental image where an objective image (including the form and color) takes shape in the visual cortex of human's brain [14,15].and CE) and short indirect connections (such as AC and BE) according to the length of the path between the different color blocks (it is measured as the sum of pixel-distances between two color blocks).Definition 4. Harmonic intensity () refers to the impact measure of the harmonic relationship among the different form-color fields of a color image and it could be divided into four types that are strong, middle, weak, and nonharmonic.The corresponding fuzzy value could be set as 1.0, 0.6, 0.2, and 0.

Coupled
Definition 5. Coupled form-color topological graph (, ) is a harmonic relationships graph among different color blocks that is reestablished from the topological form graph of the color blocks by coupling (associating) each edge with a corresponding color harmonic intensity.The corresponding coupled form-color topological graph of Figure 3 could be shown as Figure 5.
Setting the vertices of a (, ) as  = {V 1 , V 2 , . . ., V  },   express the strength of a connection relationship between the color blocks V  and V  , so, a related strength matrix () = (  ) × can be established, shown as follows: The calculation of the harmonic intensities in () is the key fundamental issue to establish the coupled formcolor topological graph and mathematical model [16].It will directly affect the application of the coupled form-color topological graph in the color aesthetic intelligent evaluation system.

The Algorithm to the Harmonic Intensity of Form-Color Field
In this paper, a harmonic intensity evaluation model to the complex image is established based on the theory of psychophysical field and human's visual feeling [17] in the process of aesthetic evaluation.This model is useful to the expert system to realize the automatic evaluation of the computer intelligent system to color harmony aesthetic.
can be described by three independent components (  ,   ,   ), which could be transformed from the corresponding HVC coordinates and the conversion formula is Setting the origin coordinates of a gray point potential as (0, 0, 0), the potential (energy), determined by the attributes of a color field, can be expressed as a Euclidean distance: So, the expression of the potential difference between the two color fields   and   is in which   is the potential difference of two form-color fields (  ,   ,   ) and (  ,   ,   ) expressing, respectively, the potential coordinates of two form-color fields.

Unit of Measure of a Visual Field.
According to the visual characteristics of human [18], the relationship between the visual acuity of a point and the visual resolution or the minimum perceived threshold is in which  is the visual resolution and its unit is second. max is the biggest visual acuity of the central fovea.So, the computational formula of the diameter of the minimum resolution cell of one visual field is in which  is the range of visibility and  is the diameter of the minimum sensor unit and its unit is mm.

Algorithm for Computing Harmonic Intensity of
Form-Color Field 3.2.1.The Calculation Principle of Harmonic Intensity.Suppose the area of a form-color field  is  and its average diameter size is ; then the amount of perception of  is represented as in which  is the number of perceived units of form-color field and  is the correction factor of the amount of perception.
According to the psychophysical field theory, the harmonic intensity formula between form-color fields   and   is Here   is the distance of visual perception between the color blocks   and   , which could be related to the visual focus.
Because the color harmonic intensity range was set as 0∼1 in the actual observation, in order to evaluate the computational method and model by comparing the computed value with actual observation results, the harmonic intensity needs to be modified to its square roots prescription:

The Example Analysis.
Taking Figure 6(A) as an example, there are 5 color blocks, namely, a, b, c, d, and e, and their color information is shown in Figure 6(B).
After calculating the field strength of various colors according to our computational model, we obtained the field strength distributions of a single form-color field a, b, c, d, and e as shown in Figure 7, where "Δ" is the location of the visual focus.After that, we applied formulas (11) and (12) to calculate the harmonic intensity value  between paired form-color fields as shown in Table 1.The table also shows the normalized values (normalized by the maximum harmonic intensity value under each viewpoint).Their distributions are given in Figure 8.

Experiment for Harmonic Intensity.
The harmonic intensity of  is varied with the color, form, size, and their topological relationships.Since people's psychological feeling has uncertainty, randomness, and fuzziness, it is easier to describe an actual harmonic intensity with a fuzzy variable [19].In the paper we designed a psychophysical experiment to verify the results of the experiment and the fuzzy quantification calculation of the harmonic intensity of Figure 6 [20].
In this experiment we invited 40 industrial design undergraduate students and their ages range from 20 to 25.They had been trained with color design for two years and with good color perception.With a D65 standard light as the source environment, the image was displayed on a 17  computer screen which had been adjusted to the color system.Those students were required to sit 0.8 meters away from the screen and to adjust the seat to keep the line of sight vertical to the screen.Then, they were asked to observe the image quickly in Figure 6 within 1 minute and describe the harmonic intensity feeling of two color blocks with the language such as "strong, quite strong, intermediate, quite weak, weak, and nonharmonic relationship." From the descriptions, we established the corresponding fuzzy values as follows: 1.0∼0.8,0.8∼0.6,0.6∼0.4,0.4∼0.2, and 0.2∼0.According to the language descriptions of the observers, we quantified the qualitative descriptions with the fuzzy quantitative values.The fuzzy quantitative results and the order of harmonic intensity of two color blocks are shown in Table 2.
Comparing Table 1 with Table 2, it is clear that the results of harmonic intensity order with different visual focus agree with the experiment results between two color fields.This result proved the effectiveness of the proposed algorithm.
However, there are some inconsistences with the harmonic intensity order of some form-color fields.The reason is that this example only calculated one visual focus, not considering the actual observation of the effect of visual attention.However, when we calculated the average of harmonic intensity of three different visual focuses, the order of the harmonic intensity of two color blocks is the same.

Conclusion
In this paper, we put forward the concepts of form topological graph, coupled form-color topological graph, and the harmonic intensity model based on the theory of psychophysical field and graph.We summarized the influence factors of color aesthetic measure such as color area, the distance, and the connection style of color blocks by psychophysical field experiment and established a harmonic intensity model.The model not only has important significance to reveal the harmony mechanism of the form-color field but also has important academic values for artificial intelligence, cognitive science, perception science, and the development of psychology.

Figure 1 :
Figure 1: The flowchart of color aesthetic evaluation.

Figure 2 :
Figure 2: The difficult examples of MS color harmony theory.

Figure 3 :Figure 4 :
Figure 3: The color blocks in a color image.

Figure 6 :
Figure 6: The type of color block and its color information.

3. 1 .
The Measure Method of a Form-Color Field 3.1.1.Measure of the Strength of Color Field.Based on the Munsell color calibration system, when we set the potential of gray in the psychophysical field as  0 , each color   has a different potential   .So the expression of potential difference between colors   and  0 is

Figure 7 :
Figure 7: The image of strength distribution of form-color field.

Figure 8 :
Figure 8: The distribution graph of color block.

Table 1 :
The harmonic intensity of color blocks.

Table 2 :
The fuzzy quantitative results of the color harmonic intensity.