Design and Evaluation of Smart Mobile Services for Cross-Channel Shopping

Guangji Liao et al. This is an open access


Introduction
The prevalence of e-commerce enables retailers to reach an expanded customer base, shopping anytime and anywhere.For instance, China was the world's second largest e-tailing market in 2011.The compound annual growth rate of the etailing market in China in 2011 was 120%, which outpaced every country in the world.Following that was the rapid growth of e-tailing in Brazil (34%) and Russia (39%), which outpaced the United States (17%) [1].
With such a high growth rate in the e-tailing market, there is a need for cross-channel shopping.On the one hand, as e-commerce thrives, many brick-and-mortar stores expand their online channel.Positive online shopping experience is expected to stimulate offline shopping sales.On the other hand, offline shopping still dominates the market.This trend was termed O2O commerce, which originally meant onlineto-offline commerce [2].However, this was later extended to cross-channel shopping.
Since then, O2O commerce has grown rapidly in China.Statistics of Google Trends show that the top three regions interested in O2O are Hong Kong, Taiwan, and mainland China [3].Specifically, online searches of the keyword "O2O" in China have surged since 2014 according to statistics of Baidu index (Chinese version of Google Trends).Current activities of O2O commerce are generally at the macrolevel, focusing on business models for connecting smart phones to various products and on-site services (e.g., fresh sea food, car wash, and nail salon).However, numerous O2O start-ups have failed recently because there is a lack of deep understanding of real users' requirements.At the microlevel, little is known about how users react to cross-channel shopping.Therefore, this study aims to dig into user requirements of O2O shopping services.

Mobile Information Systems
To increase the willingness of shoppers to make purchases, practitioners first needed to understand users' shopping values [6,8].For people with a utilitarian motivation, usability of websites should be stressed, so that desired products can be found quickly.In contrast, people with a hedonic motivation shop for fun, inspiration, and enjoyment.The more consideration is given to these hedonic emotions in the design of websites, the more likely people would be to have enjoyable experiences [9], which could be even more important than utilitarian attributes [8].Therefore, researchers went beyond usability to emotional design.Regarding personalization, current practices mainly focus on recommendation systems [10,11], and few studies explored personalization based on users' personality traits and cognitive styles [11] to provide a personalized information structure [12].
Many advanced technologies were used on mobile devices; many new smart services were created.Near field communication (NFC) service was added to smart phones, which implemented the functions of house keys, travel cards, information tags, and mobile payment.It thereby created a new adventurous experience.The services brought different benefits and evoked different emotions among users, and users look forward to novel services with adaptive and personalized features [19].The Radio Frequency Identification (RFID) technology has also been utilized to track location for indoor smart applications.The scenario and architecture were presented for an indoor location tracking service in an exhibition environment based on mobile RFID.Additionally, the prototype for a location tracking system had been designed and implemented [20].Moreover, there have been other technologies used to implement smart services, such as iBeacon [21], location based services [22], and ZigBee [23].
In current smart services research, some research is at the prototype stage [21,23], and some research has reached the implementation phase.Meanwhile, smart services involve many fields, such as health, life, and travel.To help the elderly, a practical application of smart mobility called Mobile Assistant for the Elderly (MASEL) was proposed.It can connect patients, doctors, pharmacists, and families and improve the quality of life providing detailed monitoring of medication needed by patients [24].Travelers using buses care about their waiting time and how crowded the buses are.To solve these problems, a passenger demand prediction system for mobile users was presented.It can deliver bus and traffic information to mobile users in real time [25].
The demand for smart services is increasing, and many users desire personalization services.So that users with smart devices can optimally utilize smart services, a smart service model was introduced.With the model, a smart service can be conveniently used to obtain real data from USN (Ubiquitous Sensor Network)/RFID in various smart spaces [26].Similarly, a service recommendation model was proposed based on user scenarios using fusion context-awareness, and the scenarios can help provide the best services in advance [27].
In addition to the enjoyment of smart services, the issue of security has not been neglected.In order to detect diverse types of malicious code in smart phones and respond to advanced attacks, an intelligent security model for smart phones was proposed based on human behavior in mobile cloud computing.The model notifies users to respond to malicious attacks by using behavior-based intelligent analysis [28].To improve the security of mobile banking services, an integrated framework for information was proposed [29,30].

Design and Development of Smart Mobile Services
User-centered design (UCD) was used throughout the design and development of mobile smart services.UCD is widely used to develop information technologies and services.Design features based on users' needs are implemented, and users are involved in the iterative process of user study, design, and evaluation [31,32].Young adults are leading online shopping [33][34][35] and their attitudes towards innovative services influence other potential users who prefer to "wait and see" what others make of new products and services.In China, the latest statistics indicated that the majority (73%) of online shoppers aged between 16 and 34 [36].Therefore, a series of user studies were conducted to analyze the requirements of Chinese young adults.A structured interview and a scenario-based semistructured interview of 20 young adults, a focus group of seven young adults for up to 75 minutes, and a seven-day anthropology study of five young adults, resulted in the notes for the study.Based on these results, three prototypes were designed and developed.

Low-Fidelity Prototypes.
Low-fidelity prototypes are generalized and include sketches, screen mockups, and storyboards, used to illustrate design ideas, screen layouts, and design alternatives [31].Based on user requirements, this study explored possible designs to bridge online shopping and offline shopping.First, sketches were drawn to show initial ideas for smart services.Among them, sketches that received positive feedback were refined to be storyboards and on-screen mockups to further illustrate shopping scenarios and interaction details.For example, Figure 1 shows a typical scenario of shopping for clothes: Amy is fond of buying clothes online, but she usually finds that the size of the clothes purchased is not suitable.Therefore, she wants to use a smart mobile service to accurately check if clothes fit her size.Additionally, she wants to share the fitting effect with her friends and ask for their opinions.Then, the best-fit clothes, which got positive feedback, are delivered to her door.

High-Fidelity Prototypes.
High-fidelity prototypes provide a functional version of the system that users can interact with, showing the user interface (UI) layout and its navigation.High-fidelity prototypes can be used to experience the look and feel of the final system [31].Different from final production variants, high-fidelity prototypes focus on  the front end of an application that is usually visible to the user in the form of an interface.They seldom involve backend development such as accessing server-side databases or remote services [37].To develop high-fidelity prototypes, Axure, Justinmind, Dreamweaver, and Corel VideoStudio Pro were used.In particular, the focus was whether key user requirements were clearly reflected in the prototype.Each prototype went through around eight iterations.In the final version of the prototypes, key features are summarized in Table 1 and explained in detail in the following paragraphs.
SmartMall (shown in Figure 2) aims to help improve the efficiency of searching for a specific product and enhance the enjoyment of shopping.To achieve this goal, three key features were incorporated into the prototype.First, it can automatically push the layout of the mall to users.When users search their desired products, SmartMall will guide them to the right location.This indoor navigation feature can be implemented through Wi-Fi positioning technology.Second, SmartMall applies a game experience to make the shopping experience fun.This was inspired by the treasure hunt game.The "little red dot" represents treasure, and when users find the treasure, they are required to play a simple game such as identifying differences in pictures.If the users win, they get a recommended product based on personal purchasing history or a special coupon.This game-style shopping feature could use NFC tags to launch games.Third, SmartMall automatically record users' shopping time and activities.The longer they stay in the mall or the longer the distance they walk, the higher the discount is when they check out.This activity-based discount feature can be implemented with the help of the pedometer of smart phones.
SmartWatch aims to change positive interaction to active interaction, making mobile devices smart, like an assistant.In a prior-purchase process, many people are not aware of a shopping need (e.g., running out of eggs) and often forget to include items on the shopping list for an activity (e.g., travel).To solve these problems, three features were incorporated into the prototype.First, SmartWatch was based on Internet of Things (IoT) and could automatically detect things such  as how much milk is left and how many pills are left.Then, as shown in Figure 3, SmartWatch can make a shopping list based on users' personal data and demands, and it could also remind users to buy products that they are not aware of.During the shopping process, when a users' smart watch is close to the target products, it will push relevant information (e.g., reviews and price comparisons) to users through near field communication technology (shown in Figure 4).There are many technologies able to implement this function, such as beacons, RFID, and NFC technology.NFC technology was recommended because it is widely integrated into smart phones and supports mobile payment, and other techniques may also be considered.Second, a SmartWatch can automatically gather the users' personal preferences by recording their emotional changes (e.g., frowning and head shakes).This can be implemented with the help of face tracking and gaze estimation technology using the smart phone's camera.SmartWatch can generate the optimal shopping route based on the user's shopping list and it can be updated in real time.Third, at the end of shopping, users do not need to wait in line-the mobile payment system automatically pays the bill (shown in Figure 5).NFC technology can be used to support mobile payment.
In addition, this smart watch could display information on the back of users' hands to overcome the problem of limited display area.This technology is already commercially available.For example, Cicret smart bracelets use this technology to make the arm a skin touch screen, thereby increasing the operational area of the screen.
SmartFit aims to help people judge the fit of clothes presented online.Two features were incorporated into the prototype.First, a virtual human model can be created.Shopping behaviors 29 items measuring innovativeness [14], absorption (i.e., the extent of focusing on work, avoiding distraction from daily life), single tasking and multitasking, attitude towards recommendations, attitude towards shopping quickly, personalization, and enterprising Satisfaction 10 items of System Usability Scale (SUS) [15] (a) (b) Figure 4: Proximity-based reference information.Note: when SmartWatch is close to products it pushes related information through NFC to aid in purchase decisions.
(a) (b) Figure 5: Using SmartWatch to check out at a mall.Note: SmartWatch automatically pays for the products.
Augmented reality technology could be used to create a virtual human model.Data of the human model can be from two-dimensional code scanning or manual input.When users buy clothes online, SmartFit could generate the 3D fitting effect between the human model and clothes (shown in Figure 6).To implement this feature, technology is used from the three-dimensional displays of Microsoft and Samsung [38,39].Although 3D fitting technology has been applied to platforms such as Wii and Kinect, they were tailored to the shopping scenario.SmartFit combines the shopping platform with 3D fitting technology.In the future, it could incorporate additional details of fit, such as the tightness of shoes and clothing elasticity.Second, another highlight of SmartFit is its image search function (shown in Figure 7).Users can take a photo and SmartFit will automatically search for similar clothes.This feature could be implemented by adding an image-based information retrieval system to a mobile phone [40] or by using similar technology from the application "Snap Fashion."SmartFit also has a sharing feature for users who want to ask for friends' recommendations.

Evaluation of Smart Mobile Services
An experiment was designed and conducted to evaluate three prototypes and to explore the potential of smart mobile services to enhance the online and offline shopping experience.

Independent and Dependent
Variables.The independent variable is the type of smart mobile service.It is a withinsubject variable with three levels: SmartMall, SmartWatch, and SmartFit.Apart from that, demographic information, shopping behavior, and independence were recorded through a questionnaire (shown in Table 2).These variables were included into the data analysis and excluded from further analysis if their influence was not significant.The dependent variable is subjects' satisfaction towards the proposed smart mobile service.Each item used a five-point Likert scale, anchored from "totally disagree" to "totally agree."In order to check internal consistency, two pairs of reverse questions were included.In practice, the sample size in related studies ranged from 7 to 40 [41][42][43].Theoretically, the required sample size could be computed through statistical power analysis.It is a function of significance criterion (), population effect size (ES), and statistical power ().ES could be derived from values based on social behavioral studies recommended by Cohen [44] and statistics (e.g., the partial eta square) computed from ANOVA with one within-subject variable and one between-subject variable.
The necessary sample size for the statistical power of 0.8 [44] calculated through a statistical power analysis program G * Power is 26 (partial eta square = 0.067, ES = 0.267, and  = 0.05).
Participants watched the video demonstrations on a touch-screen notebook computer (ThinkPad S1) and used prototypes on a Moto 360 and an MI2 Phone.For the SmartWatch, certain interaction was shown on the notebook computer.For example, smart watch was used to implement the voice search, and the results on the back of the band were presented on notebook computer.Participants were able to watch the demonstrations as many times as they liked.After that, they filled in the questionnaires regarding their satisfaction.At the end of the experiment, they were interviewed as to their opinions and concerns about each prototype.There were two interview questions: "What are your favorite features of this prototype?"and "What features of this prototype you do not like and why?" 4.3.Equipment and Procedure.A ThinkPad S1 Yoga notebook computer, equipped with Windows 8.1, a screen size of 12.5 inches, and a resolution of 1920 * 1080, was used.An MI2 smart phone, equipped with Android 5.0.2, a screen size of 4.3 inches, and a resolution of 1280 * 720, was used.Two pilot tests were conducted and the questionnaire was revised.It took each participant approximately 60 minutes to complete the formal experiment.The experiments were conducted in the Human-Computer Interaction Laboratory of Chongqing University.Firstly, the experimenter briefly introduced the experiment, and each participant signed a consent form.Secondly, subjects filled in the questionnaire with background information, independence, and shopping behaviors.Next, in the formal experiment process, participants watched video demonstrations of smart mobile services which were filmed in field to mimic the actual usage and used the prototypes.Furthermore, to avoid a learning effect, the order to use the three prototypes was counterbalanced.That is, participants were randomly divided into six groups, and each group was assigned to a different order to use three prototypes.Finally, participants filled in the system usability scale.Figure 8 shows participants interacting with prototypes.

Results and Discussion
Reliability of the questionnaire was checked.First, if participants' responses to the two pairs of reverse questions were not consistent, their questionnaires were excluded from further analysis.Two participants were excluded.Then, reliability of items (Cronbach's alpha) was computed.Twelve items with poor reliability were deleted.

Satisfaction with Smart Mobile Services.
The SUS score for each prototype is shown in Figure 9. Participants generally had positive feedback towards the three smart mobile services.However, there was no significant difference among the three prototypes according to the result of a one-way repeated ANOVA.
To explore the relationship between satisfaction and the other variables, correlation analysis was conducted (shown in Table 3).User satisfaction was correlated to user characteristics such as absorption for SmartMall and SmartWatch, participants' innovativeness for SmartWatch, and shopping frequency for SmartFit.Apart from demographics, there is one factor correlated to satisfaction: innovativeness.Therefore, the following sections further investigate their influence on satisfaction.
To dig into to the correlation between innovativeness and satisfaction, the data pattern of each prototype was explored.As shown in Figure 10, the influence of innovativeness on satisfaction seemed to differ among the three applications.To verify this, an ANOVA test was conducted, where the application is the within-subject variable and the innovativeness is the between-subject variable.The results (shown in Table 4) indicate that the interaction between innovativeness and the prototypes was significant.
Specifically, as shown in Table 5, innovativeness did not influence participants' satisfaction with SmartFit.However, it influenced their satisfaction with SmartWatch; participants with higher innovativeness had lower satisfaction.This is contrary to previous findings that consumers with higher innovativeness are more likely to adopt mobile shopping [17].One possible reason for the inconsistency lies in the prototype design.The findings from the previous study [17] were based on the results of a questionnaire survey without details about the interface, whereas the high-fidelity prototypes used in this study provided abundant interaction details.Participants with higher technology innovativeness were generally more interested in new technology.Participants had more knowledge about new technology and were more aware of potential downsides.This was backed up by the interview results: SmartWatch needed users' privacy data such as personal habits, social contacts, and behaviors of family members.Eleven participants worried about the security and privacy of SmartWatch, and seven out of them had high innovativeness (above the median).Apart from that, six participants worried  about the accuracy of recommended results, and three out of them had high innovativeness.Apart from innovativeness, other variables which might influence satisfaction were investigated through ANOVA.Three influential variables were identified.First, participants with higher absorption (above median) hold a higher satisfaction with two prototypes (SmartMall:  = 7.224,  = 0.001; SmartWatch:  = 4.918,  = 0.005).This is consistent with the results of the interview.Among the three prototypes, two have the common feature of indoor navigation.On the one hand, of the 17 participants who expressed that they liked indoor navigation in the interview, 12 of them had a positive or neutral absorption.On the other hand, of the 10 participants who expressed that they disliked indoor navigation in the interview, 6 of them had a negative absorption.
Second, participants who liked shopping quickly had lower satisfaction with the SmartFit ( = 4.442,  = 0.008).This is consistent with the results of interview: there are eleven participants who did not like the feature of 3D fitting of SmartFit, and nine out of them tended to shop quickly.One  possible reason is that participants who like to shop quickly usually do not want to explore and compare various 3D fitting effects.
Third, participants with a higher online shopping frequency had higher satisfaction with SmartFit ( = 3.198,  = 0.022).During the interviews, 16 participants liked the function of image search of SmartFit, and 10 of them had higher online shopping frequency.A possible reason for this is that SmartFit made the search experience convenient and efficient through the image search service.
To identify the key influential factor/item, multiple regression analysis was conducted.The results are shown in Table 6.The regression models were significant (SmartMall:  = 0.001, SmartWatch:  = 0.002, and SmartFit:  = 0.002) and could explain a medium proportion (ranged from 35.7% to 39.8%) of variance in satisfaction scores.For the SmartMall and SmartWatch, absorption was the most influential factor of participants' satisfaction, whereas the most influential factors of satisfaction with SmartFit were the attitude towards shopping quickly.Apart from that, participants who were used to play medium games had lower satisfaction with SmartMall because the game used in the prototype was too simple for them.

Attitude towards Key Features of Smart Mobile Services
5.2.1.Indoor Navigation.Participants' attitude towards indoor navigation depends on their shopping motivation.The majority of participants gave positive feedback to this feature (17/24 for SmartMall and 13/22 for SmartWatch).They thought that it could save time and was convenient.This satisfied their utilitarian motivation [45].However, ten participants had negative feedback.They were reluctant to read the display of the smart phone and the smartwatch.Instead, three participants preferred asking the salesperson, and one participant thought that indoor navigation is unsuitable for people who are familiar with the mall.Apart from that, six participants did not want to follow the recommended routes.This set constraints for them because they preferred wandering and exploration during shopping.Consistent with previous studies, users with hedonic motivation enjoyed the shopping process [46].

Game Experience.
Participants' attitude towards a game-style shopping experience depends on their shopping habits.The majority of participants gave positive feedback to this feature (17/24 participants).They thought that the game brought more pleasure to their current shopping experience, and the coupon and discount were practical and gave them a sense of achievement.However, the rest of participants had neutral feedback.Two participants thought that the game was

Figure 2 :
Figure 2: SmartMall indoor navigation.Note: digits 1 and 2 represent little red dots; the smiling face represents the user's current location; and the red coordinate icon indicates the location of the target products.

Figure 3 :
Figure 3: (a) Personal data loading, (b) Recommended shopping list.(c) The optimal route.Note: based on the Internet of Things, consumption of daily products is recorded, and the shopping list and optimal route to a mall are generated.

Figure 6 :Figure 7 :
Figure 6: 3D fitting.Note: when users click the fitting button, SmartFit shows the effect of putting on the clothes.

Figure 9 :Figure 10 :
Figure 9: The SUS scores for the three prototypes.

Table 1 :
Features of three smart mobile services.

Table 3 :
The correlation between satisfaction of each prototype and other variables.

Table 4 :
The influence of innovativeness on satisfaction with each prototype.

Table 5 :
Main effect of innovativeness on participants' satisfaction with each prototype.

Table 6 :
Influential factors on participants' satisfaction with each prototype.