This article describes a proposal and case study based on mobile phones and QR Codes to assist individuals with cognitive disabilities in their labour training and integration. This proposal, named AssisT-Task, is a full functional mobile application for Android smartphones and offers step-by-step guidance, establishing a learning method through task sequencing. It has been tested with a group of 10 users and 2 types of labour tasks. Through 7 recorded sessions, we compared the performance and the learning progress with the tool against the traditional assisting method, based on paper instructions. The results show that people with cognitive disabilities learnt and performed better and faster when using AssisT-Task than the traditional method, particularly on tasks that require cognitive effort rather than manual skills. This learning has proved to be essential to obtain an adequate degree of personal autonomy for people with cognitive impairment.
Autonomy is the main goal for people with any type of cognitive impairment. In order to achieve a fulfilling life, support is critical [
The traditional way to train and teach these skills is task repetition for a long time. During this process, caregivers monitor users’ performance and provide oral or textual information. Although they usually provide direct supervision and support, they have to let the student progressively complete the task without any help. This way, instruction-based support is usually provided, so that they can consult it and complete the task [
These issues motivated researchers to study how to introduce technological aids for daily-life activities performance, both in the learning process and in their houses or workplaces. In the literature, we can find that most of the researchers proposed new devices that provide instructions and offer prompting-based interfaces. This approach involves that users must learn how to use a new device—usually wearable screens or specifically developed interfaces—and then use them to do the tasks. In other words, this training involves a new challenge, using an unknown device, which entails a new learning process and changes in their learning paradigm, and its success might be jeopardized again.
Studies such as [
Therefore, it would be far better for them to use their well-known devices, in a less intrusive manner, instead of introducing in their lives new and unknown devices. As it will be presented in latter sections, smartphones are very popular among them and fit perfectly these requirements. Even if they had not any previous experience with them before, learning how to use them would be advantageous, since these devices will become useful in some moment of their lives. Besides, Holzinger et al. [
On that basis, we chose smartphones as the developing platform. Our approach was based on an intuitive and uncomplicated way to assist doing tasks. Users only need their smartphones, launch the application, and follow the previously prepared sequence of instructions. Thanks to the ubiquity of these devices, the assistance would be available anytime they need it. The process can be divided into two steps: task selection and task execution. As it will be detailed in further sections, task identification can be challenging so different approaches should be considered. In our case, we decided to release users from this work, tagging the environment with identification codes, easily readable by the device. The cheapest, most widespread, error-safe tagging technology nowadays is QR Codes [
In order to validate our development, we run an evaluation with 10 young adults with Down syndrome from a labour training course. We used a hybrid methodology, combining elements from inquiry (e.g., Direct observation during the trials) and test methodologies (e.g., Focus groups), which provided us with objective information about users’ performance and knowledge acquisition.
This article is organized as follows: after the introduction, we present a review of the related work in the literature in Section
Cognitive disabilities are related to mental and intellectual functioning and can be caused by several factors, such as genetics, congenital, and environmental factors. A wide accepted definition is the one by the American Association on Intellectual and Developmental Disabilities (AAIDD) [
Therefore, cognitive disabilities include different diagnosis, such as Alzheimer disease, traumatic brain injury, Down syndrome, autism spectrum disorders (ASD), and attention deficit hyperactivity disorder (ADHD). In this article, we will focus on people with Down syndrome; however, some of the ideas and studies are easily adapted to other cognitive disabilities.
Most of the works related to assistive technologies for people with disabilities are rarely focused on cognitive impairments. Despite this hurdle, the literature still provides some interesting works. Particularly, in this review, we focused on assistive technologies to help people with cognitive disabilities to do different tasks. Due to the wide variety of activities and contexts, we classified the works in three groups: daily-life activities at home, related to education, and related to workplace.
As daily-life activities at home, we usually consider every task or basic capability related to personal care (hygiene, dressing, food, etc.), instrumental activities (cleaning, meals preparation, transport, and money management), and the relations with relatives, neighbours, and flat/residence mates. This context provides a basic level of independency and it is narrowly related to age. Therefore, many researches have been working on the empowerment of users at this level. Particularly, a good example of project related to our work is “Memory Aiding Prompting System” (MAPS) [
Another interesting project is ARCHIPEL [
Finally, PREVIRNEC is a distributed telerehabilitation system based on virtual environments that allow caregivers to design and adapt activities and rehabilitation programs to users’ needs [
Another key area that researchers in assistive technologies usually focus on is education. It includes the whole learning process in all stages, from kindergarten to higher education, as well as the relations with other students, teachers, and centres’ staff. Besides, innovative technologies are commonly integrated in their curricula as part of the learning areas.
Thus, we found projects such as Artifact-AR [
Related to the use of mobile devices, we found Picaa [
Another interesting work that uses iOS devices (particularly, iPads) was presented in [
One of the problems that people with cognitive disabilities have to address is the lack of autonomy. Authors such as Taylor and Hodapp [
Thanks to the possibilities that current technologies offer, we can find novel examples of assistive developments such as ARCoach [
Another example of labour task training based on technology is Kinempt [
Finally, the literature also provides novel examples of mobile technologies applied to work inclusion, and training. Smith et al. presented in [
In summary, we found that mobile devices (such as smartphones or PDAs) are one of the promising technologies for assistance. Although other technologies such as computer vision or smart environments have been studied, they require an additional and expensive infrastructure. In contrast, the familiarity of users with smartphones, their high penetration level in society, and the increasing capabilities they offer make them suitable for task assistance in the three contexts: home, education, and workplace. Besides, they act as a motivation, which may help to reduce the high abandonment rates of assistive technologies [
In general, the assistance is delivered by different channels or modes: audio, images, video, and so on that can be prompted automatically or by user interaction. That is, some works make the user ask for the next step, while others provide the next instruction automatically. Although both have their advantages and disadvantages, the manual approach would make users more conscious about their progress doing the task, since they have to identify when the step is completed to ask for the next one. This empowers the assistance-training duality [
Besides, as it has been demonstrated in different studies, mobile devices reduce the supervisor’s load, which may lead to costs reductions (both time and human resources).
In the previous section, we have presented a view on people with Down syndrome and current developments for their assistance. As we said before, there were a few approaches that could fit their needs, but they have limitations. Therefore, we decided to design, develop, and evaluate a novel application for Android smartphones.
AssisT-Task is a mobile system based on task-sequencing and QR Codes that provides pervasive guidance to do daily-life activities. To do that, we employ smartphones as prompting devices and performance recorders.
The operation has been simplified as much as possible. First, the caregiver defines the task by means of the set of steps that compose it. This is possible thanks to the authoring tool provided. Once the task definition is ready, a QR Code containing its information is printed and tagged in a proper place (e.g., close to the washing machine for the “doing the laundry” task). Then, users only have to open the application on their phones, point at the tag, and follow the steps to complete the task. Moreover, this guidance is adapted to the task, the user, and his/her needs.
During the activity, the smartphone records every interaction that takes place. This way, caregivers would be able to reproduce and analyse users’ performance.
The system is based on a client-server architecture. The server stores all the information related to users and activities but the client also has a local copy of the information to provide offline assistance.
Activities (or tasks) are modelled as a set of steps (instructions) and other activities. They also have a name and a unique id, which is coded into a QR so they can be easily identified. On the other hand, each step is represented by a textual instruction and a descriptive image. Besides, they have sorting relations with other steps or tasks to define the sequence. In order to adapt the task to the user and his/her needs, these relations are tagged and two additional features are included into steps: repetitions and branches. This way, the sequence can be adapted in execution time (the sequence adaptation options are explained in detail in the next subsection).
Caregivers can develop tasks and edit them with a provided authoring tool. It consists of a graphical user interface which allows viewing all the available tasks, modifying them (changing images, descriptions, features as branches, repetitions, or user-labelling), creating new tasks, deleting others, and exporting the QR Code. These features have been implemented into a drag-and-drop environment. An example of the interface is shown in Figure
Authoring tool screenshot. The view presents the steps that compose the “prepare coffee” task.
Additionally, a toolbar is included in the upper part. It includes drag-and-drop icons to add tasks and steps and buttons to delete and save the work, access user adaptation mode, and generate the task’s QR Code.
Each user has a unique set of abilities, and his/her cognition level is very difficult to measure. Unlike other disabilities, the level of “cognitive prosthesis” given depends on a varying number of factors, where some of them are quite subtle [
On the other hand, the system also provides mechanisms to adapt the sequence to users’ and tasks’ contexts. To do that, we developed two mechanisms: repetitions and branches. Under some circumstances, it would be interesting to do a step for a number of times repeatedly. Besides, this number could be specified while designing the task or users should be asked in execution time. This feature is supported by the benefit that people with cognitive disabilities get from mechanical instructions instead of complex or numerical instructions, in most cases. For example, it is preferable to say seal the next envelope repeatedly instead of seal ten envelops for the “prepare the mail” task, for example. The former way makes the step atomic, clear, and understandable by the user, whereas the latter introduces conditional and complex information that can become difficult to understand by some users with a lower cognitive level. In fact, the user will likely assume the complex component of these indications by the time, in a more natural way than a complex instruction.
The other adaptation mechanism is branching. In some daily-life activities, the sequence of steps varies depending on some events during the performance or factors affecting the nature of the activity. For example, doing the laundry is different if clothes are coloured, white, or delicate. With a linear model of steps, caregivers would have to design three different tasks, generate three QR Codes, and put them near the washing machine. With three options, it does not seem very problematic, but with other many activities, photocopying, regarding all the options of paper, zoom, density, and arrangement, it is rather impractical. Therefore, the application allows creating branches in the sequence, through steps that ask the user to choose an option to continue. For example, doing the laundry would have a step asking what kind of clothes you want to wash, with three possible answers: white, coloured, and delicate. Every option would lead to different subsequences of steps, converging before the end, not necessarily, depending on the activity we want to design, with the steps to turn off the washing machine.
The interface design process was an expert-centred approach. That is, we had the support of experts and therapists of the Down Syndrome Foundation of Madrid and discussed different versions of the interface. It finally took three iterations until we designed the last version of the interface. Figure
Screenshots of users’ selection interface (a). Note that user’s photograph has been blurred in order to preserve his privacy. And “open the tray” step (b).
Once the user selects himself/herself, the QR Code screen is launched. It loads a view of the camera and automatically detects and decodes the QR it is pointing at. After that, the system requests the related information and loads the sequence of steps. An example of it is shown in Figure
As it has been said, all the design process and elements of the interface have been carefully studied and discussed with experts in special education. Thus, we have the following.
Texts: they must be shown in a simple and natural style, as recommendation for the caregiver in charge of modelling the task, so it does not become a challenge to the user to understand it. Studies such as [
Pictures: unless they are clear enough by themselves, they should be highlighted at the zones that the user must pay special attention [
Audio: when users reach a certain step, the text shown with the description is also read by a text-to-speech engine. It is also read when they touch the screen and when a certain amount of time passes and they have not interacted with the application. Spoken instructions are proved to be the most helpful prompting source in several study cases [
Vibration: the device vibrates slightly when a configurable timeout expires. Although some studies tried to build prompting systems only based on vibration of the device, Mechling et al. [
There are two particular cases related to steps’ interfaces: repetitions and branches. As it was said before, the number of repetitions can be asked in execution time or set in design time. In the first case, we first present a new screen asking for the number of times to repeat the step. An example of this interface is shown in Figure
Repetitions screens. (a) Shows the number of repetitions selection interface. (b) Presents the screen of the step that has to be repeated.
On the other hand, branches are implemented as lists. The interface shows the instruction as any other step and, instead of the image, we included a list with the options the caregiver designed. An example of an interface is shown in Figure
User interface of a branch step. It includes the instruction (select copy type) and the list of options, “one side” and “double sided.”
The interaction with the application has been designed to be the simplest and the most intuitive possible. Apart from the workload required to understand the information that represents a step, users only have to navigate to the next or previous step, in a natural way. The buttons’ layout has been designed to be handy and comfortable while holding the mobile phone with both hands or one hand; it is a desirable option for users that had acquired good handling level with the device and are able to perform a task with one hand, while holding the device with the other.
During the early stages of the design process, we run different trials to test whether our designs were suitable for the users. One of the main issues we observed was that some users pressed the next button repeatedly, even without reading or listening the information, thinking that it would allow them to finish earlier, leading them to misunderstandings and errors in the performance. Therefore, we introduced a short delay before the navigation buttons are enabled: users cannot quickly press the next buttons and finish the task; they have to wait for two seconds (this value can be configurable) to be allowed to go to the next step. This way, they are forced to wait and to pay attention to the information presented on the screen.
People with cognitive disabilities often get stunned when they have to remember how to do a task or when understanding an instruction is a bit more complex. Even more, they usually get blocked and cannot continue; therefore, the caregiver has to intervene and provide some stimuli for the user to continue. Regarding that, the application has been designed following a proactive philosophy, so the device not only expects interaction from the user but also requests it. If certain time has passed since step information is given, the device vibrates and reads aloud again the information; this behaviour is also configurable. This way, we encourage the user to try again to complete the step or draw his/her attention.
Even though the design process was assisted by experts, which reduces the probability of technology rejection, we decided to carry out an evaluation with users with cognitive disabilities. We wanted to evaluate the system from two perspectives: the first one was related to its suitability in users’ daily lives and the quality of the assistance provided. On the other hand, we wanted to compare users’ performance with our system in contrast to traditional support. In general, these methods include paper or cards with actions and pictures, verbal instructions, and direct supervision. They present advantages but, as we said before, many disadvantages, such as the costs (in terms of human resources) and the difficulties that many users present to find information or to recover from an error.
The methodology carried out can be considered as a hybrid between inquiry and test methods [
The evaluation process took place in a real working place setting. Specifically, all the sessions took place in a labour training centre. It is furnished as an office, with computers, bookcases, file cabinets, and shelves. Additionally, there are office-related devices, such as photocopiers, bind and lamination machines, and recycling points. This setting improves the training activities in the common tasks users may develop in their working places.
In order to reduce the carry-over effect during the sessions, we prepared an incomplete factorial experiment design [
Therefore, following the Latin-square experiment design, we assigned tasks, users, and support alternatively. Table
Tasks, support, and groups distribution.
Task 1 | Task 2 | |
---|---|---|
Group A | AssisT-Task | Paper support |
Group B | Paper support | AssisT-Task |
Each user did each task once a week, during an eight-week period. We arranged with the centre to program the sessions during their workshop classes. This way it would fit perfectly with their curricula and users would not feel under pressure or persuaded. Therefore, we agreed to program photocopies sessions on Monday mornings and archiving sessions on Wednesday mornings. Each participant did the task individually so there was no interference or interaction between participants.
Although support was previously assigned, we introduced some modifications in order to get reference values: during the sessions of the first, the fourth, and the eighth weeks, users performed the tasks without any support but oral instructions at the beginning. Moreover, we left one week (number 7) without training before the last session to check whether the knowledge was acquired and kept in time or not. Therefore, the distribution of tasks support and groups is summarized in Table
Tasks, support, and groups distribution during the experiments’ weeks.
1 | 2-3 | 4 | 5-6 | 8 | ||||||
---|---|---|---|---|---|---|---|---|---|---|
T1 | T2 | T1 | T2 | T1 | T2 | T1 | T2 | T1 | T2 | |
A | X | X | AT | PS | X | X | AT | PS | X | X |
B | X | X | PS | AT | X | X | PS | AT | X | X |
The number of repetitions came determined by the educators of the centre. After reviewing users’ performance on week 6, they decided that most of the users were doing their best so we could conclude the experiment. Despite the limited number of sessions, educators reported that they usually program the same number of sessions but, due to time limitations, they cannot do each task once a week and they have to extend the time between sessions up to once every two weeks for each user. Therefore, we already add a value to our system: it allowed a more efficient way of training regarding time resources.
As it was said before, we carefully chose the tasks by asking experts about the most suitable ones. Thus, we prepared a list of requisites: These tasks should be interesting for users, both from the user point of view (enjoyable) and from the formation curricula point of view. This way, users may understand the experiment as part of their studies which may avoid biases. They should be easily arranged as a sequence of steps and standardized as much as possible. This is, they should be appropriate for all the participants. Tasks should be different enough to avoid carry-over effects, but relative similar in terms of difficulty or time needed. As far as possible, tasks should not have been trained before.
According to these requisites and experts’ criteria, the first task (T1) consisted of making photocopies and the second one (T2) was archiving documents. Both tasks fulfilled all the requisites but the fourth. Since the formation course takes two years and many of the participants were on their second semester, they had already been trained on photocopies and, some of them, also on sorting documents (but not archiving). Therefore, we decided to increase T1 difficulty by introducing features configuration on the photocopier: users had to make one (and only one) copy of a map of the subway, but it had to be reduced from a DIN-A3 size to a DIN-A4 and the density had to be increased exactly 3 points. This task was modelled as a sequence of 10 steps, including a branch step: users had to decide the type of copy from a list (simple, double sided, enlargement, or reduction). On the other hand, T2 consisted of documents archiving. In this case, educators prepared a set of contracts and put them unsorted on a desktop tray. Users had to put one of them in a proper file, regarding the following criteria: the document date had to be 2012-2013; then, they had to look for the WOP code (an invented array of letters and numbers). Depending on it, they had to choose the proper folder (there were three possibilities). Finally, they had to look for a company name on the first paragraph of the contract and archive the document alphabetically depending on it. This task was modelled as a sequence of 9 steps, including a branch as well (asking for the folder name).
Although both tasks were pretty similar in terms of number of steps and time to be completed, they were intentionally different regarding the skills required: while T1 required manipulative skills to handle the paper, open and close the machine, and so on. T2 required strong cognitive skills since users had to read, look for concrete information within a text, and sort alphabetically.
Support materials for both tasks were also developed by the educators. For the traditional support (paper based), we used the materials they already employed in their courses. Task 1 manual included instructions to do different type of photocopies on the same sheet of paper. They used highlighted fonts to separate the type of photocopies and numbered the steps of each activity. The traditional support for documents archiving was more elaborated and included examples and colours to highlight relevant information (such as one colour for each folder). On the other hand, AssisT-Task support was developed specifically for this evaluation. They were based on the traditional support (same instructions) but we included photographs as well for both tasks.
Participants of labour training programs usually have mild to moderate cognitive disabilities. In many cases, they also have other disabilities, such as reduced vision or mild motor impairments. Despite their disabilities, most of them are able to read, understand simple instructions, do basic calculus, and have social manners and politeness. All these skills are usually acquired in previous stages, and now they focus on the abilities and capabilities typical of the workplace.
Thus, we asked educators to recruit participants regarding each one’s capabilities and the possible benefit they could get from the experience. In order to get a wide vision of the field and attend to the diversity, we asked them to select users of different levels so we had some heterogeneity, both genders, and typical age range (around 20 years old). Hence, they chose 10 users, 5 males and 5 females, who were 23.8 years old on average
Attention: the ability to keep concentrated on an object/action/task Memory: the ability to hold and manipulate information in the short or long term Instructions comprehension: the capability to understand and process simple and/or complex instructions Flexibility
Mobility Rhythm Cleanliness
The distribution of users in groups and their profiles are summarized in Table
Users profiles.
User | Age | Gender | Cognitive level | Social skills | Handling capabilities | Attitude | % disability | Job profile | |||||||||
---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
Attention | Memory | Instructions comprehension | Flexibility | Basics | Relation | Decisive | Mobility | Rhythm | cleanliness | Responsibility | Motivation | ||||||
A | 1 | 22 | M | 3 | 3 | 3C | 3 | 3 | 3 | 3 | 3 | 3 | 3 | 3 | 3 | 55 | Complex office assistant |
2 | 37 | F | 3 | 3 | 2S | 1 | 3 | 2 | 1 | 2 | 2 | 3 | 3 | 2 | 68 | Simple office assistant | |
3 | 25 | F | 1 | 2 | 1S | 1 | 1 | 2 | 2 | 3 | 3 | 2 | 2 | 2 | 75 | Office/education assistant | |
4 | 27 | M | 3 | 3 | 3S | 2 | 2 | 3 | 3 | 3 | 3 | 1 | 3 | 3 | 65 | Complex office assistant | |
5 | 21 | M | 2 | 2 | 2C | 3 | 3 | 3 | 3 | 3 | 2 | 3 | 2 | 2 | 33 | Off. assist facing public | |
|
|||||||||||||||||
B | 6 | 21 | F | 3 | 3 | 3S | 2 | 2 | 2 | 3 | 3 | 2 | 3 | 3 | 3 | 75 | Office assistant |
7 | 21 | M | 3 | 3 | 3S | 3 | 3 | 3 | 2 | 1 | 2 | 2 | 3 | 3 | 65 | Storekeeper, mailing | |
8 | 22 | M | 3 | 3 | 3C | 1 | 3 | 3 | 3 | 3 | 3 | 3 | 3 | 3 | 53 | Any | |
9 | 22 | F | 2 | 3 | 2S | 1 | 3 | 3 | 2 | 3 | 2 | 3 | 3 | 3 | 65 | Simple office assistant | |
10 | 23 | F | 2 | 3 | 3S | 3 | 3 | 3 | 3 | 3 | 2 | 3 | 3 | 3 | 65 | Simple office assistant |
As can be seen, most of the job profiles are office assistants, so they are usually trained on the typical tasks they will have to develop in their work. Therefore, tasks fitted perfectly to their curricula and were very interesting for their formation.
In order to get their technological profile and their familiarity with mobile devices we made an interview. From their answers, we concluded that all participants had a mobile phone, but only 6 out of 10 considered it as a smartphone. Besides, tablets were also popular, but not all of them had one. Some of them reported they used a relative’s one. In relation to Internet access, all participants reported they had connection at home and part of them also in their phones. Related to smartphone usage, the most popular purposes are instant messaging (i.e., WhatsApp), photography, multimedia reproduction, and videogames. Besides 9 out of the 10 participants reported they use their email frequently and social networks (i.e., Facebook). Thus, and despite their disabilities, they have similar technological profiles to people without disabilities of their same age.
In order to evaluate AssisT-Task in terms of the quality of assistance and suitability (regarding users’ performance improvement), we made a retrospective analysis of the records, phone registries, and observers’ notes. Traditionally, experts in special education value users’ performance regarding two factors: completion and time needed: that is, if they finish the task properly and in less time. In our case, in agreement with the educators, all users had to finish the task. This is, in case they made a mistake that would not allow them to finish the task correctly, the observer helped them to recover from the error. This decision was made in order to act as they usually do in the centre (with the traditional support).
Regarding data collection, we focus on the following measurements during the analysis: Completion time: measured as the time between the start and the end of the performance. This factor must be taken into account carefully, due to its weak representativeness when comparing between subjects: the fact that one user takes one minute against another one who takes five minutes does not show an actual difference between performance qualities. In general, some users simply take more time to complete a task than others, regardless of their success in the task. However, this measure becomes an invaluable progress indicator when it is used within subjects, in other words, when comparing the time taken to complete a task in the first session with the last one. Errors: we counted an error when users did not follow the specified instruction. For example, in T1 we considered an error to make two copies instead of one: the instructions ordered specifically one copy. Considering T2, a typical error was filing a document into an incorrect tab of the folder. Help requests: that is, the number of times users asked the observers for assistance. In some cases, users did not know how to continue, got lost, or hesitated at some point of the task and asked directly. In other cases, they looked for approval or made gestures to indirectly call the observer (on the view of the experts).
These measurements were analysed for each user and session to study their advance individually (within-subjects analysis). The evolution of each measurement along the sessions is represented in Figures
Completion time measurements along the sessions for each user. (a) and (b) present T1 values, while (c) and (d) correspond to T2.
Number of errors along the sessions for each user. (a) and (b) present T1 values, while (c) and (d) correspond to T2.
Number of help requests along the sessions for each user. (a) and (b) present T1 values, while (c) and (d) correspond to T2.
In relation to errors, we can observe similar behaviours in Figure
Finally, help requests are presented in Figure
On the other hand, if we analyse the behaviour between subjects, we can observe that there is evidence of the influence of the support on the results. In Table
Statistical analysis of the data.
Paper support | AssisT-Task |
| |
---|---|---|---|
Task 1: photocopies | |||
Time (s) | 160.75 (115.34) | 162.78 (86.36) | 0.463 |
Errors | 0.80 (0.90) | 1.11 (1.02) | 0.154 |
Help req. | 0.77 (1.46) | 0.49 (1.04) | 0.248 |
|
|||
Task 2: documents archiving | |||
Time (s) | 198.38 (112.44) | 178.87 (83.33) | 0.601 |
Errors | 1.8 (1.47) | 0.77 (1.06) |
|
Help req. | 0.46 (0.74) | 0.2 (0.63) |
|
As it was presented in Methodology, in sessions 1, 4, and 7, users did not have any support but oral instructions at the beginning. In Table
Average values for time and errors measurements of sessions 1, 4, and 7.
S | Task 1: Photocopies | Task 2: Documents archiving | |||
---|---|---|---|---|---|
Group A | Group B | Group A | Group B | ||
Time | 1 | 147.20 (55.74) | 191.39 (77.91) | 155.94 (61.94) | 199.545 (91.60) |
4 | 132.31 (74.98) | 105.73 (50.15) | 156.05 (101.19) | 145.12 (73.96) | |
7 | 101.97 (56.47) | 58.62 (13.89) | 192.14 (137.89) | 94.46 (40.03) | |
|
|||||
S | Task 1: Photocopies | Task 2: Documents archiving | |||
Group A | Group B | Group A | Group B | ||
|
|||||
Errors | 1 | 0.8 (0.84) | 1.2 (1.04) | 1.8 (0.84) | 1.4 (1.14) |
4 | 1.6 (1.34) | 0.8 (0.45) | 2 (1.41) | 0.8 (0.84) | |
7 | 1.6 (0.89) | 0.4 (0.55) | 1.8 (1.92) | 0.6 (0.89) |
From the recordings, observers’ notes, and focus groups with educators and labour trainers we made a qualitative analysis. In general, all users handled the smartphone properly. That is, all of them hold the smartphone in portrait mode, as the application was designed.
Regarding the QR scanning, all of them understood perfectly the process. Many of them named it as “taking a picture of the code.” Therefore, it was easy for them to point at the code with the phone and wait for the application to capture it.
Finally, another interesting conclusion we extracted from the recordings and educators and labour trainers was the motivational component of the application. As young adults, most of them are very interesting in new technologies. Therefore, using them as part of their formation made them keener to participate and do their best.
Although the evaluation revealed promising results, they should be carefully considered: we tried to include users with different capabilities and levels, which introduces value to the experiment, but due to the limited number of users and variation (in terms of type of disability) and the number of sessions we cannot universalize the study for all people with cognitive disabilities. However, we think it is representative for a particular group: people with Down syndrome who are being trained to get a job.
First of all, we would like to highlight the variety of the results. As can be seen in Table
Secondly, and as it was said before, the completion time is usually related to knowledge acquisition although it is not the most representative. We did not find any evidence of the influence of the support in this factor in our study.
In addition to the retrospective analysis, we carried out focus groups with educators and labour trainers. In their opinion, AssisT-Task fitted perfectly for higher and lower profiles. Higher profiles are usually more impulsive and try to finish the tasks quickly, regardless whether they are doing it right or wrong. Moreover, they are reluctant to follow fixed and repetitive orders. This issue can influence their chances to get a job. On the other hand, AssisT-Task was ideal for them. In fact, as it was reported by the educators after the experiment, one of the users (U9) was selected to participate although she had a very low profile and was not valued for cognitive tasks. Surprisingly, she was able to do the archiving task perfectly with the support, and satisfactory without any kind of help. This fact demonstrates that AssisT-Task provides new opportunities for these users.
As future work, we propose to extend the trials, including more users and settings, as well as different tasks. Moreover, it would be very interesting to test the system in a real setting (company) and evaluate the impact of AssisT-Task in the work-inclusion process.
Additionally, educators suggested improving the authoring tool to make it available on tablets. This way all the design process could be done on-site.
The authors declare that there are no conflicts of interest regarding the publication of this article.
The authors wish to thank the Madrid’s Down Foundation staff for their collaboration in this research. The work has been partially funded by the following projects: “e-Training y e-Coaching para la Integración Socio-Laboral” (TIN2013-44586--R) and “eMadrid-CM: Investigación y Desarrollo de Tecnologías Educativas en la Comunidad de Madrid” (S2013/ICE-2715).