Cognitive Accessibility User Research describes the challenges of using web technologies for people with learning disabilities or cognitive disabilities. The research describes challenges in the areas of attention, executive function, knowledge, language, literacy, memory, perception, and reasoning. It is organized by user groups of the following disabilities: Aging-Related Cognitive Decline, Aphasia, Attention Deficit Hyperactivity Disorder, Autism, Intellectual Disability, Dyscalculia, Dyslexia, and Non-Verbal. Additional user groups may be added to future versions. This document provides a basis for subsequent work to identify gaps in current technologies, suggest strategies to improve accessibility for these user groups, and develop guidance and techniques for web authors.
This document provides background research on user groups with learning disabilities and cognitive disabilities; and challenges they face when using Web technologies. We aim to identify and describe the current situation so subsequent publications can contrast it to what we want to happen.
This document will be used as a base document to enable the task force to perform a gap analysis; suggest techniques; and create a road-map for improving accessibility for people with learning disabilities and cognitive disabilities.
It is currently at its first draft. We are asking for comments. Please let us know if you are aware of omissions.
This document is important because enabling people with learning and cognitive disabilities to use the Web and Web technologies is of critical importance to both individuals and society.
More and more, the Internet and the Web have become the main way people stay informed and current on news and health information; keep in touch with friends and family; and provide independence such as convenient shopping etc. People who cannot use these interfaces will have an increased feeling of having a disability and of being alienated from society.
Further, with the advent of the Web of Things, everyday physical objects are connected to the Internet and have Web interfaces. Being able to use these interfaces now is an essential component of allowing people to maintain their independence, stay in the work force for longer, and stay safe.
Consider that the population is aging. By 2050, it is projected there will be 115 million people with dementia worldwide. It is essential to the economy and society that people with mild and moderate levels of dementia stay as active as possible, and participate in society for as long as possible. However, at the moment, even people with only a mild cognitive decline may find standard applications impossible to use. That means more and more people are dependent on care givers for things that they could do themselves, increasing the crippling cost of care and reducing human dignity.
We therefore invite you to review this draft; and comment and consider how your technologies and work may be affected by these issues.
There is a huge number of cognitive disabilities and variations of them. If we attempt an analysis of all the possibilities, the job will be too big, and nothing will be achieved. Therefore, we are adopting a phased approach, selecting in phase one a limited scope of eight diverse disabilities, and hope to achieve something useful within that scope. Also note that helping users improve skills, and emotional disabilities, are out of scope for phase one. We anticipate this analysis will continue to a second or third phase where more user groups are analyzed, and the existing analyses are updated with new research and with new technologies and scenarios.
This is an early and incomplete draft for review; and to help us get comments and early feedback. We are particularly interested in:
We welcome comments and suggestions. Please send comments to pubic-coga-comments@w3.org. All comments will be reviewed and discussed by the task force. Although we cannot commit to formally responding to all comments on this draft, the discussions can be tracked in the task force minutes.
Different people with cognitive disabilities may have problems in the following areas:
For more information, please see section 5.
It is important to note that people may have limitations in one area and not in other areas. For example, a person with dyslexia may have above-average reasoning, but impaired visual memory and literacy skills. A person with Intellectual Disability may have an above-average visual memory, but impaired judgment.
Cognitive Function Category | Cognitive Function Subcategories and Tags |
Dyslexia |
Aphasia |
Non-Verbal |
Intellectual Disability |
Autism |
Dyscalculia |
Aging-Related Cognitive Decline |
Attention Deficit Disorder (ADD/ ADHD) |
---|---|---|---|---|---|---|---|---|---|
Memory | Duration Based
Context Based
Awareness based
Also memories can be stored and recalled as
|
May have impaired:
|
Receptive and Expressive Aphasia may result in impaired short term memory which can impact on re-learning language as can the impairment of auditory memory for relearning correct articulation and visual memory that affects reading and writing. Visuo-spatial Memory maybe an issue with the inability to remember how to get to places and recall locations, not helped if procedural memory is also involved where the order of doing things is affected. This is usually automatic but actions may have to be relearnt and there can be involvement of prospective memory that involves being aware of when certain activities have to be performed. |
Cognitive impairments may result in impaired short term memory which can impact on learning how to use any symbolic representations of speech such as pictograms and other photographic symbols. This may result in a very reduced number of symbols being used on a daily basis. Lack of Auditory memory affects the ability to gain skills in phonemic awareness that aids literacy skills. Difficulties with visuo-spatial memory impact on the speed withwhich symbols may be found on a communication board or located on a screen and with physical difficulties this can further slow communication. Procedural memory difficulties result in poor automaticity in terms of Language Acquisition through Motor Planning (LAMP) which is one of the ways individuals can speed their AAC output. | Impaired auditory (verbal) short-term memory, and explicit long-term memory. However, visuospatial short-term memory, associative learning, and implicit long-term memory functions are preserved. Short-term auditory memory, which can affect writing to long-term auditory memory. Visual memory is often far-stronger. Difficulty remembering information. |
There may be problems with memory, and integration of Episodic Memory (past experience) with present action. |
Memory may be affected: Mainly Visuo-Spatial and Procedural Memory for layout, schedules, or sequences; and Prospective Memory for things such as financial planning. |
Affected in dementia: Primarily new memories and working memory. Long-term memory becomes affected as dementia progresses. Age related cognitive decline may result in slight forgetfulness. |
Working memory may be affected. |
Executive Functions | Executive Functions
|
Sometimes affected: Planning/Organization |
Those with Aphasia may have executive-functional difficulties especially if emotional lability is an issue. Cognitive impairment can affect cause and effect; and therefore planning and organization; as well as execution. |
Problems with executive function, including:
|
Sometimes affected:
Shift can be strongly affected. |
Sometimes affected when involving numbers or time such as getting the right bus/train at the right time and on the correct platform. |
All Executive Functions are affected in dementia. Sometimes Executive Function is affected in age-related cognitive decline, such as Shift and judgment (less often). |
Executive function may be affected. |
|
Reasoning |
|
Typically not affected |
Where intellectual capacity is affected there may be issues with reasoning, learning and thus remembering plus abstraction. |
Where intellectual capacity is affected there may be issues with reasoning, learning and thus remembering plus abstraction. | Typically affected.
|
Typically affected:
Mathematical intelligence is also often affected. |
Typically affected:
|
|
Typically not affected other than planning, time estimates, and short-term recall, which is part of executive function. |
Attention |
|
Selective Attention may be affected. |
Shortened-attention span can occur with Aphasia. |
Shortened attention span can occur alongside distractability when other cognitive impairments are present. | Difficulties with sustained attention. |
Typically affected. |
|
Affected in dementia. |
Affected |
Language |
See below for more details. |
|
Aphasia can cause difficulties with word finding, the meanings of words and sentences, grammar and comprehension affecting the ability to communicate. |
Young AAC users may have difficulty developing good sentence construction for written language in particular if reading skills are poor |
|
Typically affected. |
|
|
|
Speech Perception | Speech Perception depends upon:
Note: There is also related memory, such as working memory, auditory memory - see above. There is also knowledge required (see below), such as:
|
Often affected:
|
Individuals may have difficulties coping with the sounds that make up speech being unable to interpret their meaning which affects understanding and speech output. |
Cognitive impairments can affect speech perception |
|
Affected in dementia and, to a much-lesser degree, by age-related cognitive decline (temporal tracking). |
|||
Understanding Figural Language | Understanding figural language, such as: a simile, onomatopoeia, personification, an oxymoron, a paradox, an allusion, an idiom, and a pun. This is the ability to understand figural language, and does not include knowledge of metaphors. |
Not affected |
Idioms, metaphors, similes and other representations of language that contain abstract notions can cause issues for those with aphasia. |
Idioms, metaphors, similes and other representations of language that contain abstract notions can cause issues for AAC users |
|
|
|
Sometimes affected by dementia. |
|
Literacy | Depends upon Speech Perception and visual perception. Also depends upon:
|
Affected |
Aquired dyslexia can be an issue with individuals having to relearn how to read, sound out words and remember how to spell. |
Aquired dyslexia can be an issue with individuals having to relearn how to read, sound out words and remember how to spell. |
|
Typically affected. |
|
Phoneme Processing and Cross-Modal Association are affected in dementia. |
|
Visual Perception (visual recognition) | The visual system automatically groups elements into patterns: Proximity, Similarity, Closure, Symmetry, Common Fate (i.e. common motion), and Continuity. (Gestalt psychology) Functions include:
|
All can be affected. May also have visual stress. |
Not recognising letters and words impact on reading and even object recognition can be affected. |
Not recognising letters and words impact on reading and even object recognition can be affected | Strong visual memory but possible visual-processing difficulties May have visual stress |
Visual comprehension is often affected. |
Face Recognition, Object Recognition, and Visual-Pattern Recognition |
Can be affected in dementia. |
Diminished visual processing speeds |
Other Perception |
|
Auditory Perception affected Psychomotor may be affected |
Auditory perceptual difficulties affect the relearning of speech and recognition of sounds and words impacting on understanding. |
Auditory perceptual difficulties can affect phonemic awareness and any possible speech output | Psychomotor Perception seems affected.
|
Have unusual reactions to sensory-, olfactory-, smell-, tactile-, and auditory-perception
|
|
Affected in dementia and, to a lesser degree, by age-related cognitive decline (such as Psychomotor Perception -Spatial/Temporal Understanding) |
Developmental coordination disorder / motor clumsiness. |
Knowledge | Types of knowledge that might be required for use of the Web include:
|
Typically not affected. |
Aphasia does not necessarily impact on intelligence but knowledge will be trapped within the brain if the individual cannot express their thoughts. |
An AAC user does not necessarily have intellectual difficulties but knowledge can be trapped within the brain if the individual cannot express their thoughts. | Affected |
Partial Knowledge of Behaviors |
Mathematical Knowledge And Mechanical Knowledge are affected. |
Affected in acquisition of new knowledge. Affected strongly in dementia |
|
Behavioral | Behavioral Abstractions and social –
|
Slightly affected: Norms and Social Cues |
Behaviour can be affected by lability where there can be unnatural emotions including depression. Tiredness can impact on the ability to cope with day to day activities. |
Behaviour can be affected by the inability to communicate with considerable frustration occurring at times. Individuals may also become depressed and irritable, however these individuals can also show amazing resilience and understanding when issues arise. |
Affected |
Strongly affected (primary symptom) |
Not affected |
Affected in dementia |
|
Consciousness | Delusions, Hallucinations |
Typically not affected. |
Consciousness in those who have deep Aphasia with no communication can be difficult to assess. |
Consciousness in those who have no communication skillscan be difficult to assess |
|
|
Not affected |
Affected in dementia, such as delusions, and, to a lesser degree, by age-related cognitive decline, such as irritation and withdrawal. |
|
Notes on the Cognitive Function Table:
This section describes the state of the art in classification of cognitive function.
User group research modules follow. This is Phase 1. The group hopes to add more groups such as effects of Post-Traumatic Stress Disorder (PTSD) on cognitive function.
Note: We have taken terms and concepts from across the work we are doing on disability and cognitive function. Where more than one term exists for what seems to be a very similar function, we have chosen one term, but brought others for reference. We have also reviewed the Caroll taxonomy, but it was focused on educational assessment, and psychometric-based models for human intelligence, and was therefore not fully-relevant (for example: knowledge categories). When quoting a Caroll category, we have tried to put the mnemonic after the term such as (RG) or (I).
Here are the cognitive functions that we have identified so far. They are not complete, and not yet in a taxonomy form.
Executive functions (also known as cognitive control and supervisory-attentional system) is an umbrella term for the management of cognitive processes such as reasoning and problem solving (goal-focused reasoning) as described below. Executive function also includes:
In making a decision or conclusion, we may use:
Fluid reasoning is the capacity to think logically and solve problems in novel situations, independent of acquired knowledge [Fluid_and_crystallized_intelligence] Fluid intelligence may involve both the dorsolateral prefrontal cortex and the anterior cingulate cortex.
Types of fluid reasoning are:
A related idea is Speed of Reasoning (RE): Speed or fluency in performing reasoning tasks [http://www-personal.umich.edu/~itm/688/wk6/CHC%20Definitions.pdf]
Crystallized Intelligence (sometimes called Comprehension Knowledge), is the ability to use skills, knowledge, and experience. It does not equate to memory, but it does rely on accessing information from long-term memory. Crystallized intelligence is one’s lifetime of intellectual achievement, as demonstrated largely through one's vocabulary and general knowledge. [http://en.wikipedia.org/wiki/Fluid_and_crystallized_intelligence</cite> Crystallized Intelligence involves storage and usage of long-term memories, such as by the hippocampus.
We have included the dependent aspects in the sections on memory and language [ http://www-personal.umich.edu/~itm/688/wk6/CHC%20Definitions.pdf]
Reasoning and executive functions require attention. Types of attention are the following.
People talk about types of memories are often talking about different categories of types of memory. Any memory-based events can be described in all these categories. For example: an event may cause a sensory experience to go into long-term memory implicitly. Here are the types we have identified:
Also, memories can be stored and recalled as Associative Memory (AM), Meaningful memory(MM), Free-recall memory (M6),
Speak, write, read, or understand speech and/or language.
Spoken language also requires an ability to produce voice
Sign language, without spoken language, probably requires a slightly-different set of skills, such as:
Beyond basic language, literacy typically requires:
Note that many people with dyslexia achieve literacy without many of these functions, or with impaired functioning.
The visual system automatically groups elements into patterns: Proximity, Similarity, Closure, Symmetry, Common Fate (i.e., common motion), and Continuity (Gestalt psychology).
Functions include:
Auditory perception (see Speech perception above for further classifications), Motor, Tactile, Psychomotor, Kinesthetic (body position, weight, or movement), Olfactory and sensory perception.
Processing speed affect all functions above. See Caroll. A related concept is fluency
Note that these are in our mandate. For example: Dementia with Lewy bodies affects the cerebrum, where small round lumps of proteins build up and can cause fluctuations of consciousness, as well as hallucinations, delusions (firmly held beliefs in things that are not real), and false ideas (such as with paranoia).
This section summaries functions of different areas of the brain. See http://www.md-health.com/Parts-Of-The-Brain-And-Function.html and http://www.enchantedlearning.com/subjects/anatomy/brain/Structure.shtml.
Frontal Lobe
Occipital Lobe
Parietal Lobe
Temporal Lobe
Limbic System
The limbic system contains glands, which help relay emotions.
Corpus Callosum
Cerebellum
Brain Stem
Pituitary Gland
1. Educational taxonomies, such as Carol for Cyristalised resing, includes:
2. Inappropriate behavior is common with Frontotemporal dementia - impaired social interaction.
Affected in: Alzheimer’s disease, Aphasias, Advanced age, dyslexia, emotional disabilities such as Schizophrenia and PTSD
4. Expressive aphasia left inferior frontal cortex. These people are described with having severe syntactical deficits, which means they have extreme difficulty in forming sentences correctly. Hessler, Dorte; Jonkers, Bastiaanse (December 2010). "The influence of phonetic dimensions on aphasic speech perception". Clinical Linguistics and Phonetics. 12 24: 980–996.
5. Receptive aphasia - left temproparietal lobe. People with Receptive Aphasic mostly suffer from lexical-semantic difficulties, but also have difficulties in comprehension tasks. The effect of receptive aphasia on understanding is much more severe. Hessler, Dorte; Jonkers, Bastiaanse (December 2010). "The influence of phonetic dimensions on aphasic speech perception". Clinical Linguistics and Phonetics. 12 24: 980–996.
Anarthria: Loss of the motor ability that enables speech. Complete loss of the ability to vocalize words as a result of an injury to the part of the brain responsible for controlling the larynx.
Aphonia: The inability to produce voice.
Alalia: A delay in the development or use of the mechanisms that produce speech.
Dyslalia: Difficulties in talking due to structural defects in speech organs.
Developmental verbal dyspraxia: Motor speech disorder involving impairments in the motor control of speech production.
6. Carol tends to have abilites as the main category with memory and sensitivity, such as tactile sensitivity (other than psychomotor abilities, which have subcategories of static strength (P3), multi-limb coordination (P6), finger dexterity (P2), manual dexterity (P1), arm-hand steadiness (P7), sontrol precision (P8), aiming (A1), gross-body equilibrium (P4)
7. Carol brings Processing speed (Gs), such as cognitive processing speed (Gs), broad-cognitive speediness (Gs), perceptual speed (P), rate-of-test-taking (R9), number facility (N), speed of reasoning (RE), reading speed (RS), writing speed (WS), reaction and decision Speed (Gt), correct decision speed (CDS), processing speed, (RT) decision speed (such as simple-reaction time) (R1), choice reaction time (R2), semantic processing speed (R4), mental-comparison speed (R7), inspection time (IT)
8. Carol brings Ideational Fluency (FI), Associational Fluency (FA), Expressional Fluency (FE), Word Fluency (FW), Figural Fluency (FF), Figural Flexibility (FX), Sensitivity to Problems (SP), Originality/Creativity Fluency (FO), Learning Abilities (L1), Naming Facility (N)
In making user scenarios and user group research, we took a multilevel approach including:
In the user group research section of the gap analysis, we aim to identify abstract principles for accessibility for people with cognitive and learning disabilities; core challenges for each user group; as well as practical techniques.
However, when trying to identify abstract principles, it is often helpful to look at concrete-user scenarios and challenges that different user groups face. For that purpose, we have identified practical and diverse user scenarios that should be considered in user-group research. These include:
Making sure users can communicate with people and be part of society. Tasks to investigate:
Using content should be:
The aim of the Cognitive and Learning Disabilities Accessibility Task Force (COGA) is to improve Web accessibility for people with cognitive and learning disabilities.
This is a background-research document. However, it may be worth concluding with an overview of what could be done for accessibility for people with cognitive and learning disabilities. It is intended to help us (COGA) identify what needs to be done to get there.
Note that some of the ideas below may be out of scope for our mandate and role as a W3C task force.
A substantial amount of techniques are helpful for over 90% of people with cognitive disabilities. These techniques need to be gathered in one place.
For example, most people with any cognitive disability may be disturbed when form data is lost when a session times out. Almost all user groups may need help or need to double check data entered into a form. Timing out so they need to start again may make a form unusable.
See sample technique format to help us gather techniques as we come across them, so that they do not get forgotten or are hard to find later when we are finished the gap analysis.
We also need to document techniques good for some user groups and not for others (depends upon cognitive function and localization). For example, text under symbols may be useful for many people with dementia, but unhelpful for many people with severe language disabilities.
In a localization example using left-hand-side text, alignment is helpful for English sites, but right-hand-side text alignment is helpful for sites in Arabic or Hebrew.
Once we have a comprehensive set of techniques, we may want to group techniques into “enhancements”. For example, we may make a group of techniques as “simple text” enhancements for easier reference.
We may also want to identify how different enhancements benefit people with different limitations of cognitive functions.
To achieve this, we may need to label groups of cognitive functions, so that we can simplify linking enhancements to cognitive functions. See an initial page of cognitive function.
Once we have a set of enhancements, we can enable standards, such as EARL, to identify which documents support which enhancements. Other supported standards and systems include ISO, GPII including subprojects Prosperity4All and Cloud4all, and possibly FLUID.
Once we have a comprehensive set of techniques, we can also explore what is needed to make a website adaptable to different groups of users. We may be able to identify semantics that enable adaptation for specific learning and cognitive disabilities; and to conflicting needs of different users.
This could include:
(See more information about making adaptable content for people with cognitive disabilities)
This may result in suggestions to PF group for the ARIA 2.0 specification.
There may be other accommodations needed that are outside the handshaking approach or adaptable pages.
Also see more ideas.