Annotation Model: Less Than 2 Passes

For an explanation of the implementation codes and other conventions used in this report, see the README file. Other notes:

The Web Annotation Model details required and optional classes and properties for describing three classes of entities: Web Annotations, Collections of Web Annotations, and Pages of Web Annotations. Many applications choose to implement Web Annotations without implementing Collections and Pages.
A total of 7 tests files (each consisting of at between 10 and 74 sub-tests) were used for validating implementations against the Web Annotation Data Model. Three of these test files were used to validate annotations. Two test files were used to validate Collections. Two test files were used to validate Pages.
During CR, 26 representative annotations from 10 annotation-only implementations were submitted for testing. These 26 annotations were checked against test files 1, 2 & 3, the annotation tests, but were not checked against test files 4, 5, 6, & 7, the collection and page tests - hence the 10 empty columns for tests 4-7 in the test result matrix.
Separately 2 collections and 2 pages from 2 additional implementations were submitted for testing. These collections and pages were not tested against test files 1, 2 & 3 - hence, 2 empty columns in the test result matrix for tests 1, 2, & 3.
Several applications implemented multiple kinds of annotations; typically each kind of annotation demonstrated different (albeit overlapping) sets of model features. As mentioned, a total of 26 annotations from 10 implementations were tested. For each implementation, the automatically-generated test result matrix provided below combines into a single column the demonstrated characteristics of all that implematation's annotations submitted for testing.
As a way to facilitate and encourage application development, extra, granular tests of interest to developers and reporting on attributes and properties of annotations unrelated to CR Exit Criteria feature implementation were included. The Table immediately below, titled Candidate Recommendation Exit Criteria, summarizes and abstracts from the complete matrix of test results those pertinent to the demonstration of major model features.

Candidate Recommendation Exit Criteria

Required Feature (Exit Criteria)	Tests	Implementations
The Annotation class and required properties.	Must pass all of: annotationMusts, subtest 1:1 Implements @context key and 'http://www.w3.org/ns/anno.jsonld' is a value of @context annotationMusts, subtest 1:2 Implements Annotation id key which has a single value that is a string of format uri annotationMusts, subtest 1:3 Implements *Annotation type* key and 'Annotation*' is a value of type* annotationMusts, subtest 1:4 Implements target key annotationMusts, subtest 1:5 Each *target* is one of a string of format uri, an External Web Resource, a Choice or Set, or a Specific Resource annotationMusts, subtest 1:6 Annotation has a body key, or a bodyValue key, or neither, but NEVER both	DG, EB, EF, HY, KM, MM, PW, RN, TK
The Agent class and required properties, as related to an Annotation.	Must pass one of: annotationsAgentOptionals, subtest 1:1 Implements creator key which has one or more values, each of which is a string of format uri or an object annotationsAgentOptionals, subtest 1:10 Implements generator key which has one or more values, each of which is a string of format uri or an object	EB, EF, HY, KM, MM, RN
The Agent class and required properties, as related to a resource used as the Body of an Annotation.	Must pass: annotationsAgentOptionals, subtest 1:19 Implements *body creator* key** with one or more values	EB, PW
Embedded TextualBody class and required properties.	Must pass all of: annotationOptionals, subtest 1:31 Implements Embedded Textual Body with value key as a body of the Annotation annotationMusts, subtest 1:26 If an Embedded Textual Body is a body, it does NOT have an items key annotationMusts, subtest 1:27 If an Embedded Textual Body is a body, it does NOT have a source key	DG, EB, MM, PW
External web resources, used as the Body of an Annotation.	Must pass all of: annotationOptionals, subtest 1:30 Implements External Web Resource with id key as a body of the Annotation annotationMusts, subtest 1:21 If an External Web Resource is a body, it does NOT have an items key annotationMusts, subtest 1:22 If an External Web Resource is a body, it does NOT have an purpose key	DG, EB, EF, HY, MM, PW, RN, TK
A Choice of resources, used as the Body of an Annotation.	Must pass all of: annotationOptionals, subtest 1:34 Implements Choice or Set with type and items key as a body annotationMusts, subtest 1:23 If a Choice or Set is a body, it does NOT have a value key annotationMusts, subtest 1:24 If a Choice or Set is a body, it does NOT have a source key annotationMusts, subtest 1:25 If a Choice or Set is a body, it does NOT have a purpose key	MM, PW, RN
The SpecificResource class and required properties, used as the Body of an Annotation.	Must pass all of: annotationOptionals, subtest 1:53 Implements Specific Resource with source and at least one of purpose, selector, state, style, renderedVia, scope keys as a body of the Annotation annotationMusts, subtest 1:28 If a Specific Resource is a body, it does NOT have an items key annotationMusts, subtest 1:29 If a Specific Resource is a body, it does NOT have a value key annotationMusts, subtest 1:44 If present *Specific Resource selector* key has one or more values each of which is of format uri** or an object having a type key with a single value which is one of 'FragmentSelector', 'CssSelector', 'XPathSelector', 'TextQuoteSelector', 'TextPositionSelector', 'DataPositionSelector', 'SvgSelector', 'RangeSelector' annotationMusts, subtest 1:45 If present *Specific Resource state* key has one or more values each of which is of format uri** or an object having a type key with a single value which is one of 'TimeState' or 'HttpRequestState' annotationMusts, subtest 1:47 If any *Specific Resource styleClass* keys** are present, a stylesheet key (a key of Annotation) with a single value is also present	EB, RN
External web resources, used as the Target of an Annotation.	Must pass all of: annotationOptionals, subtest 1:51 Implements External Web Resource with id key as a target of the Annotation annotationMusts, subtest 1:36 If an External Web Resource is a target, it does NOT have an items key annotationMusts, subtest 1:37 If an External Web Resource is a target, it does NOT have an purpose key	DG, EB, HY, KM, MM, RN, TK
The SpecificResource class and required properties, used as the Target of an Annotation.	Must pass all of: annotationOptionals, subtest 1:54 Implements Specific Resource with source and at least one of purpose, selector, state, style, renderedVia, scope keys as a target of the Annotation annotationMusts, subtest 1:41 If a Specific Resource Target is a target, it does NOT have an items key annotationMusts, subtest 1:42 If a Specific Resource is a target, it does NOT have a value key annotationMusts, subtest 1:44 If present *Specific Resource selector* key has one or more values each of which is of format uri** or an object having a type key with a single value which is one of 'FragmentSelector', 'CssSelector', 'XPathSelector', 'TextQuoteSelector', 'TextPositionSelector', 'DataPositionSelector', 'SvgSelector', 'RangeSelector' annotationMusts, subtest 1:45 If present *Specific Resource state* key has one or more values each of which is of format uri** or an object having a type key with a single value which is one of 'TimeState' or 'HttpRequestState' annotationMusts, subtest 1:47 If any *Specific Resource styleClass* keys** are present, a stylesheet key (a key of Annotation) with a single value is also present	DG, EB, KM, MM, RN
The AnnotationCollection class and required properties.	Must pass all of: collectionMusts, subtest 1:1 Implements @context key and 'http://www.w3.org/ns/anno.jsonld' is a value of @context collectionMusts, subtest 1:2 Implements Annotation Collection id key which has a single value that is a string of format uri collectionMusts, subtest 1:3 Implements *Annotation Collection type* key such that 'AnnotationCollection*' is a value of type* collectionMusts, subtest 1:6 *Annotation Collection has first* key*, or no total* key, or total key with value of zero	CC, RI
The AnnotationPage class and required properties.	Must pass all of: pageMusts, subtest 1:1 Implements Annotation Page (or Annotation Collection for embedded Page) @context key and 'http://www.w3.org/ns/anno.jsonld' is a value of @context pageMusts, subtest 1:2 Implements Annotation Page id key which has a single value that is a string of format uri pageMusts, subtest 1:3 Implements *Annotation Page type* key such that 'AnnotationPage*' is a value of type* pageMusts, subtest 1:4 Implements *Annotation Page items* key** such that value of items key is an array of strings of format uri and/or objects of type Annotation	CC, RI

Test files without 2 passes: 4; Subtests without 2 passes: 39; Failure level: 39/166 (23.49%)

Test Files

/annotation-model/annotations/annotationOptionals-manual.html (13/39, 33.33%, 7.83% of total)
/annotation-model/annotations/annotationsAgentOptionals-manual.html (12/25, 48.00%, 7.23% of total)
/annotation-model/collections/collectionOptionals-manual.html (9/14, 64.29%, 5.42% of total)
/annotation-model/collections/pages/pageOptionals-manual.html (5/9, 55.56%, 3.01% of total)

Test Show/Hide Messages	CC	DG	EB	EF	HY	KM	MM	PN	PW	RI	RN	TK
/annotation-model/annotations/annotationOptionals-manual.html (13/39, 33.33%, 7.83% of total)	-	OK	OK	OK	OK	OK	OK	-	OK	-	OK	OK
1:5 Implements Annotation-level generated key which has a single value that is a string of format date-time - model 3.3.1	-	-	-	PASS	-	-	-	-	-	-	-	-
1:6 Implements Annotation-level modified key which has a single value that is a string of format date-time - model 3.3.1	-	-	-	-	PASS	-	-	-	-	-	-	-
1:10 Implements Annotation-level canonical key which has a single value that is a string of format uri - model 3.3.7	-	-	-	-	-	-	PASS	-	-	-	-	-
1:23 Implements *body modified* key with a single value that is of format date-time** model 3.3.1	-	-	-	-	-	-	-	-	-	-	-	PASS
1:37 Implements *target creator* key with a single value** model 3.3.1	-	-	PASS	-	-	-	-	-	-	-	-	-
1:41 Implements *target type* key with one or more values each of which is drawn from the model's list of resource classes** model 3.2.1	-	-	-	-	-	PASS	-	-	-	-	-	-
1:58 Implements *Specific Resource scope* key** - model 4.6	-	-	PASS	-	-	-	-	-	-	-	-	-
1:61 Implements *Specific Resource conformsTo* key with a single value which is of format uri on a Specific Resource FragmentSelector** - model 4.2.1	-	-	-	-	-	PASS	-	-	-	-	-	-
1:64 Implements Specific Resource Text Quote Selector - model 4.2.4	-	-	-	-	PASS	-	-	-	-	-	-	-
1:65 Implements *Specific Resource prefix* key with a single string value on a Specific Resource TextQuoteSelector** - model 4.2.4	-	-	-	-	PASS	-	-	-	-	-	-	-
1:66 Implements *Specific Resource suffix* key with a single string value on a Specific Resource TextQuoteSelector** - model 4.2.4	-	-	-	-	PASS	-	-	-	-	-	-	-
1:67 Implements Specific Resource Text Position Selector - model 4.2.5	-	-	-	-	PASS	-	-	-	-	-	-	-
1:70 Implements Specific Resource Range Selector - model 4.2.8	-	-	-	-	PASS	-	-	-	-	-	-	-
/annotation-model/annotations/annotationsAgentOptionals-manual.html (12/25, 48.00%, 7.23% of total)	-	-	OK	OK	OK	OK	OK	-	OK	-	OK	OK
1:2 Implements Annotation-level creator (Agent) id key with single value that is a string of format uri - model 3.2.2	-	-	-	-	-	-	-	-	-	-	PASS	-
1:4 Implements Annotation-level creator (Agent) nickname key with a single value that is a string - model 3.2.2	-	-	-	-	-	-	-	-	-	-	PASS	-
1:7 Implements Annotation-level creator (Agent) email key with one or more values, each of which is a mailto: uri - model 3.2.2	-	-	PASS	-	-	-	-	-	-	-	-	-
1:9 Implements Annotation-level creator (Agent) homepage key with one or more values, each of which is a string of format uri - model 3.2.2	-	-	PASS	-	-	-	-	-	-	-	-	-
1:11 Implements Annotation-level generator (Agent) id key with single value that is a string of format uri - model 3.2.2	-	-	PASS	-	-	-	-	-	-	-	-	-
1:20 Implements Body-level creator (Agent) id key with single value that is a string of format uri - model 3.2.2	-	-	-	-	-	-	-	-	PASS	-	-	-
1:27 Implements Body-level creator (Agent) homepage key with one or more values, each of which is a string of format uri - model 3.2.2	-	-	-	-	-	-	-	-	PASS	-	-	-
1:28 Implements *target creator* key** with one or more values - model 3.3.1	-	-	PASS	-	-	-	-	-	-	-	-	-
1:30 Implements Target-level creator (Agent) type key with one or more values from model-recommended list (Person, Organization, Software) - model 3.2.2	-	-	PASS	-	-	-	-	-	-	-	-	-
1:32 Implements Target-level creator (Agent) name key with a single value that is a string - model 3.2.2	-	-	PASS	-	-	-	-	-	-	-	-	-
1:33 Implements Target-level creator (Agent) name key with one or more values - model 3.2.2	-	-	PASS	-	-	-	-	-	-	-	-	-
Annotation implements optional keys and meets optional key value constraints for Creator and Generator Agents	-	-	-	-	-	-	-	-	-	-	-	PASS
/annotation-model/collections/collectionOptionals-manual.html (9/14, 64.29%, 5.42% of total)	OK	-	-	-	-	-	-	-	-	OK	-	-
1:5 Implements Annotation Collection-level modified key which has a single value that is a string of format date-time - model 3.3.1	PASS	-	-	-	-	-	-	-	-	-	-	-
1:6 Implements *Annotation Collection creator* key which has one or more values, each of which is a string of format uri or an object** - model 3.3.1	PASS	-	-	-	-	-	-	-	-	-	-	-
1:7 Implements Annotation Collection-level created key which has a single value that is a string of format date-time - model 3.3.1	PASS	-	-	-	-	-	-	-	-	-	-	-
1:8 Implements Annotation Collection-level *rights* key which has one or more values, each of which is a string of format uri - model 3.3.6	PASS	-	-	-	-	-	-	-	-	-	-	-
1:10 Implements Annotation Collection-level creator (Agent) email key with one or more values, each of which is a mailto: uri - model 3.2.2	PASS	-	-	-	-	-	-	-	-	-	-	-
1:12 Implements Annotation Collection-level creator (Agent) id key with single value that is a string of format uri - model 3.2.2	PASS	-	-	-	-	-	-	-	-	-	-	-
1:13 Implements Annotation Collection-level creator (Agent) name key with one or more values - model 3.2.2	PASS	-	-	-	-	-	-	-	-	-	-	-
1:14 Implements Annotation Collection-level creator (Agent) nickname key with a single value that is a string - model 3.2.2	PASS	-	-	-	-	-	-	-	-	-	-	-
1:15 Implements Annotation Collection-level creator (Agent) type key with one or more values from model-recommended list (Person, Organization, Software) - model 3.2.2	PASS	-	-	-	-	-	-	-	-	-	-	-
/annotation-model/collections/pages/pageOptionals-manual.html (5/9, 55.56%, 3.01% of total)	OK	-	-	-	-	-	-	-	-	OK	-	-
1:2 Implements *Annotation Page startIndex* key** with valid value of type integer >= 0 - model 5.2	PASS	-	-	-	-	-	-	-	-	-	-	-
1:6 Implements *Annotation Page last* key** (i.e., in description of Collection included using partOf key) with valid value - model 5.1	PASS	-	-	-	-	-	-	-	-	-	-	-
1:8 Implements *Annotation Page first* key** (i.e., in description of Collection included using partOf key) with valid value - model 5.1	PASS	-	-	-	-	-	-	-	-	-	-	-
1:9 Implements Annotation Page-level modified key (i.e., in description of Collection included using partOf key) which has a single value that is a string of format date-time - model 3.3.1	PASS	-	-	-	-	-	-	-	-	-	-	-
A single Annotation Page implements optional keys and meets optional key value constraints	-	-	-	-	-	-	-	-	-	PASS	-	-