(Pack­aged) Web Pub­li­ca­tions (PWP)

These Slides are Avail­able on the Web

See:
http://w3c.github.io/dpub/2016/Beijing/index.html

(Slides are in HTML)

EPUB 3 is a very mature specification

• Widely used for­mat for dig­i­tal pub­li­ca­tion
• A truly portable and non-pro­pri­etary for­mat
• The stan­dard for­mat for dig­i­tal books…
• …but can be also be used for mag­a­zines, jour­nal ar­ti­cles, doc­u­men­ta­tion, etc.

Books with illustrations

Art books

Man­gas

Tech­ni­cal books

Books with different character sets and writing directions

…journals or magazines (articles)

…of­fi­cial re­ports of all kinds

In fact, just about anything!

Well, at least one of the secrets…

• EPUB is based on Web Tech­nolo­gies like HTML, CSS, SVG, JS, etc.
  • col­lec­tively re­ferred to as “Open Web Plat­form” (OWP)
• I.e., no sep­a­rate ren­der­ing, for­mat­ting, etc., spec­i­fi­ca­tion had to be de­fined
• In­stead, EPUB re­lies on spec­i­fi­ca­tions de­fined by W3C and de­ployed in browsers

A good example

• The image on the right is dis­played through that translu­cent “screen”
• This is not done through some sep­a­rate image pro­cess­ing step
• In­stead, it is based on some com­plex CSS fea­tures (im­ple­mented in browsers but also in EPUB read­ers)

Are we all done?
I.e., are OWP and EPUB a perfect match?

There are two major areas that need work:

1. bring OWP and Dig­i­tal Pub­lish­ing closer
2. bring the Web and Dig­i­tal Pub­lish­ing closer

Missing OWP features

• Some fea­tures, needed by pub­lish­ing, are miss­ing from OWP; ex­am­ples:
  • pag­i­na­tion, page con­trols for head­ings, page num­bers
  • graph­ics tran­si­tion ef­fects (needed in, e.g., man­gas, car­toons, chil­dren books)
  • tak­ing into ac­count the type­set­ting re­quire­ments of dif­fer­ent cul­tures (French, Russ­ian, Ara­bic, Chi­nese, Japan­ese,…)
• Bring extra Web fa­cil­i­ties, li­braries, ser­vices, etc., closer to pub­lish­ing
• W3C has a Dig­i­tal Pub­lish­ing In­ter­est Group to look into these is­sues and co­op­er­ate with the rel­e­vant W3C groups

What is, in fact, a (dig­i­tal) book?

• It is a mean to trans­mit ideas to read­ers in var­i­ous for­mats
• It is in­de­pen­dent of for­mat: the same “book” should be avail­able in dif­fer­ent for­mat and media
  • printed book, dig­i­tal books, Web page(s)…
• Today, a Dig­i­tal Book is dif­fer­ent than a Web page (con­cep­tu­ally and prac­ti­cally)

What we get today…

• One can down­load an EPUB (and other for­mats) from a Web site…

What we get today…

• …get a very tra­di­tional text to read…

What we get today…

• …but ac­cess a dif­fer­ent (and pos­si­bly nicer) Web page on­line…
• This should not be the case!

“This should not be the case!”
what does this mean?

For example: book in a browser

• On a desk­top I may want to read a book just like a Web page:
  • eas­ily fol­low a link “out” of the book
  • cre­ate book­marks to “within” a page in a book
  • use use­ful plu­g­ins and tools that my browser may have
  • cre­ate an­no­ta­tions
  • some­times I may need the com­put­ing power of my desk-top for, e.g., pow­er­ful text analy­sis

For example: book in a browser

• But, at other times, I may also want to use a small ded­i­cated reader de­vice to read the book on the beach…
• All these on the same book (not con­ver­sions from one for­mat to the other)!

For example: I may not be online…

• I may find an ar­ti­cle on the Web that I want to re­view, an­no­tate, etc., while com­mut­ing home on a train
• I want the re­sults of the an­no­ta­tions to be back on­line, when I am back on the In­ter­net

For example: scholarly publishing

• Paper may be pub­lished on-line, but peo­ple may want to down­load it for of­fline use
• The for­mat of the paper should be adapt­able to read­ing en­vi­ron­ment
  • no two col­umn, fixed lay­out file that can­not be han­dled on an my tablet…
• The “paper” may also con­tain video, audio, data, pro­grams…
  • schol­arly pub­lish­ing is not text only any more!

Need for the concept of a “publication” of many resources

• A pub­li­ca­tion may con­sist of many re­sources (text, im­ages, videos, etc)
• On the Web, these are linked to­gether, but they keep their com­plete “in­de­pen­dence”
• For pub­lish­ing the ab­stract “work” should be a sin­gle, con­cep­tual unit on the Web: a Web Pub­li­ca­tion (WP)

What does that mean technically?

• The cur­rent Web builds on the no­tion of a sin­gle re­source:
  • HTML source, meta­data, CSS style sheet, etc.
  • each has its own URL
• Ren­der­ing is based on the in­ter­op­er­a­tion of many such re­sources

What does that mean technically?

• A WP is col­lec­tion of Web re­sources con­sid­ered as one unit
  • this means there is a unique Web ad­dress for the col­lec­tion (as op­posed to a sin­gle con­stituent)
  • the same WP can be of­fline or on­line with the same ad­dress
• WP-s are part of the Web!

Why do we need the WP concept?

• The whole book should be archived in a na­tional li­brary
• The pub­li­ca­tion has to be checked for in­tegrity as a whole (e.g., in a legal pub­li­ca­tion)
• Shar­ing a pub­li­ca­tion with a friend re­quires the con­cept of the pub­li­ca­tion as a whole
• Pub­lish­ing and li­brary busi­ness mod­els are based on the con­cept of “works”

Why do we need the WP concept?

• Value coun­ters (coun­ters, sec­tion num­ber­ing, foot­notes, end­notes, etc.) should be con­sis­tent across the pub­li­ca­tion
• Any search, text analy­sis, etc., fa­cil­ity for a book should have ac­cess to the full pub­li­ca­tion
• User pref­er­ences should apply to the “work” rather than to a sin­gle Web page

(Some) tech­ni­cal chal­lenges

• How to en­sure a unique iden­ti­fi­ca­tion of a WP?
• How to rep­re­sent, pro­gra­mat­i­cally, the con­cept of a WP?
• How to as­sign meta­data, ad­di­tional in­for­ma­tion, etc., to a WP (rather than just a Web page)?
• How to con­trol user in­ter­face pref­er­ences for a full WP?
• How to en­sure se­cu­rity for the full pub­li­ca­tion (even if it is copied)?

Envisioned architecture:
online

Envisioned architecture:
offline

Advances in modern browsers: Web and Service Workers

• Web Worker: a truly par­al­lel thread within the browser
• A Ser­vice Worker is a spe­cial type of Web Worker, with ad­di­tional fea­tures:
  • it is a pro­gram­ma­ble net­work proxy: the ren­derer’s net­work calls are caught and the re­quest/an­swer can be mod­i­fied on-the-fly be­hind the scenes
  • it has an in­ter­face to han­dle a local cache for net­worked data
  • it will stay alive even if the user moves away from the main page, and can be ac­cessed later if he/she re­turns to it

Service Workers are coming…

• Browser en­gines are head­ing to­wards Ser­vice Work­ers today
  • a major tech­nol­ogy to rec­on­cile Mo­bile Ap­pli­ca­tions and Web De­vel­op­ments
• I.e, Web Pub­li­ca­tions build on an evo­lu­tion that is al­ready hap­pen­ing

Manifests

• A WP needs a num­ber of extra in­for­ma­tion
  • dif­fer­ent type of meta­data (au­thor, title, pub­lisher, etc.)
  • list of re­sources within a WP
  • table of con­tent in­for­ma­tion, i.e., de­fault read­ing order
  • unique iden­ti­fier (ISBN, DOI, etc.)
  • ref­er­ences to more com­plex meta­data (e.g., ONIX data)
• The tra­di­tional term is “man­i­fest” for such in­for­ma­tion
• A de­tailed man­i­fest must be spec­i­fied for WP-s

Work on “Web App Man­i­fests”

• Work is hap­pen­ing at W3C
  • used for Web Ap­pli­ca­tions
  • con­tains lots of dis­play-ori­ented data, and some meta­data
  • de­scribes a pre­cise way of fetch­ing man­i­fests and con­tent in a se­cure con­text
  • con­tains data for an ap­pli­ca­tion based on Ser­vice Work­ers
• A WP man­i­fest can build on this evo­lu­tion as well!

Pack­aged Web Pub­li­ca­tions (PWP)

• For a large num­ber of use cases Web Pub­li­ca­tions (es­sen­tially, on­line/of­fline read­ing) is all they re­ally need
  • e.g., schol­arly jour­nals, on­line mag­a­zines, brochures
• But a num­ber of use cases rely on an extra step: to “pack” the con­tent of a WP into a sin­gle file
  • archival, li­brary dis­tri­b­u­tions,…
  • ex­ten­sion of the cur­rent busi­ness model of trade pub­lish­ers (built on EPUB)

A layer “on top” of WP-s

• Pack­ag­ing means col­lect­ing all the con­tent of a WP into a sin­gle file
• Some ad­di­tional is­sues to be han­dled:
  • spe­cial en­tries to the man­i­fest
  • archival for­mat(s)
  • etc.
• A spe­cific “pro­file” for WP may have to be de­fined for a PWP

Structure of an EPUB3 file

A Packaging of a Web Publication

• A Packaged Web Publication may have a very similar structure
• But moving to the Web would probably require to rethink the format of the administrative files
  • e.g., manifest would be in JSON
  • structure of metadata may different
  • etc.

PWP packaging structure

A PWP Proces­sor

• PWP-s may be han­dled by ded­i­cated ap­pli­ca­tions
• But the con­cept of a WP proces­sor can be ex­tended to a PWP proces­sor, un­pack­ing con­tent on the fly
  • se­cu­rity con­sid­er­a­tions must be han­dled, though

A PWP Processor

PWP vs. EPUB3.1

• PWP does not re­place EPUB 3 today
• It is, in­stead, part of a fu­ture evo­lu­tion, or a vi­sion, for the years to come

Most things are the same!

• Im­por­tant to note that the con­tent of a PWP and EPUB 3 are iden­ti­cal
  • usage of HTML, CSS, SVG, etc.
• The main change is the “ad­min­is­tra­tive” as­pect of the pub­li­ca­tion (lo­ca­tors, man­i­fest, etc)

Advantage for the publishers‘ community

• The main in­ter­est of pub­lish­ers is to pro­duce, edit, cu­rate, etc., con­tent
• Pub­lish­ers would have an eas­ier ac­cess to a large au­di­ence
• Pub­lish­ers have in­vested heav­ily into tech­nol­ogy de­vel­op­ments, but the Web de­vel­op­ers’ com­mu­nity can com­ple­ment that with a wider reach and per­spec­tive

Advantage for the publishers‘ community

• Work­ing closely with Web de­vel­op­ers avoids re-in­vent­ing wheels
  • e.g., API-s to ac­cess sys­tem re­sources or util­i­ties, like index data­base, bat­tery sta­tus API, real-time com­mu­ni­ca­tion, ge­olo­ca­tion,…
• Align­ing more on OWP means that spe­cial­ized read­ers or Web sites, soft­ware, ser­vices, etc, can rely on it

Advantage for the Web community

• Pub­lish­ers have ex­pe­ri­ence in:
  • er­gonom­ics, ty­pog­ra­phy, aes­thet­ics…
  • pub­lish­ing long texts, with the right read­abil­ity and struc­ture
• Work­flow for pro­duc­ing com­plex con­tent
• In some sense, a new type of con­tent comes to the fore

Some references

Lat­est PWP Use Cases and Re­quire­ments draft:

https://w3c.github.io/dpub-pwp-ucr/

Lat­est PWP Ed­i­tors’ draft:

https://w3c.github.io/dpub-pwp/

PWP Issue list:

https://github.com/w3c/dpub-pwp/issues

Thank you for your at­ten­tion!

This pre­sen­ta­tion:

http://w3c.github.io/dpub/2016/Beijing/index.html

My con­tact:

ivan@​w3.​org