SlideShare a Scribd company logo
1 of 24
Issues with
SignWriting in
Unicode 8
Prepared for UTC # 144 / L2 # 241 (July 27-31, 2015)
a Unicode Technical Committee meeting in Redmond, WA
by Stephen E Slevinski Jr
in association with the Center for Sutton Movement Writing
My Background
Bachelor of Science
in Mathematics
Raised two kids with
sign language
Started collaboration with Valerie
Sutton from 2004 until today
Complete symbol encoding model on
PUA Plane 16 (37,811 characters)
Complete script encoding model on
PUA Plane 15 (1,179 characters)
Argued with Unicode in 2011
and then walked away
Released the ISWA 2010
symbol set in 2010
Finalized Formal SignWriting
in ASCII on Jan 12, 2012
5 Years of stability with the
symbol set and fonts design
3 1/2 Years of stability with the
character encoding models
Involved with dozens of sign
languages around the world
Foundation for all online use and
modern publishing efforts
SignWriting in Software
All major SignWriting editors and viewers are compatible.
• SignPuddle Online
Primary source of written sign language
• Delegs Editor
Educational software from Germany for bilingual education.
• SignWriter Studio
General purpose SignWriting editor, integrated dictionary, and printing.
• SWift
SignWriting improved fast transcriber that aims to simplify the editing process.
• JSPad
SignWriting editor for Japanese sign language based in the Gifu University.
• Tunisigner
interact with SignWriting notations through a 3D virtual signer able to reproduce
the exact gestures represented within the sign language transcription.
• SignTyp
a linguistic coding system developed by Rachel Channon through an NSF grant
that is being integrated with SignWriting.
http://www.signbank.org/signmaker.html
Code Breakdown
0 KB
7 KB
14 KB
21 KB
28 KB
35 KB
42 KB
49 KB
56 KB
63 KB
70 KB
Configuration
Support Libraries
Custom HTML, JS, and CSS
SignMaker 2015
Cross-browser, drag-and-drop sign editor,
with dictionary and advanced sign searching
SignWriting in Software
Bookmarklet
Javascript-based SignWriting Keyboard
Keyboarding editing has returned to SignWriting
Wikimedia Incubator
The keyboard editor is enabled on Wikimedia
Incubator for the American Sign Language
Wikipedia and every other sign language project.
Store JavaScript in a bookmark and you can use
SignWriting on any web page in any text fields.
Any Website
Add a few KB of JavaScript and the keyboard editor can be enabled
on any website using standard edit boxes and visual presentation.
http://www.signwriting.org/symposium/presentation0041.html
SignWriting in Software
What about Unicode?
PUA Plane 15 design (1,179 characters)
The symbol only design removed 2-D layout by dropping
5 structural markers and 500 number characters
N4015 Preliminary Unicode (674 characters)
N4090 Revised Unicode (672 characters)
N4342 Unicode Proposal (672 characters)
A new inherent design removes 2 characters (F1
and R1) and breaks collation as stated in proposal
A new facial diacritic design is proposed
that is unsupported and untested
The original design is still compatible with the community efforts.
Issues with SignWriting
in Unicode 8
The Unicode 8 specification will not be used
for any SignWriting project around the world.
The Unicode 8 specification for SignWriting is
politically valuable, but unhelpful for developers.
Issues with SignWriting
in Unicode 8
The issue of the moment is sorting,
but there are three main issues.
If we address all of the issues for
SignWriting, the existing International
community of SignWriters is ready, able,
and willing to embrace the standard.
Issue 1: Unicode 8 is incomplete
http://signbank.org/SignWriting_Character_Viewer.html
Unicode 8 only encodes
the symbols and ignores
the issue of layout.
Unicode 8 is missing the
structural markers
and number characters
required for 2-D Layout.
Unicode 8 requires SVG
for the visual presentation.
Unicode 8 requires additional
characters/markup to write a sign.
Issue 2: Unicode 8 is flawed
The idea of Inherent characters
breaks from the community
use of today and historically.
Because of Inherent modifiers,
sorting is broken, searching is
ambiguous, and replacements
can be destructive.
w s P
Symbol Bases
Tokens
i oSymbol Modifiers
Tokens
identified with a
string of 3 tokens.
w i o
Writing Symbol
P i o
Punctuation Symbol
Fill Rotation
Triadic
Symbol
Issue 2: Unicode 8 is flawed
Sorting is broken
1D800 SIGNWRITING HAND-FIST INDEX (HFI)
1DAA1 SIGNWRITING ROTATION MODIFIER-2 (R2)
1DA9B SIGNWRITING FILL MODIFIER-2 (F2)
1. HFI F1 R1
5. HFI F1 R1 HFI F1 R1
2. HFI F1 R2
6. HFI F1 R2 HFI F1 R1
3. HFI F2 R1
7. HFI F2 R1 HFI F1 R1
4. HFI F2 R2
1. HFI
5. HFI HFI
3. HFI F2
7. HFI F2 HFI
4. HFI F2 R2
2. HFI R2
6. HFI R2 HFI
Correct sorting with F1 & R1 Incorrect sorting without F1 & R1
http://www.unicode.org/L2/L2015/15184-signwriting-ducet.txt
http://www.unicode.org/L2/L2015/15194-signwriting-response.pdf
http://www.unicode.org/L2/L2015/15202-signwriting-ducet-aux.txt
Issue 2: Unicode 8 is flawed
Sorting is broken
1D800 SIGNWRITING HAND-FIST INDEX (HFI)
1DAA1 SIGNWRITING ROTATION MODIFIER-2 (R2)
1DA9B SIGNWRITING FILL MODIFIER-2 (F2)
HFI weight of 100
F2 weight of 420
R2 weight of 410
1. HFI
100
5. HFI HFI
100 100
2. HFI R2
100 410
6. HFI R2 HFI
100 410 100
3. HFI F2
100 420
7. HFI F2 HFI
100 420 100
4. HFI F2 R2
100 420 410
DUCET Fix
Correct sorting with DUCET
1, 5, 2, 6, 3, 7, 4
Correct Sort Order
1, 2, 3, 4, 5, 6, 7
Incorrect Sort Order
Issue 2: Unicode 8 is flawed
Searching is ambiguous
1D800 SIGNWRITING HAND-FIST INDEX (HFI)
1DAA1 SIGNWRITING ROTATION MODIFIER-2 (R2)
1DA9B SIGNWRITING FILL MODIFIER-2 (F2)
1. HFI F1 R1
5. HFI F1 R1 HFI F1 R1
2. HFI F1 R2
6. HFI F1 R2 HFI F1 R1
3. HFI F2 R1
7. HFI F2 R1 HFI F1 R1
4. HFI F2 R2
1. HFI
5. HFI HFI
3. HFI F2
7. HFI F2 HFI
4. HFI F2 R2
2. HFI R2
6. HFI R2 HFI
Searching with F1 & R1 Searching without F1 & R1
Searching for the symbol
HFI F1 R1 correctly
finds 4 matches
Searching for the symbol HFI
incorrectly finds 10 matches
without negative lookaheads
Issue 2: Unicode 8 is flawed
Searching is ambiguous
Query String:
QS10000S20500
Searching for signs that
include 2 exact symbols will
return these results from
the ASL Dictionary.
Issue 2: Unicode 8 is flawed
Searching is ambiguous
Plus 6 more pages of signs.
Query String:
QS100uuS205uu
In Unicode 8, searching for a
symbol base without fill or rotation
modifiers will return 6 times as
much noise as signal.
Issue 2: Unicode 8 is flawed
Replacements can be destructive
sub uFD830 uFD810 uFD820 by S10000;
sub uFD830 uFD810 uFD821 by S10001;
sub uFD830 uFD810 uFD822 by S10002;
sub uFD830 uFD810 uFD823 by S10003;
sub uFD830 uFD810 uFD824 by S10004;
sub uFD830 uFD810 uFD825 by S10005;
sub uFD830 uFD810 uFD826 by S10006;
sub uFD830 uFD810 uFD827 by S10007;
sub u1DA8B u1DAA7 by S38b07;
sub u1DA8B u1DAA6 by S38b06;
sub u1DA8B u1DAA5 by S38b05;
sub u1DA8B u1DAA4 by S38b04;
sub u1DA8B u1DAA3 by S38b03;
sub u1DA8B u1DAA2 by S38b02;
sub u1DA8B u1DAA1 by S38b01;
sub u1DA8B by S38b00;
https://github.com/Slevinski/signwriting_2010_tools
The TrueType Fonts use Ligatures to support multiple character sets.
Plane 15 Characters Unicode 8 Characters
Increasing symbols keys or
decreasing works without issue.
Decreasing symbol keys
to avoid destruction.
Issue 3: Unicode 8 is fictional
Facial diacritics do not exist. There is no font
support, no software support, and no data.
Facial diacritics are described
in one document, using 177 words.
Facial diacritics have never been tested on any
individual, let alone an international group.
Facial expressions are created using
overlap and overlay of many symbols
using Cartesian coordinates for each.
Facial diacritics should
be handled in software
rather than the
character encoding.
Facial diacritics development was
quietly abandoned the end of 2012.
Formal SignWriting
Regular Expressions
Query Strings
Community Use
SVG
PUA Plane 15
Graphite Font
Unicode 8 PUA Plane 16TTF
10% to 50% reduction
15 to 50 times expansion
process million of characters per second
search results
15 times expansion
single character per symbolligatures of 1 to 3 characters
twice the size
cartesian coordinates with GPOS
CSS
style text
Isomorphic
JS
ASCII Lite Markup
preferredunused
prototype
6 KB zipped
AS18711S20500 M514x517S18711490x483S20500486x506
AS18711S20500M514x517S18711490x483S20500486x506
A S18711 S20500 M514x517 S18711490x483 S20500486x506
M 514x517 S18711 490x483 S20500 486x506
(514,517) (490,483) (486,506)
Time Space
Sequence
Marker
Symbol
Middle Lane
SignBox
Max
Coord
Spatial
Symbol
Community Use
Formal SignWriting
Standard ASCII format is Isomorphic to PUA Plane 15
Unicode 9
Regular Expressions
Query Strings
Ideal Solution
Graphite Font TTF
10% to 50% reduction
15 to 50 times expansion
process million of characters per second
search results
cartesian coordinates with GPOS
CSS
style text
http://signpuddle.net/iswa/#smartfont
Prototype Font uses Cartesian coordinates for 2-D layout with Graphite
JS
6 KB zipped
Too Late?
SignWriting is spreading around the world and exploding online.
All of the SignWriting projects are using an ASCII solution and
have no plans to switch to the Unicode 8 design for the symbols.
Without a full script solution for SignWriting, Unicode will not be
used for SignWriting, especially the Unicode 8 design which
complicates otherwise simple routines.
Using Unicode for SignWriting is a great idea in theory, but there are
few advantages and too many disadvantages to seriously consider
applying the Unicode 8 design, even if sorting is fixed.
I left the Unicode effort the end of 2011. In 2012, I was shown the
latest proposal (N4342). I objected privately and asked that they
produce a working font before they contact me again.
In 2014, I was contacted that SignWriting will be in Unicode 8. I
reiterated my objections, pointing out the issues, and was told it
was too late to change the design in any way.
Discussion Ideas
2-Color Fonts
SignWriting relies on a 2-color font. Currently, SignWriting mimics a 2-color
font by using 2 TrueType Fonts: one for the line and another for the filling. If
you have any experience with 2-color fonts, let’s discuss the possibilities.
2-Dimensional Layout with Graphite and Cartesian coordinates
SignWriting has a prototype font that uses Cartesian coordinates to control
the 2-dimensional layout with Graphite and PUA Plane 15 characters. If you
have any experience with 2-dimensional layout using Cartesian coordinates,
let’s discuss the possibilities.
Alternate designs for a 2-dimensional script
This type of discussion is interesting, but it will not effect the SignWriting
community. The standards are stable and widely used. This would make for
an interesting project, but it is not work that I will be doing myself.
Discussion Ideas
Unicode 9 or 10
Can we deprecate Unicode 8? The community design has been stable for 3
1/2 years. There is an interested community and there are many possibilities
for 2-Color fonts and 2-Dimensional layout.
Unicode 8
I will not be using Unicode 8. I partially support Unicode 8 with the SignWriting
2010 Fonts, but not the facial diacritics. I suggested that people avoid use
SignWriting in Unicode 8. I’m willing to discuss any of the 3 issues that I have
outlined, but I’m not invested in any tweaks to the Unicode 8 design.
Symbol Encoding Model
PUA Plane 16 (37,811 characters)
Script Encoding Model
PUA Plane 15 (1,179 characters)
both designs are productive and used today
Issues with SignWriting
in Unicode 8
by Stephen E Slevinski Jr
http://slevinski.github.io
slevinski@signwriting.org
http://www.slideshare.net/StephenSlevinski/presentations

More Related Content

What's hot

Color_Combinations.DOCX
Color_Combinations.DOCXColor_Combinations.DOCX
Color_Combinations.DOCXDavid Gray
 
Unicode Fundamentals
Unicode Fundamentals Unicode Fundamentals
Unicode Fundamentals SamiHsDU
 
L4 Fashioning Text Styles and Colors
L4   Fashioning Text Styles and ColorsL4   Fashioning Text Styles and Colors
L4 Fashioning Text Styles and Colorsmykella
 
Unicode Encoding Forms
Unicode Encoding FormsUnicode Encoding Forms
Unicode Encoding FormsMehdi Hasan
 
Graph representation of context-free grammar
Graph representation of context-free grammarGraph representation of context-free grammar
Graph representation of context-free grammarAlex Shkotin
 
User Defined Characters and SVG Fonts
User Defined Characters and SVG FontsUser Defined Characters and SVG Fonts
User Defined Characters and SVG FontsJun Fujisawa
 

What's hot (9)

Color_Combinations.DOCX
Color_Combinations.DOCXColor_Combinations.DOCX
Color_Combinations.DOCX
 
ODT to Braille (AEGIS project)
ODT to Braille (AEGIS project)ODT to Braille (AEGIS project)
ODT to Braille (AEGIS project)
 
Mql4 manual
Mql4 manualMql4 manual
Mql4 manual
 
Unicode Fundamentals
Unicode Fundamentals Unicode Fundamentals
Unicode Fundamentals
 
L4 Fashioning Text Styles and Colors
L4   Fashioning Text Styles and ColorsL4   Fashioning Text Styles and Colors
L4 Fashioning Text Styles and Colors
 
302 sargent word2007-ssp2008
302 sargent word2007-ssp2008302 sargent word2007-ssp2008
302 sargent word2007-ssp2008
 
Unicode Encoding Forms
Unicode Encoding FormsUnicode Encoding Forms
Unicode Encoding Forms
 
Graph representation of context-free grammar
Graph representation of context-free grammarGraph representation of context-free grammar
Graph representation of context-free grammar
 
User Defined Characters and SVG Fonts
User Defined Characters and SVG FontsUser Defined Characters and SVG Fonts
User Defined Characters and SVG Fonts
 

Viewers also liked

Moving forward with sign language projects in Formal SignWriting
Moving forward with sign language projects in Formal SignWritingMoving forward with sign language projects in Formal SignWriting
Moving forward with sign language projects in Formal SignWritingStephen Slevinski
 
Taking Social Media to the Next Level
Taking Social Media to the Next LevelTaking Social Media to the Next Level
Taking Social Media to the Next Levelmaureenalley
 
SignPuddle Standard for SignWriting Text presentation
SignPuddle Standard for SignWriting Text presentationSignPuddle Standard for SignWriting Text presentation
SignPuddle Standard for SignWriting Text presentationStephen Slevinski
 
Constructing a TrueType Font for the SignWriting Script with Unicode Characte...
Constructing a TrueType Font for the SignWriting Script with Unicode Characte...Constructing a TrueType Font for the SignWriting Script with Unicode Characte...
Constructing a TrueType Font for the SignWriting Script with Unicode Characte...Stephen Slevinski
 
Digital collaboration with machine-readable sign language text in the SignWri...
Digital collaboration with machine-readable sign language text in the SignWri...Digital collaboration with machine-readable sign language text in the SignWri...
Digital collaboration with machine-readable sign language text in the SignWri...Stephen Slevinski
 
Beyond SignWriting Plain Text
Beyond SignWriting Plain TextBeyond SignWriting Plain Text
Beyond SignWriting Plain TextStephen Slevinski
 
SignWriting in an ASCII World
SignWriting in an ASCII WorldSignWriting in an ASCII World
SignWriting in an ASCII WorldStephen Slevinski
 
якунина виктория 9 класс
якунина виктория 9 классякунина виктория 9 класс
якунина виктория 9 классСОШ ЦДО
 
はなみの上山日記
はなみの上山日記はなみの上山日記
はなみの上山日記Koei Miyakita
 
GUÍA DE COMPRAS Marzo
GUÍA DE COMPRAS MarzoGUÍA DE COMPRAS Marzo
GUÍA DE COMPRAS MarzoEl Universal
 
Sealey evolution
Sealey evolutionSealey evolution
Sealey evolutionssealey
 
How to Design Research from Ilm Ideas on Slide Share
How to Design Research from Ilm Ideas on Slide Share How to Design Research from Ilm Ideas on Slide Share
How to Design Research from Ilm Ideas on Slide Share ilmideas
 
History of Technology
History of TechnologyHistory of Technology
History of Technologycarareilly1
 

Viewers also liked (20)

Moving forward with sign language projects in Formal SignWriting
Moving forward with sign language projects in Formal SignWritingMoving forward with sign language projects in Formal SignWriting
Moving forward with sign language projects in Formal SignWriting
 
Thanks to the UTC
Thanks to the UTCThanks to the UTC
Thanks to the UTC
 
Taking Social Media to the Next Level
Taking Social Media to the Next LevelTaking Social Media to the Next Level
Taking Social Media to the Next Level
 
The SignWriting Symposium
The SignWriting SymposiumThe SignWriting Symposium
The SignWriting Symposium
 
SignPuddle Standard for SignWriting Text presentation
SignPuddle Standard for SignWriting Text presentationSignPuddle Standard for SignWriting Text presentation
SignPuddle Standard for SignWriting Text presentation
 
Constructing a TrueType Font for the SignWriting Script with Unicode Characte...
Constructing a TrueType Font for the SignWriting Script with Unicode Characte...Constructing a TrueType Font for the SignWriting Script with Unicode Characte...
Constructing a TrueType Font for the SignWriting Script with Unicode Characte...
 
Digital collaboration with machine-readable sign language text in the SignWri...
Digital collaboration with machine-readable sign language text in the SignWri...Digital collaboration with machine-readable sign language text in the SignWri...
Digital collaboration with machine-readable sign language text in the SignWri...
 
SignWriting Stack 2015
SignWriting Stack 2015SignWriting Stack 2015
SignWriting Stack 2015
 
Beyond SignWriting Plain Text
Beyond SignWriting Plain TextBeyond SignWriting Plain Text
Beyond SignWriting Plain Text
 
SignWriting in an ASCII World
SignWriting in an ASCII WorldSignWriting in an ASCII World
SignWriting in an ASCII World
 
якунина виктория 9 класс
якунина виктория 9 классякунина виктория 9 класс
якунина виктория 9 класс
 
はなみの上山日記
はなみの上山日記はなみの上山日記
はなみの上山日記
 
GUÍA DE COMPRAS Marzo
GUÍA DE COMPRAS MarzoGUÍA DE COMPRAS Marzo
GUÍA DE COMPRAS Marzo
 
Sealey evolution
Sealey evolutionSealey evolution
Sealey evolution
 
Gmaw 1
Gmaw 1Gmaw 1
Gmaw 1
 
How to Design Research from Ilm Ideas on Slide Share
How to Design Research from Ilm Ideas on Slide Share How to Design Research from Ilm Ideas on Slide Share
How to Design Research from Ilm Ideas on Slide Share
 
Dos papa sslideshare
Dos papa sslideshareDos papa sslideshare
Dos papa sslideshare
 
Note cards
Note cardsNote cards
Note cards
 
Mobile industry
Mobile industryMobile industry
Mobile industry
 
History of Technology
History of TechnologyHistory of Technology
History of Technology
 

Similar to Issues with SignWriting in Unicode 8

draft-slevinski-signwriting-text
draft-slevinski-signwriting-textdraft-slevinski-signwriting-text
draft-slevinski-signwriting-textStephen Slevinski
 
Data encryption and tokenization for international unicode
Data encryption and tokenization for international unicodeData encryption and tokenization for international unicode
Data encryption and tokenization for international unicodeUlf Mattsson
 
Structure-Compiler-phases information about basics of compiler. Pdfpdf
Structure-Compiler-phases information  about basics of compiler. PdfpdfStructure-Compiler-phases information  about basics of compiler. Pdfpdf
Structure-Compiler-phases information about basics of compiler. Pdfpdfovidlivi91
 
Go Global Fearless(I18N & L10N)
Go Global Fearless(I18N & L10N)Go Global Fearless(I18N & L10N)
Go Global Fearless(I18N & L10N)Venkat Rajesh
 
Encoding Nightmares (and how to avoid them)
Encoding Nightmares (and how to avoid them)Encoding Nightmares (and how to avoid them)
Encoding Nightmares (and how to avoid them)Kenneth Farrall
 
유니코드 표
유니코드 표유니코드 표
유니코드 표서진 홍
 
유니코드 표
유니코드 표유니코드 표
유니코드 표서진 홍
 
Software Internationalization Crash Course
Software Internationalization Crash CourseSoftware Internationalization Crash Course
Software Internationalization Crash CourseWill Iverson
 
UTF-8: The Secret of Character Encoding
UTF-8: The Secret of Character EncodingUTF-8: The Secret of Character Encoding
UTF-8: The Secret of Character EncodingBert Pattyn
 
There should be a tool for that - GameQALoc Barcelona 2016
There should be a tool for that - GameQALoc Barcelona 2016There should be a tool for that - GameQALoc Barcelona 2016
There should be a tool for that - GameQALoc Barcelona 2016Adolfo Gomez-Urda
 
Octal to binary and octal to hexa decimal conversions
Octal to binary and octal to hexa decimal conversionsOctal to binary and octal to hexa decimal conversions
Octal to binary and octal to hexa decimal conversionsAfrasiyab Haider
 
Unicode and character sets
Unicode and character setsUnicode and character sets
Unicode and character setsrenchenyu
 
Symbology plessey
Symbology plesseySymbology plessey
Symbology plesseycri fan
 
Data Representation in Computers
Data Representation in ComputersData Representation in Computers
Data Representation in ComputersCBAKhan
 
Globalization Of Software
Globalization Of SoftwareGlobalization Of Software
Globalization Of SoftwareRobert Sayegh
 

Similar to Issues with SignWriting in Unicode 8 (20)

draft-slevinski-signwriting-text
draft-slevinski-signwriting-textdraft-slevinski-signwriting-text
draft-slevinski-signwriting-text
 
Unicode 101
Unicode 101Unicode 101
Unicode 101
 
Data encryption and tokenization for international unicode
Data encryption and tokenization for international unicodeData encryption and tokenization for international unicode
Data encryption and tokenization for international unicode
 
Structure-Compiler-phases information about basics of compiler. Pdfpdf
Structure-Compiler-phases information  about basics of compiler. PdfpdfStructure-Compiler-phases information  about basics of compiler. Pdfpdf
Structure-Compiler-phases information about basics of compiler. Pdfpdf
 
Go Global Fearless(I18N & L10N)
Go Global Fearless(I18N & L10N)Go Global Fearless(I18N & L10N)
Go Global Fearless(I18N & L10N)
 
Encoding Nightmares (and how to avoid them)
Encoding Nightmares (and how to avoid them)Encoding Nightmares (and how to avoid them)
Encoding Nightmares (and how to avoid them)
 
유니코드 표
유니코드 표유니코드 표
유니코드 표
 
유니코드 표
유니코드 표유니코드 표
유니코드 표
 
Binary codes
Binary codesBinary codes
Binary codes
 
Software Internationalization Crash Course
Software Internationalization Crash CourseSoftware Internationalization Crash Course
Software Internationalization Crash Course
 
UTF-8: The Secret of Character Encoding
UTF-8: The Secret of Character EncodingUTF-8: The Secret of Character Encoding
UTF-8: The Secret of Character Encoding
 
Uncdtalk
UncdtalkUncdtalk
Uncdtalk
 
There should be a tool for that - GameQALoc Barcelona 2016
There should be a tool for that - GameQALoc Barcelona 2016There should be a tool for that - GameQALoc Barcelona 2016
There should be a tool for that - GameQALoc Barcelona 2016
 
Octal to binary and octal to hexa decimal conversions
Octal to binary and octal to hexa decimal conversionsOctal to binary and octal to hexa decimal conversions
Octal to binary and octal to hexa decimal conversions
 
Introduction to Internationalization (I18n)
Introduction to Internationalization (I18n)Introduction to Internationalization (I18n)
Introduction to Internationalization (I18n)
 
Chap 01[1]
Chap 01[1]Chap 01[1]
Chap 01[1]
 
Unicode and character sets
Unicode and character setsUnicode and character sets
Unicode and character sets
 
Symbology plessey
Symbology plesseySymbology plessey
Symbology plessey
 
Data Representation in Computers
Data Representation in ComputersData Representation in Computers
Data Representation in Computers
 
Globalization Of Software
Globalization Of SoftwareGlobalization Of Software
Globalization Of Software
 

Recently uploaded

Top 5 Benefits OF Using Muvi Live Paywall For Live Streams
Top 5 Benefits OF Using Muvi Live Paywall For Live StreamsTop 5 Benefits OF Using Muvi Live Paywall For Live Streams
Top 5 Benefits OF Using Muvi Live Paywall For Live StreamsRoshan Dwivedi
 
A Call to Action for Generative AI in 2024
A Call to Action for Generative AI in 2024A Call to Action for Generative AI in 2024
A Call to Action for Generative AI in 2024Results
 
Boost PC performance: How more available memory can improve productivity
Boost PC performance: How more available memory can improve productivityBoost PC performance: How more available memory can improve productivity
Boost PC performance: How more available memory can improve productivityPrincipled Technologies
 
EIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptx
EIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptxEIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptx
EIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptxEarley Information Science
 
A Domino Admins Adventures (Engage 2024)
A Domino Admins Adventures (Engage 2024)A Domino Admins Adventures (Engage 2024)
A Domino Admins Adventures (Engage 2024)Gabriella Davis
 
IAC 2024 - IA Fast Track to Search Focused AI Solutions
IAC 2024 - IA Fast Track to Search Focused AI SolutionsIAC 2024 - IA Fast Track to Search Focused AI Solutions
IAC 2024 - IA Fast Track to Search Focused AI SolutionsEnterprise Knowledge
 
CNv6 Instructor Chapter 6 Quality of Service
CNv6 Instructor Chapter 6 Quality of ServiceCNv6 Instructor Chapter 6 Quality of Service
CNv6 Instructor Chapter 6 Quality of Servicegiselly40
 
08448380779 Call Girls In Civil Lines Women Seeking Men
08448380779 Call Girls In Civil Lines Women Seeking Men08448380779 Call Girls In Civil Lines Women Seeking Men
08448380779 Call Girls In Civil Lines Women Seeking MenDelhi Call girls
 
Injustice - Developers Among Us (SciFiDevCon 2024)
Injustice - Developers Among Us (SciFiDevCon 2024)Injustice - Developers Among Us (SciFiDevCon 2024)
Injustice - Developers Among Us (SciFiDevCon 2024)Allon Mureinik
 
Tata AIG General Insurance Company - Insurer Innovation Award 2024
Tata AIG General Insurance Company - Insurer Innovation Award 2024Tata AIG General Insurance Company - Insurer Innovation Award 2024
Tata AIG General Insurance Company - Insurer Innovation Award 2024The Digital Insurer
 
Exploring the Future Potential of AI-Enabled Smartphone Processors
Exploring the Future Potential of AI-Enabled Smartphone ProcessorsExploring the Future Potential of AI-Enabled Smartphone Processors
Exploring the Future Potential of AI-Enabled Smartphone Processorsdebabhi2
 
Factors to Consider When Choosing Accounts Payable Services Providers.pptx
Factors to Consider When Choosing Accounts Payable Services Providers.pptxFactors to Consider When Choosing Accounts Payable Services Providers.pptx
Factors to Consider When Choosing Accounts Payable Services Providers.pptxKatpro Technologies
 
Developing An App To Navigate The Roads of Brazil
Developing An App To Navigate The Roads of BrazilDeveloping An App To Navigate The Roads of Brazil
Developing An App To Navigate The Roads of BrazilV3cube
 
The Codex of Business Writing Software for Real-World Solutions 2.pptx
The Codex of Business Writing Software for Real-World Solutions 2.pptxThe Codex of Business Writing Software for Real-World Solutions 2.pptx
The Codex of Business Writing Software for Real-World Solutions 2.pptxMalak Abu Hammad
 
Handwritten Text Recognition for manuscripts and early printed texts
Handwritten Text Recognition for manuscripts and early printed textsHandwritten Text Recognition for manuscripts and early printed texts
Handwritten Text Recognition for manuscripts and early printed textsMaria Levchenko
 
WhatsApp 9892124323 ✓Call Girls In Kalyan ( Mumbai ) secure service
WhatsApp 9892124323 ✓Call Girls In Kalyan ( Mumbai ) secure serviceWhatsApp 9892124323 ✓Call Girls In Kalyan ( Mumbai ) secure service
WhatsApp 9892124323 ✓Call Girls In Kalyan ( Mumbai ) secure servicePooja Nehwal
 
How to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected WorkerHow to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected WorkerThousandEyes
 
Partners Life - Insurer Innovation Award 2024
Partners Life - Insurer Innovation Award 2024Partners Life - Insurer Innovation Award 2024
Partners Life - Insurer Innovation Award 2024The Digital Insurer
 
Histor y of HAM Radio presentation slide
Histor y of HAM Radio presentation slideHistor y of HAM Radio presentation slide
Histor y of HAM Radio presentation slidevu2urc
 
From Event to Action: Accelerate Your Decision Making with Real-Time Automation
From Event to Action: Accelerate Your Decision Making with Real-Time AutomationFrom Event to Action: Accelerate Your Decision Making with Real-Time Automation
From Event to Action: Accelerate Your Decision Making with Real-Time AutomationSafe Software
 

Recently uploaded (20)

Top 5 Benefits OF Using Muvi Live Paywall For Live Streams
Top 5 Benefits OF Using Muvi Live Paywall For Live StreamsTop 5 Benefits OF Using Muvi Live Paywall For Live Streams
Top 5 Benefits OF Using Muvi Live Paywall For Live Streams
 
A Call to Action for Generative AI in 2024
A Call to Action for Generative AI in 2024A Call to Action for Generative AI in 2024
A Call to Action for Generative AI in 2024
 
Boost PC performance: How more available memory can improve productivity
Boost PC performance: How more available memory can improve productivityBoost PC performance: How more available memory can improve productivity
Boost PC performance: How more available memory can improve productivity
 
EIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptx
EIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptxEIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptx
EIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptx
 
A Domino Admins Adventures (Engage 2024)
A Domino Admins Adventures (Engage 2024)A Domino Admins Adventures (Engage 2024)
A Domino Admins Adventures (Engage 2024)
 
IAC 2024 - IA Fast Track to Search Focused AI Solutions
IAC 2024 - IA Fast Track to Search Focused AI SolutionsIAC 2024 - IA Fast Track to Search Focused AI Solutions
IAC 2024 - IA Fast Track to Search Focused AI Solutions
 
CNv6 Instructor Chapter 6 Quality of Service
CNv6 Instructor Chapter 6 Quality of ServiceCNv6 Instructor Chapter 6 Quality of Service
CNv6 Instructor Chapter 6 Quality of Service
 
08448380779 Call Girls In Civil Lines Women Seeking Men
08448380779 Call Girls In Civil Lines Women Seeking Men08448380779 Call Girls In Civil Lines Women Seeking Men
08448380779 Call Girls In Civil Lines Women Seeking Men
 
Injustice - Developers Among Us (SciFiDevCon 2024)
Injustice - Developers Among Us (SciFiDevCon 2024)Injustice - Developers Among Us (SciFiDevCon 2024)
Injustice - Developers Among Us (SciFiDevCon 2024)
 
Tata AIG General Insurance Company - Insurer Innovation Award 2024
Tata AIG General Insurance Company - Insurer Innovation Award 2024Tata AIG General Insurance Company - Insurer Innovation Award 2024
Tata AIG General Insurance Company - Insurer Innovation Award 2024
 
Exploring the Future Potential of AI-Enabled Smartphone Processors
Exploring the Future Potential of AI-Enabled Smartphone ProcessorsExploring the Future Potential of AI-Enabled Smartphone Processors
Exploring the Future Potential of AI-Enabled Smartphone Processors
 
Factors to Consider When Choosing Accounts Payable Services Providers.pptx
Factors to Consider When Choosing Accounts Payable Services Providers.pptxFactors to Consider When Choosing Accounts Payable Services Providers.pptx
Factors to Consider When Choosing Accounts Payable Services Providers.pptx
 
Developing An App To Navigate The Roads of Brazil
Developing An App To Navigate The Roads of BrazilDeveloping An App To Navigate The Roads of Brazil
Developing An App To Navigate The Roads of Brazil
 
The Codex of Business Writing Software for Real-World Solutions 2.pptx
The Codex of Business Writing Software for Real-World Solutions 2.pptxThe Codex of Business Writing Software for Real-World Solutions 2.pptx
The Codex of Business Writing Software for Real-World Solutions 2.pptx
 
Handwritten Text Recognition for manuscripts and early printed texts
Handwritten Text Recognition for manuscripts and early printed textsHandwritten Text Recognition for manuscripts and early printed texts
Handwritten Text Recognition for manuscripts and early printed texts
 
WhatsApp 9892124323 ✓Call Girls In Kalyan ( Mumbai ) secure service
WhatsApp 9892124323 ✓Call Girls In Kalyan ( Mumbai ) secure serviceWhatsApp 9892124323 ✓Call Girls In Kalyan ( Mumbai ) secure service
WhatsApp 9892124323 ✓Call Girls In Kalyan ( Mumbai ) secure service
 
How to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected WorkerHow to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected Worker
 
Partners Life - Insurer Innovation Award 2024
Partners Life - Insurer Innovation Award 2024Partners Life - Insurer Innovation Award 2024
Partners Life - Insurer Innovation Award 2024
 
Histor y of HAM Radio presentation slide
Histor y of HAM Radio presentation slideHistor y of HAM Radio presentation slide
Histor y of HAM Radio presentation slide
 
From Event to Action: Accelerate Your Decision Making with Real-Time Automation
From Event to Action: Accelerate Your Decision Making with Real-Time AutomationFrom Event to Action: Accelerate Your Decision Making with Real-Time Automation
From Event to Action: Accelerate Your Decision Making with Real-Time Automation
 

Issues with SignWriting in Unicode 8

  • 1. Issues with SignWriting in Unicode 8 Prepared for UTC # 144 / L2 # 241 (July 27-31, 2015) a Unicode Technical Committee meeting in Redmond, WA by Stephen E Slevinski Jr in association with the Center for Sutton Movement Writing
  • 2. My Background Bachelor of Science in Mathematics Raised two kids with sign language Started collaboration with Valerie Sutton from 2004 until today Complete symbol encoding model on PUA Plane 16 (37,811 characters) Complete script encoding model on PUA Plane 15 (1,179 characters) Argued with Unicode in 2011 and then walked away Released the ISWA 2010 symbol set in 2010 Finalized Formal SignWriting in ASCII on Jan 12, 2012 5 Years of stability with the symbol set and fonts design 3 1/2 Years of stability with the character encoding models Involved with dozens of sign languages around the world Foundation for all online use and modern publishing efforts
  • 3. SignWriting in Software All major SignWriting editors and viewers are compatible. • SignPuddle Online Primary source of written sign language • Delegs Editor Educational software from Germany for bilingual education. • SignWriter Studio General purpose SignWriting editor, integrated dictionary, and printing. • SWift SignWriting improved fast transcriber that aims to simplify the editing process. • JSPad SignWriting editor for Japanese sign language based in the Gifu University. • Tunisigner interact with SignWriting notations through a 3D virtual signer able to reproduce the exact gestures represented within the sign language transcription. • SignTyp a linguistic coding system developed by Rachel Channon through an NSF grant that is being integrated with SignWriting.
  • 4. http://www.signbank.org/signmaker.html Code Breakdown 0 KB 7 KB 14 KB 21 KB 28 KB 35 KB 42 KB 49 KB 56 KB 63 KB 70 KB Configuration Support Libraries Custom HTML, JS, and CSS SignMaker 2015 Cross-browser, drag-and-drop sign editor, with dictionary and advanced sign searching SignWriting in Software
  • 5. Bookmarklet Javascript-based SignWriting Keyboard Keyboarding editing has returned to SignWriting Wikimedia Incubator The keyboard editor is enabled on Wikimedia Incubator for the American Sign Language Wikipedia and every other sign language project. Store JavaScript in a bookmark and you can use SignWriting on any web page in any text fields. Any Website Add a few KB of JavaScript and the keyboard editor can be enabled on any website using standard edit boxes and visual presentation. http://www.signwriting.org/symposium/presentation0041.html SignWriting in Software
  • 6. What about Unicode? PUA Plane 15 design (1,179 characters) The symbol only design removed 2-D layout by dropping 5 structural markers and 500 number characters N4015 Preliminary Unicode (674 characters) N4090 Revised Unicode (672 characters) N4342 Unicode Proposal (672 characters) A new inherent design removes 2 characters (F1 and R1) and breaks collation as stated in proposal A new facial diacritic design is proposed that is unsupported and untested The original design is still compatible with the community efforts.
  • 7. Issues with SignWriting in Unicode 8 The Unicode 8 specification will not be used for any SignWriting project around the world. The Unicode 8 specification for SignWriting is politically valuable, but unhelpful for developers.
  • 8. Issues with SignWriting in Unicode 8 The issue of the moment is sorting, but there are three main issues. If we address all of the issues for SignWriting, the existing International community of SignWriters is ready, able, and willing to embrace the standard.
  • 9. Issue 1: Unicode 8 is incomplete http://signbank.org/SignWriting_Character_Viewer.html Unicode 8 only encodes the symbols and ignores the issue of layout. Unicode 8 is missing the structural markers and number characters required for 2-D Layout. Unicode 8 requires SVG for the visual presentation. Unicode 8 requires additional characters/markup to write a sign.
  • 10. Issue 2: Unicode 8 is flawed The idea of Inherent characters breaks from the community use of today and historically. Because of Inherent modifiers, sorting is broken, searching is ambiguous, and replacements can be destructive. w s P Symbol Bases Tokens i oSymbol Modifiers Tokens identified with a string of 3 tokens. w i o Writing Symbol P i o Punctuation Symbol Fill Rotation Triadic Symbol
  • 11. Issue 2: Unicode 8 is flawed Sorting is broken 1D800 SIGNWRITING HAND-FIST INDEX (HFI) 1DAA1 SIGNWRITING ROTATION MODIFIER-2 (R2) 1DA9B SIGNWRITING FILL MODIFIER-2 (F2) 1. HFI F1 R1 5. HFI F1 R1 HFI F1 R1 2. HFI F1 R2 6. HFI F1 R2 HFI F1 R1 3. HFI F2 R1 7. HFI F2 R1 HFI F1 R1 4. HFI F2 R2 1. HFI 5. HFI HFI 3. HFI F2 7. HFI F2 HFI 4. HFI F2 R2 2. HFI R2 6. HFI R2 HFI Correct sorting with F1 & R1 Incorrect sorting without F1 & R1 http://www.unicode.org/L2/L2015/15184-signwriting-ducet.txt http://www.unicode.org/L2/L2015/15194-signwriting-response.pdf http://www.unicode.org/L2/L2015/15202-signwriting-ducet-aux.txt
  • 12. Issue 2: Unicode 8 is flawed Sorting is broken 1D800 SIGNWRITING HAND-FIST INDEX (HFI) 1DAA1 SIGNWRITING ROTATION MODIFIER-2 (R2) 1DA9B SIGNWRITING FILL MODIFIER-2 (F2) HFI weight of 100 F2 weight of 420 R2 weight of 410 1. HFI 100 5. HFI HFI 100 100 2. HFI R2 100 410 6. HFI R2 HFI 100 410 100 3. HFI F2 100 420 7. HFI F2 HFI 100 420 100 4. HFI F2 R2 100 420 410 DUCET Fix Correct sorting with DUCET 1, 5, 2, 6, 3, 7, 4 Correct Sort Order 1, 2, 3, 4, 5, 6, 7 Incorrect Sort Order
  • 13. Issue 2: Unicode 8 is flawed Searching is ambiguous 1D800 SIGNWRITING HAND-FIST INDEX (HFI) 1DAA1 SIGNWRITING ROTATION MODIFIER-2 (R2) 1DA9B SIGNWRITING FILL MODIFIER-2 (F2) 1. HFI F1 R1 5. HFI F1 R1 HFI F1 R1 2. HFI F1 R2 6. HFI F1 R2 HFI F1 R1 3. HFI F2 R1 7. HFI F2 R1 HFI F1 R1 4. HFI F2 R2 1. HFI 5. HFI HFI 3. HFI F2 7. HFI F2 HFI 4. HFI F2 R2 2. HFI R2 6. HFI R2 HFI Searching with F1 & R1 Searching without F1 & R1 Searching for the symbol HFI F1 R1 correctly finds 4 matches Searching for the symbol HFI incorrectly finds 10 matches without negative lookaheads
  • 14. Issue 2: Unicode 8 is flawed Searching is ambiguous Query String: QS10000S20500 Searching for signs that include 2 exact symbols will return these results from the ASL Dictionary.
  • 15. Issue 2: Unicode 8 is flawed Searching is ambiguous Plus 6 more pages of signs. Query String: QS100uuS205uu In Unicode 8, searching for a symbol base without fill or rotation modifiers will return 6 times as much noise as signal.
  • 16. Issue 2: Unicode 8 is flawed Replacements can be destructive sub uFD830 uFD810 uFD820 by S10000; sub uFD830 uFD810 uFD821 by S10001; sub uFD830 uFD810 uFD822 by S10002; sub uFD830 uFD810 uFD823 by S10003; sub uFD830 uFD810 uFD824 by S10004; sub uFD830 uFD810 uFD825 by S10005; sub uFD830 uFD810 uFD826 by S10006; sub uFD830 uFD810 uFD827 by S10007; sub u1DA8B u1DAA7 by S38b07; sub u1DA8B u1DAA6 by S38b06; sub u1DA8B u1DAA5 by S38b05; sub u1DA8B u1DAA4 by S38b04; sub u1DA8B u1DAA3 by S38b03; sub u1DA8B u1DAA2 by S38b02; sub u1DA8B u1DAA1 by S38b01; sub u1DA8B by S38b00; https://github.com/Slevinski/signwriting_2010_tools The TrueType Fonts use Ligatures to support multiple character sets. Plane 15 Characters Unicode 8 Characters Increasing symbols keys or decreasing works without issue. Decreasing symbol keys to avoid destruction.
  • 17. Issue 3: Unicode 8 is fictional Facial diacritics do not exist. There is no font support, no software support, and no data. Facial diacritics are described in one document, using 177 words. Facial diacritics have never been tested on any individual, let alone an international group. Facial expressions are created using overlap and overlay of many symbols using Cartesian coordinates for each. Facial diacritics should be handled in software rather than the character encoding. Facial diacritics development was quietly abandoned the end of 2012.
  • 18. Formal SignWriting Regular Expressions Query Strings Community Use SVG PUA Plane 15 Graphite Font Unicode 8 PUA Plane 16TTF 10% to 50% reduction 15 to 50 times expansion process million of characters per second search results 15 times expansion single character per symbolligatures of 1 to 3 characters twice the size cartesian coordinates with GPOS CSS style text Isomorphic JS ASCII Lite Markup preferredunused prototype 6 KB zipped
  • 19. AS18711S20500 M514x517S18711490x483S20500486x506 AS18711S20500M514x517S18711490x483S20500486x506 A S18711 S20500 M514x517 S18711490x483 S20500486x506 M 514x517 S18711 490x483 S20500 486x506 (514,517) (490,483) (486,506) Time Space Sequence Marker Symbol Middle Lane SignBox Max Coord Spatial Symbol Community Use Formal SignWriting Standard ASCII format is Isomorphic to PUA Plane 15
  • 20. Unicode 9 Regular Expressions Query Strings Ideal Solution Graphite Font TTF 10% to 50% reduction 15 to 50 times expansion process million of characters per second search results cartesian coordinates with GPOS CSS style text http://signpuddle.net/iswa/#smartfont Prototype Font uses Cartesian coordinates for 2-D layout with Graphite JS 6 KB zipped
  • 21. Too Late? SignWriting is spreading around the world and exploding online. All of the SignWriting projects are using an ASCII solution and have no plans to switch to the Unicode 8 design for the symbols. Without a full script solution for SignWriting, Unicode will not be used for SignWriting, especially the Unicode 8 design which complicates otherwise simple routines. Using Unicode for SignWriting is a great idea in theory, but there are few advantages and too many disadvantages to seriously consider applying the Unicode 8 design, even if sorting is fixed. I left the Unicode effort the end of 2011. In 2012, I was shown the latest proposal (N4342). I objected privately and asked that they produce a working font before they contact me again. In 2014, I was contacted that SignWriting will be in Unicode 8. I reiterated my objections, pointing out the issues, and was told it was too late to change the design in any way.
  • 22. Discussion Ideas 2-Color Fonts SignWriting relies on a 2-color font. Currently, SignWriting mimics a 2-color font by using 2 TrueType Fonts: one for the line and another for the filling. If you have any experience with 2-color fonts, let’s discuss the possibilities. 2-Dimensional Layout with Graphite and Cartesian coordinates SignWriting has a prototype font that uses Cartesian coordinates to control the 2-dimensional layout with Graphite and PUA Plane 15 characters. If you have any experience with 2-dimensional layout using Cartesian coordinates, let’s discuss the possibilities. Alternate designs for a 2-dimensional script This type of discussion is interesting, but it will not effect the SignWriting community. The standards are stable and widely used. This would make for an interesting project, but it is not work that I will be doing myself.
  • 23. Discussion Ideas Unicode 9 or 10 Can we deprecate Unicode 8? The community design has been stable for 3 1/2 years. There is an interested community and there are many possibilities for 2-Color fonts and 2-Dimensional layout. Unicode 8 I will not be using Unicode 8. I partially support Unicode 8 with the SignWriting 2010 Fonts, but not the facial diacritics. I suggested that people avoid use SignWriting in Unicode 8. I’m willing to discuss any of the 3 issues that I have outlined, but I’m not invested in any tweaks to the Unicode 8 design. Symbol Encoding Model PUA Plane 16 (37,811 characters) Script Encoding Model PUA Plane 15 (1,179 characters) both designs are productive and used today
  • 24. Issues with SignWriting in Unicode 8 by Stephen E Slevinski Jr http://slevinski.github.io slevinski@signwriting.org http://www.slideshare.net/StephenSlevinski/presentations