ISSN: 2534-5192 (electronic) – 2681-8566 (print)

◀ D. Xu▲ ProceedingsC. S. Bianchini ▶



ISBN: 978-2-9570549-7-8
e-ISBN: 978-2-9570549-9-2

Download (152.36 MB)

Transcribing Sign Languages With TYPANNOT: The Typographic System That Retains and Displays Layers of Information
Claire Danet, Dominique Boutet†, Patrick Doan, Claudia Savina Bianchini, Adrien Contesse, Léa Chèvrefils, Morgane Rébulard, Chloé Thomas & Jean-François Dauphin
Download (6.68 MB)

Abstract. There are more than 140 sign languages (SLs) in the world and studying them is a relatively recent field of research (starting in the 1960s). Linguists have the need to represent the different levels of gestures that make up the signs in order to analyze the way SLs work. Such transcription requires the use of a dedicated graphic system [slobin2001a].
TYPANNOT, the transcription system presented in this article, is a typographic system that allows the description of all formal features of SLs. Our contribution to the field of grapholinguistics is a phonological model and a transcription system for SLs that are rooted in the articulatory possibilities of the signer’s body. Compared to existing graphematic systems, our approach of SLs description is both phonological, allowing descriptions of the different articulatory structures (low level) involved in SLs, and logographical, allowing users to read the transcriptions from a unified perspective (high level).
We will detail the design principles that drive the development of such a typographic system, the graphemic model that derives from linguistic study, and the tools that allow researchers to use TYPANNOT to its fullest capacities.
This article also outlines the kinesiological approach [boutet2018a], which TYPANNOT uses, noting radical changes in the way researchers should look at meaning through gesture. This approach opens new perspectives in researching movement itself as a central source of meaning in human communication via gesture.

DOI: https://doi.org/10.36824/2020-graf-dane


Augustus, Robert A., Elsie Ritchie, and Suzanne Stecker (2013). The Official American Sign Language Writing Textbook. si5s.org & ASLized.org.

Bébian, Auguste (1825). Mimographie ou essai d’écriture mimique, propre à régulariser le langage des sourds-muets. Paris: Louis Colas.

Bianchini, Claudia S. (2012). “Analyse métalinguistique de l’émergence d’un système d’écriture des langues des signes: SignWriting et son application à la langue des signes italienne (LIS).” PhD thesis. Université de Paris 8 Vincennes & Università degli Studi di Perugia.

_____________ (2016). “Regard sur la nature de SignWriting (SW), un système pour représenter les langues des signes (LS).” In: Dossiers d’HEL. Vol. 9, pp. 404–421.

Boutet, Dominique (2010). “Structuration physiologique de la gestuelle: modèle et tests.” In: Revue de Linguistique et de Didactique des Langue 42, pp. 77–96.

_____________ (2018). “Pour une approche kinésiologique de la gestualité: synthèse.” Habilitation à Diriger des Recherches. Université de Rouen Normandie.

Braffort, Annelies (1996). “Reconnaissance et compréhension de gestes, application à la langue des signes.” PhD thesis. Université de Paris 11 Orsay.

Brugeille, Jean-Louis (2007). “L. S. F. numérique.” In: Journée professionnalisante sur la traduction—traduction et métiers émergents: traducteur en langue des signes. Université de Toulouse Le Mirail.

Chevrefils, Léa (forthcoming). “Vers une modélisation des constituants gestuels des signes: capture de mouvement et transcription formelle d’un corpus de langue des signes française.” PhD thesis. Université de Rouen-Normandie.

Codman, Ernest (1934). The Shoulder: Rupture of the Supraspinatus Tendon and other Lesions in or about the Subacromial Bursa. Boston: R. E. Kreiger.

Cuxac, Christian (2001). “Les langues des signes: analyseurs de la faculté de langage.” In: AILE—Acquisition et iteraction en langue étrangère 15, pp. 11–36.

Danet, Claire et al. (2017). “Structural Correlation Between Location and Movement of Signs: Lacking Motion Economy for Co-Speech Gestures.” In: Language as a Form of Action. Rome: CNR.

Dumas, Raphaël, Laurence Chèze, and Jean-Pierre Verriest (2007). “Adjustments to “McConville et al. and Young et al. Body Segment Inertial Parameters”.” In: Journal of Biomechanics 40.3, pp. 543–553.

Eccarius, Petra and Diane Brentari (2008). “Handshape Coding Made Easier: a Theoretically Based Notation for Phonological Transcription.” In: Sign Language & Linguistics 11.1, pp. 69–101.

Goldin-Meadow, Susan and Diane Brentari (2017). “Gesture, Sign, and Language: the Coming of Age of Sign Language and Gesture Studies.” In: Behavioral and brain sciences. Cambridge: University Press, pp. 1–60.

Guitteny, Pierre (2007). “Langue des Signes et Schémas.” In: TAL 48.3, pp. 1–25.

Hanke, Thomas (2004). “HamNoSys: Representing Sign Language Data in Language Resources and Language Processing Contexts.” In: Workshop on the Representation and Processing of Sign Languages on the Occasion of the Fourth International Conference on Language Resources and Evaluation (LREC Lisbonne), pp. 1–6.

Haouam-Bourgeois, Nadia (2007). La Signographie: Master 1. Les Essart-le-Roi: Éditions du Fox.

Jouison, Paul (1995). Écrits sur la Langue des Signes Française (LSF). édition critique établie par Brigitte Garcia. Paris: L’Harmattan.

Kapandji, Ibrahim-Adalbert (1997). Physiologie articulaire. 1, Membre supérieur. Paris: Maloine.

Levinson, Stephen C. (1996). “Frames of Reference and Molyneux’s Question: Crosslinguistic Evidence.” In: Language, Speech, and Communication: Language and Space. Ed. by P. Bloom et al. Cambridge, MS: The MIT Press, pp. 109–169.

MacConaill, Michael A. (1953). “Movements of Bone and Joints: 5—The Significance of Shape.” In: The Journal of Bone and Joint Surgery 35.2, pp. 290–297. doi: doi:10.1302/0301-620X.35B2.290.

Pearl, Michael L. et al. (1992). “Codman’s Paradox: Sixty Years Later.” In: Journal of Shoulder & Elbow Surgery 1.4, pp. 219–225. doi: doi:10.1016/1058-2746(92)90017-W.

Poizat, Germain, Deli Salini, and Marc Durand (2013). “Approche énactive de l’activité humaine, simplexité et conception de formations professionnelles.” In: Education, Sciences & Society 4.1, pp. 97–112.

Prillwitz, Siegmund et al. (1989). Hamburg Notation System for Sign Languages: an Introductory Guide. Hamburg: Signum Press.

Sandler, Wendy and Diane Lillo-Martin (2006). Sign Language and Linguistic Universals. Cambridge: Cambridge University Press.

Slobin, Dan I. et al. (2001). “Sign Language Transcription at the Level of Meaning Components: the Berkeley Transcription System (BTS).” In: Sign Language & Linguistics 4.1–2, pp. 63–104.

Stokoe, William (1960). “Sign Language Structure: an Outline of the Visual Communication Systems of the American Deaf.” In: Journal of Deaf Studies and Deaf Education 10, pp. 3–34.

Sutton, Valerie (1995). Lessons in SignWriting. La Jolla, CA: DAC.

_____________ (2020). “SignWriting History. SignWriting Official Website.” url: http://www.signwriting.org/library/history/index.html (visited on (9/20)).

Theureau, Jacques (2004). Le cours d’action: méthode élémentaire. Toulouse: Octares.

Turvey, Michael T. (1990). “Coordination.” In: American Psychologist 45, pp. 938–953.

Varela, Francisco, Evan Thompson, and Eleanor Rosch (1993). L’inscription corporelle de l’esprit: sciences cognitives et expérience humaine. Paris: Éditions du Seuil.

@BOOK{augustus2013a,
   AUTHOR = {Augustus, Robert A. and Ritchie, Elsie and Stecker, Suzanne},
   TITLE = {The Official American Sign Language Writing Textbook},
   PUBLISHER = {si5s.org \& ASLized.org},
   YEAR = {2013},
}

@BOOK{b1825a,
   AUTHOR = {Bébian, Auguste},
   TITLE = {Mimographie ou essai d'écriture mimique, propre à régulariser le langage des sourds-muets},
   PUBLISHER = {Louis Colas},
   ADDRESS = {Paris},
   YEAR = {1825},
}

@PHDTHESIS{bianchini2012a,
   AUTHOR = {Bianchini, Claudia S.},
   TITLE = {Analyse métalinguistique de l'émergence d'un système d'écriture des langues des signes: SignWriting et son application à la langue des signes italienne (LIS)},
   SCHOOL = {Université de Paris 8 Vincennes \& Università degli Studi di Perugia},
   YEAR = {2012},
}

@INPROCEEDINGS{bianchini2016a,
   AUTHOR = {Bianchini, Claudia S.},
   TITLE = {Regard sur la nature de SignWriting (SW), un système pour représenter les langues des signes (LS)},
   BOOKTITLE = {Dossiers d'HEL},
   YEAR = {2016},
   VOLUME = {9},
   PAGES = {404--421},
}

@ARTICLE{boutet2010a,
   AUTHOR = {Boutet, Dominique},
   TITLE = {Structuration physiologique de la gestuelle: modèle et tests},
   JOURNAL = {Revue de Linguistique et de Didactique des Langue},
   YEAR = {2010},
   VOLUME = {42},
   PAGES = {77--96},
}

@PHDTHESIS{boutet2018a,
   AUTHOR = {Boutet, Dominique},
   TITLE = {Pour une approche kinésiologique de la gestualité: synthèse},
   SCHOOL = {Université de Rouen Normandie},
   TYPE = {Habilitation à Diriger des Recherches},
   YEAR = {2018},
}

@PHDTHESIS{braffort1996a,
   AUTHOR = {Braffort, Annelies},
   TITLE = {Reconnaissance et compréhension de gestes, application à la langue des signes},
   SCHOOL = {Université de Paris 11 Orsay},
   YEAR = {1996},
}

@INPROCEEDINGS{brugeille2007a,
   AUTHOR = {Brugeille, Jean-Louis},
   TITLE = {L.~S. F. numérique},
   BOOKTITLE = {Journée professionnalisante sur la traduction---traduction et métiers émergents: traducteur en langue des signes. Université de Toulouse Le Mirail},
   YEAR = {2007},
}

@PHDTHESIS{chevrefils,
   AUTHOR = {Chevrefils, Léa},
   TITLE = {Vers une modélisation des constituants gestuels des signes: capture de mouvement et transcription formelle d'un corpus de langue des signes française},
   SCHOOL = {Université de Rouen-Normandie},
   YEAR = {forthcoming},
}

@BOOK{codman1934a,
   AUTHOR = {Codman, Ernest},
   TITLE = {The Shoulder: Rupture of the Supraspinatus Tendon and other Lesions in or about the Subacromial Bursa},
   PUBLISHER = {R.~E. Kreiger},
   ADDRESS = {Boston},
   YEAR = {1934},
}

@ARTICLE{cuxac2001a,
   AUTHOR = {Cuxac, Christian},
   TITLE = {Les langues des signes: analyseurs de la faculté de langage},
   JOURNAL = {AILE---Acquisition et iteraction en langue étrangère},
   YEAR = {2001},
   VOLUME = {15},
   PAGES = {11--36},
}

@INPROCEEDINGS{danet2017a,
   AUTHOR = {Danet, Claire and others},
   TITLE = {Structural Correlation Between Location and Movement of Signs: Lacking Motion Economy for Co-Speech Gestures},
   BOOKTITLE = {Language as a Form of Action},
   PUBLISHER = {CNR},
   ADDRESS = {Rome},
   YEAR = {2017},
}

@ARTICLE{dumas2007a,
   AUTHOR = {Dumas, Raphaël and Chèze, Laurence and Verriest, Jean-Pierre},
   TITLE = {Adjustments to “McConville mph{et al.} and Young mph{et al.} Body Segment Inertial Parameters”},
   JOURNAL = {Journal of Biomechanics},
   YEAR = {2007},
   VOLUME = {40},
   NUMBER = {3},
   PAGES = {543--553},
}

@ARTICLE{eccarius2008a,
   AUTHOR = {Eccarius, Petra and Brentari, Diane},
   TITLE = {Handshape Coding Made Easier: a Theoretically Based Notation for Phonological Transcription},
   JOURNAL = {Sign Language \& Linguistics},
   YEAR = {2008},
   VOLUME = {11},
   NUMBER = {1},
   PAGES = {69--101},
}

@INPROCEEDINGS{goldin-meadow2017a,
   AUTHOR = {Goldin-Meadow, Susan and Brentari, Diane},
   TITLE = {Gesture, Sign, and Language: the Coming of Age of Sign Language and Gesture Studies},
   BOOKTITLE = {Behavioral and brain sciences},
   PUBLISHER = {University Press},
   ADDRESS = {Cambridge},
   YEAR = {2017},
   PAGES = {1--60},
}

@ARTICLE{guitteny2007a,
   AUTHOR = {Guitteny, Pierre},
   TITLE = {Langue des Signes et Schémas},
   JOURNAL = {TAL},
   YEAR = {2007},
   VOLUME = {48},
   NUMBER = {3},
   PAGES = {1--25},
}

@INPROCEEDINGS{hanke2004a,
   AUTHOR = {Hanke, Thomas},
   TITLE = {HamNoSys: Representing Sign Language Data in Language Resources and Language Processing Contexts},
   BOOKTITLE = {Workshop on the Representation and Processing of Sign Languages on the Occasion of the Fourth International Conference on Language Resources and Evaluation (LREC Lisbonne)},
   YEAR = {2004},
   PAGES = {1--6},
}

@BOOK{haouam-bourgeaois2007a,
   AUTHOR = {Haouam-Bourgeois, Nadia},
   TITLE = {La Signographie: Master~1},
   PUBLISHER = {Éditions du Fox},
   ADDRESS = {Les Essart-le-Roi},
   YEAR = {2007},
}

@BOOK{jouison1995,
   AUTHOR = {Jouison, Paul},
   TITLE = {Écrits sur la Langue des Signes Française (LSF)},
   PUBLISHER = {L'Harmattan},
   ADDRESS = {Paris},
   YEAR = {1995},
   NOTE = {édition critique établie par Brigitte Garcia},
}

@BOOK{kapandji1997,
   AUTHOR = {Kapandji, Ibrahim-Adalbert},
   TITLE = {Physiologie articulaire. 1, Membre supérieur},
   PUBLISHER = {Maloine},
   ADDRESS = {Paris},
   YEAR = {1997},
}

@INPROCEEDINGS{levinson1996a,
   AUTHOR = {Levinson, Stephen C.},
   EDITOR = {Bloom, P. and Peterson, M.A. and Nadel, L. and Garrett, M.F.},
   TITLE = {Frames of Reference and Molyneux's Question: Crosslinguistic Evidence},
   BOOKTITLE = {Language, Speech, and Communication: Language and Space},
   PUBLISHER = {The MIT Press},
   ADDRESS = {Cambridge, MS},
   YEAR = {1996},
   PAGES = {109--169},
}

@ARTICLE{macconaill1953a,
   AUTHOR = {MacConaill, Michael A.},
   TITLE = {Movements of Bone and Joints: 5---The Significance of Shape},
   JOURNAL = {The Journal of Bone and Joint Surgery},
   YEAR = {1953},
   VOLUME = {35},
   NUMBER = {2},
   PAGES = {290--297},
}

@ARTICLE{pearl1992a,
   AUTHOR = {Pearl, Michael L. and others},
   TITLE = {Codman's Paradox: Sixty Years Later},
   JOURNAL = {Journal of Shoulder \& Elbow Surgery},
   YEAR = {1992},
   VOLUME = {1},
   NUMBER = {4},
   PAGES = {219--225},
}

@ARTICLE{poizat2013a,
   AUTHOR = {Poizat, Germain and Salini, Deli and Durand, Marc},
   TITLE = {Approche énactive de l'activité humaine, simplexité et conception de formations professionnelles},
   JOURNAL = {Education, Sciences \& Society},
   YEAR = {2013},
   VOLUME = {4},
   NUMBER = {1},
   PAGES = {97--112},
}

@BOOK{prillwitz1989a,
   AUTHOR = {Prillwitz, Siegmund and others},
   TITLE = {Hamburg Notation System for Sign Languages: an Introductory Guide},
   PUBLISHER = {Signum Press},
   ADDRESS = {Hamburg},
   YEAR = {1989},
}

@BOOK{sandler2006a,
   AUTHOR = {Sandler, Wendy and Lillo-Martin, Diane},
   TITLE = {Sign Language and Linguistic Universals},
   PUBLISHER = {Cambridge University Press},
   ADDRESS = {Cambridge},
   YEAR = {2006},
}

@ARTICLE{slobin2001a,
   AUTHOR = {Slobin, Dan I. and others},
   TITLE = {Sign Language Transcription at the Level of Meaning Components: the Berkeley Transcription System (BTS)},
   JOURNAL = {Sign Language \& Linguistics},
   YEAR = {2001},
   VOLUME = {4},
   NUMBER = {1--2},
   PAGES = {63--104},
}

@ARTICLE{stokoe1960a,
   AUTHOR = {Stokoe, William},
   TITLE = {Sign Language Structure: an Outline of the Visual Communication Systems of the American Deaf},
   JOURNAL = {Journal of Deaf Studies and Deaf Education},
   YEAR = {1960},
   VOLUME = {10},
   PAGES = {3--34},
}

@BOOK{sutton1995a,
   AUTHOR = {Sutton, Valerie},
   TITLE = {Lessons in SignWriting},
   PUBLISHER = {DAC},
   ADDRESS = {La Jolla, CA},
   YEAR = {1995},
}

@UNPUBLISHED{sutton2020a,
   AUTHOR = {Sutton, Valerie},
   TITLE = {SignWriting History. SignWriting Official Website},
   YEAR = {2020},
   URL = {http://www.signwriting.org/library/history/index.html},
}

@BOOK{theureau2004a,
   AUTHOR = {Theureau, Jacques},
   TITLE = {Le cours d'action: méthode élémentaire},
   PUBLISHER = {Octares},
   ADDRESS = {Toulouse},
   YEAR = {2004},
}

@ARTICLE{turvey1990a,
   AUTHOR = {Turvey, Michael T.},
   TITLE = {Coordination},
   JOURNAL = {American Psychologist},
   YEAR = {1990},
   VOLUME = {45},
   PAGES = {938--953},
}

@BOOK{varela1993a,
   AUTHOR = {Varela, Francisco and Thompson, Evan and Rosch, Eleanor},
   TITLE = {L'inscription corporelle de l'esprit: sciences cognitives et expérience humaine},
   PUBLISHER = {Éditions du Seuil},
   ADDRESS = {Paris},
   YEAR = {1993},
}

Claire Danet, Dominique Boutet†, Patrick Doan, Claudia Savina Bianchini, Adrien Contesse, Léa Chèvrefils, Morgane Rébulard, Chloé Thomas & Jean-François Dauphin (2020), “Transcribing Sign Languages With TYPANNOT: The Typographic System That Retains and Displays Layers of Information,” in Proceedings of Grapholinguistics in the 21st Century, 2020 (Yannis Haralambous, Ed.), Grapholinguistics and Its Applications, Vol. 5, Brest: Fluxus Editions, 1007–1035.


@INPROCEEDINGS{gla5-dane,
   AUTHOR = {Claire DanetORCID[0000-0001-5362-8924] and Dominique Boutet† and Patrick Doan and Claudia Savina Bianchini and Adrien Contesse and Léa Chèvrefils and Morgane Rébulard and Chloé Thomas and Jean-François Dauphin},
   EDITOR = {Haralambous, Yannis},
   TITLE = {{Transcribing Sign Languages With TYPANNOT: The Typographic System That Retains and Displays Layers of Information}},
   BOOKTITLE = {{Proceedings of Grapholinguistics in the 21st Century, 2020}},
   SERIES = {{Grapholinguistics and Its Applications}},
   VOLUME = {5},
   PUBLISHER = {Fluxus Editions},
   ADDRESS = {Brest},
   YEAR = {2020},
   PAGES = {1007--1035},
   DOI = {https://doi.org/10.36824/2020-graf-dane},
}