ISSN: 2534-5192 (electronic) – 2681-8566 (print)

ISBN: 978-2-9570549-7-8 e-ISBN: 978-2-9570549-9-2 Download (152.36 MB)

Quantifying Sound-Graphic Systematicity. Application to Multiple Phonographic Orthographies Hana Jee , Monica Tamariz  & Richard Shillcock  Download (34.79 MB) Abstract. Do letter-shapes predict in any way the canonical sounds they represent? Does the letter <a> in any sense visually predict its canonical pronunciation /æ/? We extended existing quantitative approaches to measuring systematicity between phonology and semantics. We quantified all pairwise visual distances between letters, using Hausdorff distance. We took the corresponding canonical pronunciations of the letters and quantified all pairwise distances between their feature-level representations, using edit distance and Euclidean distance. We defined letter-sound systematicity as a correlation between these two lists of distances. We confirmed Korean as the gold standard for letter-sound systematicity; it was designed in the 15th century to have exactly this characteristic. We found small but significant correlations in Arabic, Cyrillic, English, Finnish, Greek and Hebrew orthographies, with Courier New giving the most consistent correlations. Pitman’s English shorthand and the Shavian alphabet also showed robust systematicity, and baseline fictitious orthographies showed no systematicity, validating our approach. DOI: https://doi.org/10.36824/2020-graf-jeeh References References in BIB How to cite How to cite in BIB Atteveldt, N. van et al. (2004). “Integration of letters and speech sounds in the human brain.” In: Neuron 43.2, pp. 271–282. Baier, B., A. Kleinschmidt, and N.G. Müller (2006). “Cross-modal processing in early visual and auditory cortices depends on expected statistical relationship of multisensory information.” In: Journal of Neuroscience 26.47, pp. 12260–12265. Bavelier, D. and H.J. Neville (2002). “Cross-modal plasticity: where and how?” In: Nature Reviews Neuroscience 3.6, pp. 443–452. Brekle, H.E. (1994). “Some thoughts on a historico-genetic theory of the lettershapes of our alphabet.” In: Writing systems and cognition: Perspectives from psychology, physiology, linguistics, and semiotics. Ed. by W. Watt. Berlin: Springer. Calvert, G.A., M.J. Brammer, et al. (1999). “Response amplification in sensory-specific cortices during crossmodal binding.” In: Neuroreport 10.12, pp. 2619–2623. Calvert, G.A., R. Campbell, and M.J. Brammer (2000). “Evidence from functional magnetic resonance imaging of crossmodal binding in the human heteromodal cortex.” In: Current Biology 10.11, pp. 649–657. Calvert, G.A. et al. (2001). “Detection of audio-visual integration sites in humans by application of electrophysiological criteria to the BOLD effect.” In: Neuroimage 14.2, pp. 427–438. Dautriche, I., E. Chemla, and A. Christophe (2016). “Word learning: Homophony and the distribution of learning exemplars.” In: Language Learning and Development 12.3, pp. 231–251. Dautriche, I. et al. (2017). “Wordform similarity increases with semantic similarity: An analysis of 100 languages.” In: Cognitive science 41.8, pp. 2149–2169. Dingemanse, M. et al. (2015). “Arbitrariness, iconicity, and systematicity in language.” In: Trends in Cognitive Sciences 19.10, pp. 603–615. Erfani, I.M. (2005). Arabic for Beginners. Ottawa: Laurier Books Limited. Farmer, T.A., M.H. Christiansen, and P. Monaghan (2006). “Phonological typicality influences on-line sentence comprehension.” In: Proceedings of the National Academy of Sciences 103.32, pp. 12203–12208. Fiebelkorn, I.C., J.J. Foxe, and S. Molholm (2010). “Dual mechanisms for the cross-sensory spread of attention: how much do learned associations matter?” In: Cerebral Cortex 20.1, pp. 109–120. Harm, M.W. and M.S. Seidenberg (1999). “Phonology, reading acquisition, and dyslexia: insights from connectionist models.” In: Psychological review 106.3, pp. 491–528. Havelock, E.A. (1976). Origins of Western Literacy. Four Lectures delivered at the Ontario Institute for Studies in Education. Toronto: Ontario Institute for Studies in Education. Huttenlocher, D.P., G.A. Klanderman, and W.J. Rucklidge (1993). “Comparing images using the Hausdorff distance.” In: IEEE Transactions on Pattern Analysis and Machine Intelligence 15.9, pp. 850–863. Kriegstein, K. von and A.L. Giraud (2006). “Implicit multisensory associations influence voice recognition.” In: PLoS biology 4.10. Lloyd, S. et al. (1998). The phonics handbook. Chigwell: Jolly Learning. Mantel, N. (1967). The detection of disease clustering and a generalized regression approach. Cancer Research. Monaghan, P. et al. (2014). “How arbitrary is language?” In: Philosophical Transactions of the Royal Society B: Biological Sciences 369.1651. Raij, T., K. Uutela, and R. Hari (2000). “Audiovisual integration of letters in the human brain.” In: Neuron 28.2, pp. 617–625. Robinson, A. (1995). The story of writing. London: Thames and Hudson. Rogers, H. (2005). Writing systems: A linguistic approach. Oxford: Blackwell. Sampson, G. (1985). Writing systems. London: Hutchinson. Schmandt-Besserat, D. (1989). Two precursors of writing: Plain and complex tokens. The origins of writing. Seymour, P.H., M. Aro, and J.M. Erskine (2003). “Collaboration with COST Action A8 Network.” In: British Journal of psychology 94.2, pp. 143–174. Shillcock, R.C. et al. (2001). “Filled pauses and their status in the mental lexicon.” In: Proc. 2001 Conf. of Disfluency in Spontaneous Speech, pp. 53–56. Sirat, C. (1994). “Handwriting and the writing hand.” In: Writing systems and cognition: Perspectives from psychology, physiology, linguistics, and semiotics. Ed. by W. Watt. Berlin: Springer. Spence, C. (2011). “Crossmodal correspondences: A tutorial review. Attention, Perception, and.” In: Psychophysics 73.4, pp. 971–995. Tamariz, M. (2008). “Exploring systematicity between phonological and context-cooccurrence representations of the mental lexicon.” In: The Mental Lexicon 3.2, pp. 259–278. Watt, W.C. (1979). “Iconic equilibrium.” In: Semiotica 28.1–2, pp. 31–62. _____________ (1994). Curves as angles. In Writing systems and cognition: Perspectives from psychology, physiology, linguistics, and semiotics (Vol. Ed. by W. Watt. Berlin: Springer. _____________ (2013). Writing systems and cognition: Perspectives from psychology, physiology, linguistics, and semiotics (Vol. 6). Berlin: Springer. Weissman, D.H. van, L.M. Warner, and M.G. Woldorff (2004). “The neural mechanisms for minimizing cross-modal distraction.” In: Journal of Neuroscience 24.48, pp. 10941–10949. Zangenehpour, S. and R.J. Zatorre (2010). “Crossmodal recruitment of primary visual cortex following brief exposure to bimodal audiovisual stimuli.” In: Neuropsychologia 48.2, pp. 591–600. Zipf, G.K. (1949). Human behavior and the principle of least-effort. Reading: Addison-Wesley. @ARTICLE{van2004a, AUTHOR = {van Atteveldt, N. and Formisano, E. and Goebel, R. and Blomert, L.}, TITLE = {Integration of letters and speech sounds in the human brain}, JOURNAL = {Neuron}, YEAR = {2004}, VOLUME = {43}, NUMBER = {2}, PAGES = {271--282}, } @ARTICLE{baier2006a, AUTHOR = {Baier, B. and Kleinschmidt, A. and Müller, N.G.}, TITLE = {Cross-modal processing in early visual and auditory cortices depends on expected statistical relationship of multisensory information}, JOURNAL = {Journal of Neuroscience}, YEAR = {2006}, VOLUME = {26}, NUMBER = {47}, PAGES = {12260--12265}, } @ARTICLE{bavelier2002a, AUTHOR = {Bavelier, D. and Neville, H.J.}, TITLE = {Cross-modal plasticity: where and how?}, JOURNAL = {Nature Reviews Neuroscience}, YEAR = {2002}, VOLUME = {3}, NUMBER = {6}, PAGES = {443--452}, } @INPROCEEDINGS{brekle1994a, AUTHOR = {Brekle, H.E.}, EDITOR = {Watt, W.}, TITLE = {Some thoughts on a historico-genetic theory of the lettershapes of our alphabet}, BOOKTITLE = {Writing systems and cognition: Perspectives from psychology, physiology, linguistics, and semiotics}, PUBLISHER = {Springer}, ADDRESS = {Berlin}, YEAR = {1994}, } @ARTICLE{calvert1999a, AUTHOR = {Calvert, G.A. and Brammer, M.J. and Bullmore, E.T. and Campbell, R. and Iversen, S.D. and David, A.S.}, TITLE = {Response amplification in sensory-specific cortices during crossmodal binding}, JOURNAL = {Neuroreport}, YEAR = {1999}, VOLUME = {10}, NUMBER = {12}, PAGES = {2619--2623}, } @ARTICLE{calvert2000a, AUTHOR = {Calvert, G.A. and Campbell, R. and Brammer, M.J.}, TITLE = {Evidence from functional magnetic resonance imaging of crossmodal binding in the human heteromodal cortex}, JOURNAL = {Current Biology}, YEAR = {2000}, VOLUME = {10}, NUMBER = {11}, PAGES = {649--657}, } @ARTICLE{calvert2001a, AUTHOR = {Calvert, G.A. and Hansen, P.C. and Iversen, S.D. and Brammer, M.J.}, TITLE = {Detection of audio-visual integration sites in humans by application of electrophysiological criteria to the BOLD effect}, JOURNAL = {Neuroimage}, YEAR = {2001}, VOLUME = {14}, NUMBER = {2}, PAGES = {427--438}, } @ARTICLE{dautriche2016a, AUTHOR = {Dautriche, I. and Chemla, E. and Christophe, A.}, TITLE = {Word learning: Homophony and the distribution of learning exemplars}, JOURNAL = {Language Learning and Development}, YEAR = {2016}, VOLUME = {12}, NUMBER = {3}, PAGES = {231--251}, } @ARTICLE{dautriche, AUTHOR = {Dautriche, I. and Mahowald, K. and Gibson, E. and Piantadosi, S. T.}, TITLE = {Wordform similarity increases with semantic similarity: An analysis of 100 languages}, JOURNAL = {Cognitive science}, YEAR = {2017}, VOLUME = {41}, NUMBER = {8}, PAGES = {2149--2169}, } @ARTICLE{dingemanse2015a, AUTHOR = {Dingemanse, M. and Blasi, D.E. and Lupyan, G. and Christiansen, M.H. and Monaghan, P.}, TITLE = {Arbitrariness, \index{iconicity}iconicity, and systematicity in language}, JOURNAL = {Trends in Cognitive Sciences}, YEAR = {2015}, VOLUME = {19}, NUMBER = {10}, PAGES = {603--615}, } @BOOK{erfani2005a, AUTHOR = {Erfani, I.M.}, TITLE = {Arabic for Beginners}, PUBLISHER = {Laurier Books Limited}, ADDRESS = {Ottawa}, YEAR = {2005}, } @ARTICLE{farmer2006a, AUTHOR = {Farmer, T.A. and Christiansen, M.H. and Monaghan, P.}, TITLE = {Phonological typicality influences on-line sentence comprehension}, JOURNAL = {Proceedings of the National Academy of Sciences}, YEAR = {2006}, VOLUME = {103}, NUMBER = {32}, PAGES = {12203--12208}, } @ARTICLE{fiebelkorn2010a, AUTHOR = {Fiebelkorn, I.C. and Foxe, J.J. and Molholm, S.}, TITLE = {Dual mechanisms for the cross-sensory spread of attention: how much do learned associations matter?}, JOURNAL = {Cerebral Cortex}, YEAR = {2010}, VOLUME = {20}, NUMBER = {1}, PAGES = {109--120}, } @ARTICLE{harm1999a, AUTHOR = {Harm, M.W. and Seidenberg, M.S.}, TITLE = {Phonology, reading acquisition, and dyslexia: insights from connectionist models}, JOURNAL = {Psychological review}, YEAR = {1999}, VOLUME = {106}, NUMBER = {3}, PAGES = {491--528}, } @BOOK{havelock1976a, AUTHOR = {Havelock, E.A.}, TITLE = {Origins of Western Literacy. Four Lectures delivered at the Ontario Institute for Studies in Education}, PUBLISHER = {Ontario Institute for Studies in Education}, ADDRESS = {Toronto}, YEAR = {1976}, } @ARTICLE{huttenlocher1993a, AUTHOR = {Huttenlocher, D.P. and Klanderman, G.A. and Rucklidge, W.J.}, TITLE = {Comparing images using the Hausdorff distance}, JOURNAL = {IEEE Transactions on Pattern Analysis and Machine Intelligence}, YEAR = {1993}, VOLUME = {15}, NUMBER = {9}, PAGES = {850--863}, } @ARTICLE{von2006a, AUTHOR = {von Kriegstein, K. and Giraud, A.L.}, TITLE = {Implicit multisensory associations influence voice recognition}, JOURNAL = {PLoS biology}, YEAR = {2006}, VOLUME = {4}, NUMBER = {10}, } @BOOK{lloyd1998a, AUTHOR = {Lloyd, S. and Wernham, S. and Jolly, C. and Stephen, L.}, TITLE = {The phonics handbook}, PUBLISHER = {Jolly Learning}, ADDRESS = {Chigwell}, YEAR = {1998}, } @MISC{mantel1967a, AUTHOR = {Mantel, N.}, TITLE = {The detection of disease clustering and a generalized regression approach. Cancer Research}, YEAR = {1967}, PAGES = {209--220}, } @ARTICLE{monaghan2014a, AUTHOR = {Monaghan, P. and Shillcock, R.C. and Christiansen, M.H. and Kirby, S.}, TITLE = {How arbitrary is language?}, JOURNAL = {Philosophical Transactions of the Royal Society B: Biological Sciences}, YEAR = {2014}, VOLUME = {369}, NUMBER = {1651}, } @ARTICLE{raij2000a, AUTHOR = {Raij, T. and Uutela, K. and Hari, R.}, TITLE = {Audiovisual integration of letters in the human brain}, JOURNAL = {Neuron}, YEAR = {2000}, VOLUME = {28}, NUMBER = {2}, PAGES = {617--625}, } @BOOK{robinson1995a, AUTHOR = {Robinson, A.}, TITLE = {The story of writing}, PUBLISHER = {Thames and Hudson}, ADDRESS = {London}, YEAR = {1995}, } @BOOK{rogers2005a, AUTHOR = {Rogers, H.}, TITLE = {Writing systems: A linguistic approach}, PUBLISHER = {Blackwell}, ADDRESS = {Oxford}, YEAR = {2005}, } @BOOK{sampson1985a, AUTHOR = {Sampson, G.}, TITLE = {Writing systems}, PUBLISHER = {Hutchinson}, ADDRESS = {London}, YEAR = {1985}, } @MISC{schmandt-besserat1989a, AUTHOR = {Schmandt-Besserat, D.}, TITLE = {Two precursors of writing: Plain and complex tokens. The origins of writing}, YEAR = {1989}, PAGES = {27--41}, } @ARTICLE{seymour2003a, AUTHOR = {Seymour, P.H. and Aro, M. and Erskine, J.M.}, TITLE = {Collaboration with COST Action A8 Network}, JOURNAL = {British Journal of psychology}, YEAR = {2003}, VOLUME = {94}, NUMBER = {2}, PAGES = {143--174}, } @INPROCEEDINGS{shillcock2001a, AUTHOR = {Shillcock, R.C. and Kirby, S. and McDonald, S. and Brew, C.}, TITLE = {Filled pauses and their status in the mental lexicon}, BOOKTITLE = {Proc. 2001 Conf. of Disfluency in Spontaneous Speech}, YEAR = {2001}, PAGES = {53--56}, } @INPROCEEDINGS{sirat1994a, AUTHOR = {Sirat, C.}, EDITOR = {Watt, W.}, TITLE = {Handwriting and the writing hand}, BOOKTITLE = {Writing systems and cognition: Perspectives from psychology, physiology, linguistics, and semiotics}, PUBLISHER = {Springer}, ADDRESS = {Berlin}, YEAR = {1994}, } @ARTICLE{spence2011a, AUTHOR = {Spence, C.}, TITLE = {Crossmodal correspondences: A tutorial review. Attention, Perception, and}, JOURNAL = {Psychophysics}, YEAR = {2011}, VOLUME = {73}, NUMBER = {4}, PAGES = {971--995}, } @ARTICLE{tamariz2008a, AUTHOR = {Tamariz, M.}, TITLE = {Exploring systematicity between phonological and context-cooccurrence representations of the mental lexicon}, JOURNAL = {The Mental Lexicon}, YEAR = {2008}, VOLUME = {3}, NUMBER = {2}, PAGES = {259--278}, } @ARTICLE{watt1979a, AUTHOR = {Watt, W.C.}, TITLE = {Iconic equilibrium}, JOURNAL = {Semiotica}, YEAR = {1979}, VOLUME = {28}, NUMBER = {1--2}, PAGES = {31--62}, } @BOOK{watt1994a, AUTHOR = {Watt, W.C.}, EDITOR = {Watt, W.}, TITLE = {Curves as angles. In Writing systems and cognition: Perspectives from psychology, physiology, linguistics, and semiotics (Vol}, PUBLISHER = {Springer}, ADDRESS = {Berlin}, YEAR = {1994}, } @BOOK{watt2013a, AUTHOR = {Watt, W.C.}, TITLE = {Writing systems and cognition: Perspectives from psychology, physiology, linguistics, and semiotics (Vol. 6)}, PUBLISHER = {Springer}, ADDRESS = {Berlin}, YEAR = {2013}, } @ARTICLE{van2004b, AUTHOR = {van Weissman, D.H. and Warner, L.M. and Woldorff, M.G.}, TITLE = {The neural mechanisms for minimizing cross-modal distraction}, JOURNAL = {Journal of Neuroscience}, YEAR = {2004}, VOLUME = {24}, NUMBER = {48}, PAGES = {10941--10949}, } @ARTICLE{zangenehpour2010a, AUTHOR = {Zangenehpour, S. and Zatorre, R.J.}, TITLE = {Crossmodal recruitment of primary visual cortex following brief exposure to bimodal audiovisual stimuli}, JOURNAL = {Neuropsychologia}, YEAR = {2010}, VOLUME = {48}, NUMBER = {2}, PAGES = {591--600}, } @BOOK{zipf1949a, AUTHOR = {Zipf, G.K.}, TITLE = {Human behavior and the principle of least-effort}, PUBLISHER = {Addison-Wesley}, ADDRESS = {Reading}, YEAR = {1949}, } Hana Jee, Monica Tamariz & Richard Shillcock (2020), “Quantifying Sound-Graphic Systematicity. Application to Multiple Phonographic Orthographies,” in Proceedings of Grapholinguistics in the 21st Century, 2020 (Yannis Haralambous, Ed.), Grapholinguistics and Its Applications, Vol. 5, Brest: Fluxus Editions, 905–925. @INPROCEEDINGS{gla5-jeeh, AUTHOR = {Hana Jee and Monica Tamariz and Richard Shillcock}, EDITOR = {Haralambous, Yannis}, TITLE = {{Quantifying Sound-Graphic Systematicity. Application to Multiple Phonographic Orthographies}}, BOOKTITLE = {{Proceedings of Grapholinguistics in the 21st Century, 2020}}, SERIES = {{Grapholinguistics and Its Applications}}, VOLUME = {5}, PUBLISHER = {Fluxus Editions}, ADDRESS = {Brest}, YEAR = {2020}, PAGES = {905--925}, DOI = {https://doi.org/10.36824/2020-graf-jeeh}, }