Professional Documents
Culture Documents
Subject collections Articles on similar topics can be found in the following collections
Email alerting service Receive free email alerts when new articles cite this article - sign up in the box at the top
right-hand corner of the article or click here
The goal of this paper is to widen the lens on language to include the manual
modality. We look first at hearing children who are acquiring language from a
spoken language model and find that even before they use speech to com-
Research municate, they use gesture. Moreover, those gestures precede, and predict, the
acquisition of structures in speech. We look next at deaf children whose hearing
Cite this article: Goldin-Meadow S. 2014 losses prevent them from using the oral modality, and whose hearing parents
Widening the lens: what the manual modality have not presented them with a language model in the manual modality.
These children fall back on the manual modality to communicate and use ges-
reveals about language, learning and
tures, which take on many of the forms and functions of natural language.
cognition. Phil. Trans. R. Soc. B 369: 20130295.
These homemade gesture systems constitute the first step in the emergence of
http://dx.doi.org/10.1098/rstb.2013.0295 manual sign systems that are shared within deaf communities and are full-
fledged languages. We end by widening the lens on sign language to include
One contribution of 12 to a Theme Issue gesture and find that signers not only gesture, but they also use gesture in learning
contexts just as speakers do. These findings suggest that what is key in gesture’s
‘Language as a multimodal phenomenon:
ability to predict learning is its ability to add a second representational format to
implications for language learning, processing
communication, rather than a second modality. Gesture can thus be language,
and evolution’. assuming linguistic forms and functions, when other vehicles are not availa-
ble; but when speech or sign is possible, gesture works along with language,
Subject Areas: providing an additional representational format that can promote learning.
cognition
Keywords: 1. Introduction
homesign, co-speech gesture, gesture– speech Children around the globe learn to speak with surprising ease. But they are not just
mismatch, Nicaraguan Sign Language learning to speak—they are also learning how to use their hands as they speak.
They are learning to gesture. We know that in adult speakers, gesture forms a
single system with speech and is an integral part of the communicative act [1,2].
Author for correspondence: In this paper, my goal is to widen the lens on language learning to include the
Susan Goldin-Meadow manual modality—to include gesture. I begin by examining the language-learning
e-mail: sgm@uchicago.edu trajectory when it is viewed with this wider lens. The central finding is that children
display skills earlier in development than they do when the focus is only on speech.
They can, for example, express sentence-like ideas in a gesture–speech combi-
nation several months before they express these ideas in speech alone. Gesture
thus provides insight into the earliest steps a language-learner takes and might
even play a role in getting the learner to take those steps.
I then consider what happens if a child does not have access to the oral modality
and has only the manual modality to use in communication. Deaf children who are
exposed to input from a language in the manual modality, that is, an established
sign language like American Sign Language (ASL), learn that language as naturally
as hearing children exposed to input from a language in the oral modality [3,4]. But
90% of deaf children are born to hearing parents [5], who typically do not know a
sign language and want their deaf child to learn a spoken language. Even when
given intensive instruction in the oral modality, children with severe to profound
hearing losses typically are not able to make use of the spoken language that sur-
rounds them [6,7]. If, in addition, they do not have access to a sign language, the
children are likely to turn to gesture to communicate. Under these circumstances,
the manual modality steps in and gesture assumes the roles typically played by
the oral modality—it takes over the forms and functions of language and becomes
a system of homesigns that display many of the characteristics found in established
& 2014 The Author(s) Published by the Royal Society. All rights reserved.
Downloaded from rstb.royalsocietypublishing.org on October 17, 2014
sign languages. Gesture can thus become language under the [13–16]. Even more compelling, we can predict which particu- 2
right circumstances, although it grows into a fully complex lar nouns will enter a child’s verbal vocabulary by looking at
rstb.royalsocietypublishing.org
linguistic system only with the support of a community that the objects that the child indicated using deictic gestures sev-
can pass the system along to the next generation. By observing eral months earlier [17]. For example, a child who does not
the steps a manual communication system takes as it become know the word ‘cat’, but communicates about cats by pointing
a fully elaborated sign language, we can gain insight into the at them is likely to learn the word ‘cat’ within three months
factors that have shaped human language. [17]. Gesture paves the way for children’s early nouns.
I end by asking what it might mean to widen the lens on However, gesture does not appear to pave the way for
language in the manual modality, that is, to look at gesture pro- early verbs—although we might have expected iconic ges-
duced along with sign language. Signers do gesture when they tures that depict actions to precede, and predict, the onset
sign [8]. Like the gestures that accompany speech, the gestures of verbs, they do not. Özçalışkan et al. [11] observed spon-
that accompany sign are analogue in form, and thus comp- taneous speech and gestures in 40 English-learning children
rstb.royalsocietypublishing.org
subsequent construction
type of construction preceding construction containing gesture containing speech alone
predicted their spoken vocabulary (as measured by the PPVT cup þ ‘cup’) does not reliably predict the onset of two-word sen-
[33]) at 42 months, but the number of supplementary gesture þ tence-like utterances [17], reinforcing the point that it is the
speech combinations they produced at 18 months did not. Ges- specific way in which gesture is combined with speech, rather
ture is thus not merely an early index of global communicative than the ability to combine gesture with speech per se, which sig-
skill, but is a harbinger of specific linguistic steps that children nals the onset of future linguistic achievements. The gesture in a
will soon take—early gesture words predict later spoken voca- complementary gesture þ speech combination has traditionally
bulary, and early gesture sentences predict later spoken syntax. been considered redundant with the speech it accompanies but,
Gesture does more than open the door to sentence con- gesture typically locates the object being labelled and, in this
struction—the particular gesture þ speech combinations sense, has a different function from speech [36]. Complementary
children produce predict the onset of corresponding linguistic gesture þ speech combinations have, in fact, recently been
milestones. Özçalışkan & Goldin-Meadow [34] observed 40 of found to predict the onset of a linguistic milestone—but they
the children in the Rowe & Goldin-Meadow [31] sample at 14, predict the onset of complex nominal constituents rather than
18 and 22 months and found that the types of supplementary the onset of sentential constructions.
combinations the children produced changed over time and, If children are using nouns to classify the objects they label (as
critically, presaged changes in their speech. For example, the recent evidence suggests infants do when hearing spoken nouns
children began producing ‘two-verb’ complex sentences in [37]), then producing a complementary point with a noun could
gesture þ speech combinations (‘I like it’ þ EAT gesture) several serve to specify an instance of that category. In this sense, a point-
months before they produced complex sentences entirely in ing gesture could be functioning like a determiner. Cartmill et al.
speech (‘help me find it’). Supplementary gesture þ speech [38] analysed all of the utterances containing nouns produced by
combinations thus continue to provide stepping-stones to 18 children in Rowe & Goldin-Meadow’s [31] sample and
increasingly complex linguistic constructions. focused on (i) utterances containing an unmodified noun com-
Gesture does not, however, always predict transitions in bined with a complementary pointing gesture (e.g. point at
language learning. Gesture precedes and predicts linguistic cup þ ‘cup’) and (ii) utterances containing a noun modified by
developments when those developments involve new con- a determiner (e.g. ‘the/a/that cup’). They found that the age at
structions, but not when the developments involve fleshing which children first produced complementary point þ noun
out existing constructions. For example, Özçalışkan & Goldin- combinations selectively predicted the age at which the children
Meadow [35] found that the 40 children in their sample produced first produced determiner þ noun combinations.2 Not only
combinations in which one modality conveyed a predicate and did complementary point þ noun combinations precede
the other conveyed an argument (e.g. WASH gesture þ ‘hair’ ¼ and predict the onset of determiner þ noun combinations in
predicate in gesture þ object in speech) several months before speech, but these point þ noun combinations also decreased
they produced predicate þ argument combinations entirely in in number once children gained productive control over
speech (e.g. ‘popped this balloon’ ¼ predicate þ object, both in determiner þ noun combinations. When children point to
speech). However, once the basic predicate þ argument con- and label an object simultaneously, they appear to be on
struction had been acquired in speech, the children did not rely the cusp of developing an understanding of nouns as a
on gesture to add arguments to the construction. Thus, the chil- modifiable unit of speech, a complex nominal constituent.
dren produced their first predicate þ 2 argument combinations
in speech (e.g. ‘I want the Lego’ ¼ agent þ predicate þ object,
(iv) Narratives
all in speech) and in gesture þ speech (point at father þ ‘have
Gesture has also been found to predict changes in narrative
food’ ¼ agent in gesture þ predicate in speech þ object in
structure later in development. Demir et al. [39] asked 38 chil-
speech) at the same age [35].
dren in the Rowe & Goldin-Meadow’s [31] sample to retell a
cartoon at age 5 and then again at ages 6, 7 and 8. Even at age
(iii) Complex nominal constituents 8, the children showed no evidence of being able to frame
As mentioned earlier, the age at which children first pro- their narratives from a character’s perspective in speech.
duce complementary gesture þ speech combinations in which Taking a character’s first-person perspective on events has
gesture indicates the object labelled in speech (e.g. point at been found, in adults, to be important for creating a coherent
Downloaded from rstb.royalsocietypublishing.org on October 17, 2014
narrative representation [40]. Interestingly, many of the children, gesture use at 14 months can be explained by parent gesture 4
even at age 5, did take a character’s viewpoint into account in use at 14 months, even when parent speech is controlled.
rstb.royalsocietypublishing.org
their gestures. For example, to describe a woodpecker’s actions, Importantly, parent gesture does not appear to have a direct
one child moved her upper body and head back and forth, thus effect on subsequent child spoken vocabulary—the effect is
assuming the perspective of the bird (as opposed to moving a mediated through child gesture, suggesting that it is the act of
beak-shaped hand back and forth and taking the perspective gesturing on the part of the child that is critical.
of someone looking at the bird, a skill that appears later in Although these findings suggest that child gesture is play-
development [2]). Moreover, the children who produced ing a causal role in language learning, we need to manipulate
character-viewpoint gestures at age 5 were more likely than gesture to be certain of this claim. Previous work has found
children who did not produce these gestures to go on to tell that telling 9- and 10-year-old children to gesture when
well-structured stories (as measured by the narrative structure explaining how they solved a math problem does, in fact,
coding system developed by Stein & Glenn [41]) in the later make them particularly receptive to subsequent instruction
Just as mothers are sensitive to whether their children are stand in for nouns in the children’s gesture sentences, for 5
familiar with the words they present, adjusting their strategies example, point at jar—TWIST gesture ¼ that ( jar) twist. The
rstb.royalsocietypublishing.org
to make the word comprehensible (e.g. linking the new word demonstrative pointing gesture can be used to refer to any
to related words, offering terms that contrast with it directly, situ- entity that is present, and homesigners use their pointing ges-
ating it by appealing to past experiences [53]), mothers are tures to refer to the full range of entities that young hearing
sensitive to their children’s gestures [25,54]. Mothers translate children refer to with their words, e.g. people, inanimate
into their own words not only the single gestures that children objects, body parts and places [58].
produce (e.g. ‘that’s a bird’, produced in response to the child’s Homesigners use two additional devices to refer to entities.
point at a bird), but also the gestures that children produce in They produce pointing gestures that refer not to the specific
combination with words conveying different information, that object at the end of the point, but rather to the class of objects
is, supplementary gesture þ speech combinations (‘the bird’s that the indexed object belongs to. For example, a homesigner
taking a nap’, produced in response to the child’s point at points at the bubble jar, which is already open, and produces
distinguish the two types of gestures: he used handling hand- part of a four-element predicate frame, you-give-me-apple, 6
shapes in gestures used as verbs (i.e. the handshape simply because there was less competition among the
rstb.royalsocietypublishing.org
represented a hand as it holds an object, e.g. two fists held as underlying elements in a three-element frame than in a
though beating a drum to refer to beating), but object hand- four-element frame [64]. Interestingly, although the children,
shapes in gestures used as nouns (i.e. the handshape at times, produced gestures for all of the elements in a predi-
represented features of the object itself, e.g. extending a flat cate frame, this was quite rare. In other words, the children
palm to refer to an oar) [62]. rarely fleshed out their predicate frames.
Between ages 3;3 and 3;5, David stopped distinguishing One additional point in relation to underlying structure is
between nouns and verbs in these particular ways; that is, he worth making—it is the underlying predicate frame that
no longer had a restriction on using the same handshape þ determines when a gesture for a particular argument (the
motion stem in a noun–verb pair (e.g. he could now use the actor, for example) appears in surface structure, not how
TWIST stem to mean both twist and jar) [60], and he no longer easy it is to guess the actor from context. If predictability in
BIRD ¼ bird). At times, however, the children combine demon- natural languages. But child homesign is not a full-blown 7
strative pointing gestures with iconic noun gestures (e.g. point language, and for good reason. The children are inventing
rstb.royalsocietypublishing.org
at bird—BIRD—PEDAL, to describe a bird who is pedalling a their gesture systems on their own without a community of
bicycle) to construct a complex nominal constituent, [[that bird] communication partners. Indeed, when homesign children
pedals]. These combinations function semantically and syn- were brought together after the first school for the deaf was
tactically like complex nominal constituents in conventional opened in Nicaragua in the late 1970s, their gesture systems
languages, and also function as a unit in terms of sentence began to cohere into a recognized and shared language.
length (i.e. sentences containing complex nominal constituents That language, Nicaraguan Sign Language (NSL), became
were longer than sentences the child would have been expected increasingly complex, particularly after a new generation of
to produce based on norms derived from the child’s gesture deaf children learned the system as a native language [77].
sentences without complex nominal constituents [67]. The circumstances in Nicaragua permit us to go beyond
Interestingly, homesigners tend to elaborate their sentences uncovering skills children bring to language learning to gain
was systematic, as it ought to be if the verbs are functioning in the blank—she has conveyed an add-to-equal-sign strategy 8
like classifier predicates—all groups used object handshapes in speech (4 þ 2 þ 6) but an add-all-numbers strategy in
rstb.royalsocietypublishing.org
when describing no-agent events, but used both handling gesture (4 þ 2 þ 6 þ 6). The child has thus conveyed dif-
and object handshapes when describing agent events. In con- ferent information in her gestures from what she conveyed
trast to these grammatical properties, which are already in her speech, a gesture–speech mismatch. Importantly, chil-
present in homesign, stability in noun forms does not appear dren who produce many gesture–speech mismatches on the
to be a linguistic property that an individual will necessarily math task are likely to learn how to solve the problem after a
develop without pressure from a peer linguistic commu- math lesson—more likely than children who do not produce
nity—individual homesigners used a number of different gesture–speech mismatches on the problem [92,93]. This
handshapes to label a particular object, whereas NSL and effect has also been found in children learning to solve conser-
ASL signers tended to use only one. vation problems [94], in children learning to solve balance
The manual modality can thus take on linguistic proper- problems [95] and in adults learning to solve stereoisomer
that the analogue information must be conveyed in the manual (insight that is difficult to come by when we look only at chil- 9
modality. The manual modality may be privileged when it dren acquiring spoken language under typical learning
rstb.royalsocietypublishing.org
comes to expressing emergent or mimetic ideas, perhaps conditions), and into the factors that can lead to the emer-
because our hands are an important vehicle for discovering gence of fully complex, conventional linguistic systems.
properties of the world [98–100]. Finally, when we widen the lens on conventional sign
As a final caveat, it is important to point out that the ges- languages to include gesture, we can address a question that
tures the deaf and hearing children produce along with the cannot be examined looking solely at spoken language. The
math explanations are different from the kinds of gestures representational formats displayed across two modalities in
that children produce in the early stages of language learning. speakers—the categorical in the oral modality (speech) and
The learning task facing the pre-linguistic child is language the analogue in the manual modality (gesture)—appear in
itself. When gesture is used in these early stages, it is used as one modality in signers—the categorical (sign) and the ana-
an assist into the linguistic system, substituting for words logue (gesture), both in the manual modality. Nevertheless,
References
1. Kendon A. 1980 Gesticulation and speech: 2. McNeill D. 1992 Hand and mind: what gestures sign language. In The handbook of child language
two aspects of the process of utterance. In reveal about thought. Chicago, IL: University of acquisition (eds WC Ritchie, TK Bhatia), pp. 531–567.
Relationship of verbal and nonverbal communication Chicago Press. New York, NY: Academic Press.
(ed. MR Key), pp. 207 –228. The Hague, 3. Lillo-Martin D. 1999 Modality effects and modularity 4. Newport EL, Meier RP. 1985 The acquisition of
The Netherlands: Mouton. in language acquisition: the acquisition of American American sign language. In The cross-linguistic study
Downloaded from rstb.royalsocietypublishing.org on October 17, 2014
of language acquisition, vol. 1: the data (ed. 22. Greenfield P, Smith J. 1976 The structure of 39. Demir OE, Levine S, Goldin-Meadow S. In press. 10
DI Slobin), pp. 881 –938. Hillsdale, NJ: Erlbaum. communication in early language development. A tale of two hands: development of narrative
rstb.royalsocietypublishing.org
5. Hoffmeister R, Wilbur R. 1980 Developmental: the New York, NY: Academic Press. structure in children’s speech and gesture. J. Child
acquisition of sign language. In Recent perspectives on 23. Guillaume P. 1927 Les debuts de la phrase dans le Language.
American sign language (eds H Lane, F Grosjean), pp. langage de l’enfant. J. Psychol. 24, 1–25. 40. Zwaan RA, Rapp DN. 2006 Discourse
61–78. Hillsdale, NJ: Erlbaum. 24. Leopold WF. 1939– 49 Speech development of a comprehension. In Handbook of psycholinguistics
6. Conrad R. 1979 The deaf child. London, UK: Harper bilingual child: a linguist’s record, vol. 1 –4. (eds M Traxler, MA Gernsbacher), pp. 725–764,
and Row. Evanston, IL: Northwestern University Press. 2nd edn. San Diego, CA: Elsevier.
7. Mayberry RI. 1992 The cognitive development of 25. Masur EF. 1982 Mothers’ responses to infants’ 41. Stein NL, Glenn CG. 1979 An analysis of story
deaf children: recent insights. In Child object-related gestures: influences on lexical comprehension in elementary children, vol. 2.
neuropsychology, handbook of neuropsychology, development. J. Child Lang. 9, 23– 30. (doi:10. Norwood, NJ: Ablex.
vol. 7 (eds S Segalowitz, I Rapin) (series 1017/S0305000900003585) 42. Sauer E, Levine SC, Goldin-Meadow S. 2010
56. Vygotsky L. 1986 Thought and language (A. Kozulin, 72. Hudson JA, Shapiro LR. 1991 From knowing to 85. Senghas A, Kita S, Ozyurek A. 2004 Children 11
transl.). Cambridge, MA: The MIT Press. (Original telling: the development of children’s scripts, creating core properties of language: evidence from
rstb.royalsocietypublishing.org
work published 1934) stories, and personal narratives. In Developing an emerging sign language in Nicaragua. Science
57. Goldin-Meadow S. 2003 The resilience of language: narrative structure (eds A McCabe, C Peterson), pp. 305, 1779– 1782. (doi:10.1126/science.1100199)
what gesture creation in deaf children can tell us 89 –136. Hillsdale, NJ: Lawrence Earlbaum 86. Goldin-Meadow S, So W-C, Ozyurek A, Mylander C.
about how all children learn language. New York, Associates, Publishers. 2008 The natural order of events: how speakers of
NY: Psychology Press. 73. Basso K. 1984 Stalking with stories: names, places, and different languages represent events nonverbally.
58. Feldman H, Goldin-Meadow S, Gleitman L. 1978 moral narratives among the Western Apache. In Text, Proc. Natl Acad. Sci. USA 105, 9163–9168. (doi:10.
Beyond Herodotus: the creation of language by play, and story: the construction and reconstruction of self 1073/pnas.0710060105)
linguistically deprived deaf children. In Action, symbol, and society (eds EM Bruner, S Plattner), pp. 19–55. 87. Goldin-Meadow S, Brentari D, Horton L, Coppola M,
and gesture: the emergence of language (ed. A Lock), Washington, DC: American Ethnological Society. Senghas A. In press. Watching language grow in the
pp. 351–414. New York, NY: Academic Press. 74. Göncü A, Jain J. 2000 Children’s myths and their manual modality: nominals, predicates and handshape.