You are on page 1of 12

Downloaded from rstb.royalsocietypublishing.

org on October 17, 2014

Widening the lens: what the manual modality reveals about


language, learning and cognition
Susan Goldin-Meadow
Phil. Trans. R. Soc. B 2014 369, 20130295, published 4 August 2014

References This article cites 57 articles, 8 of which can be accessed free


http://rstb.royalsocietypublishing.org/content/369/1651/20130295.full.html#ref-list-1

Subject collections Articles on similar topics can be found in the following collections

cognition (365 articles)

Email alerting service Receive free email alerts when new articles cite this article - sign up in the box at the top
right-hand corner of the article or click here

To subscribe to Phil. Trans. R. Soc. B go to: http://rstb.royalsocietypublishing.org/subscriptions


Downloaded from rstb.royalsocietypublishing.org on October 17, 2014

Widening the lens: what the manual


modality reveals about language,
learning and cognition
Susan Goldin-Meadow
rstb.royalsocietypublishing.org Department of Psychology, University of Chicago, 5848 South University Avenue, Chicago, IL 60637, USA

The goal of this paper is to widen the lens on language to include the manual
modality. We look first at hearing children who are acquiring language from a
spoken language model and find that even before they use speech to com-
Research municate, they use gesture. Moreover, those gestures precede, and predict, the
acquisition of structures in speech. We look next at deaf children whose hearing
Cite this article: Goldin-Meadow S. 2014 losses prevent them from using the oral modality, and whose hearing parents
Widening the lens: what the manual modality have not presented them with a language model in the manual modality.
These children fall back on the manual modality to communicate and use ges-
reveals about language, learning and
tures, which take on many of the forms and functions of natural language.
cognition. Phil. Trans. R. Soc. B 369: 20130295.
These homemade gesture systems constitute the first step in the emergence of
http://dx.doi.org/10.1098/rstb.2013.0295 manual sign systems that are shared within deaf communities and are full-
fledged languages. We end by widening the lens on sign language to include
One contribution of 12 to a Theme Issue gesture and find that signers not only gesture, but they also use gesture in learning
contexts just as speakers do. These findings suggest that what is key in gesture’s
‘Language as a multimodal phenomenon:
ability to predict learning is its ability to add a second representational format to
implications for language learning, processing
communication, rather than a second modality. Gesture can thus be language,
and evolution’. assuming linguistic forms and functions, when other vehicles are not availa-
ble; but when speech or sign is possible, gesture works along with language,
Subject Areas: providing an additional representational format that can promote learning.
cognition

Keywords: 1. Introduction
homesign, co-speech gesture, gesture– speech Children around the globe learn to speak with surprising ease. But they are not just
mismatch, Nicaraguan Sign Language learning to speak—they are also learning how to use their hands as they speak.
They are learning to gesture. We know that in adult speakers, gesture forms a
single system with speech and is an integral part of the communicative act [1,2].
Author for correspondence: In this paper, my goal is to widen the lens on language learning to include the
Susan Goldin-Meadow manual modality—to include gesture. I begin by examining the language-learning
e-mail: sgm@uchicago.edu trajectory when it is viewed with this wider lens. The central finding is that children
display skills earlier in development than they do when the focus is only on speech.
They can, for example, express sentence-like ideas in a gesture–speech combi-
nation several months before they express these ideas in speech alone. Gesture
thus provides insight into the earliest steps a language-learner takes and might
even play a role in getting the learner to take those steps.
I then consider what happens if a child does not have access to the oral modality
and has only the manual modality to use in communication. Deaf children who are
exposed to input from a language in the manual modality, that is, an established
sign language like American Sign Language (ASL), learn that language as naturally
as hearing children exposed to input from a language in the oral modality [3,4]. But
90% of deaf children are born to hearing parents [5], who typically do not know a
sign language and want their deaf child to learn a spoken language. Even when
given intensive instruction in the oral modality, children with severe to profound
hearing losses typically are not able to make use of the spoken language that sur-
rounds them [6,7]. If, in addition, they do not have access to a sign language, the
children are likely to turn to gesture to communicate. Under these circumstances,
the manual modality steps in and gesture assumes the roles typically played by
the oral modality—it takes over the forms and functions of language and becomes
a system of homesigns that display many of the characteristics found in established

& 2014 The Author(s) Published by the Royal Society. All rights reserved.
Downloaded from rstb.royalsocietypublishing.org on October 17, 2014

sign languages. Gesture can thus become language under the [13–16]. Even more compelling, we can predict which particu- 2
right circumstances, although it grows into a fully complex lar nouns will enter a child’s verbal vocabulary by looking at

rstb.royalsocietypublishing.org
linguistic system only with the support of a community that the objects that the child indicated using deictic gestures sev-
can pass the system along to the next generation. By observing eral months earlier [17]. For example, a child who does not
the steps a manual communication system takes as it become know the word ‘cat’, but communicates about cats by pointing
a fully elaborated sign language, we can gain insight into the at them is likely to learn the word ‘cat’ within three months
factors that have shaped human language. [17]. Gesture paves the way for children’s early nouns.
I end by asking what it might mean to widen the lens on However, gesture does not appear to pave the way for
language in the manual modality, that is, to look at gesture pro- early verbs—although we might have expected iconic ges-
duced along with sign language. Signers do gesture when they tures that depict actions to precede, and predict, the onset
sign [8]. Like the gestures that accompany speech, the gestures of verbs, they do not. Özçalışkan et al. [11] observed spon-
that accompany sign are analogue in form, and thus comp- taneous speech and gestures in 40 English-learning children

Phil. Trans. R. Soc. B 369: 20130295


lement the discrete, segmented categories found in sign (and from ages 14 to 34 months and found that the children pro-
speech). But, unlike gesture and speech, gesture and sign are pro- duced their first iconic gestures for actions six months later
duced in the same (manual) modality. The question I ask is than their first verbs. The onset of iconic gestures conveying
whether the gestures that accompany sign play the same role action meanings thus followed, rather than preceded, chil-
in learning as the gestures that accompany speech. Addressing dren’s first verbs.1 But iconic gestures did increase in
this question allows us to determine whether gesture’s impor- frequency at the same time that verbs did and, at that time,
tance in learning stems from the fact that it is produced in a children used these action gestures to convey specific verb
different modality from speech or from the fact that it represents meanings that they were not yet expressing in speech. Chil-
information in a qualitatively different format from speech. dren thus do use gesture to expand their repertoire of verb
What I hope to show is that widening the lens on language meanings, but only after they have begun to acquire the
to include the manual modality gives us deeper insight into the verb system underlying their language.
nature and the time course of language learning and learning
in general, and can also give us insight into the relationship
between language and cognition. In addition, by investigat- (ii) Sentences
ing how the manual modality can be used to create language Even though they treat gestures like words in some respects,
(as in homesign and emergent sign languages), we open a children learning a spoken language very rarely combine their
window onto language that lets us identify properties of gestures with other gestures, and if they do, the phase tends to
language that are so ‘resilient’ that they can be developed be short-lived [19]. But children do often combine their gestures
even by a single user versus properties of language that are with words, and they produce these gesture þ speech combi-
more fragile, and that require a community of users, and nations well before they produce word þ word combinations.
perhaps generations of learners, to emerge. Children’s earliest gesture þ speech combinations contain
gestures that convey information that complements the infor-
mation conveyed in speech; for example, pointing at a ball
while saying ‘ball’ [20–24]. Soon after, children begin to pro-
2. Widening the lens on spoken language duce combinations in which gesture conveys information that
learning to include the manual modality is different from and supplements the information conveyed in
the accompanying speech; for example, pointing at a ball
(a) The gestures that accompany speech selectively while saying ‘here’ to request that the ball be moved to a
predict linguistic milestones particular spot [19,22,25–28].
I begin by examining the gestures that hearing children pro- As in the acquisition of words, we find that changes in ges-
duce in the process of learning spoken language. At a time in ture (in this case, changes in the relationship gesture holds to
development when children are limited in the words they the speech it accompanies) predict changes in language (the
know and use, gesture offers a way for them to extend their onset of sentences). The age at which children first produce
communicative range. Children typically begin to gesture supplementary gesture þ speech combinations (e.g. point at
between eight and 12 months [9,10], first producing deictic box þ ‘open’, or GIVE gesture þ ‘bottle’) reliably predicts the
gestures ( pointing at objects, people and places in the age at which they first produce two-word sentence-like utter-
immediate environment, or holding up objects to draw atten- ances (i.e. sentences containing a verb, e.g. ‘open box’, ‘give
tion to them), and later at around 26 months [11] producing bottle’) [17,29,30]. The age at which children first produce comp-
iconic gestures that capture aspects of the objects, action or lementary gesture þ speech combinations (e.g. point at box þ
attributes they represent (e.g. flapping arms to refer to a ‘box’) does not. Moreover, supplementary combinations selec-
bird or to flying [12]). The fact that gesture allows children tively relate to the syntactic complexity of children’s later
to communicate meanings that they do not yet express in sentences. Rowe & Goldin-Meadow [31] observed 52 children
speech opens up the possibility that gesturing itself facilitates from families reflecting the demographic range of Chicago and
language learning. If so, changes in gesture should not only found that the number of supplementary gesture þ speech com-
predate, but they should also predict, changes in language. binations the children produced at 18 months reliably predicted
And they do, both for words and for sentences (table 1). the complexity of their sentences (as measured by the Index of
Productive Syntax [32]) at 42 months, but the number of different
meanings they conveyed in gesture (where point at dog and point
(i) Nouns and verbs at bottle are counted as conveying different meanings) at
The more a child gestures early on, the more words are likely 18 months did not. Conversely, the number of different mean-
to be found in the child’s vocabulary later in development ings children conveyed in gesture at 18 months reliably
Downloaded from rstb.royalsocietypublishing.org on October 17, 2014

Table 1. Examples of linguistic constructions preceded and predicted by gesture. 3

rstb.royalsocietypublishing.org
subsequent construction
type of construction preceding construction containing gesture containing speech alone

nouns point at bear ‘bear’


complex nominal constituents point at cat þ ‘cat’ ‘the cat’
simple sentences
argument þ argument (entity-location) ‘a choo-choo train’ þ point at tunnel ‘the cat in the tree’
argument þ predicate (actor-act) ‘baby’ þ EAT ‘mouse is swimming’

Phil. Trans. R. Soc. B 369: 20130295


argument þ predicate (act-patient) ‘hair’ þ WASH gesture ‘pull my diaper’
complex sentences
predicate þ predicate ‘did it really hard’ þ PRESS gesture ‘make my tape stop’
predicate þ predicate ‘you making me’ þ FALL gesture ‘you make him fall’

predicted their spoken vocabulary (as measured by the PPVT cup þ ‘cup’) does not reliably predict the onset of two-word sen-
[33]) at 42 months, but the number of supplementary gesture þ tence-like utterances [17], reinforcing the point that it is the
speech combinations they produced at 18 months did not. Ges- specific way in which gesture is combined with speech, rather
ture is thus not merely an early index of global communicative than the ability to combine gesture with speech per se, which sig-
skill, but is a harbinger of specific linguistic steps that children nals the onset of future linguistic achievements. The gesture in a
will soon take—early gesture words predict later spoken voca- complementary gesture þ speech combination has traditionally
bulary, and early gesture sentences predict later spoken syntax. been considered redundant with the speech it accompanies but,
Gesture does more than open the door to sentence con- gesture typically locates the object being labelled and, in this
struction—the particular gesture þ speech combinations sense, has a different function from speech [36]. Complementary
children produce predict the onset of corresponding linguistic gesture þ speech combinations have, in fact, recently been
milestones. Özçalışkan & Goldin-Meadow [34] observed 40 of found to predict the onset of a linguistic milestone—but they
the children in the Rowe & Goldin-Meadow [31] sample at 14, predict the onset of complex nominal constituents rather than
18 and 22 months and found that the types of supplementary the onset of sentential constructions.
combinations the children produced changed over time and, If children are using nouns to classify the objects they label (as
critically, presaged changes in their speech. For example, the recent evidence suggests infants do when hearing spoken nouns
children began producing ‘two-verb’ complex sentences in [37]), then producing a complementary point with a noun could
gesture þ speech combinations (‘I like it’ þ EAT gesture) several serve to specify an instance of that category. In this sense, a point-
months before they produced complex sentences entirely in ing gesture could be functioning like a determiner. Cartmill et al.
speech (‘help me find it’). Supplementary gesture þ speech [38] analysed all of the utterances containing nouns produced by
combinations thus continue to provide stepping-stones to 18 children in Rowe & Goldin-Meadow’s [31] sample and
increasingly complex linguistic constructions. focused on (i) utterances containing an unmodified noun com-
Gesture does not, however, always predict transitions in bined with a complementary pointing gesture (e.g. point at
language learning. Gesture precedes and predicts linguistic cup þ ‘cup’) and (ii) utterances containing a noun modified by
developments when those developments involve new con- a determiner (e.g. ‘the/a/that cup’). They found that the age at
structions, but not when the developments involve fleshing which children first produced complementary point þ noun
out existing constructions. For example, Özçalışkan & Goldin- combinations selectively predicted the age at which the children
Meadow [35] found that the 40 children in their sample produced first produced determiner þ noun combinations.2 Not only
combinations in which one modality conveyed a predicate and did complementary point þ noun combinations precede
the other conveyed an argument (e.g. WASH gesture þ ‘hair’ ¼ and predict the onset of determiner þ noun combinations in
predicate in gesture þ object in speech) several months before speech, but these point þ noun combinations also decreased
they produced predicate þ argument combinations entirely in in number once children gained productive control over
speech (e.g. ‘popped this balloon’ ¼ predicate þ object, both in determiner þ noun combinations. When children point to
speech). However, once the basic predicate þ argument con- and label an object simultaneously, they appear to be on
struction had been acquired in speech, the children did not rely the cusp of developing an understanding of nouns as a
on gesture to add arguments to the construction. Thus, the chil- modifiable unit of speech, a complex nominal constituent.
dren produced their first predicate þ 2 argument combinations
in speech (e.g. ‘I want the Lego’ ¼ agent þ predicate þ object,
(iv) Narratives
all in speech) and in gesture þ speech (point at father þ ‘have
Gesture has also been found to predict changes in narrative
food’ ¼ agent in gesture þ predicate in speech þ object in
structure later in development. Demir et al. [39] asked 38 chil-
speech) at the same age [35].
dren in the Rowe & Goldin-Meadow’s [31] sample to retell a
cartoon at age 5 and then again at ages 6, 7 and 8. Even at age
(iii) Complex nominal constituents 8, the children showed no evidence of being able to frame
As mentioned earlier, the age at which children first pro- their narratives from a character’s perspective in speech.
duce complementary gesture þ speech combinations in which Taking a character’s first-person perspective on events has
gesture indicates the object labelled in speech (e.g. point at been found, in adults, to be important for creating a coherent
Downloaded from rstb.royalsocietypublishing.org on October 17, 2014

narrative representation [40]. Interestingly, many of the children, gesture use at 14 months can be explained by parent gesture 4
even at age 5, did take a character’s viewpoint into account in use at 14 months, even when parent speech is controlled.

rstb.royalsocietypublishing.org
their gestures. For example, to describe a woodpecker’s actions, Importantly, parent gesture does not appear to have a direct
one child moved her upper body and head back and forth, thus effect on subsequent child spoken vocabulary—the effect is
assuming the perspective of the bird (as opposed to moving a mediated through child gesture, suggesting that it is the act of
beak-shaped hand back and forth and taking the perspective gesturing on the part of the child that is critical.
of someone looking at the bird, a skill that appears later in Although these findings suggest that child gesture is play-
development [2]). Moreover, the children who produced ing a causal role in language learning, we need to manipulate
character-viewpoint gestures at age 5 were more likely than gesture to be certain of this claim. Previous work has found
children who did not produce these gestures to go on to tell that telling 9- and 10-year-old children to gesture when
well-structured stories (as measured by the narrative structure explaining how they solved a math problem does, in fact,
coding system developed by Stein & Glenn [41]) in the later make them particularly receptive to subsequent instruction

Phil. Trans. R. Soc. B 369: 20130295


years, even controlling for early syntactic skills and initial level on that problem—the gesturing itself appears to be responsible
of narrative structure. Children were thus able to use gesture for their improved performance after instruction [44]. As
to take on a character’s perspective before being able to do so another example more relevant to language learning, LeBarton
in speech, and those early gestures signalled upcoming develop- et al. [45] studied 15 toddlers (beginning at 17 months) in an
ments in their spoken narrative production. Gesture thus eight-week at-home intervention study (six weekly training
continues to act as a harbinger of change as it assumes new sessions plus follow-up two weeks later) in which all children
roles in relation to discourse and narrative structure. were exposed to object words, but only some were told to point
at the named objects. Before each training session and at
follow-up, children interacted naturally with their parents to
(b) The mechanisms underlying gesture’s role in establish a baseline against which changes in communication
language learning were measured. Children who were told to gesture increased
the number of gesture meanings they conveyed not only
We have seen that early gesture predicts subsequent develop-
when interacting with the experimenter during training, but
ments in speech across a range of linguistic constructions
(table 1). Interestingly, gesture plays this role not only for chil- also when later interacting with their parents. Critically,
these experimentally induced increases in gesture led to
dren who are learning language at a typical pace, but also for
larger spoken repertoires at follow-up. The findings suggest
those who are experiencing delays. Children with unilateral
brain injury whose spoken language is delayed also display that gesturing can play an active role in word-learning, perhaps
because gesturing to a target picture in the context of labelling
delays in gesture. Child gesture thus has the potential to
focuses children’s attention to objects in the environment, to
serve as an early diagnostic tool, identifying which children
will exhibit subsequent language delays, and which will the labels, or to the object–label relation [46,47]. Children’s
active engagement in the bidirectional labelling context when
catch up and fall within the normative range [42,43].
told to gesture may also draw their attention to gesture’s com-
Why does early gesture selectively predict later spoken
vocabulary size and sentence complexity? At the least, gesture municative function, which could also have beneficial
consequences for vocabulary development [48–51].
reflects two separate abilities (word-learning and sentence
Although we know that encouraging children to point at
making) on which later linguistic abilities can be built. Expres-
sing many different meanings in gesture during development objects enhances word-learning, there have been no studies to
date encouraging children to produce supplementary gesture þ
is a sign that the child is going to be a good vocabulary learner,
speech combinations. We thus know only that early supplemen-
and expressing many different types of gesture þ speech com-
binations is a sign that the child is going to be a good sentence tary gesture þ speech combinations reflect the child’s readiness
to produce two-word utterances. More work is needed to deter-
learner. The early gestures children produce thus reflect their
mine whether these combinations play an active role in bringing
cognitive potential for learning particular aspects of language.
But early gesture could be doing more—it could be helping about the onset of two-word utterances.
children realize their potential. In other words, the act of
expressing meanings in gesture could be playing an active
role in helping children become better vocabulary learners, (ii) Gesture elicits timely speech from listeners
and the act of expressing sentence-like meanings in gesture þ The second way in which child gesture could play a role in
speech combinations could be playing an active role in helping language learning is more indirect—child gesture could elicit
children become better sentence learners. The next sections timely speech from listeners (e.g. [52]). Because gesture seems
explore this possibility. to reflect a child’s readiness for acquiring a particular linguistic
structure, it has the potential to alert listeners (parents, teachers
and clinicians) to the fact that a child is ready to learn that word
(i) Gesture provides opportunities to practice conveying meanings or sentence. Listeners who pay attention to those gestures and
Child gesture could have an impact on language learning in at can ‘read’ them, might then adjust their talk, providing just
least two ways. First, gesture gives children an opportunity to the right input to help the child learn the word or sentence.
practice producing particular meanings by hand at a time Consider a child who does not yet know the word ‘rabbit’
when those meanings are difficult to express by mouth. We and refers to the animal by pointing at it. His obliging
know, for example, that early gesture use is related to later voca- mother responds, ‘yes, that’s a rabbit’, thus supplying him
bulary size. In a mediation analysis, Rowe & Goldin-Meadow with just the word he is looking for. Or consider a child who
[15] found that the relatively large vocabularies children from points at her mother while saying the word ‘hat’. Her mother
high SES families display at 54 months can be partially replies, ‘that’s mommy’s hat’, thus translating the child’s
explained by child gesture use at 14 months. In turn, child gesture þ word combination into a simple sentence.
Downloaded from rstb.royalsocietypublishing.org on October 17, 2014

Just as mothers are sensitive to whether their children are stand in for nouns in the children’s gesture sentences, for 5
familiar with the words they present, adjusting their strategies example, point at jar—TWIST gesture ¼ that ( jar) twist. The

rstb.royalsocietypublishing.org
to make the word comprehensible (e.g. linking the new word demonstrative pointing gesture can be used to refer to any
to related words, offering terms that contrast with it directly, situ- entity that is present, and homesigners use their pointing ges-
ating it by appealing to past experiences [53]), mothers are tures to refer to the full range of entities that young hearing
sensitive to their children’s gestures [25,54]. Mothers translate children refer to with their words, e.g. people, inanimate
into their own words not only the single gestures that children objects, body parts and places [58].
produce (e.g. ‘that’s a bird’, produced in response to the child’s Homesigners use two additional devices to refer to entities.
point at a bird), but also the gestures that children produce in They produce pointing gestures that refer not to the specific
combination with words conveying different information, that object at the end of the point, but rather to the class of objects
is, supplementary gesture þ speech combinations (‘the bird’s that the indexed object belongs to. For example, a homesigner
taking a nap’, produced in response to the child’s point at points at the bubble jar, which is already open, and produces

Phil. Trans. R. Soc. B 369: 20130295


bird þ ‘nap’) [55]. Interestingly, mothers produce longer (and an iconic TWIST gesture; he wants his mother to open the
potentially more syntactically complex) sentences in response bubble jar that she is holding, but he uses the (open) jar that
to their children’s supplementary gesture þ speech combi- is near him to indicate the kind of object he wants opened.
nations (point at bird þ ‘nap’) than to their complementary These gestures are called category points, and homesigners
gesture þ speech combinations (point at bird þ ‘bird’). More- typically begin producing them later in development than
over, mothers’ sentences tend to be longest when they pick up demonstrative points [59].
on information conveyed in child speech and gesture (e.g. ‘the In addition to category points, homesigners also produce
bird’s taking a nap’), despite the fact that they could easily have iconic gestures (gestures that represent an aspect of an action
produced sentences that are just as long when they pick up on or object through pantomime) that function like nouns [60].
information conveyed only in the child’s speech (‘It’s time for For example, a homesigner moved two fists as though steering
your nap’) or only in the child’s gesture (‘It’s just like grandma’s a car to describe a picture of a motionless car. When function-
bird’) or when they ignore the child’s utterance entirely (‘Let’s ing as a noun, these gestures evoke a class of objects, rather
read another book’) [55]. than a specific object (unless, of course, they are accompanied
If child gesture is playing an instrumental role in language by a pointing gesture). Homesigners tend to produce their first
learning, mothers’ translations ought to be related to later iconic noun gestures during the same observation session in
word- and sentence-learning in their children—and they are which they first produce category points [59].
[55]. In terms of word-learning, when mothers translate the ges- Homesigners also use their iconic gestures as verbs and
tures that their children produce into words, those words are adjectives [60]. For example, a homesigner might use the
more likely to quickly become part of the child’s vocabulary two-fisted STEER gesture to describe a scene in which a car is
than words for gestures that mothers do not translate. In terms being driven, or to ask that a toy animal drive a car; this ges-
of sentence-learning, children whose mothers frequently trans- ture is functioning like a verb. As another example, the child
late their child’s gestures into speech tend to be first to produce forms a round circle with his fingers to describe the shape of a
two-word utterances. The age at which children produce their penny; this gesture is functioning like an adjective.
first two-word utterance is highly correlated with the proportion The little that is known about the steps homesigners follow
of times mothers translate their child’s gestures into speech, in developing nouns and verbs comes from a case study of an
suggesting that mothers’ targeted responses to their children’s American homesigner, David [59,60]. David used all three
gestures might be playing a role in helping the children take devices (demonstrative pointing gestures, category pointing
their first steps into multiword combinations. Because they are gestures and noun iconic gestures) to refer to entities, and also
finely tuned to a child’s current state (cf. Vygotsky’s zone of prox- used iconic gestures as verbs and adjectives, during his first
imal development [56]), adult responses of this sort could be observation session at 2;10 (years;months).
particularly effective in teaching children how an idea is The interesting developmental story is that, at all moments
expressed in the language they are learning. during this developmental period, David maintained a distinc-
tion between his nouns and verbs, but used different devices to
do so over time. During the earliest period beginning at 2;10,
3. When the manual modality is all that the David predominantly used demonstrative pointing gestures
to refer to entities, but also used a few iconic noun gestures
language-learner has and category pointing gestures. Interestingly, his iconic noun
As described earlier, children whose hearing losses prevent gestures, which were potentially confusable with his iconic
them from acquiring spoken language and whose hearing verb gestures, were distinguished in two ways: (i) David
parents have not exposed them to sign language turn to gesture used different stems for his noun and verb iconic gestures;
to communicate. These gestures, called homesigns, display many for example, if he used the TWIST stem (C handshape þ rotate
of the properties found in the early communication systems that motion) in a verb context to refer to twisting open a jar, he
hearing children learn from their spoken language models and did not use the TWIST stem in a noun context to refer to the jar
that deaf children learn from the signed language models [57]. itself [60]. In other words, David had no noun–verb pairs con-
taining the same handshape þ motion stem. In this way, David
resembled English-learning children whose first uses of words
(a) The linguistic milestones found in homesign that can serve as both nouns and verbs were restricted to only
(i) Nouns and verbs one use; for example, the child would use ‘comb’ as either a
Homesigners use pointing gestures to refer to the objects, verb (‘I comb hair’) or a noun (‘gimme comb’), but not both
people and places in their immediate surroundings. These [61]. (ii) In the noun and verb iconic gestures that David did
gestures function like demonstratives (this, that) and can produce early in development, he used handshape to
Downloaded from rstb.royalsocietypublishing.org on October 17, 2014

distinguish the two types of gestures: he used handling hand- part of a four-element predicate frame, you-give-me-apple, 6
shapes in gestures used as verbs (i.e. the handshape simply because there was less competition among the

rstb.royalsocietypublishing.org
represented a hand as it holds an object, e.g. two fists held as underlying elements in a three-element frame than in a
though beating a drum to refer to beating), but object hand- four-element frame [64]. Interestingly, although the children,
shapes in gestures used as nouns (i.e. the handshape at times, produced gestures for all of the elements in a predi-
represented features of the object itself, e.g. extending a flat cate frame, this was quite rare. In other words, the children
palm to refer to an oar) [62]. rarely fleshed out their predicate frames.
Between ages 3;3 and 3;5, David stopped distinguishing One additional point in relation to underlying structure is
between nouns and verbs in these particular ways; that is, he worth making—it is the underlying predicate frame that
no longer had a restriction on using the same handshape þ determines when a gesture for a particular argument (the
motion stem in a noun–verb pair (e.g. he could now use the actor, for example) appears in surface structure, not how
TWIST stem to mean both twist and jar) [60], and he no longer easy it is to guess the actor from context. If predictability in

Phil. Trans. R. Soc. B 369: 20130295


restricted handling handshapes to verbs and object handshapes context were the key, first-person actors (the child him or her-
to nouns (e.g. he might use the two-fist handshape in a gesture self ) and second-person actors (the communication partner)
referring to a drum, and the flat-palm handshape in a gesture should be omitted regardless of underlying predicate frame
referring to rowing) [62].3 But he developed new ways of because their identity can be easily guessed in context
distinguishing between nouns and verbs—he tended to (both persons are on the scene); and third-person actors
abbreviate his noun gestures (e.g. he produced the drumming should be gestured quite often regardless of underlying pre-
movement fewer times when the gesture served as a noun dicate frame because they are less easily guessed from
than when it served as a verb), and he tended to inflect his context. However, Goldin-Meadow [64, p. 237] found that
verb gestures (e.g. he displaced the drumming movement the systematic decrease in actor production probability as
towards a drum, the patient, more often when the gesture the number of potential arguments in underlying structure
served as a verb than when it served as a noun) [60]. The increases (from 1-argument to 2-argument to 3-argument)
way in which the homesigner makes the noun– verb distinc- holds for first-person, for second-person and for third-
tion thus appears to vary as a function of the complexity of person actors when each is analysed separately. The predicate
his homesign system. frame underlying a sentence is thus an essential factor in
determining how often the actor (and other semantic
elements, e.g. the patient) will be gestured in that sentence.
(ii) Sentences In terms of the surface structure of the homesigners’ ges-
Homesigners combine gestures into strings and those gesture ture sentences, the elements that are explicitly gestured
strings display many of the properties found in the early follow consistent patterns of two types [63]: (i) production
sentences produced by hearing children learning spoken probability patterns. Children are likely to produce gestures
language and deaf children learning sign languages— for particular arguments in a predicate frame; for example,
semantically their sentences convey the same types of they are more likely to produce a gesture for the patient,
propositions, and syntactically their sentences are structured drum, than for the agent, drummer, in a sentence conveying
at both underlying and surface levels [63]. In this sense, the 3-element transitive predicate, beat. (ii) Gesture order pat-
homesigners’ gesture sentences warrant the label ‘sentence’. terns. Children have preferred positions in which they place
Homesigners produce four types of action propositions in gestures for particular arguments; for example, they tend to
their gesture sentences (the proposition was determined using produce gestures for patients before gestures for actions,
gesture form and context; see [57,63] for details): transitive e.g. point at drum—BEAT.
acts with a recipient or endpoint (I give cookie to you), transi- Although homesigners do not typically flesh out their
tive acts without a recipient (I close box), intransitive acts with predicates with gestures for additional arguments, they do
a recipient or endpoint (I go outside) and intransitive acts with- elaborate their sentences by adding a second clause, that is,
out a recipient (I dance); and six types of attribute propositions: by constructing complex sentences containing two or more
nominal predicates (this is a ball), descriptor relations (ball is propositions [65]. They typically produce clauses that are
small), location relations (toaster is located in kitchen), possessive coordinately conjoined (e.g. point at jar—GIVE—SHAKE to ask
relations (toy trains belong to me), similarity relations (cup 1 the experimenter to give him a jar so that he can shake it),
resembles cup 2) and picture identification relations (picture of but they can also produce a second clause that is subordinate
car resembles toy car). to the main clause (e.g. FLUTTER—FALL—point at boots—point
The action proposition sentences homesigners produce at skates—GLIDE, a comment indicating that we wear boots
are characterized by an underlying predicate structure. and skate when snow flutters and falls; the when clause is
They produce sentences with a predicate and three argu- subordinate to the main clause). Importantly, the two-
ments (e.g. GIVE—point at self to mean you-give-me-apple), clause complex sentences homesigners produce have also
sentences with a predicate and two arguments (e.g. point at been shown to have underlying predicate frames, providing
apple—EAT, to mean you-eat-apple, or point at exper- evidence for an overarching sentence node [65,66].
imenter—MOVE to mean you-move-here) and sentences with a
predicate and one argument (e.g. point at dad—SLEEP to
mean dad-sleep). Evidence for these underlying structures (iii) Complex nominal constituents
comes from the fact that the likelihood of producing a gesture A second way in which homesigners elaborate their sentences is
for a particular argument depended on the underlying to add complexity within a constituent, in particular, within the
structure of the sentence (e.g. children were more likely to nominal constituent. As mentioned earlier, homesigners refer to
produce a gesture for apple when it was part of a three- entities by producing a demonstrative pointing gesture (point
element predicate frame, you-eat-apple, than when it was at bird ¼ that) or an iconic noun gesture (flap palms at sides,
Downloaded from rstb.royalsocietypublishing.org on October 17, 2014

BIRD ¼ bird). At times, however, the children combine demon- natural languages. But child homesign is not a full-blown 7
strative pointing gestures with iconic noun gestures (e.g. point language, and for good reason. The children are inventing

rstb.royalsocietypublishing.org
at bird—BIRD—PEDAL, to describe a bird who is pedalling a their gesture systems on their own without a community of
bicycle) to construct a complex nominal constituent, [[that bird] communication partners. Indeed, when homesign children
pedals]. These combinations function semantically and syn- were brought together after the first school for the deaf was
tactically like complex nominal constituents in conventional opened in Nicaragua in the late 1970s, their gesture systems
languages, and also function as a unit in terms of sentence began to cohere into a recognized and shared language.
length (i.e. sentences containing complex nominal constituents That language, Nicaraguan Sign Language (NSL), became
were longer than sentences the child would have been expected increasingly complex, particularly after a new generation of
to produce based on norms derived from the child’s gesture deaf children learned the system as a native language [77].
sentences without complex nominal constituents [67]. The circumstances in Nicaragua permit us to go beyond
Interestingly, homesigners tend to elaborate their sentences uncovering skills children bring to language learning to gain

Phil. Trans. R. Soc. B 369: 20130295


first by adding a second clause (i.e. producing coordinate insight into where those skills fall short; that is, to discover
sentences) and later by embedding information within a consti- which properties of language are so fragile that they cannot
tuent (i.e. producing complex nominal constituents), whereas be developed by a child lacking access to a conventional
children learning conventional spoken language show the language model [78]. By comparing current day child home-
opposite pattern [68,69], even when they are learning spoken signers in Nicaragua with groups whose circumstances have
languages that allow a great deal of noun omissions [59]. allowed them to go beyond child homesign, we can begin to
develop hypotheses about which properties of language are
(iv) Narratives fragile, and which conditions foster the development of these
Homesigners are able to use their gestures to recount stories, and relatively fragile properties (hypotheses that will then need
those gestured stories are of the same types, and of the same to be tested using other approaches, e.g. artificial language
structure, as those told by hearing children within their cul- learning studies). We begin by observing changes made to
tures—they tell stories about positive events (e.g. emotional the system when it remains the homesigner’s sole means
gain), negative events (e.g. physical harm) and routine events. of communication into adulthood [79,80]. Studying adult
In a study of narratives produced by four Chinese and four homesigners allows us to explore the impact that cognitive
American homesigners, Phillips, Goldin-Meadow and Miller and social maturity have on linguistic structure. We can also
[70] found that all eight children produced at least one gesture observe changes made to the system when it becomes a
narrative, but varied greatly in the total number of narratives community-wide language as homesigners come together for
they produced. Despite the variability in frequency of narration, the first time [81,82]. Studying the signers who originated
the homesigners displayed very similar structural patterns in NSL allows us to explore the impact that a community in
their narratives. All eight children elaborated upon the basic nar- which signers not only produce, but also receive their com-
rative, including setting information and voluntary actions in their munication, has on linguistic structure. Finally, we can observe
stories. Some children in each cultural group went further and changes made to the system when it is passed through sub-
produced narratives containing a complication and temporal order sequent generations of learners [83,84]. Studying generations
as well. Moreover, the two children who produced enough narra- of NSL signers allows us to explore the impact that passing a
tives to discern a developmental pattern (one Chinese and one newly birthed language through new learners has on linguistic
American homesigner) advanced their narrative skill by adding structure. In addition, as a backdrop, we can study the gestures
one feature at a time in a manner consistent with descriptions that hearing speakers produce, with speech [85] and without it
of the developmental patterns seen in hearing children [71,72]. [80,86], to better understand the raw materials out of which
The narratives experienced by children who are exposed to these newly emerging linguistic systems have risen.
a language model are saturated with cultural meanings; they The sign language that is evolving in Nicaragua gives us
provide cues about how to interpret experience, about what the opportunity to watch language as it grows. For example,
is valued, about what counts as a narratable event [73–76]. Goldin-Meadow et al. [87] charted the development of hand-
Unable to hear the verbal narratives that surround them, home- shape use in nouns versus verbs in three Nicaraguan groups:
signers do not have full access to the socializing messages (i) adult homesigners who were not part of the deaf com-
narratives provide. Nonetheless, their narratives bear echoes munity and used their own homesigns to communicate;
of culture-specific meaning. For example, Chinese homesigners (ii) NSL cohort 1 signers who fashioned the first stages of
use evaluative comments in their narratives more often than NSL and (iii) NSL cohort 2 signers who learned NSL from
American homesigners, thus mirroring the cultural patterns cohort 1. In addition, they compared handshapes produced
found in Chinese and American hearing children learning to by these three groups with those produced by (iv) native sign-
tell stories from a spoken language model [70]. Homesigners ers of ASL, an established sign language. They focused on
can thus produce culturally appropriate narrations despite handshapes in classifier verbs, which are part of a productive
their lack of a verbal language model, suggesting that these classifier system in ASL and thus ought to vary across agent
particular cultural messages are accessible through non- (e.g. someone moves a pen) versus no-agent (the pen moves
verbal channels and are thus so important that they are not on its own) contexts, unlike the nouns in their study, which
entrusted to a single medium. were frozen lexical items. They found that all of the groups,
including homesigners, used the same handshape form in
both an agent and a no-agent context more often when label-
(b) Homesign is the first step towards an established ling the object (e.g. the noun for pen) than when describing the
sign language event (e.g. the verb for moving); that is, there was less variabil-
We have seen that homesigning children have gesture sys- ity across contexts in noun handshape forms than in verb
tems that contain many of the basic properties found in all handshape forms. Importantly, the variability found in verbs
Downloaded from rstb.royalsocietypublishing.org on October 17, 2014

was systematic, as it ought to be if the verbs are functioning in the blank—she has conveyed an add-to-equal-sign strategy 8
like classifier predicates—all groups used object handshapes in speech (4 þ 2 þ 6) but an add-all-numbers strategy in

rstb.royalsocietypublishing.org
when describing no-agent events, but used both handling gesture (4 þ 2 þ 6 þ 6). The child has thus conveyed dif-
and object handshapes when describing agent events. In con- ferent information in her gestures from what she conveyed
trast to these grammatical properties, which are already in her speech, a gesture–speech mismatch. Importantly, chil-
present in homesign, stability in noun forms does not appear dren who produce many gesture–speech mismatches on the
to be a linguistic property that an individual will necessarily math task are likely to learn how to solve the problem after a
develop without pressure from a peer linguistic commu- math lesson—more likely than children who do not produce
nity—individual homesigners used a number of different gesture–speech mismatches on the problem [92,93]. This
handshapes to label a particular object, whereas NSL and effect has also been found in children learning to solve conser-
ASL signers tended to use only one. vation problems [94], in children learning to solve balance
The manual modality can thus take on linguistic proper- problems [95] and in adults learning to solve stereoisomer

Phil. Trans. R. Soc. B 369: 20130295


ties, even in the hands of a young child not yet exposed to problems in chemistry [96].
a conventional language model. But it grows into a full- Gesture–speech mismatches juxtapose two different ideas
blown language only with the support of a community that within a single response. Is juxtaposing different ideas across
can transmit the system to the next generation. Examining two modalities essential for gesture–speech mismatch to predict
the steps a manual communication system takes as it moves increased learning? If so, then mismatch between sign and
towards becoming a fully-fledged sign language offers a gesture (i.e. mismatch within one modality) should not predict
unique window onto factors that have made human language learning in signers, unlike mismatch between speech and
what it is. gesture (i.e. mismatch across two modalities), which does
predict learning in speakers. Alternatively, it may be the
representational formats within which different ideas are con-
4. Does gesture contribute another modality to veyed that are responsible for mismatch predicting learning.
If so, juxtaposing different ideas across two distinct repre-
learning or another representational format? sentational formats regardless of modality should be key,
Signers of established sign languages like ASL gesture when they and mismatching gesture should predict learning in signers
sign [8], but their gestures are produced in the same modality as as well as speakers.
their signs. Their utterances therefore do not constitute a multi- Goldin-Meadow et al. [97] explored this question in 40 ASL-
modality expression. However, those utterances do contain signing deaf children and found, first, that the child signers
more than one representational format—an analogue format produced gestures along with their signed explanations as
underlying gesture, and a discrete segmented format underlying often as hearing children produced gestures along with their
sign [88–90], comparable to the analogue format that underlies spoken explanations on these problems. Moreover, the signers
the gestures that accompany speech, and the discrete format produced gesture–sign mismatches as often as the hearing
that underlies the speech itself [1,2]. In this section, we take children produced gesture–speech mismatches. For example,
another look at gesture’s role in learning [91] and ask whether on the problem 5 þ 9 þ 2 ¼ __ þ 2, one signer produced the
what is key about gesture in this role is that it adds a second (incorrect) ‘add-to-equal-sign’ strategy in sign (FOURTEEN, ADD,
modality (i.e. it adds the manual to the oral4) or that it adds a TWO, ANSWER, SIXTEEN, i.e. the child indicated that the three num-
second representational format (i.e. it adds the analogue to bers on the left side of the equation should be added (14, which
the discrete). To address this question, we turn to children is the sum of 5 þ 9, plus 2) and the sum, 16, put in the blank).
who are native signers who studied in a learning context. At the same time, she produced a gesture indicating the two
As there are currently no relevant studies examining unique numbers on the left side of the equation (5 þ 9) and
language learning in young signers, we turn to learning in no other numbers, thus conveying the (correct) ‘grouping’
a different domain—mathematical equivalence—and in strategy (i.e. group and add 5 and 9) in gesture. As another
older children—9- to 10-year-olds. example, on the problem 7 þ 4 þ 2 ¼ 7 þ __, another signer
There is evidence that gesture plays the same role, at least produced the (incorrect) ‘add-to-equal-sign’ strategy in sign
in some respects, in older math-learners as it does in younger (ADD7þ4þ2, PUT13, i.e. an ADD sign produced over the 7, 4 and 2
word-learners. As described earlier, when examined in on the left side of the equation, and a PUT sign produced over
relation to speech, gesture can predict early linguistic mile- the 13 in the blank). At the same time, she produced gestures
stones in hearing children learning a spoken language; for conveying the (correct) ‘add-subtract’ strategy (indexing ges-
example, a child who produces an utterance containing a ges- tures at the 7, the 4 and the 2 on the left side of the equation,
ture that conveys different information from the information combined with a take-away gesture over the 7 on the right
conveyed in the speech (‘mama’ þ point at bottle, to indicate side of the equation, i.e. add up all of the numbers on the left
that mom is preparing a bottle) is on the cusp of producing side of the problem and subtract the number on the right).
two-word utterances (‘mama bottle’) and is likely to do so Even more important from the point of view of our discus-
within three months [17]. We find the same effect in older sion here, the more gesture–sign mismatches signers produced
children asked to solve a math task. Consider, for example in their problem-solving explanations prior to instruction, the
a child asked to solve the problem 4 þ 2 þ 6 ¼ __ þ 6. The more likely they were to profit from the lesson and solve
child puts 12 in the blank and has thus (incorrectly) solved the problems successfully after instruction [97]. It thus appears
the problem using an add-to-equal-sign strategy. When to be gesture’s ability to introduce a second representational
asked to explain her solution, she says, ‘I added the 4, the 2 format that is key to its success in predicting learning—
and the 6’, while pointing at the 4, the 2, the 6 on the left mismatch can predict learning whether the categorical
side of the equation and the 6 on the right side of the information is conveyed in the manual (sign) or oral (speech)
equation, and then says, ‘to get 12’, while pointing at the 12 modality. However, these findings leave open the possibility
Downloaded from rstb.royalsocietypublishing.org on October 17, 2014

that the analogue information must be conveyed in the manual (insight that is difficult to come by when we look only at chil- 9
modality. The manual modality may be privileged when it dren acquiring spoken language under typical learning

rstb.royalsocietypublishing.org
comes to expressing emergent or mimetic ideas, perhaps conditions), and into the factors that can lead to the emer-
because our hands are an important vehicle for discovering gence of fully complex, conventional linguistic systems.
properties of the world [98–100]. Finally, when we widen the lens on conventional sign
As a final caveat, it is important to point out that the ges- languages to include gesture, we can address a question that
tures the deaf and hearing children produce along with the cannot be examined looking solely at spoken language. The
math explanations are different from the kinds of gestures representational formats displayed across two modalities in
that children produce in the early stages of language learning. speakers—the categorical in the oral modality (speech) and
The learning task facing the pre-linguistic child is language the analogue in the manual modality (gesture)—appear in
itself. When gesture is used in these early stages, it is used as one modality in signers—the categorical (sign) and the ana-
an assist into the linguistic system, substituting for words logue (gesture), both in the manual modality. Nevertheless,

Phil. Trans. R. Soc. B 369: 20130295


that the child has not yet acquired. But once the basics of we find that gesturing in signers predicts learning just as gestur-
language have been mastered, children are free to use gesture ing in speakers does, suggesting that what matters for learning
for other purposes—in particular, to help them grapple with is the presence of two representational formats (analogue and
new ideas in other cognitive domains, ideas that are often not categorical), rather than two modalities (manual and oral).
easily translated into a single lexical item. As a result, although What is ultimately striking about children is that they are
gesture conveys ideas that do not fit neatly into speech able to use resources from either the manual or the oral moda-
throughout development, we might expect to see a transition lity to communicate in distinctively human ways. When other
in the kinds of ideas that gesture conveys as children become vehicles are not available, the manual modality can assume lin-
proficient language users. Initially, children use gesture as a guistic forms and functions and be language. But when either
substitute for the words they cannot yet express. Later, once speech or sign is available, the manual modality becomes part
they master language and other learning tasks present them- of language, providing an additional representational format
selves, they use gesture to express more global ideas that do that helps promote learning. As researchers, we too need to
not fit neatly into word-like units [2]. use resources from both the manual and the oral modalities
to fully understand language, learning and cognition.

5. Conclusion Funding statement. Preparation of this chapter was supported in part by


grant no. R01 DC00491 from NIDCD, grant nos. R01 HD47450 and
Widening the lens on language to include the manual modality P01 HD40605 from NICHD and grant no. SBE 0541957 from NSF
has given us a deeper understanding of language learning to the Spatial Intelligence and Learning Center (the author is a co-PI).
and learning in general. Hearing children who are acquiring
spoken language use gesture along with speech to communi-
cate, and those gesture þ word combinations precede, and
predict, the acquisition of word þ word combinations convey- Endnotes
ing the same notions. These findings make it clear that children 1
Estigarribia & Clark [18] have found that pointing gestures attract
have an understanding of these notions before they are able to and maintain attention in talk differently from iconic (or, in their
express them in speech, thus eliminating one frequently held terms, demonstrating) gestures, which may account for the fact that
explanation for the slow acquisition of certain structures—the pointing gestures predict the onset of nouns, but iconic gestures do
cognitive explanation, that is, that children do not express a not predict the onset of verbs.
2
This selectivity can be seen in the fact that the onset of complemen-
given structure because they lack an understanding of the tary point þ noun combinations ( point at box þ ‘box’) predicted the
notion underlying the structure. Widening our lens to include onset of determiner þ noun combinations (‘the box’) in these 18 chil-
the manual modality thus allows insight into when cognition dren, but not the onset of two-word combinations containing a verb
does, and does not, shape the course of language learning. (e.g. ‘open box’), which is predicted by the onset of supplementary
gesture þ speech combinations ( point at box þ ‘open’) [34].
We have also seen that when a child is prevented from 3
Interestingly, David treated iconic gestures serving two different
using the oral modality, that child can fall back on the noun functions in precisely the same way with respect to hand-
manual modality, creating gestures that assume many of shape—he used object handshapes in iconic gestures that serve a
the forms and functions of language. These homemade ges- nominal predicate function (e.g. that’s a bird), as well as in iconic ges-
ture systems constitute the first step in the emergence of a tures that serve a nominal argument function (e.g. that bird pedals).
This pattern suggests that noun is an overarching category in
manual sign system, which can, under the right circum-
David’s homesign system—an important finding in itself.
stances, become a fully-fledged language. Widening the 4
Although facial gestures have less potential for transparency than
lens to include the manual modality thus allows insight manual gestures, they may also offer a second window onto a speak-
into the skills children themselves bring to language learning er’s thoughts and thus predict learning.

References
1. Kendon A. 1980 Gesticulation and speech: 2. McNeill D. 1992 Hand and mind: what gestures sign language. In The handbook of child language
two aspects of the process of utterance. In reveal about thought. Chicago, IL: University of acquisition (eds WC Ritchie, TK Bhatia), pp. 531–567.
Relationship of verbal and nonverbal communication Chicago Press. New York, NY: Academic Press.
(ed. MR Key), pp. 207 –228. The Hague, 3. Lillo-Martin D. 1999 Modality effects and modularity 4. Newport EL, Meier RP. 1985 The acquisition of
The Netherlands: Mouton. in language acquisition: the acquisition of American American sign language. In The cross-linguistic study
Downloaded from rstb.royalsocietypublishing.org on October 17, 2014

of language acquisition, vol. 1: the data (ed. 22. Greenfield P, Smith J. 1976 The structure of 39. Demir OE, Levine S, Goldin-Meadow S. In press. 10
DI Slobin), pp. 881 –938. Hillsdale, NJ: Erlbaum. communication in early language development. A tale of two hands: development of narrative

rstb.royalsocietypublishing.org
5. Hoffmeister R, Wilbur R. 1980 Developmental: the New York, NY: Academic Press. structure in children’s speech and gesture. J. Child
acquisition of sign language. In Recent perspectives on 23. Guillaume P. 1927 Les debuts de la phrase dans le Language.
American sign language (eds H Lane, F Grosjean), pp. langage de l’enfant. J. Psychol. 24, 1–25. 40. Zwaan RA, Rapp DN. 2006 Discourse
61–78. Hillsdale, NJ: Erlbaum. 24. Leopold WF. 1939– 49 Speech development of a comprehension. In Handbook of psycholinguistics
6. Conrad R. 1979 The deaf child. London, UK: Harper bilingual child: a linguist’s record, vol. 1 –4. (eds M Traxler, MA Gernsbacher), pp. 725–764,
and Row. Evanston, IL: Northwestern University Press. 2nd edn. San Diego, CA: Elsevier.
7. Mayberry RI. 1992 The cognitive development of 25. Masur EF. 1982 Mothers’ responses to infants’ 41. Stein NL, Glenn CG. 1979 An analysis of story
deaf children: recent insights. In Child object-related gestures: influences on lexical comprehension in elementary children, vol. 2.
neuropsychology, handbook of neuropsychology, development. J. Child Lang. 9, 23– 30. (doi:10. Norwood, NJ: Ablex.
vol. 7 (eds S Segalowitz, I Rapin) (series 1017/S0305000900003585) 42. Sauer E, Levine SC, Goldin-Meadow S. 2010

Phil. Trans. R. Soc. B 369: 20130295


eds. F. Boller, J. Graffman), pp. 51 –68. Amsterdam, 26. Masur EF. 1983 Gestural development, dual- Early gesture predicts language delay in
The Netherlands: Elsevier. directional signaling, and the transition to words. children with pre- or perinatal brain lesions. Child
8. Emmorey K. 1999 Do signers gesture? In Gesture, J. Psycholinguist. Res. 12, 93 –109. (doi:10.1007/ Dev. 81, 528–539. (doi:10.1111/j.1467-8624.2009.
speech, and sign (eds LS Messing, R Campbell), BF01067406) 01413.x)
pp. 133 –159. Oxford, UK: Oxford University Press. 27. Morford M, Goldin-Meadow S. 1992 Comprehension 43. Özçalışkan S, Levine S, Goldin-Meadow S. 2013
9. Bates E. 1976 Language and context: the acquisition and production of gesture in combination with Gesturing with an injured brain: how gesture helps
of pragmatics. New York, NY: Academic Press. speech in one-word speakers. J. Child Lang. 19, children with early brain injury learn linguistic
10. Bates E, Benigni L, Bretherton I, Camaioni L, 559 –580. (doi:10.1017/S0305000900011569) constructions. J. Child Lang. 40, 69 –105. (doi:10.
Volterra V. 1979 The emergence of symbols: 28. Zinober B, Martlew M. 1985 Developmental changes in 1017/S0305000912000220)
cognition and communication in infancy. New York, four types of gesture in relation to acts and vocalizations 44. Broaders S, Cook SW, Mitchell Z, Goldin-Meadow S.
NY: Academic Press. from 10 to 21 months. Br. J. Dev. Psychol. 3, 293–306. 2007 Making children gesture brings out implicit
11. Özçalışkan S, Gentner D, Goldin-Meadow S. 2013 Do (doi:10.1111/j.2044-835X.1985.tb00981.x) knowledge and leads to learning. J. Exp. Psychol. Gen.
iconic gestures pave the way for children’s early 29. Goldin-Meadow S, Butcher C. 2003 Pointing toward 136, 539–550. (doi:10.1037/0096-3445.136.4.539)
verbs? Appl. Psycholinguist., 1–20. (doi:10.1017/ two-word speech in young children. In Pointing: 45. LeBarton ES, Raudenbush S, Goldin-Meadow S. In
S0142716412000720) where language, culture, and cognition meet press. Experimentally-induced increases in early
12. Iverson JM, Capirci O, Caselli MS. 1994 From (ed. S Kita), pp. 85 –107. Hillsdale, NJ: Erlbaum gesture lead to increases in spoken vocabulary.
communication to language in two modalities. Associates. J. Cogn. Dev. (doi:10.1080/15248372.2013.858041)
Cogn. Dev. 9, 23 –43. (doi:10.1016/0885- 30. Iverson JM, Capirci O, Volterra V, Goldin-Meadow S. 46. Goldfield BA, Reznick JS. 1990 Early lexical
2014(94)90018-3) 2008 Learning to talk in a gesture-rich world: early acquisition: rate, content, and the vocabulary spurt.
13. Acredolo LP, Goodwyn SW. 1988 Symbolic gesturing communication of Italian vs. American children. J. Child Lang. 17, 171–183. (doi:10.1017/
in normal infants. Child Dev. 59, 450 –466. (doi:10. First Lang. 28, 164 –181. (doi:10.1177/ S0305000900013167)
2307/1130324) 0142723707087736) 47. Werner H, Kaplan B. 1963 Symbol formation.
14. Rowe M, Özçalışkan S, Goldin-Meadow S. 2008 31. Rowe M, Goldin-Meadow S. 2009 Early gesture New York, NY: Wiley.
Learning words by hand: gesture’s role in predicting selectively predicts later language learning. Dev. Sci. 48. Csibra G, Gergely G. 2009 Natural pedagogy.
vocabulary development. First Lang. 28, 185–203. 12, 182–187. (doi:10.1111/j.1467-7687.2008.00764.x) Trends Cogn. Sci. 13, 148–153. (doi:10.1016/j.tics.
(doi:10.1177/0142723707088310) 32. Scarborough HS. 1990 Index of productive syntax. 2009.01.005)
15. Rowe M, Goldin-Meadow S. 2009 Differences in Appl. Psycholinguist. 11, 1–22. (doi:10.1017/ 49. Tomasello M, Carpenter M, Liszkowski U. 2007 A
early gesture explain SES disparities in child S0142716400008262) new look at infant pointing. Child Dev. 78,
vocabulary size at school entry. Science 323, 33. Dunn LM, Dunn LM. 1997 Peabody picture 705–722. (doi:10.1111/j.1467-8624.2007.01025.x)
951–953. (doi:10.1126/science.1167025) vocabulary test, 3rd edn. Circle Pines, MN: American 50. Woodward A, Guajardo J. 2002 Infants’
16. Colonnesi C, Stams GJJM, Koster I, Noom MJ. 2010 Guidance Service. understanding of the point gesture as an object-
The relation between pointing and language 34. Özçalışkan S, Goldin-Meadow S. 2005 Gesture is at directed action. Cogn. Dev. 17, 1061– 1084. (doi:10.
development: a meta-analysis. Dev. Rev. 30, the cutting edge of early language development. 1016/S0885-2014(02)00074-6)
352–366. (doi:10.1016/j.dr.2010.10.001) Cognition 96, B101 –B113. (doi:10.1016/j.cognition. 51. Yoon J, Johnson M, Csibra G. 2008 Communication-
17. Iverson JM, Goldin-Meadow S. 2005 Gesture paves 2005.01.001) induced memory biases in preverbal infants. Proc.
the way for language development. Psychol. Sci. 16, 35. Özçalışkan S, Goldin-Meadow S. 2009 When Natl Acad. Sci. USA 105, 13 690 –13 695. (doi:10.
368–371. (doi:10.1111/j.0956-7976.2005.01542.x) gesture–speech combinations do and do not 1073/pnas.0804388105)
18. Estigarribia B, Clark EV. 2007 Getting and index linguistic change. Lang. Cogn. Process. 24, 52. Kishimoto T, Shizawa Y, Yasuda J, Hinobayashi T,
maintaining attention in talk to young children. 190 –217. (doi:10.1080/01690960801956911) Minami T. 2007 Do pointing gestures by infants
J. Child Lang. 34, 799 –814. (doi:10.1017/ 36. Clark EV, Estigarribia B. 2011 Using speech and provoke comments from adults? Infant Behav. Dev.
S0305000907008161) gesture to introduce new objects to young children. 30, 562 –567. (doi:10.1016/j.infbeh.2007.04.001)
19. Goldin-Meadow S, Morford M. 1985 Gesture in early Gesture 11, 1 –23. (doi:10.1075/gest.11.1.01cla) 53. Clark EV. 2010 Adult offer, word-class, and child
child language: studies of deaf and hearing 37. Parise E, Csibra G. 2012 Electrophysiological uptake in early lexical acquisition. First Lang. 30,
children. Merrill Palmer Q. 31, 145– 176. evidence for the understanding of maternal speech 250–269. (doi:10.1177/0142723710370537)
20. Capirci O, Iverson JM, Pizzuto E, Volterra V. 1996 by 9-month-old infants. Psychol. Sci. 23, 728–733. 54. Golinkoff R. 1986 I beg your pardon? The preverbal
Communicative gestures during the transition to (doi:10.1177/0956797612438734) negotiation of failed messages. J. Child Lang. 13,
two-word speech. J. Child Lang. 23, 645 –673. 38. Cartmill E, Hunsicker D, Goldin-Meadow S. In press. 455–476. (doi:10.1017/S0305000900006826)
(doi:10.1017/S0305000900008989) Pointing and naming are not redundant: children 55. Goldin-Meadow S, Goodrich W, Sauer E, Iverson J.
21. de Laguna G. 1927 Speech: its function and use gesture to modify nouns before they modify 2007 Young children use their hands to tell their
development. Bloomington, IN: Indiana nouns in speech. Dev. Psychol. (doi:10.1037/ mothers what to say. Dev. Sci. 10, 778–785.
University Press. a0036003) (doi:10.1111/j.1467-7687.2007.00636.x)
Downloaded from rstb.royalsocietypublishing.org on October 17, 2014

56. Vygotsky L. 1986 Thought and language (A. Kozulin, 72. Hudson JA, Shapiro LR. 1991 From knowing to 85. Senghas A, Kita S, Ozyurek A. 2004 Children 11
transl.). Cambridge, MA: The MIT Press. (Original telling: the development of children’s scripts, creating core properties of language: evidence from

rstb.royalsocietypublishing.org
work published 1934) stories, and personal narratives. In Developing an emerging sign language in Nicaragua. Science
57. Goldin-Meadow S. 2003 The resilience of language: narrative structure (eds A McCabe, C Peterson), pp. 305, 1779– 1782. (doi:10.1126/science.1100199)
what gesture creation in deaf children can tell us 89 –136. Hillsdale, NJ: Lawrence Earlbaum 86. Goldin-Meadow S, So W-C, Ozyurek A, Mylander C.
about how all children learn language. New York, Associates, Publishers. 2008 The natural order of events: how speakers of
NY: Psychology Press. 73. Basso K. 1984 Stalking with stories: names, places, and different languages represent events nonverbally.
58. Feldman H, Goldin-Meadow S, Gleitman L. 1978 moral narratives among the Western Apache. In Text, Proc. Natl Acad. Sci. USA 105, 9163–9168. (doi:10.
Beyond Herodotus: the creation of language by play, and story: the construction and reconstruction of self 1073/pnas.0710060105)
linguistically deprived deaf children. In Action, symbol, and society (eds EM Bruner, S Plattner), pp. 19–55. 87. Goldin-Meadow S, Brentari D, Horton L, Coppola M,
and gesture: the emergence of language (ed. A Lock), Washington, DC: American Ethnological Society. Senghas A. In press. Watching language grow in the
pp. 351–414. New York, NY: Academic Press. 74. Göncü A, Jain J. 2000 Children’s myths and their manual modality: nominals, predicates and handshape.

Phil. Trans. R. Soc. B 369: 20130295


59. Hunsicker D, Goldin-Meadow S. Under review. significance. Hum. Dev. 43, 65 –68. (doi:10.1159/ 88. Klima E, Bellugi U. 1979 The signs of language.
Building sentential complexity with and without a 000022660) Cambridge, MA: Harvard University Press.
language model. 75. Miller PJ. 1994 Narrative practices: their role in 89. Liddell SK. 2000 Indicating verbs and pronouns:
60. Goldin-Meadow S, Butcher C, Mylander C, Dodge M. socialization and self-construction. In The pointing away from agreement. In The signs of
1994 Nouns and verbs in a self-styled gesture remembering self: construction and accuracy in the language revisited: an anthology to honor Ursula
system: what’s in a name? Cogn. Psychol. 27, self-narrative (eds U Neisser, R Fivush), pp. 158– Bellugi and Edward Klima (eds K Emmorey, H Lane),
259–319. (doi:10.1006/cogp.1994.1018) 179. New York, NY: Cambridge University Press. pp. 303–320. Mahway, NJ: Erlbaum Associates.
61. Macnamara J. 1982 Names for things. Cambridge, 76. Ochs E, Smith R, Taylor C. 1996 Detective stories at 90. Liddell SK, Metzger M. 1998 Gesture in sign
MA: The MIT Press. dinner time: problem solving through co-narration. In language discourse. J. Pragmat. 30, 657 –697.
62. Hunsicker D, Goldin-Meadow S. In press. How The matrix of language (eds D Brennis, RKS Macaulay), (doi:10.1016/S0378-2166(98)00061-7)
handshape can distinguish between nouns and pp. 39–55. Boulder, CO: Westview Press. 91. Goldin-Meadow S. 2003 Hearing gestures: how our
verbs in homesign. Gesture. 77. Kegl J, Senghas A, Coppola M. 1999 Creation hands help us think. Cambridge, MA: Harvard
63. Goldin-Meadow S, Mylander C. 1984 Gestural through contact: sign language emergence and sign University Press.
communication in deaf children: the effects and language change in Nicaragua. In Language creation 92. Perry M, Church RB, Goldin-Meadow S. 1988
non-effects of parental input on early language and language change: Creolization, diachrony, and Transitional knowledge in the acquisition of
development. Monogr. Soc. Res. Child. Dev, 49, development (ed. M DeGraff ), pp. 179–237. concepts. Cogn. Dev. 3, 359– 400. (doi:10.1016/
1– 121. (doi:10.2307/1165838) Cambridge, MA: MIT. 0885-2014(88)90021-4)
64. Goldin-Meadow S. 1985 Language development under 78. Goldin-Meadow S. 2010 Widening the lens on 93. Alibali MW, Goldin-Meadow S. 1993 Gesture–
atypical learning conditions: replication and language learning: language in deaf children and speech mismatch and mechanisms of learning:
implications of a study of deaf children of hearing adults in Nicaragua. Hum. Dev. 53, 301–308. what the hands reveal about a child’s state of mind.
parents. In Children‘s language, vol. 5 (ed. K Nelson), (doi:10.1159/000321294) Cogn. Psychol. 25, 468– 523. (doi:10.1006/cogp.
pp. 197–245. Hillsdale, NJ: Lawrence Erlbaum and 79. Coppola M, Newport E. 2005 Grammatical Subjects 1993.1012)
Associates. in homesign: abstract linguistic structure in adult 94. Church RB, Goldin-Meadow S. 1986 The mismatch
65. Goldin-Meadow S. 1982 The resilience of recursion: primary gesture systems without linguistic input. between gesture and speech as an index of
a study of a communication system developed Proc. Natl Acad. Sci. USA 102, 19 249–19 253. transitional knowledge. Cognition, 23, 43– 71.
without a conventional language model. In (doi:10.1073/pnas.0509306102) (doi:10.1016/0010-0277(86)90053-3)
Language acquisition: the state of the art (eds 80. Brentari D, Coppola M, Mazzoni L, Goldin-Meadow S. 95. Pine KJ, Lufkin N, Messer D. 2004 More gestures
E Wanner, LR Gleitman), pp. 51 –77. New York, NY: 2012 When does a system become phonological? than answers: children learning about balance.
Cambridge University Press. Handshape production in gesturers, signers, and Dev. Psychol. 40, 1059–1067. (doi:10.1037/0012-
66. Goldin-Meadow S. 2005 What language creation in homesigners. Nat. Lang. Linguist. Theory 30, 1–31. 1649.40.6.1059)
the manual modality tells us about the foundations (doi:10.1007/s11049-011-9145-1) 96. Ping R, Larson SW, Decatur M-A, Zinchenko E,
of language. Linguist. Rev. 22, 199 –225. (doi:10. 81. Coppola M, Senghas A. 2010 Deixis in an emerging Goldin-Meadow S. Under review. Gesture predicts
1515/tlir.2005.22.2-4.199) sign language. In Sign languages: a Cambridge readiness-to-learn in adults: the case of organic
67. Hunsicker D, Goldin-Meadow S. 2012 Hierarchical language survey (ed. D Brentari), pp. 543–569. chemistry.
structure in a self-created communication system: Cambridge, UK: Cambridge University Press. 97. Goldin-Meadow S, Shield A, Lenzen D, Herzig M,
building nominal constituents in homesign. Language 82. Senghas A, Ozyurek A, Goldin-Meadow S. 2010 The Padden C. 2012 The gestures ASL signers use tell us
88, 732–763. (doi:10.1353/lan.2012.0092) evolution of segmentation and sequencing: when they are ready to learn math. Cognition 123,
68. Brown R. 1973 A first language. Cambridge, MA: evidence from homesign and Nicaraguan Sign 448–453. (doi:10.1016/j.cognition.2012.02.006)
Harvard University Press. Language. In Proc. eighth evolution of language 98. Sommerville JA, Woodward AL, Needham A. 2005
69. Huttenlocher J, Waterfall H, Vasilyeva M, Vevea J, conference (eds ADM Smith, M Schouwstra, Action experience alters 3-month-old infants’
Hedges LV. 2010 Sources of variability in children’s B de Boer, K Smith), pp. 279–289. Singapore: perception of others’ actions. Cognition 96,
language growth. Cogn. Psychol. 61, 343–365. World Scientific Publishing Co. B1– B11. (doi:10.1016/j.cognition.2004.07.004)
(doi:10.1016/j.cogpsych.2010.08.002) 83. Senghas A. 2003 Intergenerational influence and 99. Goldin-Meadow S, Beilock SL. 2010 Action’s
70. Phillips SB, Goldin-Meadow S, Miller PJ. 2001 ontogenetic development in the emergence of influence on thought: the case of gesture.
Enacting stories, seeing worlds: similarities and spatial grammar in Nicaraguan Sign Language. Perspect. Psychol. Sci. 5, 664–674. (doi:10.1177/
differences in the cross-cultural narrative Cogn. Dev. 18, 511 –531. (doi:10.1016/j.cogdev. 1745691610388764)
development of linguistically isolated deaf children. 2003.09.006) 100. Cartmill EA, Beilock S, Goldin-Meadow S. 2012 A
Hum. Dev. 44, 311 –336. (doi:10.1159/000046153) 84. Senghas A, Coppola M. 2001 Children creating word in the hand: action, gesture, and mental
71. Peterson C, McCabe A. 1983 Developmental language: how Nicaraguan Sign Language acquired representation in human evolutions. Phil.
psycholinguistics: three ways of looking at a child’s a spatial grammar. Psychol. Sci. 12, 323 –328. Trans. R. Soc. B 367, 129– 143. (doi:10.1098/rstb.
narrative. New York, NY: Plenum. (doi:10.1111/1467-9280.00359) 2011.0162)

You might also like