Professional Documents
Culture Documents
[19]
[11]
Baker et al.
[54]
[45]
5,920,303
Patent Number:
Date of Patent:
Jul. 6, 1999
OTHER PUBLICATIONS
[75]
CA 94043.
1996.
[57]
References Cited
[56]
4,661,916
ABSTRACT
572977041
~~ 364/41915
can then provide the user With the ability to easily access
572997125
3/1994 Baker et a1
" 364/41908
5,309,546
5/1994
Baker et al. ..
..... .. 395/2
5,317,671
395/2
5,612,716
5,659,338
SPEECH
OP/CL
05.1. $
Poss.94
VERB 1
INTER-L
YOU
com.
ADVERB
&
gl
"m"
>
m/
2241.
6
NOUN
7
STORE
NQUN
0%
9 E59 STOR
,.
e e
I
1
git
A
Pig/1;?
c
BJZLN
P
J H
F9 g}
v
a I?
D .......... 3......
F.
mam/nu-
,3
FUNC INS
f2:
@gggg?gj<jjggic>
? g< 9
t
DIC'I
ADJ.
R w
2
513
{6
UUTFUI
PREP.
THEY Q: .
'
If?bl ggglu'
iii: 3,;
"FE?ch 1?;cl 52m;cr 7WORD
d: DEM. f] NOUN mugs}?
(
A.) SFK
NUMBER
SENT
I+WE+
A
345/133
SPEAK
Discs, SEAL-2LT
S Stem
g i @I] @
MARK W G
\
;\\
ESC
,
_
CALC
DELEI'E
Q1 Q. 42;.
(m
14 ji
DELETE
if 6113
55E
2 new
E G $5 CHAR.
DELETE
HELP
2755?: sH'Fr
582:
cm
ALI \No
YES
U.S. Patent
Jul. 6, 1999
Sheet 1 0f 16
5,920,303
3.
@F
\\
:2:F
2E
w9Sn? .
m
<
or
E052m
w#
m
w
\
M
Na
a
"n
HNamNzsowm
_
_
-1mM. "11.V
_
_
_
~
mwow"869mo%il n
"825E; uQz<5%
m
n:75><\N
._nYw5
m| _1/|r.
\9moE\$15E:
.5z9iw0
2 30
.mz<:u
U.S. Patent
Jul. 6, 1999
Sheet 2 0f 16
5,920,303
_-w9J.$9_
w
m
r
m_L/.JilAk
m
n
_
_
~I
i
h
k
w
9
W
9
u
m
\+51;@5 5;
w
11;
m
_
2P
m
W
n1
\T
w
v
A
i
W
%
A
m
9n
w
\.m"
>:z:W
<._n w_n
m
.
n
Il n
m
n
m
-..<\
n__.-iL_
m
m
_
<N
@E
5_QEo>w%zm/.<2omsi_\
U.S. Patent
Jul. 6, 1999
Sheet 4 0f 16
FIG. 3
5,920,303
U.S. Patent
Jul. 6, 1999
Sheet 5 0f 16
5,920,303
FIG. 4A
.p.
I
DISPLAY SYMBOLS
INDICATING VALID
CHOICES
O)
\\N
30
USER SELECTS
A KEY DISPLAYING
A SYMBOL
DISPLAY
MESSAGE
34
/
AND/ OR
MESSAGE
NO
OF DYNAMIC
CATEGORY 7
REPLACE PREVIOUS
SYMBOLS WITH NEW
SYMBOLS OF DYNAMIC
CATEGORY
U.S. Patent
Jul. 6, 1999
Sheet 6 0f 16
5,920,303
START
f42
I44
*CORFIESPONDING TO THE
KEY ACTIVATED
46
54
PROCESS
THE AccEssED
MESSAGE AS
APPROPRIATE
f48
ASSOCIATED MESSAGE
52
ACCESS THE MESSAGE
ASSOCIATED WITH THE
50
TEMPORARILY
STORED SEQUENCE
EXACTLY MATCH ANY
SEQUENCES
FIG. 4B
U.S. Patent
Jul. 6, 1999
Sheet 7 0f 16
5,920,303
0v..UE
\
mm8
6
GE"6mv
+
U.S. Patent
Jul. 6, 1999
Sheet 10 0f 16
5,920,303
FIG. 7A
72
/
DISPLAY SYMBOLS
I NDICATING VALID
CHOICES
74
v
USER SELECTS
A KEY DISPLAYING
A SYMBOL
78
DISPLAY
MESSAGE
I
82
NO
NO
SPEAK AND/ OR
DISPLAY MESSAGE
COMPLETION
OF DYNAMIC
CATEGORY 7
EMBELLISH SYMBOLS
SPECIFIC TO THE
DYNAMIC CATEGORY
U.S. Patent
Jul. 6, 1999
5,920,303
Sheet 11 0f 16
START
I
f88
1OO
fQO
92
/
PROCESS
THE ACCESSED
MESSAGE AS
APPROPRIATE
TEMPORARILY
STORED SEQUENCE
EXACTLY MATCH ANY
OF THE FIRST SET
OF STORED
96
f94
98
YES
OF FIG. 7%
FIG. 7B
U.S. Patent
Jul. 6, 1999
Sheet 12 0f 16
5,920,303
6EUN
81
9;
N:
2:m9
Q
6.omE
+
U.S. Patent
Jul. 6, 1999
Sheet 14 0f 16
5,920,303
FIG. 9A
0
DISPLAY SYMBOLS
INDICATING VALID
CHOICES
USER SELECTS
A KEY DISPLAYING
126
A SYMBOL
DISPLAY
MESSAGE
NO
SPEAK AND/ OR
DISPLAY MESSAGE
I
COMPLETION
OF DYNAMIC
CATEGORY 7
136
COMPLETION
OF DYNAMIC
SUBCATEGORY ?
YES
EMBELLISH SYMBOLS
SPECIFIC TO THE
DYNAMIC CATEGORIY
138
REPLACE PREVIOUSLY
DISPLAYED SYMBOLS
WITH NEW SYMBOLS OF
DYNAMIC SUBCATEGORY
I
U.S. Patent
Jul. 6, 1999
Sheet 15 0f 16
5,920,303
START
f14O
f142
CORRESPONDING TO THE
KEY ACTIVATED
152
PROCESS
THE ACCESSED
144
MESSAGE AS
APPROPRIATE
f146
ASSOCIATED MESSAGE
1/50
ACCESS THE MESSAGE
ASSOCIATED WITH THE
148
TEMPORARILY
STORED SEQUENCE
EXACTLY MATCH ANY
OF THE FIRST SET
OF STORED
YES
(95 OF FIG. 9%
U.S. Patent
Jul. 6, 1999
Sheet 16 0f 16
02
/
.GEOm
mm?
31
mm?
Q
6.ommm
+
5,920,303
NQ/
5,920,303
1
10
20
guage processing.
Thus, the aforementioned system of the Baker 916 patent
30
In such a system, the keyboard Was coupled to a 35 Would be a fringe Word. Some fairly common Words are
fringe Words for some individuals and some fairly obscure
computer, or Was alternately part of the stand alone entity
Words for the general population are core Words for other
Which included a microprocessor, memory and display. The
individuals.
memory stored the messages for selective retrieval by the
Normally, seven of eight Words in a typical sentence are
keyboard. The messages retrieved from the keyboard Were
then fed to a voice synthesiZer, for eXample, Which con 40 core Words for an individual and one Word is typically a
45
group.
If a seven-year old child With disabilities is not yet a
access thousands of Words or messages based upon as little 55 Walk across the desert, and What Will We see?, a child may
extremely difficult.
participant.
65
5,920,303
4
of Words.
dif?cult for the user to hit several different keys, but it Was
also very dif?cult for the user to navigate many different
menus of pictures to assemble a sentence of many individual
15
AAC.
prediction.
example.
HoWever, such systems became extremely dif?cult to use
fringe vocabulary.
It is still an even further object of the present invention to
Word please.
5,920,303
6
5
It is still another object of the present invention to
sented graphically.
Yet another object of the present invention is to provide a
15
prestored message.
displayed keyboard.
(a);
message;
comprising:
55
65