Microsoft v. Corel - Complaint

Case 5:15-cv-05836 Document 1 Filed 12/18/15 Page 1 of 39
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
Frank Scherkenbach (CA SBN 142549)

scherkenbach@fr.com
FISH & RICHARDSON P.C.
One Marina Park Drive
Boston, MA 02210-1878
Telephone: (617) 542-5070
Facsimile: (617) 542-8906
Jonathan J. Lamberson (SBN 239107)
lamberson@fr.com
500 Arguello Street, Suite 500
Redwood City, CA 94063
Telephone: (650) 839-5070
Facsimile: (650) 839-5071
John W. Thornburgh (CA SBN 154627)
thornburgh@fr.com
Olga I. May (CA SBN 232012)
omay@fr.com
12390 El Camino Real
San Diego, CA 92130
Telephone: (858) 678-5070
Facsimile: (858) 678-5099
Attorneys for Plaintiff
MICROSOFT CORPORATION
16
UNITED STATES DISTRICT COURT
17
NORTHERN DISTRICT OF CALIFORNIA
18
19
MICROSOFT CORPORATION,
Plaintiff,
20
21
22
23
24
25
26
27
28
v.
COREL CORPORATION AND COREL INC.,
Defendants.
Case No.
PLAINTIFF MICROSOFT
CORPORATIONS COMPLAINT FOR
PATENT INFRINGEMENT
DEMAND FOR JURY TRIAL
Plaintiff Microsoft Corporation (Microsoft), for its Complaint against Defendants
Corel Corporation and Corel Inc. (collectively Corel when it is not necessary to distinguish
between the two entities), alleges as follows:
4
5
INTRODUCTION
1.
Microsoft brings this action to protect its rights and investment in its innovations
embodied in utility U.S. Patent Nos. 8,255,828 (the 828 patent), 7,703,036 (the 036 patent),
7,047,501 (the 501 patent), 5,715,415 (the 415 patent), 5,510,980 (the 980 patent) and
design U.S. Patent Nos. D550,237 (the D237 patent), D554,140 (the D140 patent),
D564,532 (the D532 patent), and D570,865 (the D865 patent, collectively the Microsoft
10
11
Asserted Patents), copied by Corel into its infringing products.

2.
The Microsoft Asserted Patents are directed to, among other things, graphic user
12
interfaces used in productivity software applications, such as Microsoft Office. Microsoft has
13
given its interfaces, including menus and toolbars, a distinctive look and feel. The Microsoft
14
interfaces are recognizable and enjoy substantial goodwill. For example, Microsoft has introduced
15
and publicized the Microsoft Ribbona horizontal display of easily accessible and logically
16
grouped controls whose layout can be dynamically adjusted based on the screen size or object of
17
the program.
18
3.
Corel has copied the look and feel of the Microsoft interfaces in its accused
19
products. Among many examples, Help for WordPerfect X7 suggests that the user simulate the
20
Microsoft Word workspace until you are accustomed to work in WordPerfect:
21
22
23
24
25
26
27
28
1
COMPLAINT FOR PATENT INFRINGEMENT
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
2
4.
WordPerfect X7 offers an option to use it in the Microsoft Word mode:
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
3
1
2
5.
While in the Microsoft Word mode, WordPerfect X7 simulates the Microsoft Word
workspace by copying the look and feel of the Microsoft user interface:
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
4
1
2
6.
As another example, Help for Quattro Pro X7 suggests that the user simulate the
Microsoft Excel workspace until you are accustomed to working in Quattro Pro:
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
5
7.
Quattro Pro X7 offers the option to use it in the Microsoft Excel mode:
8.
While in the Microsoft Excel Mode, Quattro Pro X7 simulates the Microsoft Excel
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
workspace by copying the look and feel of the Microsoft Excel user interface:
17
18
19
20
21
22
23
24
25
26
27
28
6
9.
Corels advertising makes the copied Microsoft interfaces one of the central selling
points of Corels products: With a familiar Ribbon-style interface, Corel Office looks like the
office software youre used to, making it easy to get to work right away.
http://www.wordperfect.com/us/product/corel-office-software/
5
6
7
8
9
10
11
12
13
14
15
16
17
http://www.wordperfect.com/us/product/corel-office-
18
software/?showdialog=freeTrial&currency=en-US#tab3
19
10.
Corel has thus deliberately capitalized on the ready familiarity and rich
20
functionality of the Microsoft interfaces and has taken advantage of Microsofts years of effort and
21
hundreds of millions of dollars of investment in those interfaces.
22
11.
Microsoft has warned Corel on multiple occasions regarding its blatant copying of
23
the Microsoft interfaces. Despite those warnings, Corel has continued its infringement unabated.
24
Corels own actions are thus directly responsible for this lawsuit.
25
26
27
28
7
1
2
3
4
PARTIES
12.
Microsoft Corporation is a Washington corporation with a principal place of
business at One Microsoft Way, Redmond, Washington 98052-6399.

13.
On information and belief, Corel Corporation is a Canadian corporation with a
principal place of business at 1600 Carling Avenue Ottawa, Ontario, Canada K1Z 8R7. Corel
Corporation is in the business of making, selling, offering to sell, importing, licensing, and/or
distributing software.
8
9
14.
On information and belief, Corel Inc. is a Delaware corporation that has a principal
place of business at 385 Ravendale Drive, Mountain View, California 94043 and states its address
10
as 1600 Carling Avenue Ottawa, Ontario, Canada K1Z 8R7. Corel Inc. is in the business of
11
making, selling, offering to sell, importing, licensing, distributing software and/or providing
12
customer support or training.
13
14
15
16
JURISDICTION AND VENUE

15.
This is an action for patent infringement, over which this Court has subject matter
jurisdiction pursuant to 28 U.S.C. 1331 and 1338(a).

16.
This Court has personal jurisdiction over Corel Corporation for at least the
17
following reasons: (i) Corel Corporation has committed acts of patent infringement and/or
18
contributed to or induced acts of patent infringement by others in this District and continues to do
19
so; (ii) Corel Corporation regularly does business or solicits business, engages in other persistent
20
courses of conduct, and/or derives substantial revenue from products and/or services provided to
21
individuals in this District and in this State; and (iii) Corel Corporation has purposefully
22
established substantial, systematic and continuous contacts with this District and expects or should
23
reasonably expect to be subjected to this Courts jurisdiction.
24
17.
This Court has personal jurisdiction over Corel Inc. for at least the following
25
reasons: (i) Corel Inc. has committed acts of patent infringement and/or contributed to or induced
26
acts of patent infringement by others in this District and continues to do so; (ii) Corel Inc.
27
regularly does business or solicits business, engages in other persistent courses of conduct, and/or
28
derives substantial revenue from products and/or services provided to individuals in this District
8
and in this State; (iii) Corel Inc. has purposefully established substantial, systematic and
continuous contacts with this District and expects or should reasonably expect to be subjected to
this Courts jurisdiction; and (iv) Corel Inc. has designated an agent for service of process in the
State of California.
18.
Venue is proper in this judicial District pursuant to 28 U.S.C. 1391 (b)-(c) and
1400(b) because Corel does business in the State of California and in this District, has committed
acts of infringement in this State and in this District, is subject to personal jurisdiction in this
District, and a substantial part of the events or omissions giving rise to this claim has occurred in
this District.
10
11
12
INTRADISTRICT ASSIGNMENT
19.
Pursuant to Civil L.R. 3-2(c), this case is appropriate for assignment on a district-
wide basis because this is an Intellectual Property Action.
13
FACTUAL BACKGROUND
14
A.
Microsoft and Corel
15
20.
Microsoft is a technology company whose mission is to empower every person and
16
every organization on the planet to achieve more. Founded in 1975, Microsoft operates worldwide
17
and has offices in more than 100 countries. Microsoft develops, licenses, and supports a wide
18
range of software products, services, and devices that deliver new opportunities, greater
19
convenience, and enhanced value to peoples lives. Microsoft offers an array of services to
20
consumers and businesses. Microsofts products include the Windows operating system and
21
Microsoft Office, among many others.
22
21.
Corel Corporation is a Canadian corporation founded in 1985. Corel initially sold
23
CorelDRAW, a graphics editor. Over the following decades, Corel acquired more editing
24
programs and a variety of other software. In 1996, Corel acquired from Novell Inc. the
25
WordPerfect word-processor, Quattro Pro spreadsheet (originally developed by Borland), and the
26
PerfectOffice application suite of productivity software. In 2004, Corel purchased Jasc Software,
27
including its graphics editor Paint Shop Pro. In 2006, Corel acquired Ulead, including its digital
28
9
video editor VideoStudio. On information and belief, Corel licensed the Corel Home Office from
a vendor.
B.
The Microsoft Asserted Patents
22.
The invention of Microsofts 828 patent is related to one aspect of the Microsoft
Ribbon. The invention allows the computer to display controls logically grouped by tabs, and to
adjust the layout based on the size of the screen.
23.
The invention of Microsofts 036 patent focuses on another aspect of the
Microsoft Ribbon. Editing certain objects within a program, for example a picture or a table, may
require access to numerous features specific to that type of editing. The invention automatically
10
makes controls particular to that object visibly available while the user is working on it.
11
24.
Commands on a graphic user interface may be contained in (i) menus which
12
typically display commands through words and require the user to open the right drop-down
13
menu, find and select the needed menu item, or (ii) in toolbars, which display commands through
14
icons and make them accessible with one click, but may require more screen space. The invention
15
of Microsofts 501 patent allows users to customize command organization by letting the user
16
drag and drop commands anywhere the user chooses.
17
25.
Users often welcome helpful instructions or suggestions while working in an
18
application. The invention of Microsofts 415 patent conveniently makes the Help pane part of
19
the active application window for easy access and learning without disrupting the application
20
focus.
21
26.
Spreadsheet programs, such as Microsoft Excel, allow users to perform calculations
22
by using functionspre-written formulas that perform operations on the data in the spreadsheet.
23
Using a function may require the user to go through several steps of manually selecting the cells
24
with data and entering the appropriate functions. To simplify and speed up this process, the
25
invention of Microsofts 980 patent automatically searches the cells surrounding a cell containing
26
a sum function and performs the function on appropriate data.
27
28
27.
The D237, D140, D532, and D865 design patents cover distinctive ornamental
designs for parts of Microsoft user interfaces, including the Microsoft Ribbon.
10
28.
Microsoft owns all rights, titles, and interests in and to the Microsoft Asserted
Patents, including the exclusive right to bring suit with respect to any past, present, and future
infringement.
29.
Each of the Microsoft Asserted Patents is valid and enforceable.
C.
Corels Knowledge of the Microsoft Asserted Patents
6
7
8
9
1.
30.
Knowledge of the Microsoft Ribbon patents
The Microsoft Asserted 828, 036, D237, D140, D532, and D865 Patents relate
to the Microsoft Ribbon technology and design.

31.
On October 8, 2009, in Redmond, WA, several members of Microsoft management
10
met with Jimi Duff, Corels Microsoft Alliance manager; and Graham Brown, Corels Chief
11
Technical Officer, who joined by teleconference. During the meeting Microsoft raised its
12
concerns regarding potential violation of Microsofts intellectual property rights by Corels
13
unlicensed use of the Microsoft Ribbon technology and design in the Corel Home Office.
14
32.
In November 2009, Microsoft spoke with Corel about the same issues again. Four
15
individuals from Corel participated by telephone, including Corels in-house counsel and Vice-
16
President of Engineering. Microsoft reiterated its concerns regarding Corels violation of
17
Microsofts patent rights related to the Microsoft Ribbon and the need for Corel to license the
18
patents if Corel wanted to use the Microsoft technology.
19
33.
In February 2010, Microsoft contacted Eleanor Lacy, Corels new General
20
Counsel. Microsoft requested an introduction to the vendor that had developed and was licensing
21
Corel Home Office to Corel, so that Microsoft could discuss intellectual property issues and the
22
Windows Ribbon Framework opportunity with the vendor.
23
24
25
34.
In March 2010, Microsoft reached out to Eleanor Lacy again, but received no
response.
35.
After Microsoft repeatedly contacted Corel, including Corels technology officers
26
and in-house counsel, about potential infringement of the Microsoft patent rights, on information
27
and belief, Corel reviewed Microsofts related patents and applications.
28
11
36.
On information and belief, Corel was aware that Microsofts licensing program for
the Microsoft Office User Interface contained a specific exclusion for competitors use of that
interface:
4
5
6
7
8
9
10
11
12
http://blogs.msdn.com/b/jensenh/archive/2006/11/21/licensing-the-2007-microsoft-office-user-
13
interface.aspx. Information about the terms of this licensing program was included with Microsoft
14
products and was publicly available since at least 2006. On information and belief, since at least
15
2006, Corel knew of this policy and this exclusion and knew that Corel needed a license to the
16
patents related to Microsoft interfaces if Corel wanted to use those interfaces in its products.
17
37.
On information and belief, Corel was therefore aware, prior to the filing of this
18
lawsuit, of at least the 828, 036, D237, D140, D532, and D865 Patents that relate to the
19
Microsoft Ribbon technology and design. Alternatively, Corel was at least willfully blind as to the
20
existence of these patents.
21
22
23
24
2.
38.
Knowledge of Microsofts Patent Portfolio
Corel is a competitor of Microsoft in the market for productivity applications,
including word processors, spreadsheets, and presentation programs.

39.
On information and belief, Corel possesses the expertise required to understand the
25
scope of inventions claimed in the Microsoft Asserted Patents and patents related to graphic user
26
interfaces.
27
40.
28
On information and belief, Corel has followed Microsofts patent portfolio related
to productivity applications as Microsoft has obtained its patents.

12
41.
On information and belief, Corel reviewed each published application, if one was
published, for each of the Microsoft Asserted Patents promptly upon its publication, followed up
on the application to find out if it issued as a patent, and reviewed the specification and claims of
each of the Microsoft Asserted Patents promptly upon its issuance. Alternatively, Corel was at
least willfully blind as to the existence of the Microsoft Asserted Patents.
6
7
3.
42.
Knowledge of the 828 patent
Provisional application No. 60/601,815 for the 828 patent was filed on August 16,
2004. Application No. 10/955,967 was filed on September 30, 2004 and was published as U.S.
Application No. 2006/0036965 on February 16, 2006. The 828 patent issued on August 28, 2012.
10
43.
On information and belief, Corel has had knowledge of the pending and/or
11
published application for the 828 patent since at least February 16, 2006 (when it was published
12
as Application No. 2006/0036965) and/or October 2009March 2010 (when Microsoft
13
approached Corel regarding its Ribbon technology), and Corel has had knowledge of the 828
14
patent since at least the date of the patent issuance on August 28, 2012. Alternatively, Corel has
15
had knowledge of the 828 patent since at least the filing of this Complaint.
16
17
4.
44.
Provisional application No. 60/601,815 for the 036 patent was filed on August 16,
18
2004. Application No. 10/955,941 was filed on September 30, 2004 and was published as U.S.
19
Application No. 2006/0036964 on February 16, 2006. The 036 patent issued on April 20, 2010.
20
45.
On information and belief, Corel has had knowledge of the pending and/or
21
published application for the 036 patent since at least February 16, 2006 (when it was published
22
as U.S. Application No. 2006/0036964) and/or October 2009March 2010 (when Microsoft
23
approached Corel regarding its Ribbon technology), and Corel has had knowledge of the 036
24
patent since at least the date of the patent issuance on April 20, 2010. Alternatively, Corel has had
25
knowledge of the 828 patent since at least the filing of this Complaint.
26
5.
27
46.
28
Complaint.
Corel has had knowledge of the 501 patent since at least the filing of this
13
6.
47.
Complaint.
4
5
Corel has had knowledge of the 415 patent since at least the filing of this
7.
48.
The 980 patent issued on April 23, 1996. On information and belief, Corel has
had knowledge of Microsofts rights in the 980 patent since at least the date of its issuance on
April 23, 1996, and no later than 2000, when the parties had confidential interactions that cannot
be detailed in this public filing. As a result of these interactions, in 2000, Corel was aware that it
needed a license to the 980 patent for Corels products. Corel is also aware or should be aware
10
that it does not currently have a license to the 980 patent.
11
8.
Knowledge of the D237 patent
12
49.
The D237 patent issued on September 4, 2007.
13
50.
On information and belief, Corel has had knowledge of the D237 patent since at
14
least September 4, 2007 (the date it issued) and/or October 2009March 2010 (when Microsoft
15
approached Corel regarding its Ribbon technology). Alternatively, Corel has had knowledge of
16
the D237 patent since at least the filing of this Complaint.
17
9.
18
51.
The D140 patent issued on October 30, 2007.
19
52.
20
least October 30, 2007 (the date it issued) and/or October 2009March 2010 (when Microsoft
21
22
23
10.
24
53.
The D532 patent issued on March 18, 2008.
25
54.
26
least March 18, 2008 (the date it issued) and/or October 2009March 2010 (when Microsoft
27
28

14
11.
55.
The D865 patent issued on June 10, 2008.
56.
least June 10, 2008 (the date it issued) and/or October 2009March 2010 (when Microsoft
D.
Corel Infringed and Continues to Infringe Each of the Microsoft Asserted

Patents
57.
Corel does not currently have a license to any of the Microsoft Asserted Patents.
10
58.
The allegations with respect to each asserted patent claim, each accused product,
11
and each specific accused feature are exemplary. Discovery has not yet begun. Microsoft
12
reserves the right to assert additional claims, accuse additional products, and accuse additional
13
features.
14
CLAIMS FOR RELIEF
15
FIRST CLAIM FOR RELIEF
16
Infringement of the 828 Patent
17
18
19
59.
Microsoft incorporates by reference the allegations of the preceding paragraphs of
its Complaint.
60.
The 828 patent is entitled Command User Interface for Displaying Selectable
20
Software Functionality Controls. A true and correct copy of the 828 patent is attached to this
21
Complaint as Exhibit A.
22
61.
Corel has directly infringed and continues to infringe at least claim 1 of the 828
23
patent by making, using, testing, selling, licensing, offering for sale within the United States
24
and/or importing into the United States at least the following products: Corel Home Office,
25
including Corel Write, Corel Calculate, and Corel Show, and CorelCAD 2014 - 2016 (collectively
26
the 828 Accused Products).
27
28
62.
The 828 Accused Products provide Ribbon menus with logically grouped controls
whose layout can be dynamically adjusted, for example as shown below:

15
1
2
3
4
5
6
7
8
9
10
11
12
13
14
63.
Users of computing devices, including, for example, desktop, laptop, and tablet
15
computers, who use, test, sell, license, offer for sale within the United States and/or import into the
16
United States the 828 Accused Products on such devices, have infringed and continue to infringe
17
at least claim 1 of the 828 patent. Corel is and has been aware of these activities and
18
infringement.
19
64.
Corel has knowingly induced and continues to induce users of computing devices
20
to infringe the 828 patent, including by intentionally developing, making, marketing, advertising,
21
and/or providing the software, documentation, materials, training or support and aiding, abetting,
22
encouraging, promoting or inviting use thereof. (See, e.g.,
23
http://www.wordperfect.com/us/product/corel-office-software/#tab1 (promoting Corel Office
24
which includes Corel Write, Corel Calculate, and Corel Show); http://www.corel.com/us/free-
25
trials/?hptrack=mmtry (Try Corel software for free. No risk. No obligation. No credit card
26
required!); http://www.corel.com/us/support/?hptrack=mmsup (Corel Customer Service can
27
assist you with orders, product registration, and any questions you may have.);
28
http://learn.corel.com/?hptrack=mmlrn (Youll love these tips & tutorials).)

16
65.
Corel has contributed and continues to contribute to the infringement of the 828
patent by users of computing devices, including, for example, desktop, laptop, and tablet
United States the 828 Accused Products on such devices, by providing the software and related
documentation, materials, marketing, advertising, training or support. For example, each of the
828 Accused Products provides Ribbon menus with logically grouped controls whose layout can
be dynamically adjusted and constitutes a material part of the invention of the 828 patent. Corel
knows and has known that this functionality is especially made or especially adapted for use in the
infringement of the 828 patent, and is not a staple article or commodity of commerce suitable for
10
11
substantial noninfringing use.

66.
Corels infringement is and has been willful, deliberate and intentional. On
12
information and belief, Corel had pre-suit knowledge of the Microsoft 828 patent no later than
13
August 28, 2012 and deliberately copied the above-described patented functionality into its
14
products. To attract customers, Corels advertising emphasizes that Corel products mimic the
15
Ribbon interfaces of Microsoft products. Corel products suggest that customers simulate the look
16
and feel of Microsoft user interfaces. Corel has acted and continues to act in disregard of an
17
objectively high likelihood that its actions constituted direct and indirect infringement of a valid
18
patent, and knew or should have known of that objectively high risk.
19
SECOND CLAIM FOR RELIEF
20
21
22
23
67.
its Complaint.
68.
The 036 patent is entitled User Interface for Displaying Selectable Software
24
Functionality Controls that Are Relevant to a Selected Object. A true and correct copy of the
25
036 patent is attached to this Complaint as Exhibit B.
26
69.
27
28
17
including Corel Write, Corel Calculate, and Corel Show, and CorelCAD 2015 2016 (collectively
the 036 Accused Products).
70.
The 036 Accused Products provide Ribbon menus with logically grouped controls
that provide additional controls upon selection of an object for editing, for example as shown
below:
6
7
8
9
10
11
12
13
14
15
16
17
18
19
71.
20
21
22
23
infringement.
24
72.
25
to infringe the 036 patent, including by intentionally developing, making, marketing, advertising,
26
and/or providing the software, documentation, materials, training or support and aiding, abetting,
27
encouraging, promoting or inviting use thereof. (See, e.g.,
28

18
73.
Corel has contributed and continues to contribute to the infringement of the 036
United States the 036 Accused Products on such devices, by providing the necessary software and
10
related documentation, materials, marketing, advertising, training or support. For example, each
11
of the 036 Accused Products contains Ribbon menus with logically grouped controls that provide
12
additional controls upon selection of an object for editing and constitutes a material part of the
13
invention of the 036 patent. Corel knows and has known that this functionality is especially made
14
or especially adapted for use in the infringement of the 036 patent, and is not a staple article or
15
commodity of commerce suitable for substantial noninfringing use.
16
74.
17
information and belief, Corel had pre-suit knowledge of the Microsoft 036 patent since at least
18
October 2009March 2010 and no later than April 20, 2010 and deliberately copied the above-
19
described patented functionality into its products. To attract customers, Corels advertising
20
emphasizes that Corel products mimic the Ribbon interfaces of Microsoft products. Corel
21
products suggest that customers simulate the look and feel of Microsoft user interfaces. Corel has
22
acted and continues to act in disregard of an objectively high likelihood that its actions constituted
23
direct and indirect infringement of a valid patent, and knew or should have known of that
24
objectively high risk.
25
THIRD CLAIM FOR RELIEF
26
27
28
75.
its Complaint.
19
76.
The 501 patent is entitled Method for Displaying Controls in a System Using a
Graphical User Interface. A true and correct copy of the 501 patent is attached to this Complaint
as Exhibit C.
77.
including Corel Write, Corel Calculate, and Corel Show; CorelDRAW X7; and WordPerfect
Office X5 and X7, including WordPerfect X5 and X7, Quattro Pro X5 and X7, and Presentations
X5 and X7 (collectively the 501 Accused Products).
10
11
78.
The 501 Accused Products allow the user to customize a command bar by
dragging and dropping controls from a list, for example as shown below:
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
20
79.
infringement since at least the filing of this Complaint.
80.
Corel induces users of computing devices to infringe the 501 patent, including by
intentionally developing, making, marketing, advertising, and/or providing the software,
documentation, materials, training or support and aiding, abetting, encouraging, promoting or
inviting use thereof. (See, e.g., http://www.wordperfect.com/us/product/corel-office-
10
software/#tab1 (promoting Corel Office which includes Corel Write, Corel Calculate, and Corel
11
Show); http://www.corel.com/us/free-trials/?hptrack=mmtry (Try Corel software for free. No
12
risk. No obligation. No credit card required!); http://www.corel.com/us/support/?hptrack=mmsup
13
(Corel Customer Service can assist you with orders, product registration, and any questions you
14
may have.); http://learn.corel.com/?hptrack=mmlrn (Youll love these tips & tutorials).)
15
81.
Corel contributes to the infringement of the 501 patent by users of computing
16
devices, including, for example, desktop, laptop, and tablet computers, who use, test, sell, license,
17
offer for sale within the United States and/or import into the United States the 501 Accused
18
Products on such devices, by providing the necessary software and related documentation,
19
materials, marketing, advertising, training or support. For example, each of the 501 Accused
20
Products allows to customize a command bar by dragging and dropping controls from a list and
21
constitutes a material part of the invention of the 501 patent. Corel knows that this functionality
22
is especially made or especially adapted for use in the infringement of the 501 patent, and is not a
23
staple article or commodity of commerce suitable for substantial noninfringing use.
24
FOURTH CLAIM FOR RELIEF
25
26
27
28
82.
its Complaint.
83.
The 415 patent is entitled Computer Application with Help Pane Integrated into
21
Workspace. A true and correct copy of the 415 patent is attached to this Complaint as Exhibit D.
84.
Corel has directly infringed and continues to infringe at least claims 1-2, 8, and 10
of the 415 patent by making, using, testing, selling, licensing, offering for sale within the United
States and/or importing into the United States at least the following products: Word Perfect X5
and X7.
85.
Corel has directly infringed and continues to infringe at least claims 1-3, 8, and 10
of the 415 patent by making, using, testing, selling, licensing, offering for sale within the United
States and/or importing into the United States at least the following products: CorelDRAW X7.
86.
10
11
and/or importing into the United States at least the following products: Presentations X7.
12
13
87.
The above-listed products meeting the above-listed claims of the 415 patent are
hereinafter collectively referred to as the 415 Accused Products.
14
88.
The 415 Accused Products display help content in a pane that is part of the
15
application window and does not take the focus away from the window, for example as shown
16
below:
17
18
19
20
21
22
23
24
25
26
27
28
22
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
89.
22
23
24
at least claims 1-3, 8, and 10 of the 415 patent. Corel is and has been aware of these activities
25
and infringement since at least the filing of this Complaint.
26
90.
Corel induces users of computing devices to infringe the 415 patent, including by
27
intentionally developing, making, marketing, advertising, and/or providing the software,
28
documentation, materials, training or support and aiding, abetting, encouraging, promoting or

23
inviting use thereof. (See, e.g., http://www.corel.com/us/free-trials/?hptrack=mmtry (Try Corel
software for free. No risk. No obligation. No credit card required!);
http://www.corel.com/us/support/?hptrack=mmsup (Corel Customer Service can assist you with
orders, product registration, and any questions you may have.);
91.
Corel contributes to the infringement of the 415 patent by users of computing
10
11
Products displays help content in a pane that is part of the application window without taking the
12
focus away from the window, and constitutes a material part of the invention of the 415 patent.
13
Corel knows that this functionality is especially made or especially adapted for use in the
14
infringement of the 415 patent, and is not a staple article or commodity of commerce suitable for
15
substantial noninfringing use.
16
FIFTH CLAIM FOR RELIEF
17
18
19
20
92.
its Complaint.
93.
The 980 patent is entitled Method and System for Selecting and Executing
21
Arithmetic Functions and the Like. A true and correct copy of the 980 patent is attached to this
22
Complaint as Exhibit E.
23
94.
Corel has directly infringed at least claim 1 of the 980 patent by making, using,
24
testing, selling, licensing, offering for sale within the United States and/or importing into the
25
United States at least the following products: Quattro Pro X5 and Corel Calculate (the 980
26
Accused Products).
27
28
95.
The 980 Accused Products allow the software to automatically select cells in a
spreadsheet to perform a sum function, for example as shown below:

24
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
96.
16
17
United States the 980 Accused Products on such devices, have infringed at least claim 1 of the
18
980 patent. Corel is and has been aware of these activities and infringement.
19
97.
Corel has knowingly induced users of computing devices to infringe the 980
20
patent, including by intentionally developing, making, marketing, advertising, and/or providing
21
the software, documentation, materials, training or support and aiding, abetting, encouraging,
22
promoting or inviting use thereof. (See, e.g.,
23
http://www.wordperfect.com/static/landing_pages/16900020/QP_2.pdf (Quattro Pro offers over
24
500 functions: built-in calculations that you can use withinor instead ofmath formulas.);
25
http://www.corel.com/us/free-trials/?hptrack=mmtry (Try Corel software for free. No risk. No
26
obligation. No credit card required!); http://www.corel.com/us/support/?hptrack=mmsup (Corel
27
Customer Service can assist you with orders, product registration, and any questions you may
28
have.); http://learn.corel.com/?hptrack=mmlrn (Youll love these tips & tutorials).)

25
98.
Corel has contributed to the infringement of the 980 patent by users of computing
Products allows to automatically select cells in a spreadsheet to perform a sum function and
constitutes a material part of the invention of the 980 patent. Corel knows that this functionality
is especially made or especially adapted for use in the infringement of the 980 patent, and is not a
staple article or commodity of commerce suitable for substantial noninfringing use.
10
99.
Corels infringement has been willful, deliberate and intentional. On information
11
and belief, Corel had pre-suit knowledge of the Microsoft 980 patent no later than 2000 and
12
deliberately copied the above-described patented functionality into its products. To attract
13
customers, Corels advertising emphasizes that Corel products mimic the graphic user interfaces
14
of Microsoft products. Corel products suggest that customers simulate the look and feel of
15
Microsoft user interfaces. Corel has acted in disregard of an objectively high likelihood that its
16
actions constituted direct and indirect infringement of a valid patent, and knew or should have
17
known of that objectively high risk.
18
SIXTH CLAIM FOR RELIEF
19
Infringement of the D237 patent
20
21
22
23
24
100.
its Complaint.
101.
The D237 patent is entitled User Interface for a Portion of a Display Screen. A
true and correct copy of the D237 patent is attached to this Complaint as Exhibit F.
102.
Corel has directly infringed and continues to infringe the D237 patent by making,
25
using, testing, selling, licensing, offering for sale within the United States and/or importing into
26
the United States at least the following products: Corel Home Office, including Corel Write,
27
Corel Calculate, and Corel Show (collectively the D237 Accused Products), that incorporate a
28
26
user interface for a portion of a display screen identical to the D237 patented design, for example
as shown below:
3
4
The D237 patent
5
6
7
8
9
10
11
12
13
Corel Write:
14
15
16
17
18
Corel Calculate:
19
20
21
22
Corel Show:
23
24
25
26
27
28
27
103.
United States the D237 Accused Products on such devices, have infringed and continue to
infringe the D237 patent. Corel is and has been aware of these activities and infringement.
104.
to infringe the D237 patent, including by intentionally developing, making, marketing,
advertising, and/or providing the software, documentation, materials, training or support and
aiding, abetting, encouraging, promoting or inviting use thereof. (See, e.g.,
10
11
12
13
14
15
105.
Corel has contributed and continues to contribute to the infringement of the D237
16
17
18
United States the D237 Accused Products on such devices, by providing the necessary software
19
and related documentation, materials, marketing, advertising, training or support. For example,
20
the above-shown design included in the D237 Accused Products is a material component of the
21
patented design. Corel knows and has known that this design is especially made or especially
22
adapted for use in the infringement of the D237 patent, and is not a staple article or commodity of
23
commerce suitable for substantial noninfringing use.
24
106.
25
information and belief, Corel had pre-suit knowledge of the Microsoft D237 patent no later than
26
October 2009March 2010 and deliberately copied the above-described patented functionality
27
into its products. To attract customers, Corels advertising emphasizes that Corel products mimic
28
the Ribbon interfaces of Microsoft products. Corel products suggest that customers simulate the
28
look and feel of Microsoft user interfaces. Corel has acted and continues to act in disregard of an
SEVENTH CLAIM FOR RELIEF
Infringement of the D140 Patent
6
7
8
9
10
107.
its Complaint.
108.
true and correct copy of the D140 patent is attached to this Complaint as Exhibit G.
109.
11
12
the United States at least the following products: Corel Home Office, including Corel Write,
13
Corel Calculate, and Corel Show (collectively the D140 Accused Products), that incorporate a
14
user interface for a portion of a display screen identical to the D140 patented design, for example
15
as shown below:
16
17
The D140 patent
18
19
20
21
22
23
24
25
26
27
28
29
1
2
Corel Write:
3
4
5
6
7
8
9
10
Corel Calculate:
11
12
13
14
15
16
17
18
Corel Show:
19
20
21
22
23
24
25
26
27
28
30
110.
111.
10
11
12
13
14
15
112.
16
17
18
19
20
21
22
23
24
113.
25
26
27
28
31
EIGHTH CLAIM FOR RELIEF
6
7
8
9
10
114.
its Complaint.
115.
true and correct copy of the D532 patent is attached to this Complaint as Exhibit H.
116.
11
12
the United States at least the following product: CorelCAD 2014 - 2016 (collectively the D532
13
Accused Products), that incorporates a user interface for a portion of a display screen identical to
14
the D532 patented design, for example as shown below:
15
16
17
The D532 patent
18
19
20
21
CorelCAD:
22
23
24
25
26
27
28
32
117.
118.
http://www.coreldraw.com/us/product/cad-software/?&gclid=CIOBja6wv8kCFSISfgodJ9MJRA
10
(promoting Corel CAD); http://www.corel.com/us/free-trials/?hptrack=mmtry (Try Corel
11
12
13
14
15
119.
16
17
18
19
20
21
22
23
24
120.
25
26
27
28
33
NINTH CLAIM FOR RELIEF
6
7
8
9
10
121.
its Complaint.
122.
true and correct copy of the D865 patent is attached to this Complaint as Exhibit I.
123.
11
12
the United States at least the following product: Corel Home Office, including Corel Write, Corel
13
Calculate, and Corel Show (the D865 Accused Products), that incorporates a user interface for
14
a portion of a display screen identical to the D865 patented design, for example as shown below:
15
16
17
The D865 patent
18
19
20
21
22
23
24
25
26
27
28
34
1
Corel Write:
2
3
4
5
6
7
8
9
10
Corel Calculate:
11
12
13
14
15
16
17
Corel Show:
18
19
20
21
22
23
24
124.
25
26
27
28
35
125.
which includes Corel Show); http://www.corel.com/us/free-trials/?hptrack=mmtry (Try Corel
10
11

126.
12
13
14
15
16
17
18
19
20
127.
21
22
23
24
25
26
27
28
36
E.
Corels Infringement Has Caused and Will Continue to Cause Injury to

Microsoft
128.
Corels infringement of each of the Microsoft Asserted Patents as pleaded above
2
3
4
5
has caused injury to Microsoft in the past and will continue to cause injury in the future.
129.
Microsoft is entitled to recover damages adequate to compensate for Corels
infringement, in an amount to be determined at trial. Such damages shall be in no event less than
a reasonable royalty and should include lost profits and/or disgorgement of profits, to the extent
permitted by law.
PRAYER FOR RELIEF
10
WHEREFORE, Microsoft prays that this Court enter judgment and provide relief as
11
follows:
12
(a)
That Corel has directly infringed the Microsoft Asserted Patents;
13
(b)
That Corel has induced infringement of the Microsoft Asserted Patents;
14
(c)
That Corel has contributed to the infringement of the Microsoft Asserted Patents;
15
(d)
That Corel has willfully infringed the 828, 036, 980, D237, D140, D532, and
16
17
D865 Microsoft Asserted Patents;

(e)
That Corel be ordered to account for and pay to Microsoft the damages resulting
18
from Corels infringement of the Microsoft Asserted Patents, together with interest and costs, and
19
all other damages permitted by 35 U.S.C. 284 and/or 289, including enhanced damages up to
20
three times the amount of damages found or measured, and further including an accounting for
21
infringing sales not presented at trial and an award by the court of additional damages for any such
22
infringing sales;
23
(f)
That this case, including Corels prosecution of its claims, be declared exceptional
24
and Microsoft be awarded its costs, expenses, and reasonable attorneys fees in this action
25
pursuant to 35 U.S.C. 285; and
26
27
(g)
That Microsoft be awarded such other equitable or legal relief as this Court deems
just and proper under the circumstances.
28
37
1
2
DEMAND FOR JURY TRIAL

Pursuant to Federal Rule of Civil Procedure 38, Microsoft demands a jury trial on all issues
so triable.
Dated: December 18, 2015
By: /s/ Olga I. May
Frank Scherkenbach (CA SBN 142549)

scherkenbach@fr.com
One Marina Park Drive
Boston, MA 02210-1878
Telephone: (617) 542-5070
Facsimile: (617) 542-8906
7
8
9
10
Jonathan J. Lamberson (SBN 239107)

lamberson@fr.com
500 Arguello Street, Suite 500
Redwood City, CA 94063
Telephone: (650) 839-5070
Facsimile: (650) 839-5071
11
12
13
14
John W. Thornburgh (CA SBN 154627)

thornburgh@fr.com
Olga I. May (CA SBN 232012)
omay@fr.com
12390 El Camino Real
San Diego, CA 92130
Telephone: (858) 678-5070
Facsimile: (858) 678-5099
15
16
17
18
19
Attorneys for Plaintiff Microsoft Corporation
20
21
22
23
24
25
26
27
28
38
Case 5:15-cv-05836 Document 1-1 Filed 12/18/15 Page 1 of 27
Exhibit A
Illlll llllllll Ill lllll lllll lllll lllll lllll 111111111111111111111111111111111

US008255828B2
c12)
United States Patent
(IO)
Harris et al.
(45)
(54)
COMMAND USER INTERFACE FOR

DISPLAYING SELECTABLE SOFTWARE
FUNCTIONALITY CONTROLS
(75)
Inventors: Jensen M. Harris, Kirkland, WA (US);

Aaron M. Butcher, Duvall, WA (US);
David A. Morton, Redmond, WA (US);
Jesse Clay Satterfield, Seattle, WA
(US); Justin Denney, Seattle, WA (US)
(73)
Assignee: Microsoft Corporation, Redmond, WA

(US)
( *)
Notice:
Subject to any disclaimer, the term ofthis

patent is extended or adjusted under 35
U.S.C. 154(b) by 675 days.
(21)
Appl. No.: 10/955,967
(22)
Filed:
(51)
(52)
( 58)
References Cited
U.S. PATENT DOCUMENTS
A
A
A
A
4/1989
10/1992
611993
911993
FOREIGN PATENT DOCUMENTS

AU
2005203411
3/2006
(Continued)
Primary Examiner - Steven Sax
Int. Cl.
G06F 31048
(2006.01)
U.S. Cl. ........ 715/810; 7151711; 715/800; 715/802;
715/825; 715/828; 715/841; 715/842; 715/843
Field of Classification Search . ... ... ... ... .. ... 715/841,
715/843, 845,530, 711, 724, 810, 800, 802,
715/825, 828, 842
See application file for complete search history.
4,823,283
5,155,806
5,220,675
5,247,438
Baber et al. ....................... 705/8

Scannell et al. ... ... ... ... .. 718/ 103
Monson
Kalm
Murata ......................... 715/513
Allen et al. ................... 395/156
Frid-Nielsen et al ............. 705/9
Bieselin et al ........... 379/202.01
Ono .............................. 715/841
Jenson .......................... 715/823
Myers et al.
Bowden et al ................ 715/828
(Continued)
Provisional application No. 60/601,815, filed on Aug.

16, 2004.
(56)
6/1994
12/ 1994
5/1995
10/1995
12/1995
3/1996
5/1996
9/1996
9/1996
10/1996
12/1996
12/1996
(Continued)
Feb. 16, 2006
Related U.S. Application Data

(60)
A
A
A
A
A
A
A
A
A
A
A
A
Aug. 28, 2012
Screendumps (Microsoft Corporation, Microsoft Office Professional

Edition 2003; 4 pages).*
Prior Publication Data

US 2006/0036965 Al
5,323,314
5,377,354
5,412,772
5,461,708
5,475,805
5,500,936
5,519,606
5,559,875
5,559,944
5,570,109
5,581,677
5,588,107
US 8,255,828 B2
OTHER PUBLICATIONS
Sep.30,2004
(65)
Patent No.:
Date of Patent:
Diehm et al. ................. 715/825

Hoeberetal ................. 715/711
Padawer et al.
Subas et al. ..................... 700/90
250
Assistant Examiner - Linh K Pham

(74) Attorney, Agent, or Firm - Merchant & Gould
(57)
ABSTRACT
An improved user interface is provided for displaying selectable software functionality controls and for presenting logical
groupings of particular functionality controls associated with
a selected top-level functionality. Underneath a row of toplevel functionality tabs, functionalities controls associated
with a given top-level functionality tab are presented in logical groupings. Selection of a particular tab switches modes of
the user interface to present controls for functionalities associated with the selected tab.
33 Claims, 8 Drawing Sheets

US 8,255,828 B2
Page 2
5,592,602
5,596,694
5,625,783
5,634,100
5,634,128
5,638,504
5,644,737
5,659,693
5,664,127
5,664,208
5,673,403
5,721,847
5,734,915
5,760,768
5,760,773
5,761,646
5,764,960
5,778,402
5,778,404
5,787,295
5,793,365
5,805,167
5,812,132
5,821,936
5,828,376
5,838,321
5,842,009
5,844,558
5,844,572
5,855,006
5,864,848
5,872,973
5,873,108
5,874,956
5,885,006
5,893,073
5,893,125
5,895,476
5,898,436
5,899,979
5,903,902
5,905,863
5,926,806
5,936,625
5,937,160
5,940,078
5,940,847
5,943,051
5,956,737
5,960,406
5,970,466
5,999,173
5,999,938
6,008,806
6,012,075
6,016,478
6,018,343
6,034,683
6,038,395
6,038,542
6,043,816
6,067,087
6,067,551
6,072,492
6,073,110
6,073,142
6,085,206
6,101,480
6,133,915
6,154,755
6,175,363
6,188,403
6,192,381
6,195,094
6,199,102
6,211,879
6,216,122
6,219,670
A
111997 Edmunds
A
111997 Capps ........................... 345/473
A
4/1997 Ezekiel et al. ................ 395/352
A
5/1997 Capps ............................... 705/9
A
5/1997 Messina ........................ 710/200
A
6/1997 Scott et al. .................... 715/202
A * 7/1997 Tunimanetal. .............. 715/810
A
8/1997 Hansen et al. ................ 715/779
A
9/1997 Anderson et al. ............. 715/209
A
9/1997 Pavley et al ................... 715/209
A
9/1997 Brown eta!. ................. 715/744
A
2/1998 Johnson ........................ 395/333
A
3/1998 Roewer ......................... 395/773
A
6/1998 Gram ............................ 345/333
A
6/1998 Berman et al. ................ 715/808
A
6/1998 Frid-Nielsen et al. ............ 705/9
A
6/1998 Perks et al.
A
7/1998 Gipson ......................... 715/201
A
7/1998 Capps et al .................. 715/531
.................... 715/210
A
7/1998 Nakao .
A
8/1998 Tang eta!. .................... 715/758
A
9/1998 Van Cruyningen ........... 715/808
A
9/1998 Goldstein ..................... 715/797
A * 10/1998 Shaffer et al. ................. 715/810
A * 10/1998 Solimene et al. ............. 715/821
1111998 Wolf ............................. 345/343
A
A
1111998 Borovoy et al ................... 707/1
12/1998 Kumar et al .................. 345/339
A
12/1998 Schott ........................... 345/440
A
12/1998 Huemoeller et al. ............. 705/9
A
111999 Horvitz et al.
A
2/1999 Mitchell et al.
A
2/1999 Goyal et al. .................. 715/203
A
2/1999 LaHood
A
A
3/1999 Sheedy .... ... ... ... ... ... .... .. 384/192
A
4/1999 Kasso et al. ...................... 705/8
A
4/1999 Shostak ........................ 715/206
A
4/1999 Orr et al. ....................... 715/202
A
4/1999 Stewart et al. ................ 345/354
A
5/1999 Miller et al. ...................... 705/9
A
5/1999 Orr et al. ....................... 715/517
A
5/1999 Knowles et al. .............. 709/206
A
7/1999 Marshall et al. .................. 707/3
A
8/1999 Kahl et al. .................... 715/775
A
8/1999 Davis et al .................... 709/203
8/1999 Nagarajayya et al ........ 345/346
A
8/1999 Fein et al.
A
.......... 707 /540
8/1999 Onda et al. .................... 715/786
A
9/1999 King et al. .................... 715/517
A
9/1999 Rasansky et al. ................. 705/9
A
10/1999 Detjen et al. ...................... 705/8
A
12/1999 Ubillos
A
12/1999 Bliss et al. .................... 707/102
A
A
12/1999 Nakajima et al. ............. 345/335
A
112000 Fein et al. ..................... 707 /540
A
112000 Zhang et al ....................... 705/9
A
112000 Wang et al .................... 345/356
A
3/2000 Mansour et al. .............. 715/764
A
3/2000 Chow et al.
A
3/2000 Ruckdashel ...................... 705/9
A
3/2000 Williams et al.
A
512000 Krauss et al. ................. 715/762
111
A
512000 Brown et al.
A
612000 Schagen et al. ............... 715/733
A
612000 Rhodes et al.
A
612000 Geiger et al.
A
712000 Domini et al. ................ 707 /533
A
8/2000 Conmy et al .................... 705/9
A
10/2000 Arcuri et al ................... 715/779
A
1112000 Dellert et al.
Bl
112001 Williams et al. .............. 345/334
Bl
2/2001 Sacerdoti et al. ............. 715/764
2/2001 Stiegemeier et al ......... 715/210
Bl
2/2001 Celebiler
Bl
........... 715/764
3/2001 Cobb
Bl
4/2001 Soohoo ......................... 715/854
Bl
Bl
4/2001 Elson ................................ 707/5
Bl
4/2001 Mocek et al. ................. 707/102
6,222,540
6,230,173
6,230,309
6,232,971
6,236,396
6,237,135
6,256,628
6,269,341
6,278,450
6,289,317
6,307,544
6,307,574
6,323,883
6,326,962
6,327,046
6,341,277
6,353,451
6,359,634
6,373,507
6,381,740
6,384,849
6,385,769
6,405,216
6,424,829
6,429,882
6,430,563
6,433,801
6,433,831
6,434,598
6,442,527
6,456,304
6,457,062
6,459,441
6,466,236
6,469,722
6,469,723
6,476,828
6,480,865
6,484,180
6,493,006
6,493,731
6,507,845
6,546,417
6,564,377
6,570,596
6,578,192
6,583,798
6,618,732
6,621,504
6,621,508
6,635,089
6,639,611
6,664,983
6,680,749
6,686,938
6,691,281
6,701,513
6,707,476
6,708,205
6,721,402
6,727,919
6,732,330
6,734,880
6,750,890
6,778,990
6,785,866
6,785,868
6,789,107
6,825,859
6,826,727
6,826,729
6,850,255
6,857,103
6,871,195
6,882,354
6,895,426
6,904,449
6,906,717
6,915,492
Bl
Bl
Bl
Bl
Bl
Bl
Bl
Bl
Bl
Bl
Bl
Bl
Bl
Bl
Bl
Bl
Bl
Bl
Bl
Bl
Bl *
Bl
Bl
Bl
Bl
Bl
Bl
Bl
Bl
Bl
Bl
Bl
Bl
Bl
Bl
Bl
Bl
Bl
Bl
Bl
Bl
Bl
Bl
Bl
B2
Bl
Bl
Bl
Bl
Bl
Bl
Bl
B2
Bl
Bl
Bl
Bl
Bl
B2
B2
Bl*
Bl
B2
Bl*
B2
Bl
Bl
Bl
Bl
Bl
Bl
B2
Bl
B2
Bl
Bl
Bl
B2
B2 *
412001
512001
5/2001
5/2001
5/2001
5/2001
712001
712001
8/2001
912001
10/2001
10/2001
1112001
12/2001
12/2001
112002
3/2002
3/2002
412002
412002
512002
512002
612002
712002
8/2002
8/2002
8/2002
8/2002
8/2002
8/2002
912002
912002
10/2002
10/2002
10/2002
10/2002
1112002
1112002
1112002
12/2002
12/2002
112003
4/2003
5/2003
5/2003
6/2003
6/2003
9/2003
9/2003
9/2003
10/2003
10/2003
12/2003
112004
212004
212004
3/2004
3/2004
3/2004
412004
412004
512004
512004
6/2004
8/2004
8/2004
8/2004
912004
1112004
1112004
1112004
212005
212005
3/2005
412005
512005
6/2005
6/2005
7/2005
Sacerdoti ...................... 345/440

Ferrel et al.
Turner et al.
Haynes ......................... 715/800
Jenson et al. ................. 715/764
Timbol
Dobson et al. .................... 70716
Redcay, Jr......................... 705/8
Arcuri et al. .................. 345/334
Peterson ........................... 705/7
Harding ........................ 715/709
Ashe
Minouraetal. .............. 715/784
Szabo ........................... 715/762
Miyamoto et al ........... 358/1.15
Coden et al.
............. 707 /718
Teibel et al. .................. 715/803
Cragun et al. . ............... 715/777
Camara et al. ................ 345/825
Miller et al. .................. 717/151
Morcos et al. ................ 715/810
Lewallen
Minnaert et al ............ 707/104.1
Kraft .......................... 455/412.1
Abdelnur et al. ............. 345/763
Fritz et al. ..................... 707 /694
Moon et al. ................... 345/840
Dinwiddie et al. ........... 348/553
Gish ............................. 709/203
Worthington ..................... 705/8
Angiulo et al ................ 345/779
Pivowar et al. ............... 709/248
Perroux et al. ................ 345/837
Pivowar et al. ............... 715/835
Kinoe et al. .................. 345/837
Gould
Burkett et al. ................ 715/760
Lee et al. ...................... 715/523
Lyons et al.
111
Gourdol et al. ............... 715/825
Jones et al. ................... 715/234
Cohen et al. .................. 707 /608
Baker ........................... 709/206
Jayasirnha et al.
Frederiksen .................. 715/808
Boehme et al. ............... 717 /115
Hoek et al ..................... 345/822
White et al. .................. 707/103
Nadas et al ................... 715/723
Shiraishi et al. .............. 715/810
Burkett et al. ................ 715/513
Leduc ........................... 715/764
Ludolph ....................... 715/775
Anderson et al. ........ 348/231.99
Jobs et al ...................... 345/835
Sorge et al .................... 715/503
Bailey
Hochstedler .................. 715/789
Sheldon et al ................ 709/206
Usami
Reder et al. ................... 715/810
Claussen et al ............... 715/513
Chang et al .................. 715/738
Sugimoto .................... 715/838
Garcia et al.
Lewis et al. ................... 715/209
Raff .............................. 715/530
Bates et al.
Severenuk et al ............. 345/764
Mohr et al. ................... 715/235
Giesen et al. ................. 715/837
Muschetto .................... 715/788
Wason
Ryan et al. ...................... 706/46
Nielsen ......................... 715/784
Cortright et al.
Quinones ...................... 709/203
Couckuyt et al. ............. 345/440
Kurtenbach et al. .......... 715/810

US 8,255,828 B2
Page 3
6,924,797
6,925,605
6,928,610
6,928,613
6,931,623
6,941,304
6,964,025
6,983,889
6,988,241
6,990,637
6,990,652
6,990,654
6,993,711
7,027,463
7,032,210
7,039,596
7,039,863
7,046,848
7,051,276
7,069,538
7,085,999
7,093,162
7,107,525
7,107,544
7,110,936
7,111,238
7,117,370
7,120,868
7,149,983
7,152,207
7,181,697
7,188,073
7,188,158
7,188,317
7,206,813
7,206,814
7,212,208
7,216,301
7,219,305
7,225,244
7,234,132
7,240,323
7,246,311
7,249,325
7,263,668
7,272,789
7,290,033
7,296,241
7,325,204
7,328,409
7,337,185
7,346,705
7,346,769
7,356,772
7,360,174
7,362,311
7,386,535
7,386,835
7,392,249
7,395,221
7,395,500
7,421,660
7,421,690
7,426,713
7,472,117
7,484,213
7,499,907
7,505,954
7,530,029
7,555,707
7,567,964
7,584,253
7,627,561
7,664,821
7,703,036
7,707,255
7,711,742
7,716,593
7,739,259
Bl
B2
B2
Bl
B2
B2
B2 *
B2
Bl
B2 *
Bl
B2
Bl
B2
B2
Bl
Bl
Bl
Bl
Bl
B2
B2
B2
Bl
B2
Bl
B2
B2
Bl
Bl
B2
Bl
Bl
Bl
B2
B2
B2
B2 *
B2
B2
B2
Bl
B2
Bl
Bl*
B2
Bl
B2
B2
B2
B2
B2
B2
B2
B2
B2
Bl
Bl
Bl*
B2
B2
B2
B2
B2
B2
B2
B2
B2
B2
Bl
B2
B2
B2
Bl
B2
B2
B2
B2
B2
8/2005
8/2005
8/2005
8/2005
8/2005
912005
1112005
112006
112006
112006
112006
112006
112006
412006
412006
512006
512006
512006
512006
612006
8/2006
8/2006
912006
912006
912006
912006
10/2006
10/2006
12/2006
12/2006
212007
3/2007
3/2007
3/2007
4/2007
4/2007
5/2007
5/2007
5/2007
5/2007
6/2007
7/2007
7/2007
7/2007
8/2007
9/2007
10/2007
1112007
112008
2/2008
2/2008
3/2008
3/2008
4/2008
4/2008
4/2008
6/2008
6/2008
6/2008
7/2008
7/2008
9/2008
9/2008
9/2008
12/2008
112009
3/2009
3/2009
512009
612009
712009
912009
12/2009
212010
4/2010
412010
512010
5/2010
612010
MacPhail ...................... 345/326

Bates et al .................... 709/206
Brintzenhofe et al. ....... 715/202
Ishii
Vermeire et al.
Gainey et al.
Angiulo et al. ............... 715/838
Alles ............................ 236/49.l
Guttman et al. .............. 715/503
Anthony et al ............... 715/851
Parthasarathy et al.
Carroll, Jr.
Tanaka et al. ................. 715/513
Mathew et al.
Alloing et al.
Lu ..................................... 705/8
Caro et al. .................... 715/209
Olcott ........................... 382/176
Mogilevsky et al. ......... 715/517
Renshaw
Maeda et al. ................. 715/236
Barga et al.
Purvis ........................... 715/244
Luke ............................. 715/752
Hiew et al. ...................... 703/22
Kuppusamy et al.
Khan et al. .................... 713/186
Salesin et al. ................. 715/249
Robertson et al. ............ 715/810
Underwood et al. ......... 715/526
Tai et al. ....................... 715/779
Tam et al. ......................... 705/9
Stanton et al.
Hazel ............................ 715/804
Dunbar et al.
Kirsch
Khozai ......................... 345/440
Moehrle ....................... 715/811
Jennings
Reynolds
Lam
Desai et al. ................... 717/100
Bargeron et al. ............. 715/251
Donaldson .................... 715/777
Lentz ............................ 715/801
O'Brien ........................ 715/247
Goldman et al .............. 709/206
Oshiro et al.
Rogers .......................... 715/792
Awada et al .................. 715/765
Ellis et al. ..................... 707/102
Hullot et al. .................. 709/238
Forlenza et al ............... 713/151
Brownholtz et al. ......... 715/752
Grossman et al ............. 715/854
Filner et al. ................... 345/169
Kalucha et al.
Desai et al.
Harris et al.
111
Doss et al. ........................ 705/9
Whittle et al.
Charmock et al. ............ 715/751
Forstall et al. ................ 709/206
Duggan et al.
Dettinger et al.
111
Mathew et al.
Brown et al.
111
Heidloff et al. ................... 707I1
Satterfield et al. ............ 715/779
Labarge et al.
Brice et al. ........................ 70719
Curbow et al.
Pell et al. .......................... 707/3
Ancin et al. .................. 709/206
Bennett et al. ................ 70717 59
Durazo et al ................. 715/752
Hartwell et al. .............. 7071706
7,747,966
7,788,598
7,802,199
7 ,831,902
7,853,877
7,856,596
7,865,868
7,870,465
7,886,290
7,895,531
8,117,542
8,146,016
8,150,930
8,201,103
200110014900
200110032220
200110035882
200110049677
2002/0007380
2002/0029247
2002/0036662
2002/0037754
2002/0052721
2002/0052880
2002/0070977
2002/0078143
2002/0083054
2002/0083097
2002/0091697
2002/0091739
2002/0122071
2002/0133557
2002/0135621
2002/0140731
2002/0140740
200210149623
200210149629
2002/0154178
2002/0156815
200210158876
2002/0163538
2002/0175938
2002/0175955
200210186257
200210188632
2002/0196293
2003/0009455
2003/0011638
2003/0011639
2003/0014421
2003/0014490
2003/0022700
2003/0025732
2003/0035917
2003/0038832
2003/0043200
2003/0043211
2003/0046528
2003/0066025
2003/0070143
2003/0084035
2003/0093490
2003/0097361
2003/0097640
2003/0098891
2003/0106024
2003/0110191
2003/0112278
2003/0135825
2003/0156140
2003/0160821
2003/0163455
2003/0163537
2003/0167310
2003/0169284
2003/0184585
2003/0195937
2003/0206646
2003/0218611
B2
B2
B2
B2
B2
B2
B2
B2
B2
B2
B2
B2
B2
B2
Al
Al
Al*
Al
Al*
Al
Al
Al
Al
Al
Al
Al
Al
Al
Al
Al
Al
Al
Al
Al
Al
Al
Al
Al
Al
Al
Al
Al
Al
Al
Al
Al
Al
Al
Al
Al
Al
Al *
Al
Al *
Al
Al
Al
Al
Al
Al
Al
Al
Al
Al
Al
Al
Al
Al
Al
Al
Al
Al
Al
Al
Al
Al
Al
Al
Al
612010 Leukart et al. ................ 715/792
8/2010 Bansal et al. ................. 715/810

912010 Shneerson et al.
1112010
12/2010
12/2010
112011
112011
212011
2/2011
212012
3/2012
412012
612012
8/2001
10/2001
1112001
12/2001
112002
3/2002
3/2002
3/2002
512002
512002
612002
612002
612002
612002
712002
712002
912002
912002
912002
10/2002
10/2002
10/2002
10/2002
10/2002
10/2002
10/2002
1112002
1112002
1112002
12/2002
12/2002
12/2002
112003
112003
112003
112003
112003
112003
212003
212003
212003
3/2003
3/2003
3/2003
4/2003
4/2003
5/2003
5/2003
5/2003
5/2003
5/2003
6/2003
6/2003
6/2003
7/2003
8/2003
8/2003
8/2003
8/2003
9/2003
9/2003
10/2003
10/2003
1112003
1112003
Sourov et al. ................. 715/220

Giesen et al. ................. 715/711
Crider et al ................... 715/243
Falzone Schaw et al.
Versteeg ....................... 714/774
Dhanjal et al. ................ 717 /170
Radtke et al. ................. 715/810
Radtke et al.
Himberger et al.
Satterfield et al.
Dukhon et al.
Brauer et al. ................. 707/513
Van Hoff ...................... 707/513
Stoakley et al ............... 345/779
Talib et al. ........................ 707/3
Bauchot et al. ............... 707 /530
Kawamoto .................... 709/206
Gauthier et al. .............. 345/835
Hama et al. ................... 455/566
Ruff et al. ......................... 703/1
Fruensgaard et al. ..... 707/104.1
Morcos et al. ................ 345/810
DeBoor et al.
Peltonen et al. .................. 70715
Warrington
Huang et al. .................... 707I10
Ferlitsch ....................... 707/526
Camara et al.
Winarski ...................... 709/207
Angiulo et al ................ 345/838
Subramaniam et al. ...... 345/762
Chen
West et al. .................... 345/765
Craycroft et al. ............. 345/861
Barnett et al ................. 715/853
Davia ............................ 707/517
Janssen ......................... 345/504
Shteyn .......................... 345/7 52
Hackworth ................... 345/7 51
Gourdol et al. ............... 345/821
Cadiz et al. ................... 715/764
Su ................................. 707 /513
Suppan et al. ................ 345/853
Carlson et al. .................... 707 /6
Chung .......................... 345/808
Webb ............................ 715/808
Jung ............................. 707/102
Bates et al. ................... 709/206
Wang ............................ 455/566
Prichard
Hyman ........................... 428/67
Sobol
Faieta et al. ................... 345/804
Kremer et al.
Haitani et al. .. .................. 713/2
Garner et al. ................. 715/500
Maslov ......................... 715/513
Emerick ........................... 707 /3
Yamamoto et al. ........... 709/213
Huang et al. .................... 707I10
Abrams et al. ................ 715/530
Molander ..................... 715/841
Silverbrook et al. ......... 715/515
Handsaker et al. ........... 707 /503
Driskell ........................ 715/788
Gertner et al.
Watanabe ..................... 345/810
Yoon
Dettinger et al. ................. 707 /3
Rohall et al. .................. 709/206
Moody et al .................. 709/206
Dettinger et al. ............. 715/708
Lin et al. ....................... 345/763
Kircher et al. ................ 709/207
Brackett
Ben-Tovim et al. .......... 345/440

US 8,255,828 B2
Page 4
2003/0225853
2003/0226106
2003/0227487
2003/0233419
2004/0003351
2004/0006570
200410012633
2004/0021647
2004/0030993
2004/0056894
2004/0083432
2004/0088359
2004/0090315
200410100504
200410100505
2004/0107197
200410109025
200410109033
2004/0117451
2004/0119760
2004/0122789
2004/0125142
2004/0128275
2004/0133854
2004/0142720
200410153968
200410164983
2004/0168153
2004/0186775
200410189694
2004/0192440
2004/0215612
2004/0221234
2004/0230508
2004/0230906
2004/0239700
2004/0243938
2004/02607 56
2004/0261013
2004/0268231
2004/0268270
2005/0004989
2005/0004990
2005/0005235
2005/0005249
2005/0010871
2005/0021504
2005/0022116
2005/0033614
2005/0039142
2005/0043015
2005/0044500
2005/0055449
2005/0057584
2005/0086135
2005/0091576
2005/0097465
2005/0097511
2005/0114778
2005/0117179
2005/0132010
2005/0132053
2005/0138576
2005/0144241
2005/0144284
2005/0144568
2005/0172262
2005/0177789
2005/0183008
2005/0203975
2005/0216863
2005/0223066
2005/0223329
2005/0234910
200510240902
2005/0251757
2005/0256867
2005/0278656
2005/0289109
Al
Al
Al
Al
Al
Al
Al
Al
Al
Al
Al
Al
Al
Al
Al *
Al
Al
Al
Al
Al
Al
Al
Al*
Al
Al
Al
Al
Al
Al
Al
Al
Al
Al
Al *
Al
Al
Al
Al
Al
Al
Al
Al
Al
Al
Al*
Al
Al
Al
Al
Al
Al
Al
Al
Al
Al
Al
Al
Al
Al
Al
Al
Al
Al
Al
Al
Al
Al*
Al
Al
Al
Al
Al
Al*
Al
Al
Al
Al
Al
Al
12/2003
12/2003
12/2003
12/2003
112004
112004
112004
212004
212004
3/2004
412004
512004
512004
512004
512004
6/2004
6/2004
6/2004
6/2004
6/2004
6/2004
7/2004
7/2004
7/2004
7/2004
8/2004
8/2004
8/2004
912004
912004
912004
10/2004
1112004
1112004
1112004
12/2004
12/2004
12/2004
12/2004
12/2004
12/2004
112005
112005
112005
112005
112005
112005
112005
212005
212005
212005
212005
3/2005
3/2005
412005
412005
512005
512005
512005
6/2005
6/2005
6/2005
6/2005
6/2005
6/2005
6/2005
8/2005
8/2005
8/2005
912005
912005
10/2005
10/2005
10/2005
10/2005
1112005
1112005
12/2005
12/2005
Wang et al .................... 709/217

McKellar et al. ............. 715/513
Hugh ............................ 715/777
Beringer ....................... 709/206
Sornrnerer et al. ............ 715/251
Gelb et al. .................... 707/102
Helt
Iwema et al.
Hong Huey et al.
Zaika et al. ................... 345/762
Kawamura et al. ........... 715/526
Simpson
Mackjust et al ......... 340/426.13
Sommer ....................... 345/810
Cazier ........................... 345/811
Shen et al. ........................ 70719
Hullot et al. .................. 715/764
Vienneau et al. ............. 345/863
Chung .......................... 709/207
Grossman et al ............. 715/854
Ostertag et al.
Mock et al. ................... 345/765
Moehrle ........................... 707/1
Black ............................ 715/517
Smethers ................... 455/550.l
Ching et al.
Khozai ......................... 345/440
Marvin ......................... 717 /120
Margiloff et al. ............... 705/14
Kurtz et al.
Evans et al.
Brody ............................... 707/3
Imai .............................. 715/256
Minnis et al. ................... 705/35
Pik et al. ....................... 715/522
Baschy ......................... 715/781
Weise et al. ................... 715/205
Forstall et al.
Wynn et al .................... 715/511
Tunning ........................ 715/513
Hill et al. ...................... 715/963
Durazo et al. .. .............. 709/206
Hill et al. ...................... 715/963
Ruthfield et al .............. 715/712
Atchison ........................... 707/3
Bowman et al. .............. 715/513
Lettovsky et al. ................ 705/5
Jalon et al. .................... 715/823
Muramatsu ................ 455/412.1
Orimoto et al. ............... 715/706
Rappold, III ................. 709/228
Gruen et al. .................. 715/752
Lu ................................... 705/30
Relyea et al.
Giesen et al. ................. 715/700
Bergman et al.
Branson et al ................ 715/711
Ito et al ........................ 358/1.15
Muller
Roth et al. .................... 709/227
Baumert et al. .............. 715/862
Stata et al.
Ludwig et al. ................ 709/226
Gruen et al. .................. 715/822
Lalwani ........................ 717/109
Abbar et al. .................. 705/528
Crider et al ................... 715/517
Jindal et al. ................... 7071204
Schumacher et al. ........ 715/827
Buchheit et al.
Schwartz eta!. ............. 715/711
Buchheit et al.
Bunker et al.
Farn
Walther et al. .................... 707/5
Goldthwaite et al. ........ 715/810
Arrouye et al .................... 707/1
2005/0289156 Al
2005/0289158 Al
2006/0015816 Al
200610020962 Al
2006/0026033 Al
2006/0026213 Al
2006/0026242 Al
2006/0036580 Al
2006/0036945 Al
2006/0036946 Al
2006/0036950 Al
2006/0036964 Al
2006/0036965 Al
2006/0041545 Al
2006/0047644 Al
2006/0053383 Al
2006/0064434 Al
2006/0069604 Al
2006/0069686 Al
2006/0080303 Al
2006/0095865 Al
2006/0101051 Al
2006/0101350 Al
200610117249 Al
200610117302 Al
2006/0129937 Al
2006/0132812 Al
200610155689 Al
2006/0161849 Al
2006/0161863 Al
2006/0165105 Al
2006/0168522 Al
2006/0173824 Al
2006/0173961 Al
2006/0218500 Al
2006/0224946 Al
2006/0242557 Al*
2006/0242575 Al
2006/0242591 Al
2006/0248012 Al
2006/0259449 Al
2006/0271869 Al
2006/0271910 Al
2006/0282817 Al
2006/0294452 Al
2006/0294526 Al
200710006206 Al
2007/0033250 Al
2007/0050182 Al
2007/0050401 Al
2007/0055936 Al
2007/0055943 Al
2007/0061306 Al
2007/0061307 Al
2007/0061308 Al
2007/0061705 Al
2007/0061738 Al
2007/0094608 Al
2007/0106951 Al
200710143662 Al
200710143671 Al
2007/0180040 Al
2007/0185826 Al
2007/0203991 Al
2007/0240057 Al
200710260996 Al
2007/0279417 Al
2007/0282956 Al
2007/0300168 Al
2008/0005686 Al
2008/0034304 Al
2008/0040682 Al
2008/0052670 Al
2008/0077 571 Al
2008/0104505 Al
2008/0109787 Al
2008/0134138 Al
2008/0141156 Al
2008/0141242 Al
12/2005
12/2005
112006
112006
212006
212006
212006
212006
212006
212006
212006
212006
212006
212006
3/2006
3/2006
3/2006
3/2006
3/2006
412006
512006
512006
512006
612006
612006
612006
612006
712006
712006
712006
712006
712006
8/2006
8/2006
912006
10/2006
10/2006
10/2006
10/2006
1112006
1112006
1112006
1112006
12/2006
12/2006
12/2006
112007
212007
3/2007
3/2007
3/2007
3/2007
3/2007
3/2007
3/2007
3/2007
3/2007
4/2007
5/2007
6/2007
6/2007
8/2007
8/2007
8/2007
10/2007
1112007
12/2007
12/2007
12/2007
1/2008
2/2008
2/2008
2/2008
3/2008
5/2008
5/2008
6/2008
6/2008
6/2008
Maryka et al. ................ 707/100

Weiss et al. ................... 707/100
Kuehner et al.
Stark ............................... 725/32
Brydon et al. .................... 705/1
Yaskin et al .................. 7071200
Kuhlmann et al.
Stata ................................. 707 /3
Radtke et al. ................. 715/708
Radtke et al. ................. 715/711
Himberger et al. ........... 715/732
Satterfield
Harris et al ................... 715/777
Heidloff et al .................... 70714
Bocking et al.
Gauthier et al. .............. 715/764
Gilbert et al. .............. 707/104.1
Leukart et al. .................... 705/9
Beyda et al. .................... 707I10
Sargent et al ..................... 707 /3
Rostom ......................... 715/810
Carr et al ...................... 707/102
Scott ............................. 715/779
Hu et al. ....................... 715/255
Mercer et al .................. 717/131
Shafron ........................ 715/733
Barnes et al. ................ 358/1.11
Blakeley et al. .................. 707 /3
Miller et al. .................. 715/744
Gallo ............................ 715/810
Shenfield et al.
Bala
Bensky ............................. 707 /3
Turski et al.
Sauve et al. ................... 715/767
Barrett
Nortis, III ..................... 715/509
Winser .......................... 715/530
Van Dok
Kircher et al. .................. 705/50
Betz et al .......................... 707 /1
Thanu et al ................... 715/764
Burcham et al.
Darst et al.
Matsumoto ................... 715/236
Hambrick et al ............. 719/315
Dhanjal et al.
Levin et al.
Sneddon et al. .................. 704/2
Young et al. .................. 707/102
Dhanjal et al.
McCormick
Pell et al. .......................... 707 /3
Hartwell et al. .................. 707 /3
Hartwell et al. .................. 707 /3
Arnrnerlaan
Taboada et al.
Getsch
McCormack et al. ........ 715/764
Carlson et al. ................ 715/507
Paterson et al ................ 715/209
Etgen et al. ................... 709/207
Brice et al ......................... 707 /1
Fisher et al.
Jakobson ...................... 715/781
Garg et al. .................... 345/440
Staats ........................... 709/206
Bosma et al. ................. 715/820
Singh
Feuerbacher et al. ........ 715/764
Sorenson et al. ............. 715/777
Espinosa et al.
Harris et al ....................... 70715
Keohane et al. .............. 715/246
Wang et al.
Chamieh et al ............... 717/105
Reik
Shapiro ......................... 717 /174

US 8,255,828 B2
Page 5
2008/0155555
2008/0178110
2008/0209316
2008/0244440
2009/0007003
200910012984
2009/0083656
200910100009
2009/0106375
2009/0217192
2009/0222763
2009/0249339
2009/0319619
2009/0319911
2010/0011310
2010/0060645
2010/0191818
2010/0211889
2010/0223575
2010/0293470
201110072396
201110138273
201110296322
Al
Al
Al
Al
Al
Al
Al
Al
Al
Al
Al
Al
Al
Al
Al
Al
Al
Al
Al
Al
Al
Al
Al
6/2008
7/2008
8/2008
10/2008
112009
112009
3/2009
412009
412009
8/2009
912009
10/2009
12/2009
12/2009
112010
3/2010
712010
8/2010
9/2010
1112010
3/2011
612011
12/2011
Kwong .........................
Hill et al. ......................
Zandstra
Bailey
Dukhon et al. ...............
Ravid et al ....................
Dukhon et al. ...............
Karp
Carmel et al. .. ..............
Dean et al. ....................
Dukhon et al. ...............
Larsson et al.
Affronti
McCann
Rainisto
Garg et al .....................
Satterfield et al. ............
Durazo et al .................
Leukart et al. ................
Zhao et al.
Giesen eta!. .................
Radtke et al ..................
Dhanjal et al. ................

CN
EP
EP
EP
EP
EP
EP
GB
GB
ID
ID
ID
JP
JP
JP
JP
JP
JP
JP
JP
JP
JP
JP
JP
JP
JP
JP
JP
JP
JP
JP
JP
JP
JP
JP
JP
JP
JP
JP
JP
JP
KR
KR
KR
KR
KR
KR
PH
TW
TW
TW
WO
WO
WO
1746914
0 774 722
1077405
1 223 503
1 376 337
1462 999
1 542 133
2329813
2 391 148
p 0027717
p 0027754
p 0029297
03-043824
04-186425
04-312186
05-204579
06-052282
06-342357
10-074217
10-326171
11-175258
11-259200
2001-034775
2001-503893
2001-337944
2003-101768
2003-015719
2003-256258
2003-256302
2004-078512
2004-086893
2004-102803
2004-512578
2004-145569
2004-159261
2004-342115
2005-032041
2005-182353
2005-236089
4832024
4832024
10-2005-0023805
10-2005-0036702
10-1130421
10-1149960
10-1149990
10-1159334
1-2005-000404
460839
490652
2003-05097
94-20921
96/10231
96-39654
A2
A2
A2
A2
3/2006
5/1997
2/2001
712002
212004
912004
6/2005
3/1999
112004
3/2011
3/2011
10/2011
2/1991
3/1992
1111992
8/1993
2/1994
12/1994
3/1998
12/1998
7/1999
9/1999
2/2001
3/2001
12/2001
4/2003
9/2003
9/2003
9/2003
3/2004
3/2004
412004
412004
512004
6/2004
12/2004
212005
A
A
7/2005
9/2011
9/2011
12/2011
3/2005
412005
3/2012
5/2012
5/2012
6/2012
8/2011
10/2001
612002
10/2003
9/1994
4/1996
12/1996
719/315
715/771
715/778
707/101
715/781
709/206
715/777
715/808
WO
WO
WO
WO
WO
WO
WO
WO
WO
WO
WO
98/20410
WO 99/04353
WO 01155894
WO 03/003240
WO 03/098500
WO 2007/033159
WO 2007/027737
W02008/121718
2009-158151
2009-158171
2009-158172
A2
Al
Al
Al
5/1998
111999
8/2001
112003
1112003
3/2007
8/2007
10/2008
12/2009
12/2009
12/2009
OTHER PUBLICATIONS
345/440
709/206
715/752
715/779
715/841
715/256
715/760
MS. Office 2003 (Microsoft Corporation, Microsoft Office Professional Edition 2003; 10 pages).*
ScreenShot of MS_Office_2003; (Microsoft Corporation,
Microsoft Office Professional Edition 2003; 6 pages).*
Ribbons; Microsoft; 2012 Microsoft; http://msdn.microsoft.com/
en-us/library/windows/desktop/cc872782.aspx; 45 pages.*
AutoCAD 2011-CustomiztionGuide; Feb. 2010;Autodesk, Inc.; 554
Pages; http://images.autodesk.com/ adsk/files/ acad_acg.pdf. *
U.S. Final Office Action dated Dec. 21, 2007 cited in U.S. Appl. No.
10/851,506.
U.S. Final Office Action dated Jan. 8, 2008 cited in U.S. Appl. No.
10/955,928.
U.S. Office Action dated Jan. 28, 2008 cited in U.S. Appl. No.
10/836,154.
U.S. Appl. No. 12/028,797, filed Feb. 9, 2008 entitled "Side-by-Side
Shared Calendars".
U.S. Office Action dated Feb. 21, 2008 cited in U.S. Appl. No.
10/851,442.
Marshall School of Business, Workshop 1-Introduction to Outlook
& E-mail, Apr. 6, 2000, pp. 1-11.
Jane Dorothy Calabria Burke, Ten Minute Guide to Lotus Notes 4.6,
Publication date: Dec. 23, 1997, 2 pgs.
Bill Dyszel, Microsoft Outlook 2000 for Windows for Dummies,
Copyright 1999, pp. 82-86, 102-103, 141,143.
Gina Danielle Venolia et al., Understanding Sequence and Reply
Relationships within Email Conversations: A Mixed-Model Visualization, CHI 2003, Apr. 5-10, 2003, vol. No. 5, Issue No. 1, pp.
361-368.
U.S. Office Action dated Sep. 26, 2007 cited in U.S. Appl. No.
111151,686.
U.S. Office Action dated Oct. 9, 2007 cited in U.S. Appl. No.
10/982,073.
10/955,940.
Philippines Examiner's Action dated Aug. 19, 2008 cited in Application No. 1-2005-000405.
Chinese Second Office Action dated Oct. 10, 2008 cited in Application No. 200510092141.1.
U.S. Final Office Action dated Oct. 28, 2008 cited in U.S. Appl. No.
111151,686.
Microsoft Office Word 2003. Part of Microsoft Office Professional
Edition 2003. Copyright 1983-2003 Microsoft Corporation.
U.S. Final Office Action dated Apr. 15, 2008 cited in U.S. Appl. No.
10/955,942.
Screendumps Microsoft Corporation, Microsoft Office Professional
Edition 2003, 5 pgs.
U.S. Final Office Action dated May 28, 2008 cited in U.S. Appl. No.
10/982,073.
Chinese Official Action dated Mar. 21, 2008 cited in Chinese Application No. 200510092146.4.
Philippine Official Action dated Apr. 21, 2008 cited in Philippine
Application No. 1-2005-000405.
Chinese First Office Action dated Apr. 18, 2008 cited in Application
No. 200510092142.6.

US 8,255,828 B2
Page 6
Chinese First Office Action dated May 23, 2008 cited in Application
No. 200510089514.X.
Philippines Examiner's Action dated Sep. 12, 2008 cited in Application No. 1200500406.
Microsoft Office 11 Beta Layperson's Specification, Copyright
2002, Microsoft Corporation, 28 pgs.
FrontPage 11 Beta Layperson's Specification, Copyright 2002,
Microsoft Corporation, 12 pgs.
Office 11 Beta Letter, Copyright 2002, Microsoft Corporation, 6 pgs.
Microsoft XDocs Beta Layperson Specification, Copyright 2002,
Microsoft Publisher 11 Beta Layperson's Specification, Copyright
10/955,941.
Habraken, Microsoft Office XP 8 in 1, published Jun. 5, 2001, http://
proquest.safaribooksonline.corn/0789725096/, 12 pgs.
Word 2002, Chapter 14; Paradigm Publishing Inc., copyright 2002;
http://www.emcp.com/tech_tutorials/sig_irc/Signature_Word_
Chapter_l4.ppt, 21 pgs.
Chilean Office Action dated Mar. 28, 2008 cited in Application No.
1770-05, no English Translation.
No. 200510092141.1.
Microsoft Office Word 2003, Part of Microsoft Office Professional
Edition 2003, 1983-2003 Microsoft Corporation, screen shot 1, 1 pp.
Screendumps-Microsoft Office, Microsoft Office Professional Edition 2003, Microsoft Corporation, 10 pages.
Screendumps-Microsoft Office Outlook, Microsoft Office Outlook
Professional Edition 2003, Microsoft Corporation, 2 pages.
Chinese Second Office Action dated Nov. 21, 2008 cited in Appln No.
200510089514.X.
U.S. Official Action dated Jun. 19, 2008 cited in U.S. Appl. No.
10/851,506.
10/955,928.
U.S. Official Action dated Jul. 17, 2008 cited in U.S. Appl. No.
10/955,940.
U.S. Official Action dated Dec. 23, 2008 in U.S. Appl. No.
10/955,942.
U.S. Official Action dated Jan. 6, 2009 in U.S.Appl. No. 10/955,941.
Chilean Second Office Action dated Mar. 4, 2009 cited in Appln No.
2512-2005.
U.S. Office Action dated Apr. 28, 2009 in U.S. Appl. No. 12/028,797.
Nielsen, Jacob. "Tabs, Used Right," Alertbox, Sep. 17, 2007, http://
www.useit.com/alertbox/tabs.html, 6 pages.
"Managing the Code Editor and View" Microsoft Corporation, http://
msdn.microsoft.corn/en-us/library/zO 1zks9a(VS.71 ).aspx, 2008.
Agarwal, Vikash K., "Creating a Visually Arresting User-Interface:
A 3 D Tab Control Example," Jan. 4, 2008, http://microsoft.apress.
corn/ asptodayarchive/7 l 723/creating-a-visually-arresting-user-interface-a-3d-tab-control-example, 12 pages.
"Omni Web Help," Omni Group, 2004, http://www.omnigroup.com/
documentation/omniweb/browser/tabs.html, 2 pages.
Hepfner, Troy, "New SOCET CXP Interface Improves Usability,"
Sep. 2008, http://www.socetset.com/gxpmosaic/?p~95, 4 pages.
U.S. Appl. No. 12/372,386, filed Feb. 17, 2009 entitled "Command
User Interface for Displaying Multiple Sections of Software Functionality Controls''.
Chinese Office Action dated Apr. 3, 2009 cited in Appln No.
200510089514.X.
U.S. OfficeActiondatedMar.18, 2009 in U.S.Appl. No. 111401,470.
U.S. Office Action dated Nov. 25, 2008 cited in U.S. Appl. No.
111154,278.
U.S. Office Action dated Dec. 11, 2008 cited in U.S. Appl. No.
10/982, 073.
Chilean Office Action dated Nov. 27, 2008 cited in Appln No. 17682005.
Chilean Office Action dated Sep. 23, 2008 cited in Appln No. 17702005.
Billo, E. Joseph. "Creating Charts: an Introduction," Excel for Chemists: . A Comprehensive Guide, http://www.ahut.edu.cn/yxsz/ahk/
Teaching/Excel%for%20Chemists/ChQ2.pdf, 9 pages.
Screendumps-Microsoft Office, Microsoft Corporation, Microsoft
Office Professional Edition 2003, 13 pages.
Russian Office Action dated Jul. 21, 2009 cited in Appln No.
2005125837/09(029011).
2005125831109(029005).
European Search Report dated Sep. 7, 2009 cited in EP Application
No. 09006972.5-2211.
European Communication dated Sep. 14, 2009 cited in Appln. No.
07795391.7-1225.
U.S. OfficialActiondatedAug. 4, 2009 in U.S. Appl. No.10/955,942.
U.S. Official Action dated Aug. 18, 2009 m U.S. Appl. No.
111782,059.
U.S. Official Action dated Sep. 23, 2009 m U.S. Appl. No.
111401,470.
Berliner E.M. et al., "Microsoft Office 2003", Feb. 24, 2004, p. 39-40,
120-124, 175-177, 233-234 [Dl].
Berliner E.M. et al., "Microsoft Office 2003", Feb. 24, 2004, p.
173-178 [D2].
Israeli Office Action dated Sep. 6, 2009 cited in Appln No. 169716.
Russian Office Action dated Sep. 10, 2009 cited in Appln No.
2005125836/09(029010).
2005125839/09(029013).
European Communication dated Sep. 28, 2009 cited in Appln No.
09006972.5-2211.
Chinese Office Action dated Oct. 16, 2009 cited in Appln No.
200510092142.6.
U.S. Official Action dated Nov. 24, 2009 in U.S. Appl. No.
111445,393.
Perronne et al. "Building Java Enterprise Systems with J2EE", Publisher: Sams, Pub Date: Jun. 7, 2000 (pp. 1-8).
Russian Office Action dated Oct. 26, 2009 cited in Appln No.
2005120363/09(023023).
PCT Search Report and Written Opinion dated Dec. 29, 2009 cited in
International Application No. PCT/US2009/046344.
U.S. Official Action dated Sep. 6, 2007 in U.S. Appl. No. 111136,800.
111136,800.
111154,278.
U.S. OfficialActiondatedDec. 8, 2009 in U.S.Appl. No. 111151,686.
U.S. OfficialActiondatedDec. 9, 2009 in U.S.Appl. No. 12/028,797.
10/955,940.
U.S. Official Action dated Jan. 6, 2010 in U.S. Appl. No. 10/607,020.
U.S. Official Action dated Jan. 25, 2010 in U.S. Appl. No.
10/982,073.
T. Shih et al., "A Stepwise Refinement Approach to Multimedia
Presentation Designs", IEEE, Oct. 1997, pp. 117-122.
U.S. Official Action dated Mar. 3, 2010 in U.S. Appl. No. 10/780,547
(Perkins matter).
U.S. Appl. No. 12/725,605, filed Mar. 17, 2010 entitled "Improved
User Interface for Displaying Selectable Software Functionality
Controls that are Relevant to a Selected Object''.
U.S. Appl. No. 12/753,923, filed Apr. 5, 2010 entitled "Automatic
Grouping of Electronic Mail''.
Chinese Office Action dated Jan. 22, 2010 cited in Appln No.
200680032564.7.
Chinese Third Office Action dated Feb. 12, 2010 cited in Appln No.
200510092142.6.
Philippines Examiner's Action dated Mar. 11, 2010 cited in Appln
No. 1-2005-000405.
Chinese Office Action dated Mar. 11, 2010 cited in Appln No.
200780020312.7.
Australian Office Action dated Mar. 25, 2010 cited in Appln No.
2005203411.
2005203412.

US 8,255,828 B2
Page 7
2005203409.
Australian Office Action dated Apr. 8, 2010 cited in Appln No.
2005203410.
U.S. Official Action dated Feb. 22, 2010 in U.S. Appl. No.
111401,470.
U.S. Appl. No. 12/769,787, filed Apr. 29, 2010 entitled "Conversation Grouping of Electronic Mail Records".
U.S. Appl. No. 12/777,287, filed May 11, 2010 entitled "User Interface for Providing Task Management and Calendar Information".
U.S. Appl. No. 111217,071, filed Aug. 30, 2005 entitled "Markup
Based Extensibility for User Interfaces".
Clifton, The Application Automation layer-Using XML to
Dynamically Generale GUI Elements-forms and controls, The
Code Project, Jun. 2003, pp. 1-37.
Australian Office Action dated May 28, 2010 cited in Appln No.
2005202717.
U.S. Official Action dated Mar. 30, 2010 m U.S. Appl. No.
111217,071.
U.S. Official Action dated Apr. 15, 2010 m U.S. Appl. No.
111823,999.
U.S. Official Action dated May 5, 2010 in U.S.Appl. No.10/851,506.
U.S. Official Action dated May 25, 2010 in U.S. Appl. No.
10/607,020.
U.S. OfficialActiondatedAug. 6, 2010 in U.S.Appl. No.111401,470.
Chinese Second Office Action dated Jul. 6, 2010 cited in Appln No.
200680033212.3.
Mexican Office Action dated Aug. 12, 2010 cited in Appln No.
2005/008354.
U.S. OfficialActiondatedAug. 2, 2010 in U.S.Appl. No.10/955,942.
111217,071.
10/836,154.
Israeli Office Action dated Oct. 28, 2010 cited in Appln No. 169716.
U.S. Official Action dated Dec. 8, 2010 in U.S. Appl. No.10/851,506.
U.S. Official Action dated Dec. 16, 2010 m U.S. Appl. No.
111430,562.
111445,393.
12/574,256.
12/028,787.
U.S. Official Action dated Jan. 5, 2011 in U.S.Appl. No. 111823,999.
Korean Notice of Rejection dated Nov. 3, 2011 cited in Appln No.
10-2005-0067257.
Japanese Notice ofRejectiondatedNov. 11, 2011 citedinAppln. No.
2008-530229.
Chinese Office Action dated Nov. 18, 2011 cited in Appln. No.
200910148820.4.
Chinese Office Action dated Nov. 29, 2011 cited in Appln. No.
200980124383.0.
Chinese Third Office Action dated Dec. 5, 2011 cited in Appln. No.
200680018095.3.
U.S. Appl. No. 111430,561, filed May 9, 2006 entitled "Integrated
Search and Find User Interface".
U.S. Appl. No. 111430,562, filed May 9, 2006 entitled "Expanded
Search and Find User Interface".
U.S. Appl. No. 111430,416, filed May 9, 2006 entitled "Search and
Find Using Expanded Search Scope".
U.S. Appl. No. 12/059,644, filed Mar. 31, 2008 entitled "Associating
Command Surfaces with Multiple Active Components".
U.S. Appl. No. 09/620,876, filed Jul. 21, 2000 entitled "On-Object
User Interface".
U.S. Appl. No. 10/780,547, filed Feb. 17, 2004 entitled "Method and
System for Separation of Content and Layout Definitions in a Display
Description" (Perkins Case).
Screendumps-Microsoft Office (Microsoft Corporation, Microsoft
Office Professional Edition 2003; 16 pages).
Padwick, Gordon "Using Microsoft Outlook 2000," 1999 Que Publishing, pp. 530-533.
Slovak, Ken. "Absolute Beginner's Guide to Microsoft Office Outlook 2003." 2003, Que Publishing, pp. 237-241.
Microsoft Press, Microsoft Computer Dictionary, Microsoft Press,
Fifth Edition, pp. 374, 382, 2002.
Riggsby, McCoy, Haberman and Falciani, "Mastering Lotus Notes
and Domino 6." 2003, pp. 18, 22, 33-35, 47, 122, 123, 215-241, 378.
Find any file or email on your PC as fast as you can type! , http://
www.xl.com, 2003, 1 page.
"About Google Desktop Search", http://www.desktop.google.com/
about.html, Oct. 15, 2004, 8 pages.
"Lookout", http://www.lookoutsoft.com, Apr. 22, 2005, 20 pages.
"Yahoo to test desktop search",
http://news.com.com/
yahoo+to+test+desktop+searcach/2100-103 2_3-5486381.html,
Dec. 9, 2004, 6 pages.
"Microsoft reinvents its own wheel", http://www.theinquirer.net/default.aspx?article~20214, Dec. 14, 2004, 5 pages.
"Microsoft Desktop Search (beta)", http://www. pcmag.corn/article2/
0.1895.1771841.00.asp, Mar. 2, 2005.
"Windows Desktop Search". Http://kunal.kundale.net/reviews/wds.
html, Jul. 10, 2005, 7 pages.
"Microsoft Enters Desktop Search Fray", http://www.internetnews.
corn/ent-news/article.php/3447331, Dec. 13, 2004, 5 pages.
"User Interface Architecture," Data Master 2003, 2 pages.
Kim et al., "Migrating Legacy Software Systems to CORBA based
Distributed Environments through an Automatic Wrapper Generation
Technique,"
http://www.cs.colostate.edu/-bieman/Pubs/
KimBiemanOO.pdf, accessed on Jan. 28, 2009, 6 pages.
Selca, Viki "Customizing the Office Fluent User interface in Access
2007," Microsoft Corporation, Dec. 2006, 22 pages.
Parry; "CREWS: A Component-Driven, Run-Time Extensible Web
Service Framework"; http://eprints.ru.ac.za/74/0 l/Parry-MSC.pdf;
Dec. 2003; 103 Pgs.
Louw, et al.; "Extensible Web Browser Security"; http://www.cs.uic.
edu/-venkat/research/papers/extensi bl e-browser-dimva07. pdf; pp.
1-20, Oct. 16, 2007.
W3C, "Positioning HTML Elements with Cascading Style Sheets,"
Aug. 19, 2007, pp. 1-14, Retrieved from the Internet <http://www.
w3 .org/TR/NOTE-layout>.
C. Jacobs et al., "Adaptive Grid-Based Document Layout", Microsoft
Research, ACM, Jul. 2003, pp. 838-847.
J. Bateman et al., "Towards Constructive Text, Diagram, and Layout
Generation for Information Presentation", Association for Computational Linguistics, 2001, pp. 409-449.
S. Feiner, "A Grid-Based Approach to Automating Display Layout",
In Proceedings of Graphics Interface'88, pp. 249-254.
K. Gajos et al., "Supple: Automatically Generating User Interfaces",
ACM, Jan. 2004, pp. 1-8.
NZ Application No. 541301, Examination Report dated Jul. 25, 2005.
NZ Application No. 541299, Examination Report dated Jul. 25, 200 5.
Chilean Second Office Action dated Nov. 4, 2009 cited in Appln No.
1770-2005.
Chilean Office Action dated Dec. 4, 2009 cited in Appln No. 17682005.
Chilean Second Office Action dated Jan. 29, 2010 cited inAppln No.
1769-2005.
PCT Search Report and Written Opinion dated Nov. 30, 2009 cited in
U.S. Official Action dated Jun. 14, 2007 in U.S. Appl. No.10/780,547
(Perkins matter).
U.S. Official Action dated Oct. 4, 2007 in U.S. Appl. No. 10/780,547
(Perkins matter).
U.S. Official Action dated May 14, 2008 m U.S. Appl. No.
10/780,547 (Perkins matter).
U.S. Official Action dated May 30, 2008 m U.S. Appl. No.
111430,562.
111430,416.
111430,562.
U.S. Official Action dated Jan. 9, 2009 in U.S. Appl. No. 111430,561.
U.S. OfficialActiondatedFeb. 20, 2009 in U.S. Appl. No.10/780,547
(Perkins matter).

US 8,255,828 B2
8
U.S. Otlicial Action dated Jun. 19, 2009 in U.S. Appl. No.
111430,562.
ll.S. Official Action dated Aug. 17. 2009 in U.S. Appl. No.
111430,56 J.
U.S. Official Action dated Sep. 15, 2009 in ll.S. Appl. No.
101780,547 (Perkins matter).
ll.S. Official Action dated Jan. 7, 2010 in U.S.Appl. No. 111430,562.
11!782,059.
ll.S. Official Action dated Feb. 19, 2010 in U.S. Appl. No.
101955.942.
Aoyagi, Hideo, "Mail Mac Fan Special 33"; Manichi Communications Inc., Mar. 1, 2004, 5 pgs.
Morita, Utako; "Literatme Searching System, 'JDream"'; Online
Search; vol. 23, No. 4; The Society of Japan Terminal. Dec. 2002; 5
pgs.
Milstein, Sarah; '"The Missing Manual: The book that should have
been in the box", First Edition; O'Reilly Japan, Inc.; Nov. 25. 2004;
1 pg.
Cole; "New Arrival! Forefront of Downloading"; Mac People; vol.
1 L No. 10; ASCII C01poration; Aug. 31, 2005; l pg.
Sada, Morihiro; "Clue for Managing Common Data Filed on Server";
Business Personal Computer Age; vol. 15, No. 7; Dempa Publications, Inc.; Jul. l, 1997; 1 pg.
JapaneseKoticeofRejectiondated:"rov. 25. 2011 citedinAppln. No.
2008-531249.
Korean Notice of Rejection dated Jan. 30, 2012 cited in Appln No.
I 0-2004-0048176.
Japanese Notice of Rejection dated Feb. 3. 2012 cited inAppln No.
2008-530218.
U.S. Official Action dated Jan. 26. 2012 in U.S. Appl. No.
121464,584.
ll.S. Appl. No. 13/027,289, filed Feb. 15, 2011 entitled "Floating
Command Object".
Microsoft Press, Microsoft Computer Dictionaiy, Microsoft Press,
Fifth Edition, 2002, pp. 374, 382.
Halvorson et al., Microsoft Office Professional Official Manual, Aug.
20, 2002, 10 pgs.
Adler. "Emerging Standards for Component Software."
Cybersquare, 1995 IEEE, 10 pgs.
Chamberland, et al., "IBMVisualAge for Java," vol. 37, No. 3, 1998,
26
pgs.,
http://researchweb.watson.ibm.com/joll111al/ sj/373/
chamberland.html [Accessed Feb. 6, 2007].
Zykov, "ConceptModcller: a Problem-Oriented Visual SDK for Globally Distributed Enterprise Systems." Proceedings of the 7th International Workshop on Computer Science and Information Technologies, CSIT 2005, 4 pgs.
"Create Office add-ins: ribbons, toolbars, taskpanes, menus etc.",
http://www.add-in-express.com/creating-addins-blog/feed/, Jul. 4,
2007.
"RibbonX API: Extend the 2007 Office System with Your Own
Ribbon Tabs and Controls", 2007. Microsoft Corporation, http:/."
msdn.microsoft.com/msdnmag/issues.'07!02RibbonXide-fault.aspx.
"'Wnafs New in Excel 2007'', Feb. 26, 2007.
Whitechapel et al., "Microsoft Visual Studio 2005 Tools for the 2007
Microsoft
Office",
Sep.
2006,
http:i/72.14.235.104/
search?q=cache:lGXduIDB6o-wJ:download.microsoft.com/download/3/21d/3 2db7049-bc04-4c 79-a91b-7f62eaae7 54a/
VST02005SE~ Tutorial.
doc+ This+tutorial+focuses+on+the+new+featmes+introduced+in+
VSTO+ 2005 ~... SE&hl =en&ct=clnk&cd=3&gl=in.
PCT Written Opinion and Search Rep01t dated Jan. 9, 2007 cited in
European Search Report dated Nov. 25, 2008 cited in Application EP
06 79 0087.
European Office Action mailed :\iai 9, 2009, cited in Appln No.
06790087.8.
Chinese Office Action dated Nov. 27, 2009 cited in Appln No.
200680033212.3.
Russian Office Action dated Dec. 28, 2009 cited in Appln No.
2005125836/09(029010).
Mexican Office Action dated May 4, 2010 cited in Appln No. 2005/
008354.
Israeli Office Action dated Jul. 5, 2010 cited in Appln No. 169718.
Notice on Reexamination dated Jan. 21. 2011 cited in Appln No.

200510089514.X.
Chinese Third Office Action dated Feb. 10, 2011 cited inAppln No.
200680033212.3.
U.S. Official Action dated Sep. 15. 2009 m U.S. Appl. No.
11/217,071.
11/401.470.
"The New "Office 2007'' User Interface", Microsoft Corporation
2005, 32 pgs.
"The New Look in Office 12 I Office 2007'', Office Watch, posted
Sep.20,2005,9
Atwood,
a Word is Worth a Thousand Icons", Coding
Horror, Feb. 22, 2006, 9 pgs.
PCT Written Opinion and Search Report dated Nov. 29, 2010 cited in
Egypt Official Decision dated Mar. 14, 2011 cited in Appln No.
2005080371
:\1alaysian Substantive Exainination Adverse Report dated :\1ai 15,
2011 cited in Appln No. PI 20053260.
2nd Notice on Reexamination dated Mar. 25, 2011 citedinApplnNo.
200510089514.X.
12' 163,784.
U.S. Official Action dated Apr. 21. 2011 in ll.S. Appl. No.
111445.393
U.S. Official Action dated Apr. 21. 2011 m U.S. Appl. Ko.
12/574,256.
U.S. Appl. No. 13/102,633, filed May 6, 2011 entitled "Maikup
Based Extensibility for User Interfaces".
Philippines Examiner's Action dated Apr. 12, 2011 cited in Appln
Ko. 1-2005-00404.
Japanese Notice of Rejection dated May 6, 2011 cited in Appln. :"ro.
2005-236089.
Japanese Notice of Rejection dated May 6, 2011 cited inAppln. No.
2005-236087.
Chinese Second Office Action dated May 19, 2011 cited in Appln No.
200780020312.7.
U.S. Official Action dated May 5, 2011 in U.S. Appl. No. 10/836,154.
U.S. Official Action dated May 12, 2011 m U.S. Appl. :"ro.
12/753.923.
U.S. Official Action dated May 19, 2011 in U.S. Appl. No.
111430,562.
U.S. Official Action dated May 19. 2011 m U.S. Appl. No.
10/851,506.
Seo et al. "Hangul Office 2000 Tutoring Book", Sep. 15, 2000, 16
pgs.
Office 2007, Microsoft, Released on Nov. 6, 2006, 23
No. PA/a/
Mexican Office Action dated Jan. 6, 2011 cited in
2005/008354.
Mexican Office Action dated Mar. 31, 2011 cited in Appln No.
PA/a/20051008351.
Mexican Office Action dated :Mar. 31, 2011 cited in Appln No.
PA/a/2005/008349.
:Mexican Office Action dated Mar. 3L 2011 cited in Appln No.
PA/a/2005/008350.
Korean Notice of Rejection dated May 17, 2011 cited in Appln No.
10-2004-48176.
Russian Office Action dated Jun. 14, 2011 cited in Appln No.
2008147090.
U.S. Official Action dated Jun. 9, 2011 in U.S. Appl. No. 121464,584.
Marsh, Bruce, Integrating Spreadsheet Templates and Data Analysis
Into Fluid Power Instruction, Journal of Industrial Technology, vol.
16, No. 4, Aug. 2000-0ct. 2000. http://www.nait.org/jit/Articlesl
marsh071200.pdf, 7 pages.
Oracle Discoverer Desktop User's Guide; lOg (9.0.4) for Windows;
Part No. 810272-0 l; published 2003; http://download-uk.oracle.
com/docs/cd/B12166~0libi/Bl0272~01/3graph.htm;
1-18.
ProjectLisa K. Averett; Joshua R. Knisley; Mark A. Marvin;
ing Tactical Network and Systems Management; 1995 IEEE pp.
906-910.
Mexican Office Action dated Feb. 5, 2009 cited in Appln No. PA/a/
2005/008349.

US 8,255,828 B2
Page 9
Mexican Office Action dated Mar. 3, 2009 cited in Appln No. PAia!
2005/008351 English language only.
Chinese Third Office Action dated Jun. 19, 2009 cited in Appln No.
200510092139.4.
2005120363/28(023023).
111445,393.
U.S. Official Action dated Oct. 8, 2008 cited in U.S. Appl. No.
111445,393.
U.S. Official Action dated Jun. 1, 2009, U.S. Appl. No. 111445,393.
U.S. Official Action dated Jun. 8, 2009 in U.S. Appl. No. 10/982,073.
U.S. Official Action dated Jun. 10, 2009 m U.S. Appl. No.
111154,278.
111151,686.
10/607,020.
The Discussion Board Component of Blackboard: An Instructor's
Guide; Aug. 2004; 23 pgs.
Hock, "Yahoo! to the Max"; May 10, 2005; 5 excerpted pgs.
Homeworking Forum; archived Dec. 6, 2004; 11 pgs.
Gina Danielle Venolia et al., Supporting Email Workflow, revised
Dec. 2001; 11 pgs.
Mock et al., "An Experimental Framework for Email Categorization
and Management", Sep. 9-12, 2001, 3 pgs.
Yang, "Email Categorization Using Fast Machine Learning Algorithms", 2002,8 pgs.
Islam et al., "Email Categorization Using Multi Stage Classification
Technique", 2007, 3 pgs.
"Look and Layout", retrieved at <<http://liv.ac.uk/csd/email/outlook/layout.htm>>, University of Liverpool, 9 pgs, Feb. 29, 2008.
"Preview Pane in Conversation: 4 pane view", 2005, Zinbra Inc., 3
pgs.
"Reading Pane in Conversation View", retrieved at <<http://www.
zimbra. com/forums/users/ 5918-reading-pane-conversation -view.
html>>, 5 pgs, Feb. 29, 2008.
New Zealand Office Action dated Oct. 14, 2009 cited in NZ Application No. 566363.
European Office Action dated Jun. 15, 2010 cited in EP Application
No. 06814358.5.
Russian Office Action dated Jul. 26, 2010 cited in RU Application No.
2008109034, w/translation.
Chinese Office Action dated Nov. 11, 2010 cited in CN Application
No. 200680032789.2, w/translation.
Russian Office Action dated Nov. 12, 2010 cited in Application No.
2008109034, w/translation.
Australian OA dated Jan. 17, 2011 cited in Application No.
2006287408.
Chinese Second Office Action dated Apr. 7, 2011 cited in Application
No. 200680032789.2, w/translation.
Japanese Office Action dated Jun. 10, 2011 cited in JP Application
No. 2008-530229, w/translation.
200680030421.2.
Chinese Second Office Action dated Jul. 14, 2011 cited in Appln No.
20680018095 .3.
Chinese Decision on Rejection dated Jul. 21, 2011 cited in Appln No.
20068032789.2.
U.S. Official Action dated Oct. 5, 2009 in U.S. Appl. No. 111332,822.
12/144,642.
111332,822.
12/144,642.
U.S. Official Action dated Jan. 6, 2011 in U.S.Appl. No. 12/142,927.
U.S. Official Action dated Feb. 1, 2011 in U.S. Appl. No. 111332,822.
U.S. Official Action dated Feb. 1, 2011 in U.S.Appl. No. 12/144,642.
U.S. Official Action dated Jun. 7, 2011 in U.S. Appl. No. 111332,822.
U.S. Official Action dated Jul. 8, 2011 in U.S. Appl. No. 111401,470.
U.S. Official Action dated Jul. 8, 2011 in U.S. Appl. No. 12/163,784.

U.S. Appl. No. 111154,278, filed Jun. 16, 2005 entitled "Cross Version and Cross Product User Interface Compatibility".
U.S. Appl. No. 111151,686, filed Jun. 13, 2005 entitled "Floating
Command Object".
U.S. Appl. No. 111401,470, filed Apr. 10, 2006 entitled "Command
User Interface for Displaying Selectable Functionality Controls in a
Database Application".
U.S. Appl. No. 10/982,073, filed Nov. 5, 2004 entitled "Gallery User
Interface Controls".
U.S.Appl. No. 10/607,020, filed Jun. 26, 2003 entitled "Side-by-Side
Shared Calendars".
U.S. Appl. No. 10/741,407, filed Dec. 19, 2003 entitled "Methods,
Systems, and Computer-Readable Mediums for Providing Persisting
and Continuously Updating Search Folders".
U.S. Appl. No. 11/782,059, filed Jul. 24, 2007 entitled "Methods,
U.S. Appl. No. 10/836,154, filed Apr. 30, 2004 entitled "Combined
Content Selection and Display User Interface".
U.S. Appl. No. 10/848,774, filed May 19, 2004 entitled "Automatic
Grouping of Electronic Mail".
U.S. Appl. No. 10/851,442, filed May 21, 2004 entitled "Conversation Grouping of Electronic Mail Records".
U.S. Appl. No. 10/851,506, filed May 21, 2004 entitled "Adaptive
Multi-Line View User Interface".
U.S.Appl. No. 10/955,941, filed Sep. 30, 2004 entitled "An Improved
Controls that are Relevant to a Selected Object".
User for Displaying Selectable Software Functionality Controls that
are Contextually Relevant to a Selected Object".
User Interface for Displaying a Gallery of Formatting Options Applicable to a Selected Object".
U.S. Appl. No. 10/955,928, filed Sep. 30, 2004 entitled "User Interface for Providing Task Management and Calendar Information".
U.S. Appl. No. 10/800,056, filed Mar. 12, 2004 entitled "Method and
System for Data Binding in a Block Structured User Interface Scripting Language".
Charles Rich et al., "Segmented Interaction History in a Collaborative Interface Agent," 1997, ACM, pp. 23-30.
Andrew Dwelly, "Functions and Dynamic User Interface," 1989,
ACM, pp. 371-381.
Gordon Kurtenbach et al., "The Hotbox: Efficient Access to a Large
Number of Menu-items," ACM, 1999, pp. 231-237, May 1999.
Charles Rich et al., "Adding a Collaborative Agent to Graphical User
Interfaces," 1996, ACM, pp. 21-30.
Boyce, "Microsoft Outlook Inside Out," 2001, pp. 67, 68, 109, 110,
230, 231, 310, 316-318, 798.
Halvorson et al., "Microsoft Office XP Inside Out," 2001, pp. 10051009, 1015, 1023-1028, 1036-1039, 1093.
Riggsby et al., "Mastering Lotus Notes and Domino 6," 2003, pp.
135-139.
135-138, 607-612.
Khare et al., "The Origin of (Document) Species," University of
California, 1998, 9 pgs.
"Separate Structure and Presentation," http://www.webreference.
corn/html/tutorial5/1.html, Aug. 20, 1998, 4 pgs.
"The Style Attribute and CSS Declarations," http://www.webreference.com/html/tutorial5/2, Aug. 20, 1998, 4 pgs.
"What's Hot in Internet Services?" http://www.webreference.com/
html/tutorial 5/3, Aug. 20, 1998, 3 pgs.
"The Style Element & CSS Selectors," http://www.webreference.
http://www.webreference.com/html/tutorial5/5.html, Aug. 20, 1998,
3 pgs.
"ID & Class Selectors, Pseudoclasses," http://www.webreference.
http://www. webreference.corn/html/tutorial 5/7 .html, Aug. 20,
1998, 3 pgs.

US 8,255,828 B2
Page 10
2 pgs.
"External Style Sheets," http://www.webreference.com/html/
tutorial5/9.html, Aug. 20, 1998, 3 pgs.
Raman, "Cascaded Speech Style Sheets," 1997, 7 pgs.
"Primary Windows," http://www-03.ibm.com/servers/eserver/iseries/navigator/guidelines/primary.html, 23 pgs, Feb. 23, 2007.
Schumaker, "User Interface Standards," http://msdn2.microsoft.
com/en-us/library/aa217660(office.l l.d~printer).aspx, Sep. 2001, 5
pgs.
Budinsky et al., "WebSphere Studio Overview," http://researchweb.
watson.ibm.com/journal/sj/432/budinsky.html, May6, 2004, 25 pgs.
Gordon Padwick, Using Microsoft Outlook 2000, Que, Sp. Ed., May
1999.
Becker et al., "Virtual Folders: Database Support for Electronic Messages Classification," Pontificia Universidade Catolica do Rio
Grande do Sul, Porto Alegre, Brazil, pp. 163-170, 2010.
Goldberg et al., "Using Collaborative Filtering to Weave an Information Tapestry," Communication of the ACM, vol. 35, No. 12, pp.
61-70, Dec. 1992.
Liu et al., "Continual Queries for Internet Scale Event-Driven Information Delivery," IEEE Transactions on Knowledge and Data Engineering, vol. 11, Issue 1, pp. 610-628, 1999.
Chen et al., "NiagaraCQ: A Scalable Continuous Query System for
Internet Databases," Int. Conf. on Management of Data, Proc. of the
2000 ACM SIGMOD Int. Conf. on Management of Data, pp. 379390, 2000.
Marshall School of Business: "Workshop IV-Calendar," http://
www.marshall.usc.edu/computing/PDF _Files/Outlook/Workshop4, PDF, Apr. 10, 2000, pp. 1-4.
M. Williams, "Programming Windows NT4: Unleashed," Sams Publishing, Indianapolis, 1996, pp. index & 167-185.
"Microsoft Outlook 2000: Introduction to Calendar," Version Mar.
25, 2002, http://www.uakron.edu/its/learning/training/docs/Calendar032502.pdf, Mar. 25, 2002, pp. 1-52.
Screen Dumps of Microsoft Outlook (1999, pp. 1-3).
"To-do List--effective task management software" [on line], Aug. 3,
2004,
http://web.archive.org/web/20040804 l 03 24 5/www.
htpshareware.com/todolist/changes.txt and http://web.archive.org/
web/20040803075026/www.htpshareware.com/todolist/index.
htm>.
"Rainy's Rainlendar" [online], Aug. 12, 2004, http://web.archive.
org/web/20040811043048/www.ipi.fi/-rainy/Rainlendard/Manual.
html and http://web.archive.org/web/20040812092939/http://www.
ipi.fi/-rainy/index.php?pn~probjects&project~rainlendar>.
Microsoft Windows XP Professional, Version 2002, Service pack 2,

3 pgs.
Camarda, Using Microsoft Word 97, copyright 1997, QUE Corporation, pp. 412, 968.
Danish Written Opinion Appl. No. SG 200504508-3 dated Sep. 18,
2006.
Danish Search Report Appl. No. SG 200504475-5 dated Sep. 19,
2006.
Australian Search Report dated Jan. 16, 2007 cited in Singapore
Application No. 200504474-8.
PCT Search Report dated Feb. 26, 2007 cited in International Application No. PCT/US2006/034993.
European Communicated dated Oct. 20, 2005 cited in EP Application
No. 04102463.0-2211 PCT/.
Australian Written Opinion/Search Report cited in Singapore Application No. 200505257-6 mailed Feb. 12, 2007.
09/896,384.
U.S. Notice ofAllowance dated Aug. 24, 2004 cited in U.S. Appl. No.
09/896,384.
U.S. Office Action dated Apr. 27, 2006 cited in U.S. Appl. No.
10/800,056.
10/800,056.
10/851,506.
U.S. Office Action dated Jun. 4, 2007 cited in U.S. Appl. No.
10/955,940.
U.S. Office Action dated Jul. 26, 2006 cited in U.S. Appl. No.
10/741,407.
10/741,407.
U.S. Notice of Allowance dated Apr. 10, 2007 cited in U.S.Appl. No.
10/741,407.
10/607,020.
10/836,154.
10/955,928.
U.S. Notice of Allowance dated Jul. 5, 2007 cited in U.S. Appl. No.
10/607,020.
10/955,941.
10/955,942.
Ohmori, Yasuo et al., "Eigyo Mind-A Sales Support Tool," PFU
Tech. Rev., vol. 10, No. 1, pp. 32-38, PFU Limited, May 1, 1999.
Mexican Office Action dated May 26, 2011 cited in Appln. No.
MX/a/2009/004151.
Korean Notice of Preliminary Rejection dated Jul. 22, 2011 cited in
Appln No. 10-2005-0058160.
Japanese Notice of Rejection dated Aug. 12, 2011 citedinAppln. No.
2005-184990.
Korean Preliminary Rejection dated Aug. 23, 2011 cited in Appln.
No. 10-2005-0067236.
No. 10-2005-0067411.
Chinese Office Action dated Aug. 26, 2011 cited in Appln No.
200980112454.5.
No. 10-2005-0066460.
Australian Office Action dated Aug. 31, 2011 cited in Appln. No.
2007255043.
3rd Official Notice, Mailing No. 134028, dated Sep. 16, 2001 cited in
Appln. No. PH1707009.
4th Official Notice, Mailing No. 134052, dated Sep. 16, 2001 cited in
Appln. No. PH1707009.
12/372,386.
12/163,758.
Mexican Office Action dated Oct. 3, 2011 cited in Appln. No. MX/a/
2008/014849.
U.S. Official Action dated Oct. 25, 2011 in U.S. Appl. No.
12/144,642.
U.S. Official Action dated Nov. 2, 2011 cited in U.S. Appl. No.
10/836,154.
PCT Written Opinion and Search Report dated Sep. 2, 2010 cited in
Malaysian Substantive Examination Adverse Report dated Sep. 30,
Australian Office Action dated Oct. 21, 2010 cited in Appln No.
2006284908.
Chinese Second Office Action dated Oct. 29, 2010 cited in Appln No.
200680030421.2.
U.S.Appl. No. 12/954,952, filed Sep. 29, 2010 entitled "Gallery User
Bellavista et al., "A Mobile Infrastructure for Terminal, User, and
Resource Mobility", Network Operations and Management Symposium, NOMS 2000, pp. 877-890, IEEE/IFIP.
"Microsoft Office Professional Plus 2007", 2006, Microsoft Corporation; 66 pgs.
U.S. OfficialActiondatedNov. 9, 2010 in U.S. Appl. No.10/607,020.
U.S. Official Action dated Nov. 22, 2010 m U.S. Appl. No.
11/782,059.
U.S. Official Action dated Nov. 26, 2010 m U.S. Appl. No.
12/753,923.

US 8,255,828 B2
Page 11
Dr. Dobb's Journal; "Windows 95 Common Controls"; May 1, 1995;
12 pgs.
Mexican Office Action Summary, dated Sep. 22, 2011 cited in Appln.
No. MX/a/2008/003342.
Japanese Notice of Rejection dated Nov. 4, 2011 cited in Appln No.
2008-513476.
European Search Report dated Dec. 6, 2011 cited in Appln No.
06803424.8.
Japanese Notice of Rejection dated Dec. 16, 2011 cited inAppln No.
2008-529218.
U.S. Official Action dated Jan. 12, 2012 cited in U.S. Appl. No.
11/782,059.
U.S. Official Action dated Jan. 25, 2012 in U.S. Appl. No.
12/059,644.
Taiwan Office Action dated Feb. 8, 2012 cited in Appln No.
94123640, with Eng Lang Summary.
Taiwan Search Report dated Mar. 14, 2012 cited in Appln No.
094123420.
Chilean Office Action dated Mar. 29, 2012 cited in Appln No. 15602010, w/English Language Summary.
Chilean Office Action dated Mar. 29, 2012 cited in Appln No. 15592010, w/English Language Summary.
India First Examination Report dated Mar. 30, 2012 cited in Appln
No. 1817/DEL/2005.
Japanese Notice of Allowance dated Apr. 11, 2012 cited in Appln No.
2008-530229.
U.S. Official Action dated Feb. 27, 2012 m U.S. Appl. No.
12/372,386.
12/142,927.
U.S. Official Action dated Apr. 5, 2012 in U.S. Appl. No. 12/163,758.
13/102,633.
11/782,059.
Malaysian Substantive Examination Adverse Report dated Jan. 31,
Malaysian Substantive Examination Adverse Report dated Jan. 31,
European Search Report dated Feb. 10, 2012 cited in Appln No.
05107153.8.
05107157.9.
05107184.3.
Chinese Office Action dated Feb. 29, 2012 cited in Appln No.
200980124664.9.
Chinese Decision on Rejection dated Mar. 7, 2012 cited in Appln No.
200780020312.7.
Chinese Second Office Action dated Mar. 9, 2012 cited in Appln No.
200980124383.0.
Japanese Notice of Final Rejection dated Mar. 9, 2012 cited inAppln
No. 2008-513476.
European Search Report dated Mar. 16, 2012 cited in Appln No.
05107186.6.
Taiwan Notice of Allowance dated Mar. 29, 2012 cited in Appln No.
10120306600.
Douglas et al., "Dynamic Popup Menu Titles"; IP.Com Journal,
IP.COM Inc., West Henrietta, NY, Aug. 1, 1992, 2 pgs. (cited in Feb.
28, 2012 Search Report).
Haden et al.; "Scrollable Popup Menu with Selection Tracking Display of Graphical Objects"; IP.Com Journal, IP.COM Inc., West
Henrietta, NY, Aug. 1, 1994, 6 pgs. (cited in Feb. 28, 2012 Search
Report).
"Index Card Metaphor for Multiple Property Sheets Associated with
A Given Object"; IBM Technical Disclosure Bulletin, International
Business Machines Corp., vol. 33, No. 3A,Aug. 1, 1990, 2 pgs. (cited
in Feb. 15, 2012 Search Report).
"Menu Selection Method for Related Attributes"; IBM Technical
Disclosure Bulletin, International Business Machines Corp., vol. 33,
No. 6B, Nov. 1990, 3 pgs. (cited in Feb. 15, 2012 Search Report).
U.S. Appl. No. 13/437,031, filed Apr. 2, 2012 entitled "Automatic
Grouping of Electronic Mail''.
U.S. Appl. No. 13/427,939, filed Mar. 23, 2012 entitled "An
Improved User Interface for Displaying a Gallery of Formatting
Options Applicable to a Selected Object''.
European Communication dated Jun. 23, 2008 cited in European
Application No. 04102463.9-221111517239.
U.S. Appl. No. 13/464,572 filed May 4, 2012 entitled "Accessing an
Out-Space User Interface for a Document Editor Program''.
Changing a Graph Type: Ultimate Illustration of Excel 2002 for
Windows XP, General Book, X-media Corp., Aug. 31, 2002, p. 224
(cited in May 11, 2012 JP NOR).
Russel et al., (hereinafter "Russel"); "Special Edition Using
Microsoft Office Outlook 2003"; Que publishing on Sep. 25,
2003, 71 pgs. (cited in Jun. 6, 2012 OA).
Chinese Fourth Office Action dated Apr. 27, 2012 cited in Appln No.
200680018095.3.
Japanese Notice of Rejection dated May 11, 2012 citedinAppln No.
2009-513223.
Mexican Office Action dated Jun. 6, 2012 cited in Appln No. MX/a/
2008/014849.
U.S. OfficialActiondatedMay8, 2012 in U.S.Appl. No. 12/144,642.
U.S. Official Action dated Jun. 6, 2012 in U.S.Appl. No. 12/777,287.
U.S. Official Action dated Jun. 3, 2010 in U.S.Appl. No. 12/028,797.
U.S. Official Acton dated Jun. 22, 2010 in U.S.Appl. No. 111430,562.
U.S. Official Action dated Jun. 23, 2010 in U.S. Appl. No.
10/955,940.
U.S. Official Action dated Jul. 1, 2010 in U.S. Appl. No. 111782,059.
Screen Shot of MS_Office_2003; (Microsoft Corporation,
Microsoft Office Professional Edition 2003; 6 pages).
Israeli Office Action dated May 3, 2012 cited in Appln No. 169718.
Taiwan Office Action dated May 14, 2012 cited in Appln No.
94122180, with Eng Lang Summary.
Chinese Second Office Action dated Jun. 18, 2012 in Appln No.
200910148820.4.
U.S. Official Action dated Jun. 19, 2012 in U.S. Appl. No.
12/769,787.
* cited by examiner
22
4
CENTRAL
PROCESSING
UNIT
12
SYSTEM
MEMORY
RANDOM
ACCESS
MEMORY
NETWORK
INTERFACE
UNIT
105
10
READ
ONLY
MEMORY
INPUT/OUTPUT
CONTROLLER
20
OPERATING
SYSTEM
MASS STORAGE
DEVICE
APPLICATION
PROGRAM
SLIDE
PRESENTATION
APPLICATION
WORD
125
PROCESSING
APPLICATION
130
ELECTRONIC
MAIL
APPLICATION
Fig.1
SPREADSHEET
APPLICATION
DATABASE
APPLICATION
14
140
U.S. Patent
Aug. 28, 2012
Sheet 2of8
US 8,255,828 B2
212
filtr
~ [II
~
,
[@
41
7-~-
t<!j\~
"
lillf<9
g..,,._
("O
5J@mmllilm)
ffij-00@)
\1
315
310
=
~
>
=
Abraham Llncaln
Second Inaugural Address
i'iBfYllf1Y,,..M.a.rx:J:i.5, ..l.{!J
JC
Abrah11m Lincoln's second inauguration speech was made on March 4, 1865.
1ln:. thcologicolTJ' i1'fim.:jc ~h h2J hem wuld7 aaltnml~ a& On.it oj'tmi most Tcma,.kahi.e tfcc~ 112 ~ican
history. Th.a Londo'1.s):iectdfo, ~aid qfit, "~cannot r..ad 1'th'fthout a remlHd C01?fC'ffo11'fhat1tf.s the nobtcti' political
doctm"Mnt kmwn to hi:stor1, aM Jha..t!d h:aefor the nahon and the Jti:ateJmen ht left behind him $0mtthing ofi::i uicrcd al'ld
almo.31 popheHc charader."
.k.murlul Noah &o1*s. on qefl'i~:; to the jpat:h, J.aid that O!I Lincoln advonJ:edjrom hi:. .se.at.. ' i:.1 roat of applause shock
the air, an.-:( ag.:in wr1 agni'n rcpcder1,Jina11.y &cd awqF ct'l the oUo fringe efHt throng, l1b a .sw~epttg waw upon the
shoU .Just af that momuif the &II'!, wkfdf kmJ belU'I ohJ.curerJ aJJ &,J, bur~jbrfh in itJ. UJ1Clm.ukJ meridian Jlmdor, rzn:1
flooded NM SJ*f:le wtth gbry and W#h lig111," ~:aid .tinroln Iatw told him. "Did you mtk:'11'1d SlblburM? 1t made
"')'hflMIJUT!IP.#
~'ngfo Eh~
IM autl#N~ t#fivtdtht :;pf/ht>t '"pl'ofowd.silence, alffU//tzom1pa1~ prt>'f<tk#lic~t.m"1

~ ..I.oddng do'lfltl ihlO thlt}ace~<>fthepccpie. iilwnimted ~the tnifidr4)1J ofthe :un. <14 cQUJd .sH mott.teye.s and
even karfa/faceJ."'
Brook.$ 1.1! ob.KTVli: ,.But dl<fly mcmcrablc in the mind oftht:wt. who saw thlt :..0nd lnaUfUlation mwt ;;Jill 1<ema1'n ffK
tali~pathdic, melanchalyjli-lre<>Jthl man who, then inducted i>io o.fice in tJ,. mith.ta,fth#. glad accb:dm qfthou~qf
poople. and ilfwninu.i b,1 die Mcq#in brfllitDr ofa Mmch .umbu1Jt, wm alraody JtaruJing in tfR 5hadow ofdeath"
Fellow~Countrymen;
At this second appearing to take the oath of the Prcudential office there is less occasion for an extended
address than there was: at th~ first Then a statement 11omcwhat in detail ofa coune to be pursued seemed
fitting and proper. Now, at the expiration of four
years~
during which pubhc declarations have been
constani:ly caUed Cortb Qn every point and pWe of the great contest which still absbs the attention and
engross.es the energies of the nahon. l1ttle that is new could be presented The progre:s11 of our arms. upor.
Fig. 3
N
0
.....
N
U.S. Patent
Aug. 28, 2012
Sheet 4of8
US 8,255,828 B2
-~
~
~ B1eab
~
Bootmarl:.,.
~ru Objct
~.r ~ Aa.
Effects. Borders .... case ...
Fon1 Details ...
510
515
Abra ha
Secondlnaugur
5?.turday, March 4. l
Abraham Lincoln's
second inauguration
speech was made on
March 4, 1865.
:~s
Asian 1ext font;
CJ
im::=]L~
jMSMincho
All text ----- . ~nt ~olor:
I Automatic
\,!nderline style:
~J I(none)
Uocertne <'ior:
l:..J f
;.utnmatc
1J1
Emphasis marki
--:J I
(none)
=-
l~I
('D
('D
.....
Effects --- --- -- - -
Strifiethrough
Double strikfthrough
OQutline
Shadot;.
Su11.erscript
01;.mboss
Ot:Jidden
Engray_e
Osu~script
Pr~e,_ie_w_-_--_-__
-_--_---------------~
Journalist Noah 8
lh""1s_is_a_T_ru-eT_yp_e_fo,...n-t-.lh.,..1-.s-fo-nt_w_'ill_be_u_s_ed.,..o_n_b_oth-pr-in-ter_a_n_d_srr_e_en_._ _,
,_ _ __
Ul
0Smallcaps
O!l!I caps
This theologically
documents in Am
conviction that it i
the statesmen he
AaBbCcYyZz
.....
ost remarkable
d it without a renewed
hove for the nation and
haracter.
QO
'I'
I I
I
ced from his seat, "a roar
of applause shoo [ ~efault... ]

OK
-J I cancel
the outer fringe of the
throng, like a swe
h had been obscured all
day, burst forth in its unclot1ded meridian splendor, and flooded the spectacle with glory and with light.
Brooks said Lincoln later told him, oid you notice tlwt mnburst? It made my heart jump.
!
I
rJl
00
According to Brooks, the audience received the speech in "profound silence," although some passages
~
lflfll
Fig. 5
'N
tit
tit
Oo
N
00
=
N
205
~File
210
Edit
v;-
~ ~ ">
~ -~ ~ 1TulrrrID :J_~~J ffi;ll"'"""'Lil:l1l;_L~_l~J 111.;;:~~:;'~1
~~-
----------~-~~-Normal
llftgjJ
~~~
. . Verdana
=:
Illustration ....
52
rm
Table.-
IQ)~
~:> Hyperlint_
f2
tm
Symbol....
~Too
-_e--;j
j
_________
~ Aa.
Etfect5.,.. Borders ...
Case ...
Paragraph Details...
510
Abraham L
General ---
Second Inaugural Ad
Saturday, March" 1865
Alignment:
~l@~ll~~~~llv~]
Qutline level: jsody :ext
1v;I
Indentation
Abraham Lincoln's second

inauguration speech was
made on March 4, 1865.
be ft:
~cial:
S:c:
[v=-1
l~(n-on-e)_ _ _
!l}ght:
AutomabcaUy aruust right indent when document grid is defaied
Spacing--------------------
g,efore:
This theologically inteme

documents in American
conviction that it is the n
the statesmen he le~ be!
Journalist Noah Brooks,
of applause shook the ai
throng, like a sweeping 1
day, burst forth in its unc
Brooks said Lincoln later
Li!! spacing:
[ Si119le
!t:
______j".'.,.J ~
Dodt add $Dace bet',.-een pJragrnphs of the ~arne sty1e
~Snap to grid aihen document grid is defined

Preview -- - - - -
~-:=-~'..:~::,; ~:-:~~ .. ~~7~ ~~/;.;~~; ~;:.~~ :~:;; ~;~.
r-.
~-,, r "'"-: ...;:

t"-"";~< ~.~, ~:-o;!~
from his seat, "a roar

outer fringe of the
ad been obsrnred all
glory and with light.
jump."
:,H h~!o
7:x, h.,,.!< ".':.. h'"i!' 7.. , h_'"';;: 7... t !i~1 7.,,,

Tu.1 ti.~!: ".':ut~";'l: 7nt t~:r :'tu!~:: 7t:I
t_,,.b ':'n ir..;4 7~ =-b :""' l~ls 7<ut-.;!1 ':'n t .....a :'iu '"""'~':'ts
,, _, . .-:;_-_,,.,.,, ~ :..~:-:;;'>Je' q;:,_..,,:-~Jo ....-.~=--r.~
'
: ..:."'-.:'>-
.. , ~--' -:::n ,.. ,, ~.;.-...;--.; h', -~ r"""!-:.
t~b
Tu'
i~~:i 7~u ~l"';':i
~:~~~'.~: ~
Iabs ...
-.. . . _~~.:.~- : :_:=E.::-~:~~~:--:~!":~:.::~

OK
t remarkable
t without a re11ewed
ve for the nation and
acter.
C.ncel
@l
Fig. 6
Page Layout View...-
00
(710
.
.,ti.
~~ &~~
'"""'
,l,l6llli,~Jb-'V Y~i.i'!.
..
1vl
~r..~
':flno
:, W
~1
!1c]IJ:Jljl~
'\
~; Q;a>ol)j",w;.f'}.
~~ie.!Jo
't.11i<>20Q@""'10
"
<
-~---~ L 730
Abraham Lincoln
N
0
....
N
Grard a1 Apponat1ox Cow tho use. Chi:::f Justice Salmon Cb.a.st: admmi.:tne:d th::: oath of office. ln little:
more than a month, the President would b.e nsta!>s:irnted

71u.s !J.eol~r:dl.J 1nto:n.ae spcoch Jm bec.12 wrdrzy tldtruw!t:tlgeda~ 01111 q/rltc 100.!J rcmmlw!111. dactm.V1Wl ui A:r.11lJ'1c.a11
Ptfstary. TIN Umtkm .sptcfdo1 utid {!fit, "We cmtf10I rcod if k'llltrut a ,.c.11i:wul cail/1~ rkat 111.s JIM 11>:>.EitsJ pofiflNll
d"'-"tmlbttb'>i'1'1 ra ~n011. ttutfjJiruld J11nfar' tll.t 11Nf& nm/ll'J.1.11.'ll'd!l'Xlll'J11 tu ltft bf11ftt.-ilttm~1hJn,g rJj"tJ jtt,'!td.t:it<td
olmo.;1 prop#14i< duva:f", ..
JowndiJt H"1 .B.oodr.J, an Q'IJ'.wiP.&:1J WllK-JPBr:&h JtAidiwt o~ Lln~"\."'narJrr:m,;r.d.fro:in ~-:.cut, '"'a 1tXUofrJFpJt:.W4 .ihodt
tM 011, mtd. agan mda.gam ~cd.ftttQ/.11 a~dawq;o "'!ftc oi.t'1ftl'l1i:fJ r.fth11-tfvo'1,&. llkf a slll'Cqr'ngll'Ql." up011lhc:
llic111. .hnsaJ that mommtl'H!~ wJll"dJhadh."11:nob.trute:lall fivi, fJwJJjar1hinilJwu:bLJddcxridlanlpiff1lllor,wid
flood~d tli11 3Pfodc 1t111h gi?!")' a>id wuh ltght... St-cob MJd !flt(O/n latu toJd ht111,, "!Ad.fC'U n;m...., :U .umbur~ /J r:utU
r.v1"14m1jump.,.
14qrtfrr1gn>-Brooh,#icaa.tdAl.\'6,-.eco:1rtfdtf1~~~D1 )'o.;~l'll~Jitnc~".:ll~tfl;.pm.:;~~prcvcktd"Ji<~rJartd
OJK
could u.c mci;tq-~~ o.nd
tn'Cl Nmfal _flrn.."
&ooA.i W~ o-b.:av~ ".Gl.d di'lfi.rm.tmo1abJ.: in1'1lf mind cftho.Jo:. whoww 1'1at JCCOHdlll.\11.~.im.itianmu:J stiD rcmaili tltii
talJ, p~. mr!orn:"hol}' Jf9"' c/Ht ma11 who, then mdui.TW 1rt.:> qJ-lcf in li1e- miih: QfrJM glad n.:ciaim c;ffflcuUrh c;
piplc, an:lillunmi'db] Hirrdu:qml bnllum:~oja AAm:-J1J1mbimt. wa;alrr.ad} ~i'1tfE~g'W ofdcolh"
Fell-ow-Countrymen
At this
~econ-d
rq>peru"in.g
ai
t()
ulr..e the Qath of the Pn.::ideutial Qfftce there i~ li:s' QC(:a:1ion fo1 an ex1ended
the first Then a natt-ment somewhat in deiaiJ of a co1.:.rse to:- be pursued seemed
fitting and proper Now, 01 the expin11ion of four years. during which ~ublic declarations have been
C(lru:ta.ntly i:.a.lled f<:1rth l)fl "''ety point and ph1m: <:tithe great conse~t which srill abrerh= thP. attention nnd
engJosscs the en.ergiei of the aa11on. httle that 1:1 new could be prtsented. Th'! pr(lgress -of ou1 arms. upon
Pa;~;
1/J
Wllrd Co-.Jff.: 0
1:1P21~~U~l..l\oliW
?to:itt;t~ei--.. -~:- -- ~ -
ff)(~ lt;iWiiiiEt.,=""'""""''"''""''"'2~'__________________,,.@,,~
Fig. 7
N
~CIO
Weeks of wet wemher prcce4ing Lincoln's second inauguration had caused Pen.nsylvar.m Aven1Je to
betme a 'ea f mttd arid Handing w.ate:r. Thousarid$ of specto\t<>n: cto'llod tll thick mud at the Cai~iu,I
grounds to hear the l'reside111. A~ he ttv~d en tht Ea::t P~rtleo to take the exetutive oath. 1he cornpleted
Capitol dome ()vef the President's heJ!;d was a ph;sltaJ rtmindcr- of the rewlvc of his Administration
Utr-ughout. the yean of Civil War. In one Moonh. Robe11 Lee would formally surrender t<> Ulysses S.
addrtss than there was
=
~
g!Jg_@y,,/..f.q!J."/.(f.,J).
..Loa\:111g d011nl11Dd1i.Jac:. qfthl.,ople, 11lWr'l!mti:tll:)i t.flc tmiJ1!rrv.sojt!ir .gLl-1.
>
=
applaw~
.... ~h
""r--Size&
-_ ~I Hearlcn&l ,rNumben
Line
I Orientation I Footers
i
~ i'1 @
-- _,.
:I
. \
;'
I'
Paoe . ' ( P<tgl!Ylt!W

, Bacuround, f:t.1, Rufer
.
I
,;
--'
. '~,~-'llou""'"' i
,
'--~ P<it~~~.ar~ j
About Columns
."f VouCMi,o<tt0>t0<o<t0<y
trhe Assassination of
Abraham Lincoln
ilnswslett.ers, brrxllt.ires,and
ftrersbycr~newslctter
stylecoLnw.
Text n newsletter ccbms flows
continuoud)lfromthebottomol
tM:
one coUrn to the tOJl d

nedcoUm.
Oriltr""leTrOCtln';J (SrNn)
Complete H&!p Attkle
On the evming oi April l-t, 1865, while attcndjng a

special petformancc of the comedy, "Our American
Cousin," President Abrahi!ID Lincoln w.u shot.
Accompanying him at Ford's Theater that night were
his \,ife, :\~ Todd Lincoln, a n,e.nty-cight year-cld
officer named
Major
Hmry R. Rathl)ons. and

in
P..!!l!R~U ft~~. Clara Hurls. After the play was
progicss, a figure with a dtawn de1ringer pistol stiepped

imo the presidential bo:'t, aimed, and fired. The
president slumped forv.ard.
---
1J1
'!/~
~-~,'-;
c~;~
~~' .rllll~ll
'of",'
The assassin, John \\ilk.cs Booth. dropped the pistol a.n wand a daggei. ~.h.P.2VS
lunged at him, and though slashed in the ann. forced the killer to the railing. Booth leapt
from the balcony and caught the spur of Ills left boot on a thg draped O\'eI' the rail, and
shattered a bone in h..is kg ou landing. Though injured, he tushed out the back door, and
disappeared into the njght on horseback.
A docror in the audience immediatrly Wfill upsrairs to the box. The huller had entered
through Lincoln's left ear and lodged bc:h.ind his right eye. He was paral~zed and barely
breathing. He \vas catt"ied aaoss T~.~h...$..iue~, to a boarding-house opposite the thcata,
but the doaors' besr effons failed. Nine hours la.tcr, at 7:.22 A)..i on April 15th, Lincoln
died.
At almost the same momem Booth fired the fatal shot, his accomplice, Lewis Paine,
attacked Uncohi's Secretary of State, William Henry Se,vai:d. Seward lay in bed,
reco\ering from a carriage accident. Paine entered the mmsion, daiming to ha~:c a
ddhery of medicine irom the Secretary's doctor. SC'\nrd's son, Fredeiick, was brutally
beaten while t1:.-ing to keep Paine from his father's door. Pa.inc slashed the Secretary's
S\lD Augustus, a.n attending hospital corps
throa.t nvicc, ~fought his way past Scwards

wteran. and a Srart Dtp:mmenr me~stnger.
Paine es.::apcd into the night, bclic,ing his dtcd comp1etc. Houcver, a metal surgical
WordCCU"lt; 1,253 : Tr.is Document Mech to be appioved by O:?f0:3i2001. Clidc. heres to ApprO"'!o er Rey::~t.
f/l
Fig. 8
=-
('D
('D
.....
"''
~~
QO
"l
'
QO
.....

US 8,255,828 B2
1
COMMAND USER INTERFACE FOR

DISPLAYING SELECTABLE SOFTWARE
FUNCTIONALITY CONTROLS
a selected top-level functionality. It is with respect to these

and other considerations that the present invention has been
made.
CROSS-REFERENCE TO RELATED
APPLICATIONS
SUMMARY OF THE INVENTION
The present application claims priority to U.S. Provisional

Application No. 60/601,815, filed Aug. 16, 2004, entitled
"Improved User Interfaces for Computer Software Applications."
10
FIELD OF THE INVENTION

The present invention generally relates to software application user interfaces. More particularly, the present invention relates to a command user interface for displaying selectable software functionality controls.
BACKGROUND OF THE INVENTION
With the advent of the computer age, computer and software users have grown accustomed to user-friendly software
applications that help them write, calculate, organize, prepare
presentations, send and receive electronic mail, make music,
and the like. For example, modern electronic word processing
applications allow users to prepare a variety of useful documents. Modem spreadsheet applications allow users to enter,
manipulate, and organize data. Modem electronic slide presentation applications allow users to create a variety of slide
presentations containing text, pictures, data or other useful
objects.
To assist users to locate and utilize functionality of a given
software application, a user interface containing a plurality of
generic functionality controls is typically provided along an
upper, lower or side edge of a displayed workspace in which
the user may enter, copy, manipulate and format text or data.
Such functionality controls often include selectable buttons
with such names as "file," "edit," "view," "insert," "format,"
and the like. Typically, selection of one of these top-level
functionality buttons, for example "format," causes a dropdown menu to be deployed to expose one or more selectable
functionality controls associated with the top-level functionality, for example "font" under a top-level functionality of
"format."
After a user selects a desired functionality control, or if the
user moves the mouse cursor to a different location, the dropdown menu typically disappears. If the user determines that
functionality of the first drop-down menu was the desired
functionality, the user must remember which top-level functionality was selected, reselect that functionality and then find
the desired functionality control all over again. Accordingly,
in order to use the functionality of a given software application, the user must know the desired functionality is available
under one of the selectable buttons, or the user must select
different top-level functionalities until the desired specific
functionality is located. Such a method of searching for
desired functionality is cumbersome and time-consuming,
particularly for less experienced users, and when new functionality is added by developers of the software application,
the new functionality may never be utilized unless the user is
somehow educated as to its existence.
Accordingly, there is a need in the art for an improved
functionality command user interface for displaying selectable software functionality controls and for presenting logical
groupings of particular functionality controls associated with
15
20
25
30
35
40
Embodiments of the present invention solve the above and

other problems by providing an improved user interface for
displaying selectable software functionality controls and for
presenting logical groupings of particular functionality controls associated with a selected top-level functionality. Generally, aspects of the present invention provide for organization of the functionality of a given software application into
task-based modes. The modes are associated with tabs in a
ribbon-shaped user interface, and the tabs are labeled with
descriptive text associated with different functionality modes
or tasks. Underneath a row of top-level functionality tabs,
functionalities associated with a given top-level functionality
tab are presented in logical groupings. Selection of a particular tab switches modes of the user interface to present controls
for functionalities associated with the selected tab.
According to an aspect of the invention, methods and systems for providing functionality from a software application
via an improved user interface are provided. A plurality of
functionalities available from one or more software applications is organized according to one or more tasks that may be
performed with the software application. A user interface tab
for each of the one or more tasks is provided in the user
interface. Upon receiving an indication of a selection of a
given user interface tab, one or more selectable functionality
controls are provided in the user interface for selecting one or
more functionalities organized under a given task associated
with the selected user interface tab.
These and other features and advantages, which characterize the present invention, will be apparent from a reading of
the following detailed description and a review of the associated drawings. It is to be understood that both the foregoing
general description and the following detailed description are
exemplary and explanatory only and are not restrictive of the
invention as claimed.
BRIEF DESCRIPTION OF THE DRAWINGS
45
50
55
60
65
FIG. 1 is a block diagram showing the architecture of a

personal computer that provides an illustrative operating
environment for embodiments of the present invention.
FIG. 2 is an illustration of a computer screen display showing a ribbon-shaped user interface for displaying task-based
top-level functionality tabs and for displaying a plurality of
functionalities available under a selected top-level functionality tab.
FIG. 3 illustrates a computer screen display showing the
user interface illustrated in FIG. 2 whereby a different set of
functionalities is presented associated with a different toplevel functionality tab.
user interface illustrated in FIG. 2 whereby a different set of
functionalities is presented associated with a different toplevel functionality tab.
FIG. 5 illustrates a computer screen display showing a
pop-up user interface for providing detailed functionality
associated with a selected subset of functionalities presented
in the ribbon-shaped user interface illustrated in FIGS. 2
through 4.
pop-up user interface for providing detailed functionality

US 8,255,828 B2
3
associated with a selected subset of functionalities presented

in the ribbon-shaped user interface illustrated in FIGS. 2
through 4.
drop-down menu of functionalities associated with a selected
functionality presented in the ribbon-shaped user interface
illustrated in FIGS. 2 through 4.
presentation of a tool tip dialog box for providing helpful
information about a selected or focused-on functionality control.
network. In a distributed computing environment, program

modules may be located in both local and remote memory
storage devices.
Turning now to FIG. 1, an illustrative computer architecture for a personal computer 2 for practicing the various
embodiments of the invention will be described. The computer architecture shown in FIG. 1 illustrates a conventional
personal computer, including a central processing unit 4
("CPU"), a system memory 6, including a random access
memory 8 ("RAM") and a read-only memory ("ROM") 10,
and a system bus 12 that couples the memory to the CPU 4. A
basic input/output system containing the basic routines that
help to transfer information between elements within the
computer, such as during startup, is stored in the ROM 10.
The personal computer 2 further includes a mass storage
device 14 for storing an operating system 16, application
programs, such as the application program 205, and data.
The mass storage device 14 is connected to the CPU 4
through a mass storage controller (not shown) connected to
the bus 12. The mass storage device 14 and its associated
computer-readable media, provide non-volatile storage for
the personal computer 2. Although the description of computer-readable media contained herein refers to a mass storage device, such as a hard disk or CD-ROM drive, it should be
appreciated by those skilled in the art that computer-readable
media can be any available media that can be accessed by the
personal computer 2.
By way of example, and not limitation, computer-readable
media may comprise computer storage media. Computer
storage media includes volatile and non-volatile, removable
and non-removable media implemented in any method or
technology for storage of information such as computer-readable instructions, data structures, program modules or other
data. Computer storage media includes, but is not limited to,
RAM, ROM, EPROM, EEPROM, flash memory or other
solid state memory technology, CD-ROM, DVD, or other
optical storage, magnetic cassettes, magnetic tape, magnetic
disk storage or other magnetic storage devices, or any other
medium which can be used to store the desired information
and which can be accessed by the computer.
According to various embodiments of the invention, the
personal computer 2 may operate in a networked environment
using logical connections to remote computers through a
TCP/IP network 18, such as the Internet. The personal computer 2 may connect to the TCP/IP network 18 through a
network interface unit 20 connected to the bus 12. It should be
appreciated that the network interface unit 20 may also be
utilized to connect to other types of networks and remote
computer systems. The personal computer 2 may also include
an input/output controller 22 for receiving and processing
input from a number of devices, including a keyboard or
mouse (not shown). Similarly, an input/output controller 22
may provide output to a display screen, a printer, or other type
of output device.
As mentioned briefly above, a number of program modules
and data files may be stored in the mass storage device 14 and
RAM 8 of the personal computer 2, including an operating
system 16 suitable for controlling the operation of a networked personal computer, such as the WINDOWS operating
systems from Microsoft Corporation of Redmond, Wash. The
mass storage device 14 and RAM 8 may also store one or
more application programs. In particular, the mass storage
device 14 and RAM 8 may store an application program 105
for providing a variety of functionalities to a user. For
instance, the application program 105 may comprise many
types of programs such as a word processing application, a
spreadsheet application, a desktop publishing application,
10
DETAILED DESCRIPTION
As briefly described above, embodiments of the present
invention are directed to an improved user interface for displaying selectable software functionality controls associated
with task-based functionality and for presenting logical
groupings of particular functionality associated with a
selected task-based functionality. As will be described in
detail below, when one task-based functionality tab is
selected from the user interface of the present invention,
selectable functionality controls provided by the associated
software application for performing aspects of a task related
to the selected task-based functionality tab are presented in a
ribbon-shaped user interface above a workspace in which the
user is entering or editing a document or object. Upon selection of a different task-based functionality tab, the presentation of functionality controls associated with the first task is
removed, and selectable functionality controls associated
with the second selected task-based functionality tab are presented in the user interface. The selectable functionality controls presented in the user interface are grouped into logical
groupings for more efficient utilization.
In the following detailed description, references are made
to the accompanying drawings that form a part hereof, and in
which are shown by way of illustrations specific embodiments or examples. These embodiments may be combined,
other embodiments may be utilized, and structural changes
may be made without departing from the spirit or scope of the
present invention. The following detailed description is therefore not to be taken in a limiting sense and the scope of the
present invention is defined by the appended claims and their
equivalents.
Referring now to the drawings, in which like numerals
represent like elements through the several figures, aspects of
the present invention and the exemplary operating environment will be described. FIG. 1 and the following discussion
are intended to provide a brief, general description of a suitable computing environment in which the invention may be
implemented. While the invention will be described in the
general context of program modules that execute in conjunction with an application program that runs on an operating
system on a personal computer, those skilled in the art will
recognize that the invention may also be implemented in
combination with other program modules.
Generally, program modules include routines, programs,
components, data structures, and other types of structures that
perform particular tasks or implement particular abstract data
types. Moreover, those skilled in the art will appreciate that
the invention may be practiced with other computer system
configurations, including hand-held devices, multiprocessor
systems, microprocessor-based or progranimable consumer
electronics, minicomputers, mainframe computers, and the
like. The invention may also be practiced in distributed computing environments where tasks are performed by remote
processing devices that are linked through a communications
15
20
25
30
35
40
45
50
55
60
65

US 8,255,828 B2
5
and the like. According to an embodiment of the present

invention, the application program 105 comprises a multiple
functionality software application for providing word processing functionality, slide presentation functionality, spreadsheet functionality, database functionality and the like. Some
of the individual program modules comprising the multiple
functionality application 105 include a word processing
application 125, a slide presentation application 135, a
spreadsheet application 140 and a database application 145.
An example of such a multiple functionality application 105
is OFFICE manufactured by Microsoft Corporation. Other
software applications illustrated in FIG. 1 include an electronic mail application 130.
functionalities available under a selected top-level functionality tab. As briefly described above, the improved user interface of the present invention includes a ribbon-shaped user
interface for displaying selectable controls associated with
task-based functionality available under a given software
application, such as the software application 105 illustrated in
FIG. 1. A first section 210 of the user interface 200 includes
generic selectable controls for functionality not associated
with a particular task, such as word processing versus spreadsheet data analysis. For example, the section 210 includes
selectable controls for general file commands such as "file
open," "file save" and "print." According to one embodiment
of the present invention, the selectable controls included in
the first section 210 are controls that may be utilized by a
variety of software applications comprising a multiple functionality application 105. That is, the selectable controls
included in the first section 210 may be controls that are
generally found and used across a number of different software applications.
Selectable controls included in the first section 210 may be
utilized for all such applications comprising such a multiple
functionality application, but other selectable controls presented in the user interface 200 described below, may be
tailored to particular tasks which may be performed by particular software applications comprising the multiple functionality application. On the other hand, it should be appreciated that the user interface 200 described herein may be
utilized for a single software application such as a word
processing application 125, a slide presentation application
135, a spreadsheet application 140, a database application
145, or any other software application which may utilize a
user interface for allowing users to apply functionality of the
associated application.
Referring still to FIG. 2, adjacent to the first section 210 of
the user interface 200 is a task-based tab section. The tab
section includes selectable tabs associated with task-based
functionality provided by a given software application. For
purposes of example, the task-based tabs illustrated in FIG. 2
are associated with tasks that may be performed using a word
processing application 125. For example, a "Writing" tab 215
is associated with functionality that may be utilized for performing writing tasks. An "Insert" tab 220 is associated with
functionality associated with performing insert operations or
tasks. A "Page Layout" tab 230 is associated with functionality provided by the associated application for performing or
editing page layout attributes of a given document.
As should be appreciated, many other task-based tabs or
selectable controls may be added to the tab section of the user
interface for calling functionality associated with other tasks.
For example, task tabs may be added for text effects, document styles, review and comment, and the like. And, as
described above, the user interface 200 may be utilized for a

variety of different software applications. For example, ifthe
user interface 200 is utilized for a slide presentation application, tabs contained in the tab section may include such tabs as
"Create Slides," "Insert," "Format," "Drawing," "Effects,"
and the like associated with a variety of tasks that may be
performed by a slide presentation application. Similarly, tabs
that may be utilized in the tab section of the user interface 200
for a spreadsheet application 140 may include such tabs as
"Data" or "Data Entry," "Lists," "Pivot Tables," "Analysis,"
"Formulas," "Pages and Printing," and the like associated
with tasks that may be performed using a spreadsheet application.
Immediately beneath the generic controls section 210 and
the task-based tab section is a selectable functionality control
section for displaying selectable functionality controls associated with a selected tab 215, 220, 230 from the task-based
tab section. According to embodiments of the present invention, when a particular tab, such as the "Writing" tab 215 is
selected, selectable functionality available from the associated software application for performing the selected task, for
example a writing task, is displayed in logical groupings. For
example, referring to FIG. 2, a first logical grouping 240 is
displayed under a heading "Clipboard." According to
embodiments of the present invention, the clipboard section
240 includes selectable functionality controls logically
grouped together and associated with clipboard actions
underneath the general task of writing. For example, the
clipboard section 240 may include such selectable controls as
a cut control, a copy control, a paste control, a select all
control, etc. Adjacent to the clipboard section 240, a second
logical grouping 250 is presented under the heading "Formatting." Selectable controls presented in the "Formatting" section 250 may include such selectable controls as text justification, text type, font size, line spacing, boldface, italics,
underline, etc. Accordingly, functionalities associated with
formatting operations are logically grouped together underneath the overall task of"Writing." A third logical grouping
260 is presented under the heading "Writing Tools." The
writing tools section 260 includes such writing tools as find/
replace, autocorrect, etc.
As described below with reference to FIGS. 3 and 4, upon
selection of a different task-based tab from the tab section, a
different set of selectable functionality controls in different
logical groupings is presented in the user interface 200 associated with the selected task-based tab. As illustrated in FIG.
3, the "Insert" task tab 220 is selected, and the selectable
functionality controls presented in the user interface 200 are
changed from those illustrated in FIG. 2 to include selectable
functionality controls associated with the insert task. For
example, a first selectable functionality control section 310 is
illustrated under a heading "Illustrations." The illustrations
section 310 includes selectable controls for allowing a user to
insert into the application workspace a variety of illustrations
such as pictures, clip art, word art, charts, diagrams, organization charts, drawings and the like. A second selectable
functionality control section 315 is provided under the heading "Text" and provides selectable functionality controls for
inserting text-type objects or data into the user's workspace.
For example, controls contained in the text section 315
include hyperlink, symbol, text box, date and time, page
numbers, headers and footers, etc. A third selectable functionality control section 320 is presented under the heading
"Breaks." This section includes selectable functionality controls for inserting breaks such as page breaks, column breaks,
section breaks, etc.
10
15
20
25
30
35
40
45
50
55
60
65

US 8,255,828 B2
7
Referring to FIG. 4, the user interface 200 illustrated in

FIGS. 2 and3 is illustrated wherein the "Page Layout'' tab 230
is selected. Upon selection of the "Page Layout" tab 230,
selectable functionality controls associated with performing
page layout tasks are presented to the user in logical groupings 410, 420, 430, 440, 450, 460. For example, a first logical
grouping 410 is illustrated under the heading "Show/Hide"
and includes selectable functionality controls associated with
showing or hiding page layout information such as ruler
information, paragraph markings, text boundaries, and the
like. A second section 420 is grouped under a heading "Page
Setup." The page setup section 420 includes selectable functionality controls for adjusting or editing a page's orientation,
size, margins, column settings, page layout breaks, etc. A
third section 430 is presented under a heading "Header &
Footer." This section 430 includes selectable functionality
controls for software application functionality related to
inserting and editing header and footer information.
Along the right edge of the user interface 200 is included a
"Background" section 450 and a "Position" section 460.
According to the user interface illustrated in FIG. 4, these
selectable functionality control sections are closed or collapsed. That is, the user interface 200, as illustrated in FIG. 4,
has insufficient space for displaying individual selectable
functionality controls under each of these two sections.
Accordingly, these two sections are closed from view. As
should be appreciated, depending upon the screen size available for displaying the user interface 200 or depending upon
the display settings utilized by a given user of the user interface 200, varying amounts of space will be available for
displaying the task-based tabs and associated selectable functionality controls. Accordingly, when insufficient space is
available in the user interface 200 for displaying all logical
groupings associated with a given task-based tab, a determination may be made at application run time as to any logical
groupings that must be collapsed or closed until the associated task-based tab is selected. Similarly, ifthe user manually
reduces the size of the user interface 200, a determination is
made as to the available space for displaying selectable functionality control sections, and certain selectable functionality
control sections are collapsed as required. As should be
appreciated, a determination may be made as to the order of
collapsing selectable functionality control sections such that
a criteria, such as "most used" or "most recently used" may be
used for determining which selectable functionality control
sections are displayed and which sections are collapsed as the
available space in the user interface is decreased.
According to an alternate embodiment, if the user interface
200 lacks sufficient space to display all logical groupings of
functionality controls associated with a given task-based tab,
the size of the display of individual logical groupings is
reduced to allow space forthe display of all associated logical
groupings. According to one aspect of this embodiment, different sizes of groupings displays, for example small,
medium and large, may be defined. At display time, a determination may be made as to the available space. At a starting
point, the largest size for each applicable logical grouping
display is presented. As required, the display size is reduced
(i.e., large to medium to small) for each logical grouping until
each grouping fits in the available space. In addition, for
smaller logical grouping display layouts, text labels may be
shortened or eliminated, and the layout of individual selectable controls contained in given groupings may be rearranged
to allow for more efficient use of space.
According to embodiments of the present invention, selecti on of a closed or collapsed selectable functionality control
section, such as the sections 450, 460 causes a rearrangement
of the user interface 200 for presenting the selectable functionality controls associated with the selected section. That is,
as should be appreciated, one or more of the other presently
fully displayed sections may be collapsed in order to make
room for the selectable functionality controls of a previously
closed or collapsed section. Alternatively, all selectable functionality controls presently displayed in the user interface 200
may remain displayed as is, and selectable functionality controls contained under a selected closed or collapsed section
may be displayed in a drop-down display that is presented
vertically below the selected closed or collapsed section or
that is displayed horizontally underneath the user interface
200. Alternatively, the selectable functionality controls associated with a selected closed or collapsed section may be
displayed in a pop-up menu or text box.
According to embodiments of the present invention, customization of the displayed selectable functionality control
sections may be performed. That is, the selectable functionality control sections under a given selected task tab may be
reordered according to the particular needs of a given user,
and certain sections may be hidden from view ifthe functionality associated with those sections are never used by a given
user. Or, a presently displayed selectable functionality control
section may be manually collapsed in order to make space in
the user interface 200 for the display of a selectable functionality control section that is presently closed or collapsed due
to insufficient space in the user interface 200.
According to embodiments of the present invention, a user
may browse through available selectable functionality controls using a mouse-over action. During the mouse-over
action, the displayed functionality is dynamically changed
relative to a tab or functionality control on which the mouse
cursor is focused at a given time. For example, referring to
FIGS. 2, 3, 4, if a user clicks and holds the mouse cursor over
the "Writing" tab, the selectable functionality controls sections and associated controls are displayed. If the user does
not see desired functionality controls, the user may mouseoverto a second tab, for example, the "Insert" tab 220, and the
selectable functionality controls groupings associated with
the "Insert" tab are dynamically displayed as illustrated in
FIG. 3. If the user sees a desired control in one of the selectable functionality controls sections or groupings under the
"Insert" tab, for example, the user may select the desired
control for application to a selected document or object. After
the user selects the desired control or command, the user
interface 200 reverts back to the display that was presented to
the user before the user started the mouse-over action. That is,
a display of the selectable functionality control sections of the
finally selected control does not remain displayed in the user
interface 200. The user interface 200 returns to the original
display prior to the mouse-over action.
As should be appreciated by those skilled in the art,
because of space limitations in the sections of the user interface 200 containing logical groupings of selectable functionality controls, not all functionality that may be desired or
utilized by a given user of the software application may be
accessible by selecting one of the controls presented in a
given section. Many additional functionalities may be available that may be associated with, or otherwise related to a
given selectable functionality control section under a selected
task-based tab. Referring now to FIG. 5, if a user requires the
use of additional functionality not presented in a given selectable functionality control section, or if the user desires
detailed information regarding the attributes of a document or
object according to the application offunctionality presented
in a given selectable functionality control section, a dialog
540 may be launched to provide additional selectable func-
10
15
20
25
30
35
40
45
50
55
60
65

US 8,255,828 B2
9
10
tionality controls, or to provide detailed information regarding the application of functionality to a document or object.
For example, as illustrated in FIG. 5, selection of the
"Fonts" selectable functionality control section 510 causes
the deployment of a "Font Details" tab 515 below the section
510. Selection of the "Font Details" tab 515 causes deployment of the "Font" dialog 540 to provide the user detailed
information as to the application of particular functionality,
for example fonts, to a selected document or object and provides the user additional selectable functionality not presented to the user in the selectable functionality control section 510. As should be appreciated, the "Font Details" tab 515
may be deployed each time the user focuses a mouse cursor in
any portion of the section 510 to alert the user that the user
may selectively launch the dialogue 540 if desired. Alternatively, other mechanisms may be used for deploying the tab
515 such as selecting the section heading, for example
"Fonts" for the section 510, or selecting any area within the
section 510 not associated with a particular control, or right
clicking the "Fonts" section 510.
Referring to FIG. 6, a second launched dialog 600 is illustrated which is associated with a second selectable functionality control section 520 of the user interface 200. As
described with respect to FIG. 5, a tab 522 is deployed underneath the selectable functionality control section 520 for
launching the dialog 600 for providing a user additional functionality or additional information regarding attributes
applied to a selected document or object underthe associated
selectable functionality control section 520, for example the
"Paragraph" section. As should be appreciated, dialog such as
the dialogs 540 and 600 illustrated in FIGS. 5 and 6, may be
launched for any selectable functionality control section displayed in the user interface 200 where additional functionality or details may be provided to a desiring user.
Referring now to FIG. 7, a drop-down menu of selectable
functionality controls is illustrated beneath a selected control
710 in the main body of the user interface 200. In some cases,
insufficient space may be available for all selectable functionality controls to be displayed into a logical grouping in the
user interface 200 upon selection of an associated functionality tab 230. According to embodiments of the invention, in
such a case, a control such as the "Header & Footer" control
710 may be populated into the user interface 200. Selection of
the control 710 causes deployment of the drop-down menu
730 for displaying selectable functionality controls associated with the control 710.
Referring now to FIG. 8, a variety of tool tips may be
displayed to the user to provide helpful information or tutorials regarding different functionality of an associated application. For example, as illustrated in FIG. 8, a tool tips pop-up
dialog 820 is displayed for providing helpful information
regarding the functionality available under a "Columns" section 810. As shown in the pop-up dialog 820, helpful information is provided regarding application of colunms formatting and structure to a document. In addition, online training
and other helpful information may be provided through the
deployed pop-up dialog. As should be understood, helpful
tool tips, such as the tool tip 820, may be provided for any
functionality grouping displayed in the user interface 200, or
tool tips 820 may be provided for individual functionality
controls. Deployment of tool tips 820 may be performed in
response to a variety of different user actions. For example,
placing a mouse cursor on a selected control or grouping of
controls followed by selection of a function key, such as the
Fl key may deploy the pop-up dialog. For another example, a
right-click of a mouse device on a given grouping of functionality controls may deploy the pop-up dialog. Other
mechanisms including mouse-over actions or automatic

deployment after a set amount of time of focusing a mouse
cursor in a given section of the user interface 200 may be
utilized for deploying the tool tips pop-up dialog.
As described herein, an improved user interface is provided
for exposing task-based top-level functionality tabs for displaying logical groupings of selectable software functionality
controls associated with given task-based functionality tabs.
It will be apparent to those skilled in the art that various
modifications or variations may be made in the present invention without departing from the scope or spirit of the invention. Other embodiments of the invention will be apparent to
those skilled in the art from consideration of the specification
and practice of the invention disclosed herein.
We claim:
1. A method for providing functionality from a software
application by displaying an improved user interface at a
display device, the method comprising:
organizing a plurality of software functionalities according
to tasks to be performed by the software application, the
tasks being identified textually by user interface tabs;
upon receiving an indication of a selection of a first user
interface tab, providing a plurality of selectable controls
associated with a first task, each selectable control being
presented by a graphic representation and a textual representation;
grouping the plurality of selectable controls into logical
groupings of the plurality of selectable controls, wherein
each of the logical groupings combine a subset of functionalities associated with the selected first user interface tab;
dynamically adjusting a layout of at least one of the logical
groupings to accommodate the user interface, wherein
dynamically adjusting the layout of the at least one logical grouping comprises reducing a size of the graphical
representation of at least one selectable control within
the logical grouping eliminating the textual representation of at least one selectable control associated with the
at least one logical grouping, and preserving the graphical representation associated with the at least one selectable control associated with the at least one logical
grouping;
upon receiving an indication of a selection of a second user
interface tab, providing in the user interface a plurality of
additional selectable controls for selecting functionalities organized under a second task associated with the
second user interface tab;
after providing in the user interface the plurality of additional selectable controls for selecting functionalities
organized under the second task, receiving an indication
of a selection of one of the additional selectable controls
organized under the second task;
applying functionality associated with the selected additional selectable control to a selected object; and
when the second user interface tab is not selected in the
user interface, providing in the user interface the plurality of selectable controls organized under the first task
associated with the selected first user interface tab.
2. The method of claim 1, further comprising upon receiving an indication of a selection of one of the selectable controls, applying functionality associated with the selected one
of the selectable controls to a selected document object.
3. The method of claim 1, further comprising upon receiving an indication of a selection of the second user interface
tab, providing the plurality of additional selectable controls
for selecting functionalities organized under the second task
associated with the selected second user interface tab.
10
15
20
25
30
35
40
45
50
55
60
65

US 8,255,828 B2
11
4. The method of claim 1, further comprising upon receiv-
12
additional selectable controls for selecting functionaling a selection of one of the logical groupings of selectable
ities organized under a second task associated with the
controls, providing a details tab for selectively deploying a
after providing in the user interface the plurality of addisecond user interface for providing additional functionality
tional selectable controls for selecting functionalities
controls associated with the selected logical grouping.
5. The method of claim 4, wherein providing the details tab
for selectively deploying the second user interface comprises
providing information identifying functionality, organized
applying functionality associated with the selected addiunder the selected logical grouping, presently applied to a
10
tional selectable control to a selected object; and
selected document object.
6. The method of claim 1, further comprising when the user
interface lacks sufficient space for displaying the plurality of
user interface, providing in the user interface the pluralselectable controls of the at least one logical grouping, colity of selectable controls organized under the first task
lapsing the at least one logical grouping into a single selectassociated with the selected first user interface tab.
able control for accessing the plurality of selectable controls 15
13. The computer readable device of claim 12, further
grouped under the at least one logical grouping.
comprising upon receiving an indication of a selection of one
7. The method of claim 6, further comprising upon receivof the selectable controls, applying functionality associated
ing a selection of the single selectable control, providing a
with the selected one of the selectable controls to a selected
menu of the plurality of selectable controls grouped under the
document object.
20
at least one logical grouping.
comprising upon receiving an indication of a selection of the
interface lacks sufficient space for displaying the plurality of
second user interface tab, providing the plurality of additional
selectable controls of a given logical grouping, reducing the
selectable controls for selecting functionalities organized
display size of each of the logical groupings until each of the
under the second task associated with the selected second
25 user interface tab.
logical groupings is displayed in the user interface.
9. The method of claim 8, further comprising rearranging a
layout of individual selectable controls grouped in the given
comprising upon receiving a selection of one of the logical
logical grouping for reducing the display size of the logical
groupings of selectable controls, providing a details tab for
grouping.
selectively deploying a second user interface for providing
10. The method of claim 9, further comprising amending a 30 additional functionality controls associated with the selected
display of individual selectable controls grouped in the given
logical grouping.
16. The computer readable device of claim 15, wherein
grouping.
providing the details tab includes providing the details tab for
11. The method of claim 1, further comprising upon receivselectively deploying the second user interface for providing
ing a selection of one of the logical groupings of selectable 35 information identifying functionality organized under the
controls, providing a tool tips dialog for providing informaselected logical grouping presently applied to a selected
tion about software application functionalities associated
document object.
with the selected logical grouping.
12. A computer readable device having a set ofinstructions
comprising when the user interface lacks sufficient space for
which when executed performs a method for providing func- 40 displaying selectable controls of the at least one logical
tionality from a software application via an improved user
grouping, collapsing the at least one logical grouping into a
single selectable control for accessing the selectable controls
interface, the method executed by the set ofinstructions comgrouped under the at least one logical grouping.
prising:
18. The computer readable medium of claim 17, further
organizing a plurality of software functionalities according
to tasks to be performed by the software application, the 45 comprising upon receiving a selection of the single selectable
tasks being identified textually by user interface tabs;
control, providing a menu of the selectable controls grouped
under the at least one logical grouping.
interface tab, providing a plurality of selectable controls
associated with a first task, each selectable control being
presented by a graphic representation and a textual rep- 50 displaying selectable controls of the at least one logical
resentation;
grouping, reducing the display size of each of the logical
groupings until each of the at least one logical grouping is
grouping the plurality of selectable controls into logical
groupings of the plurality of selectable controls, wherein
displayable in the user interface.
each of the logical groupings combine a subset of functionalities associated with the selected first user inter- 55 comprising amending a display of individual selectable controls grouped in the given logical grouping for reducing the
face tab;
display size of the logical grouping.
upon detection of a variation in a display size of the user
interface, rearranging a layout of the logical groupings,
wherein rearranging the layout of at least one of the
comprising upon receiving a selection of one of the logical
logical groupings comprises rearranging a layout of at 60 groupings of selectable controls, providing a tool tips dialog
least a portion of the selectable controls within the at
for providing information about software application funcleast one logical grouping and reducing a size of at least
tionalities associated with the selected logical grouping.
22. A computer readable storage device having a set of
a portion of the selectable controls within the at least one
instructions which when executed performs a method for
logical grouping and eliminating the textual representation associated with the at least one selectable control; 65 providing functionality from a software application via an
improved user interface, the method executed by the set of
instructions comprising:

US 8,255,828 B2
14
13
providing a user interface tab that is identified textually for
each of a plurality of tasks to be performed by the software application;
interface tab, providing selectable controls for selecting
functionalities associated with a first task, each selectable control being presented by a graphic representation
and a textual representation;
grouping the selectable controls into logical groupings of
selectable controls, wherein each of the logical groupings combine a subset of functionalities associated with
the selected first user interface tab;
upon a change in a display size of the user interface, reducing a display size of at least one of the logical groupings,
wherein reducing the display size of the at least one
logical grouping comprises reducing a size of the
graphical representation of at least one selectable control within the at least one logical grouping and eliminating the textual representation associated with the at
least one selectable control;
additional selectable controls for selecting functionalities organized under a second task associated with the
aft~r providing in the user interface the plurality of additional selectable controls for selecting functionalities
applying functionality associated with the selected additional selectable control to a selected object; and
user interface, providing in the user interface the plurality of selectable controls organized under the first task
associated with the selected first user interface tab.
23. A computer readable storage device of claim 22, further
comprising upon receiving an indication of a selection of one
of the selectable controls, applying functionality associated
with the selected one of the selectable controls to a selected
document object.
comprising upon receiving an indication of a selection of a
second user interface tab, providing in the user interface a
~lural!ty
10
15
20
25
30
35
40
of addi!ional selectable controls for selecting funct10naht1es assocrnted with a second task.
25. A computer readable storage device of claim 22 further
c?mpri~ing when the user interface lacks sufficient s~ace for
d1splaymg select~ble controls of the at least one logical
g_roupmg, collapsmg the at least one logical grouping into a
smgle selectable control for accessing the selectable controls
grouped under the at least one logical grouping.
26. A computer readable storage device of claim 25 further
comprising upon receiving a selection of the single selectable
control, providing a menu of the selectable controls grouped
under the at least one logical grouping.
displaying selectable controls of the at least one logical
grouping, reducing the display size of each of the logical
groupings until each of the at least one logical grouping is
displayable in the user interface.
comprising rearranging a layout of individual selectable controls grouped in the at least one logical grouping for reducing
the display size of the logical grouping.
comprising amending the display of individual selectable
controls grouped in the at least one given logical grouping for
reducing the display size of the at least one logical grouping.
~ 0. !he method of claim 1, further comprising dynamically
adjustmg the layout of the at least one of the logical groupings
to accommodate a change in a size of the user interface.
31. A computer readable device of claim 12, further comprising collapsing, as a size of the user interface decreases the
logical groupings in an order that is based on at least one of the
following: a set of most used selectable controls and a set of
most recently used selectable controls associated with the
logical groupings.
comprising collapsing, as a size of the user interface
decreases, the logical groupings in an order that is based on at
least one of the following: a set of most used selectable
controls and a set of most recently used selectable controls
associated with the logical groupings.
~3. !he method of claim 1, further comprising dynamically
adjustmg the layout of the at least one logical grouping upon
a decrease of a size of the user interface.
* * * * *
Exhibit B

US007703036B2
c12)
(54)
(75)
(10)
Satterfield et al.
(45)
USER INTERFACE FOR DISPLAYING

SELECTABLE SOFTWARE FUNCTIONALITY
CONTROLS THAT ARE RELEVANT TO A
SELECTED OBJECT
US 7,703,036 B2
Patent No.:
Date of Patent:
(56)
Apr. 20, 2010
References Cited

5,155,806
5,377,354
5,500,936
5,519,606
Inventors: Jesse Clay Satterfield, Seattle, WA

(US); Aaron M. Butcher, Duvall, WA
(US); David A. Morton, Redmond, WA
(US); Jensen M. Harris, Kirkland, WA
(US); Justin Denney, Seattle, WA (US)
A
A
A
A
10/1992
12/1994
3/1996
5/1996
Hoeberetal. ............... 715/711

Scannell et al. ............. 718/103
Allen et al. ................. 395/156
Frid-Nielsen et al ........... 705/9
(Continued)
(73)

(US)
( *)
Notice:
Appl. No.: 10/955,941
(22)
Filed:
(52)
(58)
OTHER PUBLICATIONS
Microsoft Office XP 8 in 1 by Joe Habraken; Published date Jun. 5,
2001 ;http://proquest.safaribooksonline.com/0789725096/. *
(Continued)
Feb. 16, 2006
(51)
4/1999
(Continued)
Sep.30,2004
US 2006/0036964 Al
(60)
0 910 007
Subject to any disclaimer, the term ofthis

U.S.C. 154(b) by 645 days.
(21)
(65)
EP
Provisional application No. 60/601,815, filed on Aug.

16, 2004.
Int. Cl.
G06F 31048
(2006.01)
G06F 17100
(2006.01)
G06F 3100
(2006.01)
U.S. Cl. ....................... 7151777; 715/724; 7151711;
715/779; 715/788; 715/798; 715/810; 715/815;
715/841; 715/843; 715/845; 715/762; 715/255
Field of Classification Search . ... ... ... ... .. .. 715/841,
715/843, 845,530, 711, 724, 779, 777, 810,
715/762,255, 788, 798, 815
Primary Examiner-Dennis-Doon Chow

Assistant Examiner-Linh K Pham
(74) Attorney, Agent, or Firm-Merchant & Gould
(57)
ABSTRACT
An improved user interface is provided for displaying select-
able software functionality controls that are relevant to a

selected object and that remain visibly available for use while
the selected object is being edited. Upon selection of a particular object for editing, functionality available for editing
the object is presented in a ribbon-shaped user interface above
the software application workspace to allow the user ready
and efficient access to functionality needed for editing the
selected object. The display of relevant functionality controls
is persisted until the user dismisses the display, selects
another top-level functionality control or selects another
object for editing.
300
ill
355

US 7, 703,036 B2
Page 2
5,559,944
5,570,109
5,596,694
5,634,100
5,634,128
5,638,504
5,644,737
5,664,127
5,664,208
5,721,847
5,760,773
5,761,646
5,778,402
5,778,404
5,805,167
5,828,376
5,842,009
5,844,558
5,844,572
5,855,006
5,884,572
5,898,436
5,899,979
5,905,863
5,926,806
5,936,625
5,940,847
5,943,051
5,960,406
5,970,466
5,999,938
6,008,806
6,012,075
6,018,343
6,034,683
6,067,087
6,072,492
6,085,206
6,101,480
6,133,915
6,175,363
6,188,403
6,192,381
6,216,122
6,211,879
6,219,670
6,222,540
6,232,971
6,236,396
6,256,628
6,289,317
6,307,544
6,323,883
6,353,451
6,359,634
6,373,507
6,384,849
6,405,216
6,424,829
6,456,304
6,466,236
6,469,722
6,480,865
6,493,006
6,493,731
6,546,417
6,570,596
6,578,192
6,583,798
6,621,504
6,621,508
A *
A
A
A
A
A
A
A
A
A
A
A
A
A
A
A
A
A
A
A
A
A
A
A
A
A
A
A
A
A
A
A
A
A
A
A
A
A
A
A *
Bl
Bl
Bl
Bl
Bl
Bl
Bl
Bl
Bl
Bl
Bl
Bl
Bl
Bl
Bl
Bl
Bl *
Bl
Bl
Bl
Bl
Bl
Bl
Bl
Bl
Bl
B2
Bl
Bl
Bl
Bl
9/1996
10/1996
111997
5/1997
511997
6/1997
7/1997
9/1997
9/1997
211998
6/1998
6/1998
7/1998
7/1998
9/1998
10/1998
1111998
12/1998
12/1998
12/1998
3/1999
4/1999
5/1999
511999
7/1999
8/1999
8/1999
8/1999
9/1999
10/1999
12/1999
12/1999
112000
112000
3/2000
512000
612000
712000
8/2000
10/2000
112001
212001
212001
3/2001
412001
4/2001
412001
512001
512001
7/2001
912001
10/2001
1112001
3/2002
3/2002
412002
512002
612002
712002
912002
10/2002
10/2002
1112002
12/2002
12/2002
4/2003
5/2003
6/2003
6/2003
9/2003
9/2003
Ono ........................... 715/841

Jenson ....................... 715/823
Capps ........................ 345/473
Capps ........................... 705/9
Messina ..................... 710/200
Scott et al. .................. 715/202
Tuniman et al. ............ 715/810
Anderson et al. ........... 715/776
Pavley et al ................. 715/209
Johnson ...................... 395/333
Berman et al. .............. 715/808
Frid-Nielsen et al. .......... 705/9
Gipson ....................... 707/530
Capps et al. ................ 715/531
Van Cruyningen .......... 715/808
Solimene et al. ............ 715/821
Borovoy et al ................. 707/1
Kumar et al ................ 345/339
Schott ........................ 345/440
Huemoeller et al. ........... 705/9
Kawaguchi ................. 345/440
Stewart et al. .............. 345/354
Miller et al. ................... 705/9
Knowles et al. ............. 709/206
Marshall et al. ................ 707/3
Kahl et al. .................. 715/775
Fein et al. ................... 707/540
Onda et al. ................. 715/786
Rasansky et al. ............... 705/9
Detjen et al. ................... 705/8
Bliss et al. .................. 707/102
Nakajima et al. ........... 345/335
Fein et al. ................... 707 /540
Wang et al .................. 345/356
Mansour et al. ............. 715/764
Krauss et al. ............... 715/762
Schagen et al. ............. 715/733
Domini et al. .............. 707/533
Conmy et al ................... 705/9
Arcuri et al ................. 715/779
Williams et al. ............ 345/334
Sacerdoti et al. ............ 715/764
Stiegemeier et al. ........ 707 /505
Elson ... ... ... .. ... ... ... ... .. ... 707/3
Soohoo ...................... 345/357
Mocek et al. ............... 707/102
Sacerdoti .................... 345/440
Haynes ....................... 345/340
Jenson et al. ............... 715/764
Dobson et al. ................. 707/6
Peterson ........................ 705/7
Harding ...................... 715/709
Minoura et al. ............. 715/784
Teibel et al. ................ 345/803
Cragun et al ................ 715/777
Camara et al. .............. 345/825
Morcos et al. .............. 715/810
Minnaert et al .......... 707/104.1
Kraft ....................... 455/412.1
Angiulo et al. ............. 345/779
Pivowar et al. .............. 715/835
Kineo et al. ................ 345/837
Lee et al ..................... 715/523
Gourdol et al. . ............ 715/825
Jones et al ............... 7071501.1
Baker ......................... 709/206
Frederiksen ................ 715/808
Boehme et al. . ............ 717 /115
Hoek et al. ................. 345/822
Nadas et al. ................ 715/723
Shiraishi et al. ............. 715/810
6,635,089
6,664,983
6,680,749
6,691,281
6,708,205
6,727,919
6,732,330
6,734,880
6,750,890
6,785,868
6,825,859
6,850,255
6,871,195
6,882,354
6,904,449
6,906,717
6,915,492
6,964,025
6,988,241
6,990,637
7,039,596
7,046,848
7,107,544
7,110,936
7,152,207
7,188,073
7,212,208
7,249,325
7,325,204
7,328,409
7,337,185
7,346,705
7,346,769
7,392,249
7,505,954
7,530,029
7,567,964
2002/0007380
2002/00377 54
2002/0052721
2002/0070977
2002/0075330
2002/0078143
2002/0122071
2002/0133557
2002/0135621
2002/0140740
200210149623
200210149629
2002/0154178
2002/0163538
2002/0175955
2003/0009455
2003/0011638
2003/0011639
2003/0014490
2003/0035917
2003/0038832
2003/0043211
2003/0066025
2003/0093490
2003/0097361
2003/0098891
2003/0110191
2003/0112278
2003/0167310
2003/0169284
2003/0195937
2003/0206646
2003/0218611
2003/0226106
2003/0227487
2003/0233419
Bl
B2
Bl
Bl
B2
Bl
Bl
B2
Bl*
Bl
Bl
B2
B2
Bl
Bl
B2
B2
B2
Bl*
B2
Bl
Bl
Bl
B2
Bl
Bl
B2
Bl
B2 *
B2
B2
B2 *
B2
Bl
B2
B2
B2
Al
Al *
Al
Al *
Al
Al
Al
Al
Al
Al*
Al
Al
Al
Al
Al
Al
Al
Al
Al
Al
Al
Al
Al
Al
Al*
Al
Al
Al
Al
Al
Al
Al
Al
Al
Al
Al
10/2003 Burkett et al. ............... 715/513

12/2003 Ludolph ..................... 715/775
112004 Anderson et al. . ... .. 348/231.99
212004 Sorge et al .................. 715/503
3/2004 Sheldon et al. . ............ 709/206
412004 Reder et al. ................. 715/810
512004 Claussen et al. . ........... 715/513
512004 Chang et al. ................ 715/738
6/2004 Sugimoto ................... 715/838
8/2004 Raff ........................... 715/530
1112004 Severenuk et al. . ......... 345/764
212005 Muschetto .................. 715/788
3/2005 Ryan et al. .................... 706/46
412005 Nielson ...................... 715/784
6/2005 Quinones .................... 709/203
6/2005 Couckuyt et al. ........... 345/440
7/2005 Kurtenbach et al. ......... 715/810
1112005 Angiulo ...................... 715/838
112006 Guttman et al. ............. 715/220
112006 Anthony et al .............. 715/851
512006 Lu .. .. ... ... ... ... ... .. ... ... ... .. 705/8
512006 Olcott ........................ 382/176
912006 Luke .......................... 715/752
912006 Hiew et al. .................... 703/22
12/2006 Underwood et al. ........ 715/526
3/2007 Tam et al. ... ... ... ... .. ... ... .. 705/9
5/2007 Khozai ....................... 345/440
7/2007 Donaldson .................. 715/777
112008 Rogers ....................... 715/792
2/2008 Awada et al. ............... 715/765
2/2008 Ellis et al .................... 707/102
3/2008 Hullot et al ................. 709/238
3/2008 Forlenza et al. ............. 713/151
6/2008 Harris et al.
3/2009 Heidloff et al ................. 707 /1
512009 Satterfield et al. ........... 715/779
712009 Brice et al ..................... 707/9
112002 Bauchot et al. ............. 707 /530
3/2002 Hama et al. ................. 455/566
512002 Ruff et al. ...................... 703/1
612002 Morcos et al. .............. 345/810
612002 Rosenzweig et al. ........ 345/854
612002 DeBoor et al.
912002 Camara et al.
912002 Winarski .................... 709/207
912002 Angiulo et al. . ............ 345/838
10/2002 Chen .......................... 345/810
10/2002 West et al. .................. 345/765
10/2002 Craycroft et al. ............ 345/861
10/2002 Barnett et al ................ 715/853
1112002 Shteyn ....................... 345/7 52
1112002 Gourdol et al. ............. 345/821
112003 Carlson et al. . ... ... .. ... ... .. 707 /6
112003 Chung ........................ 345/808
112003 Webb ......................... 715/808
112003 Bates et al. ................. 709/206
212003 Hyman ........................ 428/67
212003 Sobol
3/2003 Kremer et al.
4/2003 Garner et al. ............... 715/500
5/2003 Yamamoto et al. .......... 709/213
5/2003 Huang et al. .................. 707I10
5/2003 Molander ................... 715/841
6/2003 Handsaker et al. .......... 707 /503
6/2003 Driskell ...................... 715/788
9/2003 Moody et al ................ 709/206
9/2003 Dettinger et al. .. ... .. ... ... .. 707 /3
10/2003 Kircher et al. .............. 709/207
1112003 Brackett
1112003 Ben-Tovim et al. ......... 345/440
12/2003 McKellar et al. ............ 715/513
12/2003 Hugh ......................... 715/777
12/2003 Beringer ..................... 709/206

US 7, 703,036 B2
Page 3
2004/0003351
200410012633
2004/0056894
2004/0090315
200410100504
2004/0107197
200410109025
200410109033
2004/0119760
2004/0133854
2004/0142720
200410164983
2004/0168153
2004/0186775
2004/0221234
2004/0230508
2004/0230906
2004/0239700
2004/0243938
2005/0004990
2005/0005249
2005/0021504
2005/0022116
2005/0039142
2005/0044500
2005/0057584
2005/0086135
2005/0117179
2005/0138576
2005/0172262
2005/0216863
2005/0223329
2005/0256867
2005/0278656
2005/0289156
200610020962
2006/0036580
2006/0036945
2006/0036965
2006/0041545
2006/0095865
2006/0101051
2006/0101350
200610111931
200610117249
2006/0129937
200610173824
2006/0218500
2006/0242557
2006/0242575
2006/0294452
2007/0050401
2007/0106951
200710143671
200710185826
2007/0240057
200710260996
2007/0279417
2007/0300168
2008/0034304
2008/0040682
2008/0178110
2009/0007003
2009/0083656
2009/0217192
2009/0222763
Al
Al
Al
Al
Al
Al
Al
Al
Al
Al
Al
Al
Al
Al
Al
Al *
Al
Al
Al
Al
Al*
Al
Al
Al
Al
Al
Al
Al
Al
Al*
Al
Al
Al
Al
Al
Al
Al
Al
Al
Al
Al
Al
Al
Al
Al
Al*
Al
Al
Al
Al
Al
Al
Al
Al
Al
Al
Al
Al
Al
Al
Al
Al
Al
Al
Al
Al
112004 Sommerer et al. .......... 715/251

112004 Helt
3/2004 Zaika et al. ................. 345/762
512004 Mackjust et al ........ 340/426.13
512004 Sommer ..................... 345/810
6/2004 Shen et al. .. ... .. ... ... ... ... .. 70719
6/2004 Hullot et al. ................ 715/764
6/2004 Vienneau et al. ............ 345/863
6/2004 Grossman et al ............ 715/854
7/2004 Black ......................... 715/517
7/2004 Smethers ................. 455/550.l
8/2004 Khozai ....................... 345/440
8/2004 Marvin ....................... 717 /120
912004 Margiloff et al. ............. 705/14
1112004 Imai ........................... 715/256
1112004 Minnis et al. ................. 705/35
1112004 Pik et al. .................... 715/522
12/2004 Baschy ....................... 715/781
12/2004 Weise et al. ................. 715/205
112005 Durazo et al ................ 709/206
112005 Hill et al. .................... 715/963
112005 Atchison ....................... 707/3
112005 Bowman et al. ............ 715/513
212005 Jalon et al. .................. 715/823
212005 Orimoto et al. ............. 715/706
3/2005 Gruen et al. ................ 715/752
412005 Lu .............................. 705/30
6/2005 Ito et al ..................... 358/1.15
6/2005 Baumert et al. ............. 715/862
8/2005 Lalwani ...................... 717/109
912005 Schumacher et al. ........ 715/827
10/2005 Schwartzetal. ............ 715/711
1112005 Walther et al. ................. 707/5
12/2005 Goldthwaite et al. ........ 715/810
12/2005 Maryka et al. .............. 707/100
112006 Stark . ... ... ... .. ... ... ... ... .. . 725/32
212006 Stata . ... ... ... .. ... ... ... ... .. ... 707/3
212006 Radtke et al ................ 715/708
212006 Harris et al. ................ 715/777
212006 Heidloff et al. ................ 707/4
512006 Rostom ...................... 715/810
512006 Carr et al. ................... 707/102
512006 Scott .......................... 715/779
512006 Johnson et al. ................ 705/1
612006 Hu et al. ..................... 715/255
612006 Shafron ...................... 715/733
8/2006 Bensky . ... ... .. ... ... ... ... .. ... 707/3
912006 Sauve et al .................. 715/767
10/2006 Nortis, III ................... 715/234
10/2006 Winser ....................... 715/530
12/2006 Matsumoto ................. 715/236
3/2007 Young et al ................. 707/102
5/2007 McCormack et al. ....... 715/764
6/2007 Paterson et al. ............. 715/209
8/2007 Brice et al. .................... 707/1
10/2007 Satterfield et al. ........... 715/705
1112007 Jakobson .................... 715/781
12/2007 Garg et al ................... 345/440
12/2007 Bosma et al. ............... 715/820
2/2008 Feuerbacher et al. ........ 715/764
2/2008 Sorenson et al ............. 715/777
7/2008 Hill et al. .................... 715/771
112009 Dukhon et al. .............. 715/778
3/2009 Dukhon et al. .............. 715/781
8/2009 Dean et al. .................. 715/777
912009 Dukhon et al. .............. 715/808

EP
EP
EP
EP
1672518
1 223 503
1 376 337
1 835 434 Al
6/2001
712002
212004
9/2007
WO
WO
WO
WO 99/27495
WO 02/091162 A3
WO 00/309850
6/1999
1112002
1112003
OTHER PUBLICATIONS
Word 2002; Chapter 14; by Paradigm Publishing Inc. Copyright 2002
http://www.emcp.com/tech_tutorials/sig_irc/
Signature_Word_Chapter_l4.ppt.*
10/851,506.
10/800,056.
10/955,928.
10/836,154.
U.S. Appl. No. 12/028,797, filed Feb. 9, 2008 entitled "Side-by-Side
Shared Calendars".
10/848,774.
10/851,442.
Marshall School of Business, Workshop 1-Introduction to Outlook
& E-mail, Apr. 6, 2000, pp. 1-11.
Jane Dorothy Calabria Burke, Ten Minute Guide to Lotus Notes 4.6,
Publication date: Dec. 23, 1997, 2 pgs.
Bill Dyszel, Microsoft Outlook 2000 for Windows for Dummies,
Copyright 1999, pp. 82-86, 102-103, 141, 143.
Gina Danielle Venolia et al., Understanding Sequence and Reply
Relationships within Email Conversations: A Mixed-Model Visualization, CHI 2003, Apr. 5-10, 2003, vol. No. 5, Issue No. 1, pp.
361-368.
U.S. Appl. No. 111154,278, filed Jun. 16, 2005 entitled "Cross Version and Cross Product User Interface Compatibility".
U.S. Appl. No. 111151,686, filed Jun. 13, 2005 entitled "Floating
Command Object".
U.S. Appl. No. 111401,470, filed Apr. 10, 2006 entitled "Command
User Interface for Displaying Selectable Functionality Controls in a
Database Application".
U.S. Appl. No. 10/982,073, filed Nov. 5, 2004 entitled "Gallery User
U.S.Appl. No. 10/607,020, filed Jun. 26, 2003 entitled "Side-by-Side
Shared Calendars".
U.S. Appl. No. 10/741,407, filed Dec. 19, 2003 entitled "Methods,
U.S. Appl. No. 111782,059, filed Jul. 24, 2007 entitled "Methods,
U.S. Appl. No. 10/836,154, filed Apr. 30, 2004 entitled "Combined
Content Selection and Display User Interface".
U.S. Appl. No. 10/848,774, filed May 19, 2004 entitled "Automatic
Grouping of Electronic Mail".
U.S. Appl. No. 10/851,442, filed May 21, 2004 entitled "Conversation Grouping of Electronic Mail Records".
U.S. Appl. No. 10/851,506, filed May 21, 2004 entitled "Adaptive
Multi-Line View User Interface".
User for Displaying Selectable Software Functionality Controls that
are Contextually Relevant to a Selected Object".
U.S. Appl. No. 10/955,967, filed Sep. 30, 2004 entitled "Command
Controls".
User Interface for Displaying a Gallery of Formatting Options Applicable to a Selected Object".
U.S. Appl. No. 10/955,928, filed Sep. 30, 2004 entitled "User Interface for Providing Task Management and Calendar Information".
U.S. Appl. No. 10/800,056, filed Mar. 12, 2004 entitled "Method and
System for Data Binding in a Block Structured User Interface Scripting Language".

US 7, 703,036 B2
Page 4
Charles Rich et al., "Segmented Interaction History in a Collaborative Interface Agent," 1997, ACM, pp. 23-30.
Andrew Dwelly, "Functions and Dynamic User Interface," 1989,
ACM, pp. 371-381.
Gordon Kurtenbach et al., "The Hotbox: Efficient Access to a Large
Number of Menu-items," ACM, 1999, pp. 231-237, May 1999.
Charles Rich et al., "Adding a Collaborative Agent to Graphical User
Interfaces," 1996, ACM, pp. 21-30.
Boyce, "Microsoft Outlook Inside Out," 2001, pp. 67, 68, 109, llO,
230,231,310,316-318, 798.
Halvorson et al., "Microsoft Office XP Inside Out," 2001, pp. 10051009, 1015, 1023-1028, 1036-1039, 1093.
135-139.
135-138, 607-612.
Khare et al., "The Origin of (Document) Species," University of
California, 1998, 9 pgs.
"Separate Structure and Presentation," http://www.webreference.
"The Style Attribute and CSS Declarations," http://www.webreference.com/html/tutorial5/2, Aug. 20, 1998, 4 pgs.
"What's Hot in Internet Services?" http://www.webreference.com/
html/tutorial5/3, Aug. 20, 1998, 3 pgs.
"The Style Element & CSS Selectors," http://www.webreference.
3 pgs.
"ID & Class Selectors, Pseudoclasses," http://www.webreference.
http://www.webreference.com/html/tutorial5/7 .html, Aug. 20, 1998,
3 pgs.
2 pgs.
"External Style Sheets," http://www.webreference.com/html/tutorial5/9 .html, Aug. 20, 1998, 3 pgs.
Raman, "Cascaded Speech Style Sheets," 1997, 7 pgs.
"Primary Windows," http://www-03.ibm.com/servers/eserver/iseries/navigator/guidelines/primary.html, 23 pgs.
Schumaker, "User Interface Standards," http://msdn2.microsoft.
corn/en-us/library/aa217660(office.l l.d~printer).aspx, Sep. 2001, 5
pgs.
Budinsky et al., "WebSphere Studio Overview," http://researchweb.
watson.ibm.corn/journal/sj/432/budinsky.html, May6, 2004, 25 pgs.
Gordon Padwick, Using Microsoft Outlook 2000, Que, Sp. Ed., May
1999.
Becker et al., "Virtual Folders: Database Support for Electronic Messages Classification," Pontificia Universidade Catolica do Rio
Grande do Sul, Porto Alegre, Brazil, pp. 163-170.
Goldberg et al., "Using Collaborative Filtering to Weave an Information Tapestry," Communication of the ACM, vol. 35, No. 12, pp.
61-70, Dec. 1992.
Liu et al., "Continual Queries for Internet Scale Event-Driven Information Delivery," IEEE Transactions on Knowledge and Data Engineering, vol. 11, Issue 1, pp. 610-628, 1999.
Chen et al., "NiagaraCQ: A Scalable Continuous Query System for
Internet Databases," Int. Conf. On Management of Data, Proc. Of the
2000 ACM SIGMOD Int. Conf. On Management of Data, pp. 379390, 2000.
Marshall School of Business: "Workshop IV-Calendar," http://
www.marshall.usc.edu/computing/PDF _Files/Outlook/Workshop4, PDF, Apr. 10, 2000, pp. 1-4.
M. Williams, "Progranuning Windows NT4: Unleashed," Sams Publishing, Indianapolis, 1996, pp. index & 167-185.
"Microsoft Outlook 2000: Introduction to Calendar," Version Mar.
25, 2002, http://www.uakron.edu/its/learning/training/docs/Calendar032502.pdf, pp. 1-52.
Screen Dumps of Microsoft Outlook (1999, pp. 1-3).
"To-do List-effective task management software"[ on line], Aug. 3,
2004,
http://web.archive.org/web/20040804 l 03 24 5/www.
htpshareware.corn/todolist/changes.txt and http://web.archive.org/
web/20040803075026/www.htpshareware.com/todolist/index.
htm>.
"Rainy's Rainlendar" [online], Aug. 12, 2004, http://web.archive.

org/web/20040811043048/www.ipi.fi/-rainy/Rainlendard/Manual.
html and http://web.archive/org/web/20040812092939/http://www.
ipi.fi/-rainy/index.php?pn~probjects&project~rainlendar>.
Microsoft Windows XP Professional, Version 2002, Service pack 2,

3 pgs.
Camarda, Using Microsoft Word 97, copyright 1997, QUE Corporation, pp. 412, 968.
Danish Written Opinion Appl. No. SG 200504508-3 dated Sep. 18,
2006.
Danish Search Report Appl. No. SG 200504475-5 dated Sep. 19,
2006.
Australian Search Report dated Jan. 16, 2007 cited in Singapore
Application No. 200504474-8.
European Communicated dated Oct. 20, 2005 cited in EP Application
No. 04102463.0-22ll PCT/.
Australian Written Opinion/Search Report cited in Singapore Application No. 200505257-6 mailed Feb. 12, 2007.
09/896,384.
U.S. Notice of Allowance dated Aug. 24, 2004 cited in U.S. Appl. No.
09/896,384.
10/800,056.
10/800,056.
10/851,506.
10/955,940.
10/741,407.
10/741,407.
U.S. Notice of Allowance dated Apr. 10, 2007 cited in U.S.Appl. No.
10/741,407.
10/607,020.
10/836,154.
10/955,928.
U.S. Notice of Allowance dated Jul. 5, 2007 cited in U.S. Appl. No.
10/607,020.
10/955,967.
10/955,942.
U.S. Office Action dated Sep. 26, 2007 cited in U.S. Appl. No.
111151,686.
U.S. Office Action dated Oct. 9, 2007 cited in U.S. Appl. No.
10/982,073.
10/800,056.
10/955,940.
10/955,942.
10/955,967.
U.S. Final Office Action dated May 28, 2008 cited in U.S. Appl.
10/982,073.

US 7, 703,036 B2
Page 5
Chilean Office Action dated Mar. 28, 2008 cited in Application No.
1770-05, no English Translation.
No. 200510092141.1.
U.S. Final Office Action dated Jul. 24, 2008 cited in U.S. Appl. No.
111151,686.
Microsoft Office Word 2003. Part of Microsoft Office Professional
Edition 2003. Copyright 1983-2003 Microsoft Corporation.
Philippine Official Action dated Jul. 31, 2008 cited in Philippine
Application No. 12005000495.
European Communication dated Jun. 23, 2008 cited in European
Application No. 04102463.9-221111517239.
No. 200510092142.6.
Chinese First Office Action dated May 23, 2008 cited in Application
No. 200510089514.X.
Philippines Examiner's Action dated Sep. 12, 2008 cited in Application No. 1200500406.
Microsoft Office 11 Beta Layperson's Specification, Copyright
FrontPage 11 Beta Layperson's Specification, Copyright 2002,
Office 11 Beta Letter, Copyright 2002, Microsoft Corporation, 6 pgs.
Microsoft XDocs Beta Layperson Specification, Copyright 2002,
Microsoft Publisher 11 Beta Layperson's Specification, Copyright
Philippines Examiner's Action dated Aug. 19, 2008 cited in Application No. 1-2005-000405.
U.S. Final Office Action dated Oct. 28, 2008 cited in Application No.
111151,686.
U.S. Office Action dated Nov. 25, 2008 cited in U.S. Appl. No.
111154,278.
10/982, 073.
Microsoft Office Word 2003, Part of Microsoft Office Professional
Edition 2003, 1983-2003 Microsoft Corporation, screen shot 1, 1 pp.
Microsoft Office 2003, Microsoft Office Professional Edition 2003,
Microsoft Corporation, 10 pages.
Screendumps-Microsoft Office, Microsoft Office Professional Edition 2003, Microsoft Corporation, 10 pages.
Screendumps-Microsoft Office Outlook, Microsoft Office Outlook
Professional Edition 2003, Microsoft Corporation, 2 pages.
Chinese Second Office Action dated Nov. 21, 2008 cited in Appln No.
200510089514.X.
10/851,506.
10/955,928.
10/955,940.
10/955,942.
10/955,967.
U.S. Appl. No. 12/372,386, filed Feb. 17, 2009 entitled "Command
User Interface For Displaying Multiple Sections of Software Functionality Controls".
200510089514.X.
U.S. OfficeActiondatedMar.18, 2009 in U.S.Appl. No. 111401,470.
Chilean Office Action dated Sep. 23, 2008 cited in Appln No. 17702005.
Chilean Office Action dated Nov. 27, 2008 cited inAppln No. 17692005.
Chilean Second Office Action dated Mar. 4, 2009 cited in Appln No.
2512-2005.
U.S. Office Action dated Apr. 28, 2009 in U.S.Appl. No. 12/028,797.
Nielsen, Jacob. "Tabs, Used Right," Alertbox, Sep. 17, 2007, http://
www.useit.com/alertbox/tabs.htrnl, 6 pages.
"Managing the Code Editor and View" Microsoft Corporation, http://
msdn.microsoft.corn/ en-us/library/zO 1zks9a(VS.71 ).aspx, 2008.
Agarwal, Vikask K., "Creating a Visually Arresting User-Interface:
A 3 D Tab Control Example," Jan. 4, 2008, http://microsoft.apress.
corn/aspto-dayarchive/7 l 723/creating-a-visually-arresting-user-interface-a-3d-tab-control-example, 12 pages.
"Omni Web Help," Omni Group, 2004, http://www.omnigroup.com/
documentation/omniweb/browser/tabs.htrnl, 2 pages.
Hepfner, Troy, "New SOCET CXP Interface Improves Usability,"
Sep. 2008, http://www.socetset.com/gxpmosaic/?p~95, 4 pages.
Billo, E. Joseph. "Creating Charts: An Introduction," Excel for
Chemists: . A Comprehensive Guide, http://www.ahut.edu.cn/yxsz/
ahk/Teaching/Excel%for%20Chemists/ChQ2.pdf, 9 pages.
Marsh, Bruce, Integrating Spreadsheet Templates and Data Analysis
Into Fluid Power Instruction, Journal of Industrial Technology, vol.
16, No. 4, Aug. 2000 - Oct. 2000. http://www.nait.org/jit/Articles/
marsh071200.pdf, 7 pages.
Oracle Discoverer Desktop User's Guide; lOg (9.0.4) for Windows;
Part No. Bl0272-0l; published 2003; http://download-uk.oracle.
corn/docs/cd/B 12166_0 l/bi/Bl 0272_0 l/3graph.htm; pp. 1-18.
Lisa K. Averett; Joshua R. Knisley; Mark A. Marvin; Haiti: Projecting Tactical Network and Systems Management; 1995 IEEE pp.
906-910.
Mexican Office Action dated Feb. 5, 2009 cited in Appln No. PA/a/
2005/008349.
Mexican Office Action dated Mar. 3, 2009 cited in Appln No. PA/a/
2005/008351 English language only.
200510092139.4.
2005120363/28(023023).
111445,393.
U.S. Official Action dated Oct. 8, 2008 cited in U.S. Appl. No.
111445,393.
U.S. Official Action dated Jun. 1, 2009, U.S. Appl. No. 111445,393.
111154,278.
111151,686.
10/607,020.
200510089514.X.
"TeeChart for .Net Charting Control," TeeChart for Net Steema Software. http://Iwww.teechart.net.
"Convert to Word 2007," http://www.regencytraining.com/word2007-conversion.htrnl, Regency Training and Consulting, 2 pages
(Date Printed Apr. 21, 2008).
"Customer Story: SourceXtreme," SourceXtreme -Trolltech, http://
trolltech.corn/customers/casestories/stories/sourcextreme/
?searchterm~sourcextreme, 2 pages (Date Printed Apr. 22, 2008).
"Inter-Widget Communication," http://web.mit.edu/6. l l 5/www/
miscfiles/amulet/amulet-help/IWC.htrn, 6 pages (Feb. 13, 2007).
"The Technology in Document and Check Security," http://www.
securedoc.in/thetechnology.htrn, 7 pages (Date Printed Apr. 21,
2008).
Ando, R. et al., "Visualization-enabled multi-document summarization by Iterative Residual Rescaling," Natural Language Engineering, vol. 11, No. 1, pp. 67-86 (Mar. 2005) (2 page Abstract).
Bos, B, "Re: A proposal for addition to HTML 3.0: Frames," http://
www.nyct.net/-aray/htmlwg/95q3/l 141.htrnl, 5 pages (Sep. 21,
1995).

US 7, 703,036 B2
Page 6
de Candussio, N., "Common GUI Features Report," Herschel CSDT
Meeeting, pp. 1-21 (Sep. 2007).
Krill, P., "Microsoft's Ribbon Interface Draws Frowns, Smiles,"
Info World,
http://www.infoworld.com/ article/08/03/04/ 1ONFmicrosoft-fluentui_l.html, 3 pages (Mar. 4, 2008).
Rice, F, "Customizing the 2007 Office System Document Inspector,"
http://msdn2.microsoft.com/en-us/library/aa33 8203( d~printer).
aspx, 10 pages (May 2006).
Boyce, "Microsoft Outlook Inside Out," 2001, pp. 133, 134, 721-728.
Halvorson et al., "MicrosoftOfficeXP Inside Out," 2001, pp. 4, 5, 10,
11, 70-74, 281-288, 1010-1014, 1173-1175.
Pogue, David. "Windows XP Home Edition: The Missing Manual,"
O'Reilly, 1st Edition, May 1, 2002, pp. 37, 38, 41.
Screendumps - Microsoft Office, Microsoft Corporation, Microsoft
Office Professional Edition 2003, 13 pages.
International Search Report dated Nov. 27, 2007 in PCT/US2007/
012573, 9 pages.
Supplementary European Search Report dated May 28, 2009 cited in
EP Application No. 07795391.7-1225.
International Search Report dated Nov. 2007 in PCT/US2007/
012573, 9 pages.
European Communication dated Jun. 9, 2009 cited in EP Application
No. 07795391.7-1225.
Mexican Office Action dated Jun. 19, 2009 cited in Appln. No.
pA/a/200 5/007073.
Chinese Office Action dated Jul. 3, 2009 cited in Appln. No.
200680018095.3.
2005125837/09(029011).
2005125831109(029005).
European Search Report dated Sep. 7, 2009 cited in EP Application
No. 09006972.5-2211.
European Communication dated Sep. 14, 2009 cited in Appln. No.
07795391.7-1225.
U.S. Official Action dated Sep. 6, 2007 in U.S. Appl. No. 111136,800.
U.S. Official Action dated May 30, 2008 cited in U.S. Appl. No.
111430,562.
111430,416.
111136,800.
U.S. Official Action dated Aug. 18, 2009 m U.S. Appl. No.
11/782,059.
111401,470.
International Search Report dated Oct. 17, 2007 cited in International
Application No. PCT/US2006/012724.
Berliner E.M. et al., "Microsoft Office 2003", Feb. 24, 2004, p. 39-40,
120-124, 175-177, 233-234 [Dl].
Berliner E.M. et al., "Microsoft Office 2003", Feb. 24, 2004, p.
173-178 [D2].
2005125836/09(029010).
2005125839/09(029013).
European Communication dated Sep. 28, 2009 cited in Appln No.
09006972.5-2211.
Chinese Office Action dated Oct. 16, 2009 cited in Appln No.
200510092142.6.
111445,393.
Perronne et al. "Building Java Enterprise Systems with J2EE", Publisher: Sams, Pub Date: Jun. 7, 2000 (pp. 1-8).
Russian Office Action dated Oct. 26, 2009 cited in Appln No.
2005120363/09(023023).
PCT Search Report and Written Opinion dated Dec. 29, 2009 cited in
111154,278.
U.S. Official Action dated Dec. 8, 2009 in U.S. 111151,686.
U.S. OfficialActiondatedDec. 9, 2009 in U.S.Appl. No. 12/028,797.
10/955,940.
U.S. Official Action dated Jan. 6, 2010 in U.S. Appl. No. 10/607,020.
* cited by examiner
00
=
~
4
CENTRAL
PROCESSING
UNIT
12
NETWORK
INTERFACE
UNIT
INPUT/OUTPUT
CONTROLLER
20
>
'e
:-:
N
~o
N
0
....
~
2
SYSTEM
MEMORY
RANDOM
ACCESS
MEMORY
-kl
105
READ
ONLY
MEMORY
125
OPERATING
SYSTEM
MASS STORAGE
DEVICE
APPLICATION
PROGRAM
SLIDE
PRESENTATION
APPLICATION
WORD
PROCESSING
APPLICATION
ELECTRONIC
MAIL
130~ APPLICATION
11
1J1
14
=....
.........
('D
('D
.....
135
j
Ul
SPREADSHEET
APPLICATION
DATABASE
APPLICATION
rJl
-....l
=
w
Fig.1
=
w
0--,
=
N
00
200
=
~
>
'e
:-:
260
250
270
N
~o
N
0
....
1J1
=-
('D
('D
.....
N
0
.........
Ul
rJl
-....l
=
w
Fig. 2
=
w
0--,
=
N
00
Oll
Insert
Page Layout
Reference
Text Effects
Styles
A&ademic
Letters & Mailings
Review & Comment
-~
~r~tingi:_i>o~~- j_Yie~ ______ _

I .ffo; Find I Replace : ~I Document Map
J
{k
Cut
m~ COP\"
~ Show Clipboard
.~~~I g Line Spacing
- , Select All
tE\;i Paste ~ Clear
, Times New Roman
lill 9!!
&"
Im
~: Format Painter
/1 ~ ,,JJ~ ffiThi I ~
I ~.
i'S
I~
<;jj'
ci
j _ Insert Symbol j l~i Thumbnails

0
I~
Autocorrect
=
~
~ Ruler
>
'e
:-:
N
~o
320
300
N
0
....
330
1J1
11111e111.,11111!i1ll
350
=-
('D
('D
.....
(.H
.........
Ul
355
rJl
-....l
=
w
Fig. 3
=
w
0--,
=
N
205
00
215 220 230
rn
ii.. ,[.
r,rn td i
.J
~210
7@>1) (i)W.~
~:!>;
~li&1l>o
Au1demh
leittr\&Moiling1
~-'Ill lilll;: ;::If:!< ... 'll!i:>~o <)'"'"'1il-0}, ~ ~
.~l\ID
a <!IIDo
'"""".,.""""'
,,,!112
.:,/A OB
l! .......
IMOlm!JU~
CO~~
,;ll>"'1Jl~
ID~
Ox'" 1!~..J.- ~~
~IOO:l
=
~
.1
>
Abraham Lincoln
'e
:-:
N
~o
.at,rday, March. 4,J.865

_J
N
0
....
1J1
=-
('D
('D
.....
.i;...
.........
Ul
Abraham Lincoln's second inauguration speech was made on March 4, 1865.
Thi:. thcofogicdT,y il'tul:se ;speech~ been widd,y ack11:1wledged aJ one ofthe mootremmkaHe documents in .Amt!rican
hi:.tor.1. '1he London Spectr:ioT said ofit, "Wi: cannot read it wlfhcut a renewed cooviction ti-lat rt is the noble.Jt political
document kmwn to ti story, and ~culd hnefor the nahm and the ~ate.smm he left' behind him JOmdhing ofa ~crcd and
a!moM prophetic character."
JcumdiU Nooh Broclu,
rJl
-....l
Lincoln adwmcedjtom hls sud, "'o roar of appla1.t:st. shook

tJM au, on4 .agt:1M and aga" r4;xutad,jlMJ!JlJy di~ a'lf'ap CM th4 oil<VjnMga ojtha flao11g. liha .:i :m'ca;;t11gwal'a up01 tl14
.shorL Just at that momott tM .sim, whidl had bt1>1 obJCur~ all &zy, bwstj<Jrffl in it3 uncloudttl marid,-~ 3pJt!Yidor1 and
fl_~~~aC'le with glory and wJt.1-i light." Ehoolu. said Lim:olM fatu told J.nm. "Did you 110hce thd sunburst? J)' made
P~e-: lfl
LJEiaMl
if @rllGw !l!idjl..
0
qew:ihies.s to HM
:s~ech, ~id that a.s
~
IE r~~l.JjiPJtV~w~
1u,z;;::,,;;;;s1wm ~,,'
Fig. 4
~oor.i: !00%~ ~
{'G,~
=
w
=
w
0--,
=
N
330
~[~fit:
~ Back to Microsoft Word
$<&a:ODa!I Uanoo1lllgon11aiU Aa!Ja!lll'<&SS

. 0-:ti:r.'4.:J'., Afri:r~Ji_
11..lf."6.5.
~
~
l:ilIDlf<Bl DnmD1lll [Lo Dll ~<IDDDll
jfl~lilllllil,lilillDI~
355
00
=
~
ii
>
'e
:-:
N
~o
N
0
....
1J1
=-
('D
('D
.....
Ul
.........
Ul

Thisfh~0Jogi..dfyi1:tcmc :p.uchhl~ bc-1.v; ~itJdy :1r.~.m1kd.g-1J ,-J.< me oftlu1 mo.f ...1.11a:k:ibJ-1 docz.;1r.c1!f= b.4.'*!i.::111
~iisrc:ry. Ti:~ Londvn Saa'!or .:;aid ;jft, "W>!. (am1of r.r;;dirwtt.r1mt a r<.n.!Wf.J <o.nkf:vn fiiat !f Jl ffie :'10!'1t:.rpo!itico;J
dcr..m:r;;1~1.1>1.~"''1 to!asiory, and :;!1ould '1,-iv..,for tl!I! n;1i1,;~1 ~md1'-!cJ:a;.;s.>.i;n h.! ! l:-dn1>1d .l~m ~o.mthmgcj a ~a.:~t::d tw:l
cJmcJI pro_v.~nir: c1~mc7a "

Joiir"lr.11.~: N"HF. &.X..:C:.. mi ~V>1Wifll.?S! to th!? .:pe(?ch ~::irl ti1.'1I o:. Ll>lt:'c'1n .'1rlw.-nc~)1on ili,1 SP.at. '"a T?ttr ~r a_?~!'lausc .<.'1"-"*
th._ t.<U, mid, a.}'ir onl agaiu ro!p-t'la1,J!naii]' i1i1t:d ..11"1}" -1"1 lh~ .:.,uro}m~(li' oJth(, th;,_,111;. hi\.<( a .>W!l<(:)Jil~ wiiw l.ipo1J lh':.hon. Juu "1 thtJ!l1:om1mtthtJ ;.u.~ wkfch had .Nocn A:,,1,,1-.:i ail &2y. bu.l'S!"_l~l'th i;i it~ 1,t;r-ioud-?dm.e1idfrm ~plcr.d:>t. or.d
fl ::>Vtied the ~>.Icacle wit.:.i glor,," m'd with f1fji:r. ,. r('(.-k.= ~md l.i~IC'._-,fn iatcr told hil.i, "Didy-c.u n.Jrii:-! '11ti ~Ul!!r..tr:if":' [I made
rJl
-....l
=
w
Fig. 5
=
w
0--,
=
N
00
320 330
310
~ 811ck to Microsoft: Word
PidiireTu!\
I~i
1111111111111111~lil
I
(,....------~610
i'Cente.ed
1
Large
355
__ ....
600
':7~:
=
~
>
cl
181.J
-- l!
'e
:-:
N
~o
TapR;ght
I 63
N
0
....
~:
~1
1J1
=-
('D
('D
[~]
....
O'I
.........
Ul
'-'-'
1JiiJ rii.101ogicdiy f!i..,ISC
~~!Edi Jia~
6ev1 widi!'j
ackr:owi~i.gui o:; ...n.?
eo/1;;.: m:d remw.lrabill a6cw1Jo011t; :.n...ii."1?1crican
h.n!ory. Th;; Lon.MM ~ct/30,

d,,:-.,w'lD1t.lm.:i11.1n
~-d cfi!, "Wq cmmct l'ilud 1: wit.lieut a r(;r.-tll<Jll t::''>ll"Jitc>r~ ~arJ! !~ !~c ;to;' cu f'C'illical
to it~t.::ry, mid ~cuid JunJOr tlx! mitia1 :md :lu )f;$i,:;:71o;1! he !<!,,fl -~>.,"}rmJ l;im x-1.~dhing :;fa ~acrizd and
dr.ionprovl1i=1r: chr.a.;r.:.t "

}.;'-'m!il);f Nvah E7cclt;, ari cy.,.witm:;; I:' fr-z ;.pu.'1. ;mdt>::it :;! imc.;iii~ ::dv:.mcldji.::rii i!J; 5.1,:at, "a r<;.:;rof:._::plru..:~ )/1Q.:o,4.
1h.s:tJ1r. mul, agirn t<:.i aeam r!JP.!.~ui.j~arl.J di.!d "111''-'f a;''~.! Jt.1.:1" fn1~J1..! ..,/ti.'.! fhr.::nf., Urt! (< ~ln:.:;.~-.:.'1g wa>:;: i..pon zh~
.<.:h)r.1 .hn.t r1f !Cimnon:i>ntti:.: l!m_ wh!ci'.i ;lflLi k,;~10f1x~ir.-L;i ')JI da)' fim.1rfat!ii m l!J rn:r.-bud~d ~1.:ridian Jp\:-:dnr. m!i
~-0:::/!~~!~...:.r.:..~hJ::IJ '*'ifJ.! ,j.:7 tintiwn;i lrgh: "bock: i.iul Ll>i..."Ofn f,1Jor r.:>id kn, "Di.(.rto!J y,.ofic--1.111.:.s ::-imbi...,.$!~ it m.'l:ic
rJl
-....l
=
w
Fig. 6
=
w
0--,
=
N
I~[~
g Dack tCJ Microsoft Word
ili'lrilillD
00
lf1~t.!
~1
=
~
355
340
bl[b)U'<aillo~ITiID O..aITil<SOITil
01!1lii!lnngunll'ii!l0 Aa!la!lll'<&ss
>
'e
$<&(tIIDa!l
:-:
41 0
Sal!irday, Merci; 4-. 1 S65
N
~o
N
0
....
Abraham Lincoln's second inauguration

speech was made on March 4, 1865.
1J1
1
:r
=~:0;~;~7~~~~:~~t:.:;;:~:;):;,. :~~; ;;~~;::;:~ ~t~~~::~e~1:~e::~:~:~;i=.::;i:~~:~:l
documoit.bvwJi to ;i;:;i-ory, und sliwfd il:lll1<JOr 1ti11.

almo;:;f prvpi.id"ic ch.J.1't1-.;ti!:r,"
.>0 atirn
mid 31.z. :,fatesmen he
=-
('D
('D
1:1
.....
-....J
ieft b.,:~;md him :,om~!~iingq_f a 50CT!i'.d and
hwndi~t N,;id1 Bro.:k.s, a11 '{V*-"fmc;; f.;. ~he ~polc:h !'11d fi:~ta.i: l.mcoln advan.c-cdj1om flf$ :;;:di, "a r.,;11' ofappft2i.1Se ~hcd-;
Ti!.? air, a11d, ,,gan ;;;~'OJ ,1gan 'f(;p.z.--:t<!~;.ft.'Mi~.v ,t(d aw,ry ......-i rl~11 cxtc!'.fhiigz cfthe t~,.o,!g. l!lc,z a .!H'<ltpl)!gwai:.::: :JF.:i ti .J
1
::ho!'.s Ju;f d! rl?a!mcmz><t tha .:un. w."sich l'l:-<d tc.m o"scw<.;.i aif d.-iy, bu!'3!J:>1!h m ''s u11c!~tmand1a~ :spl<I>:J., .., t<nd
g.to")' and 1cfr'31l.~kr "E'C'Ck.J sm"d Lf)'l(Cin T!lr~r rcM h:m, 'nn.Yoo K>nl~.t ma !'.!.m~1stf' 3 rr.aat
.l''"'.delit~'" :~-;a.:f~ u:frh
.........
Ul
''V .narrpm::p.
kcordin;g te> Bro...">!<-::, :he: cJu.dii;;;"Kc r.cr:..'1vd the .spcou:h in ".moJO~md :,;if.n1r:-r.H alllv1..f}1 :-0mc pa~:..1g,;;iprovoitt:d dN.a:. and
applm::,1; '1Looki11g dv1m into t1:ef..~e:J v_.f"f.:hf. pcoplo&. diw:a1ut.=:.J cy. 1/.i,; !mf}rtr1v.:i: =!ff.~ .':1m, 01~ C.:Jt.Jd ~'3 n;o1~tc:yc:s and
.:,.v.;n tit:.ar)i.~ff,.1.::<::J."
B'!.:>,,k,.s aixo ob~C."l"C~ "EUt d::.y!y m<;mor.:7d-t m t:r:.: "'11iHd c:ft~K:.o! ll'hc ui..,. tit:it J.zcod :11.r~r.:mcn mun m!i ><.z:mam :J~:t
c;1Jc.; m the 111ida.:f:11~ ciad .a.:clalm cfrh.;-usan.i:; of
m(':.:p1iv" b~i:Ha~c c/<1 -~lfa.~cn s!1t::bu,.~!. 1.1tii:: .1frMd,p ~f!ll1di~g :11 rl:ic shad:iw ofdv:h"'
faff, .vatil,J.~f:, mdandi:;Jy}i[;lirc ofrl!.Z mmi w.t:o, the11 in~o?d :r,to

p:;,~~prc, .1ro:i!ih1nr~.:d b; the
Fellw-C\:.11r1trym.en:
Atth1s se.C\'rld
;1Pfi~l1rir18
trJ take the ,,,lth ,,~-the Pn31,~entrn.J .:,ffic.e tJ1.ere 1s lest ocrasl. iri
. for :Ua r,;;ttrided
,v1dres:$ than tht"rt' w.=.i~ at ti--.~ :int T'=ien a s:tatement ~Jm~what in detail vf a
C(ll..'J
se
ttJ
be pursued :;eemed
fitting and prnper. Nvw, at tl-.e expi!'ation of four :;ear:.::. during which p;;l..lit declarations '.'l<We bee:1
rJl
-....l
=
w
=
w
Fig. 7
0--,
=
N
00
,_.,,200
215 220 230
v{;
Rde1en1e
~----- ;F ;F ~ l;IJ!!;?~ e:/-~ u '~- ... 11

lrmo<NewR""""
'il1
tutEffem.
00
~g~ Q;J"'mrtl~
d~Al!BI!!* ... Ux"-U~..I.

::lloo'<i~
ID~
..
"
\ i i - r.'}OC..:t:i
,,
1
I
I
:1
Abraham Lincoln
'i
>
'e
:-:
N
~o
Saturday, March 4, 1865
N
0
....
IDu.s tm,,logicdf] t>t'eme q>Ueh 1w hem w'idtly adttt:1wr1dged a.s one oftlu ,,,.,st rcmmlcatic docume11ts
1J1
in Amctcafl
hisi"or]. ie London Spu:tator Mnd ofit, ~ cannotrcaditwithatt a rQ'lawedcon'fidlcm that ttu tlN nolle:>tpoliticol
document .Wmt to hJtory. a'1d .shrufd ~?ejor tha Mti"1 aHd 6N .staksme111'N l behind him .something ofa UJcrul 01d
almost prophdic charactu...
=-
('D
('D
.....
Jou.nu:li:t Nod1Broo.l:.s,1211 cyWi!'m3.s to tho :peech, u:nd that a.s Lf11coh1 adwmcedjom. hi.s uat, "a roar ofapplawa z.hook.
tM ail', emd, ag'311 and agan rqm:te~jfnalJy eled aw'31 CfJ the outer fringe ofthe throng. JJ!t1 a .swHpi11g wave upai tJM
:>horc. Jwt at thatmommt the .sr.m, which had bae'1 ob.scwrd all &zy. burst.forth in Its r.mclol.4dcd meridian .sploidor, an:I
flooded 11HJ spectacle wtth glory t1Yld wtth light." BTook.& S1:1id Uncoln Tata told him, "!Xdr:ni notice thd wnbwst' It mad4:
myhe.t:irtJUmp."
QO
.........
Ul
kcording fl) B7oolu, the auda1cll' rec.ivI tht ~pcu:'1 in ''p'rofoW?J $1.IU!&ll',." altlcui}! .s.omll' pan.a~ p1oroked cfill'Dl emd
--'
applt:IWA. "Looking down inft:> the Jae~ ofthe prop/a, illumil'rltcd qi the briflrt ra7l ofthe lW\ 01'N c~ l f f moil! T~ and
even tuu}Wjacu"
Broob olJO oW4red. "But cllfly nxmorable in the mindofthoJe who .saw tfnt :ACondi11alJ8Wafion rrulf mn remain the
tall, pa!Jwtic, melancholy figure of the man who, then indudedirto office in the mid:;t of the glad accklim ofthowanth of
peopJe, curl illumined by the i:k"ep1ive brilb'arre of a March lUn~nt, wal alrea4f Randing in thi .madow of death "
Fellow-Countrymen'
At thts second appearmg to take the oath of the Presidential office there is less occasion for an extended
address than there was at the first Then a statement somewhat in detail of a course to be pursued seemed
rJl
-....l
fitting and proper. Now, at the expiratton of four years, dwln,g wh1ch pubhc declarations have been
constantly called forth on every point and phase of the geat contest which still absorbs the attention and
enarosses the ener.e1es of the nation. little that is new could be presented The oroeress of our arms. uoon
Ill f'.a~ Layout 'lo'1ew
Fig. 8
Zoom: lDIJ'-'>
Et
r - --
=
w
=
w
0--,
=
N
205
00
200
30
c;-:-~-~$t~<>i!J~~'..,-";J""-"'...""'. ,.
.... ,,,..,
j-'
~
@!.
MJ!ii,ifffij-1
;ll el1~@w;ulill[::O:=;i:~8'l'"'>~<./"""'1l""""71i~-:"'1f ~l>:i:lD~ Q;J~lll!w
r"-
2 0 ./
1
~ ,gi
iry' "'"';JM"""
~@i;;ll
~l.l)o
lrmesNewRoman
,,
~
12 L'"..
A.
A'
LJ
!2 .M
lh
[!
lC
..,,
! l!l;<:j!-1
x ~ ~~ ~~
d ...,..
~~" Q~i<:>
[]~
~~
=
~
.<
,1
.I
Abraham Lincoln
900
>
'e
:-:
N
~o
Saturday, March 4, 1865
N
0
Abraham Lincoln's
second inauguration
speech was made on
March 4, 1865.
T<!!ble~e
....... of'""'"''
tUnlJer of {DWS:
Justory. 1Jx London Spectdor 3t:lJd o:

document kmw11 to f:i.stor/, and .s
al mo.st prophetic chmacter."
Journdill Nod! Brook.s, an l!)'lllWJ

t11' air, and, rJga111 ani agtiin repe
.shore. Juli at tnatmomen1 the JWt, If'
flooded the J~ctacle with glo17 and
I'll' heart jwnp."
AlJ;oFltbeh.a"'foll'
I7m.s th.rofogicdlyuftn.sc lpUCh Ins
....
c=:::ri:
Axed coUnn ~th:
,.,,
l~i
QAl.toE,ll:tocontris
Table~:TableGnd
1J1
=-
arMblc documoit3 in Amcncan
QAltofittoMY;;low
lautoFm<t ... J ~:::::n~~:;::!~~= and
('D
('D
.....
"
0
.....
Jiu .uat, "a roar ofappfowe .shodt
't! like a :iweepng wawi: upai th11

~Joudcl meridian .sprOJdor, ani
~ td1oungtinthd~fQ..int?llm
D Remerrber ~for MI t.?bles
CK:]
....
Ul
.According to Brook:J, Hx aude11Cc received the .speech m 'jnofoun:J .sHC1CC," alth:Julfi ~me P'"sagu J'TOolud chun and
opprQl..,/ll.. "Lodcing down inlo tn.&face;s ofthe p1.opre, illumimted o/ the briEfrt 1<l}'l ofthe sun, on.t could lei. moist q1.;s and
even tca1fidfaC'es."
&ook;s al.so ~rP~ "But ch<fly m.=moMble in the mind ofth.:Js1. wh.:J .saw th2t ~econd m.:1t.tgU7ahOl1 P1WM lh-JT n:m.:::1111 "11.
tall,pali11.tic, mdmtehDl1Jlgur1 qftlt1 man who, flH:n mdu.d1di1'60 offir:e in the miibtofth1glad12eclaim ofthoo3tmdJ qf
people, andilluminedb] the dtlC"ep1Jve brilTiwre of a March 3Ul1bursl; wa.s 12!ready ~ta1dingi11 the shadow of dea1h"
Fellow-Countrymen.
At this second appearing to take the oath of the Presidential office there is less occasion for an extended
address than there was at the first. Then a statement somewhat in detail of a course to be pursued seemed
rJl
-....l
fitting and proper. Now, atthe expiration of four years, during which public declarations have been
constantly called forth on every point and phase of the great contest which still absorbs the attenti.on and
en.wosses the enera:ies of the nation. little that is new could be presented The pro.1Zress of our arms. uoon
ti! P~ Layou: View
Zct-in: !Wk~.---
=
w
=
w
0--,
=
N
,.. .. ..? 1 --1 . . .

51
!~[~[lf,l
fl>
Tablela,uvt
:=~ 11r1~:rl"ll :
111
1000
101b
1020
Dotu
1030
~ 811dc: to Micmomft Word

1<r~-
1-f-1 11r1rr
... .1ir:rr:r11~11
. ... .. - - - 1
1.
~
10:1
00
Newstylesereavaileble
1!;.;Ull.Offl:eanine.
"-
=
~
1040
:\1.JD~llilca:muo [l.oDDc;;ODD
>
$~~~a~~oogoo~~a~~~11Gss
'e
:-:
Saturday, M1rch 4. 1c<55
N
~o
N
0
....
1050
1J1
=....
('D
('D
.....
0
0
~ i:tn.~
mt~n!l'
b~-n
ra:..'11.~ti!i/
hn
i1111k!.P !'l,-j-J-r.iwt.rii'.:C as C'n-=' cjt.:-ie mDlr
d,:..__"L")U!n!'$ J-., _.u.-i.:nc.:1t:
.i~-;i.~y. ?h:: !.ondc11 S;.u-t:r--:>r :aid ofzf, "lf.-i: ran1r:it r;adlt -t>U'~f a 11mcw<?d c..mict:\'.ll m.inr :; ;Jw .>1-;J.bi,ts; po!Jtirni
d.J<:U'lll~nt iwnm1 !U rurvry, mul :J1a:ld .~vc.10r r"i~ 11anM mWihi .:;r1;t<z.;mn1 Jie i9~ '.Jel:md !um :,,:-mnf:mg ?_(v :.aa.;d tmd
:JJei:oJogicd.'y
J}."tct:ii
[f
.........
Ul
ai11r::i~t pr.,pJuti,; ~hmad<{r."
Journd1st 1/.:Jah Br~-..Jt:~, a;) eyemtne.;~ t,;i thf: ~P4:u.r1, ~1ud fh.."'ltas i.11~<:>Jr. adva1i.:cdf1cm fo:; :;eat. ";;i roar :>f applm.i~~ ~.'1oclt
th<? afr. wid agr;ih cmd agan rf'.;"7'.d,;rf,j.n:;i!)' dicJ <?lf"l{I' Q': rh:t ~~i.vJi"f~1gc c/thc lh.r.;r.;. h~-?-a .>1fe.?.~rig wc.i.>e ipi.-.,, f.r-ic
;h..vw.
. Jt.:!1
,i; tfiaf :non;.;n11he ;zm,
wl:idi iiad .:Wn o-QJ..-.trd al!~~-, !.JOJ.rst};;rfh m ;"b w:dvw"c..i :::c;-idi.m ~iei:dc-:, ar.d
ff~th"f .J?JCC"ac:i.r wtil glci:y c<ndwfti1 i1giJT "i.1r.:.vkJ :!a~a i.f.iroin ic<u: f~ld hi:ti.
"LiJyc.t< .'10!11:>? ~}:~ JIJ.'1!.J1.,Ts!? !! ~r.ad.:
11'.fh.1;.".iftmip"
. .4:c-Ydin3 J.:i BToo.b, :Ju !it.'.d..nc.;: ci;:..;dJdlhot ;,/.~i;:,;;h i1 "pro_0t.m' ~}-i:,l~t:,-,," W.:!v~?J1 ...vm~ Jl'l:;:;uz_;,,;,pruv:ii<K'.i r::h1c.;, .::J.d
appkiu.H. "Locl:ing d~-.w>1 mro rill/fa-:..:; oj!hc p11opil/, 1)iumma!cd o/ r~ b!-i~:t .q:.. Q_,fr.li:; Q..."'l, C'l:-i could .'er.! moi:;r if/'>!:; ~mf
rJl
-....l
1.:ro1t~Mfacl!3"
3.r<Jolts 11ixi o.;Krv('d, ''Bu: cY:u.~y m.miv1Clbk m riu m:Hd oft.fie;:;{) wi:c
sc.w .-.liiar s.:ccndI"ltlugl;~a!i0-: m~ s!1J: T.!mmn 1h-r

~~~~~~~~~~~'
, ;;~;,'.::.~.,:~;!c;;:~:,~~
Pai;ie:1/l
[jJ ffi?l1l !l!li)wo!!!ll!W!lC<t.k
Fig. 10
=
w
=
w
0--,
=
N
7J)_
=
~
>
'e
'. ._.
!Alabama
Alaska
Arizona
Arkansas
1ca1ifornia
Colorado
Connecticut
Delaware
Florida
Georaia
Hawaii
Idaho
Illinois
Indiana
Iowa
Kansas
Kentuckv
1
Lou1s1ana
Maine
Marvland
l'"WWW
'-
52,237
-rnl.'-,,,,..ID~.
::::/r;
4,447,100
85
626,932
1
45
5, 130,632
114,00fr'
53, 102:
2,673,400
1ss,s691EMt~ _
I
I
2,397'
59,988:
58,977!
6,459i
--- 83,574!
:-:
N
~o
_AJ
_ _ _r_
, 11!/JO
_ ___
1_
~-J
3,405,565
/ 614 1___..----l---------..----1
783,600
327
15,982,378
266 1________1__ _
B, 186,453
139
1,211,537
188
1,293,cJS3 ----1-5 - -
___________ _
-~--=-=~:::-~:'
--
=........
.........
.....
12, 419, 293 ,___2_1_4 11 ______ ,1 ____________+!---------------------~--167

/
56,276!
2,926,324
52 1 _
1
82,2821
2,688,418
33
+---_0,4111
4,041,7691
100
49,6501
4,468,976
90
I
33,741!
1,274,9231
38
12,297 1 S,296,4861
431
9,241!
6,349,0971
687
96,7051
9,938,4441
103
86,943!
4,929,4791
57
--t--4~8~,~2~86-'--+1
2,844,658
59
69,709J~595 211
80
96, 7051
9,938,444
103
-------:: : _:_: :_:__ ,
1J1
('D
('D
57, 918 I
3c:
....
36,42of-- 6,080,485
Sheet3
N
0
50
______l_llj
104, 100, -- 4;301,261
5,544'
-- -=-~-_:__~=-=-~!
Fig. 11
Ul
d
r.r;_
-....l
=
w
=
w
0--,
=
N
00
~-..&.vC!Wl5!!i
~~Q
to~
Picture!,..
Teictbox
" " c:> p
130Glb.
@- Auto5hape'i""
Diagram..
mv [i)xr
=-,~
~JI~~~ (i $~~!fa
line
Column
Area
Bar
Column
Pie
Area
6..'.lr
line
; BChart
SubyrnGmarize\
rcwser..
~ Hyperliok -
>~Object~
r- Chart
,,ummary
roup
Symbol...
84
AI
_!_
2
.~p,,u,latio.n,~
. ,~ Square
.
_l_ ___ States by S1z
Miles r;- Populat1cr;
_!_
Alabama
I
52,237. 4,447,100
___ __ Alaska
'"""""''"15~1!-30 I
626,932
6
7
8
J1_
10
,.!.!.
_!l__
Arizona
Arkansas
California
Colorado
Connecticut
Delaware
5,544
2,397
3 405,565
783,600
Florida
Georq1a
Hawaii
Idaho
Illinois
Indiana
Iowa
Kansas
Kentucky
Louisiana
Maine
II
_______ j ____________J(________I__
i
V ...:
.{:l
'-123d
J
i ~f40
'
_______________ J_'.j
'-----------------------
___ _
____
J___[_l"I
T
iI
>
'e
:-:
N
~o
N
0
....
, .
1150-
I;
1J1
014 1_----+-----lf-----+----+-------+---+----+----+--
327
266
139 _
188
15
214
167
52
33
__ _
__ ________
------i--~'-_ ___ -----+------------------
=....""""
.L
('D
('D
-------e----L
'
--- ----------r--,.----_., ____ ----- - - - - - -
N
0
.........
+--- - - + - - -
Ul
100
9o
3s
431
687
103
26
57
59
J'.[
85
1
45
50
213
41
,r
Pop I
samif;"
114,006
5,130,632
53,182
2,673,400
158,869 ll!J.38J8}11oti,;.8 I
104,100 - -4,30-l,261
59,988 15,982,378
58,977
8,186,453
6,459
1,211,537
- 14 _!_
83,574
1,293,953
16
57,918 12,419,293
.JI_
36,420
6,080,485
~
56,276
2,926,324
19
82,282
2,688,418
.]Q_ _ ..
40,411
4,041,769
~
49,650
4,468,976
22
33,741
1,274,923
.~ ~:Maryland
12,297
5,296,486
~Massachusetts
9,241
6,349,097
25
Michiqan
96, 705
9,938,444
Minnesota
86,943
4 929,479
Mississiooi
48,286
2,844,658
..l[_. Missouri
69 709
5,595 211
25
Michigan
96, 705
9,938,444
,. > >1i\Sheen,(sheet2;(sheet3/ ,_s1
~-----Ready
,_!l..
80
- --
--t--~----1-
__
,
--- -- _,__ __
=l=-+"'""'"!---
103
..
_.L_.
__;__o___I~- --
,m;rrn:
Fig.12
.,
t---+---:
r---
d
r.r;_
"
-....l
=
w
=
w
0--,
=
N
00
=
~
,<J.
.11 1 ~ lU " S'!2 liZ @ ~: Ii) ~ taa
~I
[iJ
&
Arizona
Arkansas
Cklt.rod8illt
Sliilcbd B.lilr
100% Bt.11el:itd Bar
Ctttstan:>d a.,, (:kl)
California
Colorado
Connecticut
!_
,,:,, _
Georaia
Hawaii
Idaho
Illinois
Indiana
Iowa
Kansas
Ken tuck
Blll!ICIUHI
fhf t34J
:ilJ
:.~----
100% Gtilleked lhr
Compares the eontribullon

of eacil value to a t<>lal
across categories .
_,,_
Florida
If!
L:~~~---
Clustered Bar Chart
WHkond Cor Salos
Delaware
,, ___ J
r1
O=~--
1310
.~r- 1 - - -
_ l- - '
"
~---+-:
::) [) --"-- --1ltOl
Chart SutHypcs
:__:=_!
f'l___j_~
11
Ii
I
:o
l-11
N
0
Ii
:-:
N
~o
---1--~
>
'e
,-11
I
-~=~-.~T==~-~~~~u
....
1-
1J1
------+---+
=....
i
r
----r-----:
('D
('D
---L--+-
(.H
I
l
il
....
.........
I
i
Ul
Preview
Lowsiana
~f.1<:11!U
Massachusetts
96, 705
-+
14
'4
Re.ldy
86,943
48,286
4,929,479
2,844,658
69,709
~~5~9~5~2~1~1l------~==--------~------~------+---~--r-~-+--~-+----r----+-~--~tg!g3s!444
1D
-------- _, _= -- ---====--- _. --N. , ------ ~--- _,,,.,,_,,, _.
Fig.13
..,,
d
r.r;_
-....l
=
w
=
w
0--,
=
N
Ea .Microsoft Excel - Book1
I Fil
Edit
v;,,,, Id !!it ..,
, Chart Structure
D Source Data ...
&Al1!81IUSMMrrm&&iliii46.tiiDl.i$MU411.J IB!!I
1420
Chart Options
1410
~ JColors & Lines I Draw ~ -
Chart ools
Legend.,. Trendlines .... Widths...
li''"";lf
~
~
3DVie..v
f'.c:J
E'.]Locationv
~hpaert.
~~ ~
00
Data
Labe1sv
lCO:O .,.
Major Units
Auto ....
Auto ...
Minor Units:
Auto ....
=
~
B4
Al
2
3
.<,._li!!~ ,Jl',qp_q1f11J,9tml.Jw,!;~Ji.~J;l~.~m<fi,,:ki
Square
Population
Miles
Alabama
52,2371
4,447, 100
Alaska
t-i!ll:~~:\..)12:30J
626,932
Mizona
114,1Jd6J
5,130,632
Arkansas
53, 1821
2,673,400
California
1s0, B69fI:;3~,'l:j71{6:4s
104, 10or~~4;301;;:>5T
Colorado
Connecticut
5,5441
3,405,565
Delaware
2,3971
783,600
Florida
59,9881 15,982,378
Georgia
58,9771
8, 186,453
Hawaii
6,4591
1,211,537
Idaho
83,5741
1,293,953
57,9181 12,419,2931
Illinois
36,4201
6,080,4851
Indiana
56,2761
2,926,3241
82,2821
2,688,4181
---+
40,4111
4,041,7691
49,650
4,468,976
---!
33.7411
1,274,9231
,______
12,297
5,296,486
6,349,0971
9,938,4441
4,929,479
'r .
1i4o--___-:r::~:::~~~~QJ
>
'e
:-:
N
~o
f1r.rinkiin
N
0
....
0
614
327
1J1
266
139
188
15
214
167
=....
('D
('D
.....
.i;...
.........
52
33
1001 - - 90[
38;
431
Ul
i... ---
6871
1031
571
- 48~286 --2,844-;-658 ____ 59 1

69 709
5 595 211
96, 705
9,938,444
Sheet3 /
i_I
l430
]150
States by Size
9,2411
96,7051
86,943
+--~
d
",
rJl
-....l
=
w
Fig.14
=
w
0--,
=
N
00
['.;]~
El Microsoft Excel - Book1
=
~
B4
' .
T-
. I
----I
States bv Size
Alabama
Alaska
Arizona
Arkansas
California
Colorado
Connecticut
Delaware
Florida
Geornia
Hawaii
Idat10
Illinois
Indiana
Iowa
Kansas
i .:
!i ;: I
_I
1-230 I-
9,241
96, 705
86,943
48,286
69 709
96, 705
N
~o
N
0
.....
,I
t--
PivotCh~[t report (A~th PivotTable report)
-------1.-
1J1
=-
2,397
59,988
58,977
6,459
83,574
57,918
35,420
56,276
82,282
33, 741
12>297
; ;
-''
:-:
---j--.J
0P~'Otiablo
49,650
=--r----+-I_ ---:-: I
__,___-=i-
What kind of ri=port do you Hant to create?
----+-. -1,J
>
'e
('D
('D
.....
.....
Ul
L <sa:i:
4,041, 759
4,468_,976
1,274 923
5,296,486
__ , __ .
6--. 349,097
9,938,444
4,929,479
2,844.. 658
s 595 211
"'"""'-ul
0
O?Q .d.t:Ld..
------. '.
~I
.....
.....
] H----+
Finish
Ul
T ---- Tm - --r
--------. 1510---------------.
. --------- --------1.--T'
!
38
431
687
103
'
57
i;g -----
~80 -
----
I -----
103:
---1I
r--1
--
----- - - ____ J___=

I
----
d
r.r;_
-----'--
_____j____
-.....l
=
w
Fig.15
=
w
0--,
=
N

US 7,703,036 B2
1
USER INTERFACE FOR DISPLAYING

SELECTABLE SOFTWARE FUNCTIONALITY
CONTROLS THAT ARE RELEVANT TO A
SELECTED OBJECT
appears. When the user desires to make a second or subsequent edit to the object, the user must once again find the
correct top-level functionality control, deploy a menu of
available functionalities, and find the desired particular functionality. Such a method of searching for desired functionality
is cumbersome and time-consuming, particularly for lessexperienced users, and when new functionality is added by
developers of the software application, the new functionality
may never be utilized unless the user is somehow educated as
to its existence.
Accordingly, there is a need in the art for an improved user
interface for displaying selectable software functionality controls that are relevant to a selected object and that remain
visibly available for use while the object is being edited. It is
with respect to these and other considerations that the present
invention has been made.
APPLICATIONS
The present application claims priority to U.S. Provisional
Application No. 60/601,815, filed Aug. 16, 2004, entitled
"Improved User Interfaces for Computer Software Applications."
10
FIELD OF THE INVENTION

15
The present invention generally relates to software application user interfaces. More particularly, the present invention relates to an improved user interface for displaying
selectable software controls that are relevant to a selected
object.

20

With the advent of the computer age, computer and software users have grown accustomed to user-friendly software
applications that help them write, calculate, organize, prepare
presentations, send and receive electronic mail, make music,
and the like. For example, modern electronic word processing
applications allow users to prepare a variety of useful documents. Modern spreadsheet applications allow users to enter,
manipulate, and organize data. Modern electronic slide presentation applications allow users to create a variety of slide
presentations containing text, pictures, data or other useful
objects.
To assist users to locate and utilize functionality of a given
software application, a user interface containing a plurality of
generic functionality controls is typically provided along an
upper, lower or side edge of a displayed workspace in which
the user may enter, copy, manipulate and format text or data.
Such functionality controls often include selectable buttons
with such names as "file," "edit," "view," "insert," "format,"
and the like. Typically, selection of one of these top-level
functionality buttons, for example "format," causes a dropdown menu to be deployed to expose one or more selectable
functionality controls associated with the top-level functionality, for example "font" under a top-level functionality of
"format."
After a user selects a desired functionality control, or if the
user moves the mouse cursor to a different location, the dropdown menu typically disappears. If the user determines that
functionality of the first drop-down menu was the desired
functionality, the user must remember which top-level functionality was selected, reselect that functionality and then find
the desired functionality control all over again. Accordingly,
in order to use the functionality of a given software application, the user must know the desired functionality is available
under one of the selectable buttons, or the user must select
different top-level functionalities until the desired specific
functionality is located.
This is particularly cumbersome when the user desires to
apply many available functionalities to a given object type.
For example, ifthe user desires to edit a picture object imbedded in a text document, according to prior methods and systems, the user must find functionality in a drop-down menu
associated with editing the picture object. After application of
any given functionality, the drop-down menu associated with
editing the selected object, e.g., picture object, typically dis-
25
30
35
40
45
50
55
Embodiments of the present invention solve the above and

other problems by providing an improved user interface for
displaying selectable software functionality controls that are
relevant to a selected object and that remain visibly available
for use while the selected object is being edited. Generally,
aspects of the present invention provide for presenting selectable functionality controls associated with a given top-level
functionality upon selection of a given object for editing.
Upon selection of a particular object for editing, functionality
available for editingthe object is presented in a ribbon-shaped
user interface above the software application workspace to
allow the user ready and efficient access to functionality
needed for editing the selected object. The display of relevant
functionality controls is persisted until the user dismisses the
display, selects another top-level functionality control or
selects another object for editing.
According to an aspect of the invention, methods and systems provide functionality from a software application that is
relevant to an edited object via an improved user interface. A
plurality of functionalities available from a given software
application is provided. Upon receiving an indication of a
selection of an object for editing via the software application,
one or more selectable controls representing a subset of the
plurality of functionalities is displayed in a ribbon-shaped
user interface whereby the subset of the plurality offunctionalities is relevant to and allows for editing the selected object.
The subset of the plurality of functionalities is persisted in the
user interface until an indication is received of the selection of
a different object for editing or the selection of a different
functionality associated with a different subset of the plurality of functionalities.
These and other features and advantages, which characterize the present invention, will be apparent from a reading of
the following detailed description and a review of the associated drawings. It is to be understood that both the foregoing
general description and the following detailed description are
exemplary and explanatory only and are not restrictive of the
invention as claimed.
60
65
FIG. 1 is a block diagram showing the architecture of a

personal computer that provides an illustrative operating
environment for embodiments of the present invention.
functionalities available under a selected top-level functionality tab.

US 7,703,036 B2
3

ribbon-shaped user interface in which is disposed selectable
functionality controls relevant to and associated with the editing of a selected object.
FIG. 4 illustrates a computer screen display showing an
editable object according to embodiments of the present
invention.
presentation of a plurality of functionalities associated with a
selected object for editing.
FIG. 6 illustrates the computer screen display of FIG. 5
wherein a drop-down menu of selectable formatting options
combinations is illustrated under a selectable formatting control.
FIG. 8 illustrates a computer screen display showing an
editable object according to embodiments of the present
invention.
pop-up functionality menu for providing functionality associated with a selected object for editing.
system on a personal computer, those skilled in the art will

recognize that the invention may also be implemented in
combination with other program modules.
Generally, program modules include routines, programs,
components, data structures, and other types of structures that
perform particular tasks or implement particular abstract data
types. Moreover, those skilled in the art will appreciate that
the invention may be practiced with other computer system
systems, microprocessor-based or progrannnable consumer
like. The invention may also be practiced in distributed computing environments where tasks are performed by remote
processing devices that are linked through a communications
network. In a distributed computing environment, program
modules may be located in both local and remote memory
storage devices.
Turning now to FIG. 1, an illustrative computer architecture for a personal computer 2 for practicing the various
embodiments of the invention will be described. The computer architecture shown in FIG. 1 illustrates a conventional
personal computer, including a central processing unit 4
("CPU"), a system memory 6, including a random access
memory 8 ("RAM") and a read-only memory ("ROM") 10,
and a system bus 12 that couples the memory to the CPU 4. A
basic input/output system containing the basic routines that
help to transfer information between elements within the
computer, such as during startup, is stored in the ROM 10.
The personal computer 2 further includes a mass storage
device 14 for storing an operating system 16, application
programs, such as the application program 205, and data.
The mass storage device 14 is connected to the CPU 4
through a mass storage controller (not shown) connected to
the bus 12. The mass storage device 14 and its associated
computer-readable media, provide non-volatile storage for
the personal computer 2. Although the description of computer-readable media contained herein refers to a mass storage device, such as a hard disk or CD-ROM drive, it should be
appreciated by those skilled in the art that computer-readable
media can be any available media that can be accessed by the
personal computer 2.
By way of example, and not limitation, computer-readable
media may comprise computer storage media. Computer
storage media includes volatile and non-volatile, removable
and non-removable media implemented in any method or
technology for storage of information such as computer-readable instructions, data structures, program modules or other
data. Computer storage media includes, but is not limited to,
RAM, ROM, EPROM, EEPROM, flash memory or other
solid state memory technology, CD-ROM, DVD, or other
optical storage, magnetic cassettes, magnetic tape, magnetic
disk storage or other magnetic storage devices, or any other
medium which can be used to store the desired information
and which can be accessed by the computer.
According to various embodiments of the invention, the
personal computer 2 may operate in a networked environment
using logical connections to remote computers through a
TCP/IP network 18, such as the Internet. The personal computer 2 may connect to the TCP/IP network 18 through a
network interface unit 20 connected to the bus 12. It should be
appreciated that the network interface unit 20 may also be
utilized to connect to other types of networks and remote
computer systems. The personal computer 2 may also include
an input/output controller 22 for receiving and processing
input from a number of devices, including a keyboard or
10
15
20
25
30
35
40
As briefly described above, embodiments of the present
invention are directed to an improved user interface for displaying selectable functionality controls that are relevant to a
selected object and that remain visibly available for use while
the selected object is being edited. In the following detailed
description, references are made to the accompanying drawings that form a part hereof, and in which are shown by way
of illustrations specific embodiments or examples. These
embodiments may be combined, other embodiments may be
utilized, and structural changes may be made without departing from the spirit or scope of the present invention. The
following detailed description is therefore not to be taken in a
limiting sense and the scope of the present invention is
defined by the appended claims and their equivalents.
represent like elements through the several figures, aspects of
the present invention and the exemplary operating environment will be described. FIG. 1 and the following discussion
are intended to provide a brief, general description of a suitable computing environment in which the invention may be
implemented. While the invention will be described in the
general context of program modules that execute in conjunction with an application program that runs on an operating
45
50
55
60
65

US 7,703,036 B2
5
mouse (not shown). Similarly, an input/output controller 22

may provide output to a display screen, a printer, or other type
of output device.
As mentioned briefly above, a number of program modules
and data files may be stored in the mass storage device 14 and
RAM 8 of the personal computer 2, including an operating
system 16 suitable for controlling the operation of a networked personal computer, such as the WINDOWS operating
systems from Microsoft Corporation of Redmond, Wash. The
mass storage device 14 and RAM 8 may also store one or
more application programs. In particular, the mass storage
device 14 and RAM 8 may store an application program 105
for providing a variety of functionalities to a user. For
instance, the application program 105 may comprise many
types of programs such as a word processing application, a
spreadsheet application, a desktop publishing application,
and the like. According to an embodiment of the present
invention, the application program 105 comprises a multiple
functionality software application for providing word processing functionality, slide presentation functionality, spreadsheet functionality, database functionality and the like. Some
of the individual program modules comprising the multiple
functionality application 105 include a word processing
application 125, a slide presentation application 135, a
spreadsheet application 140 and a database application 145.
An example of such a multiple functionality application 105
is OFFICE manufactured by Microsoft Corporation. Other
software applications illustrated in FIG. 1 include an electronic mail application 130.
functionalities available under a selected top-level functionality tab. As briefly described above, the improved user interface of the present invention includes a ribbon-shaped user
interface for displaying selectable controls associated with
task-based functionality available under a given software
application, such as the software application 105 illustrated in
FIG. 1. A first section 210 of the user interface 200 includes
generic selectable controls for functionality not associated
with a particular task, such as word processing versus spreadsheet data analysis. For example, the section 210 includes
selectable controls for general file commands such as "file
open," "file save" and "print." According to one embodiment
of the present invention, the selectable controls included in
the first section 210 are controls that may be utilized by a
variety of software applications comprising a multiple functionality application 105. That is, the selectable controls
included in the first section 210 may be controls that are
generally found and used across a number of different software applications.
Selectable controls included in the first section 210 may be
utilized for all such applications comprising such a multiple
functionality application, but other selectable controls presented in the user interface 200 described below, may be
tailored to particular tasks which may be performed by particular software applications comprising the multiple functionality application. On the other hand, it should be appreciated that the user interface 200 described herein may be
utilized for a single software application such as a word
processing application 125, a slide presentation application
135, a spreadsheet application 140, a database application
145, or any other software application which may utilize a
user interface for allowing users to apply functionality of the
associated application.
Referring still to FIG. 2, adjacent to the first section 210 of
the user interface 200 is a task-based tab section. The tab
section includes selectable tabs associated with task-based

functionality provided by a given software application. For
purposes of example, the task-based tabs illustrated in FIG. 2
are associated with tasks that may be performed using a word
processing application 125. For example, a "Writing" tab 215
is associated with functionality that may be utilized for performing writing tasks. An "Insert" tab 220 is associated with
functionality associated with performing insert operations or
tasks. A "Page Layout" tab 230 is associated with functionality provided by the associated application for performing or
editing page layout attributes of a given document.
As should be appreciated, many other task-based tabs or
selectable controls may be added to the tab section of the user
interface for calling functionality associated with other tasks.
For example, task tabs may be added for text effects, document styles, review and comment, and the like. And, as
described above, the user interface 200 may be utilized for a
variety of different software applications. For example, ifthe
user interface 200 is utilized for a slide presentation application, tabs contained in the tab section may include such tabs as
"Create Slides," "Insert," "Format," "Drawing," "Effects,"
and the like associated with a variety of tasks that may be
performed by a slide presentation application. Similarly, tabs
that may be utilized in the tab section of the user interface 200
for a spreadsheet application 140 may include such tabs as
"Data" or "Data Entry," "Lists," "Pivot Tables," "Analysis,"
"Formulas," "Pages and Printing," and the like associated
with tasks that may be performed using a spreadsheet application.
Immediately beneath the generic controls section 210 and
the task-based tab section is a selectable functionality control
section for displaying selectable functionality controls associated with a selected tab 215, 220, 230 from the task-based
tab section. According to embodiments of the present invention, when a particular tab, such as the "Writing" tab 215 is
selected, selectable functionality available from the associated software application for performing the selected task, for
example a writing task, is displayed in logical groupings. For
example, referring to FIG. 2, a first logical grouping 240 is
displayed under a heading "Clipboard." According to
embodiments of the present invention, the clipboard section
240 includes selectable functionality controls logically
grouped together and associated with clipboard actions
underneath the general task of writing. For example, the
clipboard section 240 may include such selectable controls as
a cut control, a copy control, a paste control, a select all
control, etc. Adjacent to the clipboard section 240, a second
logical grouping 250 is presented under the heading "Formatting."
Selectable controls presented in the "Formatting" section
250 may include such selectable controls as text justification,
text type, font size, line spacing, boldface, italics, underline,
etc. Accordingly, functionalities associated with formatting
operations are logically grouped together underneath the
overall task of "Writing." A third logical grouping 260 is
presented under the heading "Writing Tools." The writing
tools section 260 includes such writing tools as find/replace,
autocorrect, etc. According to embodiments of the present
invention, upon selection of a different task-based tab from
the tab section, a different set of selectable functionality controls in different logical groupings is presented in the user
interface 200 associated with the selected task-based tab. For
example, ifthe "Insert" task tab 220 is selected, the selectable
functionality controls presented in the user interface 200 are
changed from those illustrated in FIG. 2 to include selectable
functionality controls associated with the insert task. For
detailed information regarding the user interface 200, illus-
10
15
20
25
30
35
40
45
50
55
60
65

US 7,703,036 B2
7
tratedin FIG. 2, see United States PatentApplication, Ser. No.

10/955,967, entitled "Connnand User Interface for Displaying Selectable Software Functionality Controls," which is
incorporated herein by reference as if fully set out herein.
FIGS. 3through10 illustrate aspects of a first embodiment
of the present invention. FIG. 3 illustrates a computer screen
display showing a ribbon-shaped user interface in which is
disposed selectable functionality controls relevant to and
associated with the editing of a selected object. According to
the embodiment illustrated in FIGS. 3-10, of the present
invention, when a portion of a document or a particular object
is selected for editing, such as a text object, picture object,
spreadsheet object, or the like, the user interface illustrated in
FIG. 2 is temporarily replaced with a user interface, as illustrated in FIG. 3, which contains selectable functionality controls particularly associated with editing the selected object.
For example, if a picture object embedded in a text file is
selected for editing, the task-based functionality tabs and any
associated logical groupings of individual selectable functionality controls, as described above with reference to FIG.
2, are replaced with one or more task-based functionality tabs
and associated logical groupings of selectable functionality
controls that are particular to editing the selected object.
For example, referring to FIG. 3, if a picture object embedded in a text file or other document is selected for editing by
the user, the ribbon-shaped user interface 300 replaces the
ribbon-shaped user interface 200 so that the user is provided
with task-based tabs 310, 320, 330 particular to editing the
selected picture object. Similar to the description of the user
interface 200 described above, upon selection of one of the
task-based tabs 310, 3 20, 33 0, the portion of the user interface
300 disposed beneath the tabs is populated with individual or
logical groupings of selectable functionality controls for
applying functionality available under the selected taskbased tab to the selected object. For example, referring to the
user interface 300, selection of a "Style Gallery" tab 310
causes the presentation of a "Layout" section 350 and a "Picture Styles" section 355. In addition, a "Selection" section
345 is provided for allowing the user to select between multiple picture objects, for example, for application of any
selected functionality. If the user applies a given functionality
to the selected object, but is not satisfied with the result of the
functionality application, a reset button 340 is provided for
allowing the user to reset the selected object back to its
condition prior to applying the selected functionality. Selection of one of the other task-based tabs, such as the "Effects"
tab 320 or the "Picture Tools" tab 330, will cause a different
set of selectable functionality controls to be displayed in the
lower portion of the user interface 300 associated with the
selected task-based tab.
Referring to the example functionality controls illustrated
in the user interface 300, in the "Picture Styles" section 355,
a plurality of images are provided for showing a user how a
selected object would be displayed if a particular combination of formatting options or picture styles is applied to the
object. According to embodiments of the present invention,
selection of one or more of the images may cause all commands necessary for formatting or stylizing the selected
object in a manner consistent with the selected image from the
user interface 300. That is, upon selecting a desired image in
the "Picture Styles" section 355, the selected object in the
user's document is automatically formatted or stylized
accordingly. The "Layout" section 350 is representative of a
functionality controls section which may have one or more
images or potential layout styles or schemes than may be
displayed in the user interface 300. Accordingly, as illustrated
and described below with reference to FIG. 6, selection of the
"Layout" section 350 may cause a drop-down menu or dropacross menu to be displayed providing a user with a variety of
different layout options that may be applied to the selected
object.
As should be understood by those skilled in the art, the
example task-based tabs and individual functionality controls
illustrated in the user interface 300 are for purposes of
example only and are in no way limiting of the variety of
object-specific functionalities that may be provided in the
user interface 300. According to embodiments of the present
invention, by replacing the normal functionality offerings of
the user interface 200 with functionality particular to the
selected object, the user experience is one of being innnersed
in the functionality available to the user for editing the
selected object.
Ifinsufficient space is available in the user interface 300 for
displaying all logical groupings of functionality controls
associated with a given task-based tab, a determination may
be made at application run time as to any logical groupings
that must be collapsed or closed until the associated taskbased tab is selected. Similarly, ifthe user manually reduces
the size of the user interface 300, a determination is made as
to the available space for displaying selectable functionality
control sections, and certain selectable functionality control
sections are collapsed as required. As should be appreciated,
a determination may be made as to the order of collapsing
selectable functionality control sections such that a criteria,
such as "most used" or "most recently used" may be used for
determining which selectable functionality control sections
are displayed and which sections are collapsed as the available space in the user interface is decreased.
According to an alternate embodiment, if the user interface
300 lacks sufficient space to display all logical groupings of
functionality controls associated with a given task-based tab,
the size of the display of individual logical groupings is
reduced to allow space for the display of all associated logical
groupings. According to one aspect of this embodiment, different sizes of groupings displays, for example small,
medium and large, may be defined. At display time, a determination may be made as to the available space. At a starting
point, the largest size for each applicable logical grouping
display is presented. As required, the display size is reduced
(i.e., large to medium to small) for each logical grouping until
each grouping fits in the available space. In addition, for
smaller logical grouping display layouts, text labels may be
shortened or eliminated and the layout of individual selectable controls contained in given groupings may be rearranged
to allow for more efficient use of space.
Referring now to FIG. 4, an example text document is
displayed in a word processing application workspace having
an embedded picture object. The user interface 200, disposed
along the upper edge of the word processing application
workspace, is displayed with task-based tabs and associated
selectable functionality control sections for writing text into
the displayed document. If the user desires to edit the picture
object 410, according to embodiments of the present invention, the user need not search for functionality required for
editing picture objects. Upon selecting the picture object 410
for editing, a "Show Picture Tools" control 420 is displayed to
the user for allowing the user to call up tools and other
functionality available to the user for editing the selected
object. As should be understood by those skilled in the art, the
description of the editing of a picture object is for purposes of
example only and is not limiting of a variety of different tools
and functionalities that may be exposed to the user in a user
interface 300 described above upon selection of different
types of objects. For example, tools and functionality may be
10
15
20
25
30
35
40
45
50
55
60
65

US 7,703,036 B2
9
10
provided for editing table objects, spreadsheet objects, slide

presentation objects, database objects, and the like.
If the user selects the "Show Pictures Tools" control,
according to the embodiment illustrated in FIGS. 3-10, the
user interface 300 is dynamically generated and temporarily
replaces the user interface 200, as illustrated in FIG. 5. Referring to FIG. 5, the user interface 300 replaces the user interface 200, and task-based functionality available to the user for
editing the selected picture object is displayed in the user
interface 300, as described above with reference to FIG. 3.
Now, the user may select one or more functionalities applicable to editing the selected object (e.g., picture object) without the need for searching through a variety of different
menus or tool bars for functionality needed for editing the
selected object. In order to dismiss the user interface 300 and
return to the user interface 200, an exit control may be
selected.
Referring to FIG. 6, consider, for example, that the user
decides to change the layout of the document by moving the
embedded picture object to a different location. The user
could manually move the embedded object to a different
location followed by changing the orientation and location of
text contained in the document to cause the overall document
to have an acceptable and desirable layout. However, according to embodiments of the present invention, the user may
select the layout control 350 to deploy a drop-down menu for
providing a variety of different potential layouts for the
selected object within the selected document. For example,
the drop-down menu 600 provides layouts such as "Centered
Large," 610, "Top Left," 620, "Top Right," 630, "Centered in
Text," 640, "Above & Below," 650 and "Alone on Page" 660.
As should be understood, the potential layouts described and
illustrated with respect to FIG. 6 are for purposes of example
only and are not limiting of a variety of different layouts that
may be provided to the user via the user interface 300.
As described above with reference to FIG. 3, according to
embodiments of the present invention, all required commands for applying a presented formatting or layout to the
selected object may be coded for execution upon selecting
one of the formatting or layout images provided in the user
interface. Accordingly, if the user desires to select a layout
placing the selected picture object in the top right orientation
of the selected document, the user may select the "Top Right"
layout 630, and all required functionality for rearranging the
selected object and document according to the selected layout
is applied to the document and object so that the document
assumes the selected layout, as illustrated in FIG. 7.
Referring to FIG. 7, the selected object 410 is now positioned in the upper right-hand comer of the document, and the
text has been rearranged accordingly. As illustrated in FIG. 7,
the user interface 300 containing the functionality associated
with the selected object remains persisted in the user interface
until the user selects a different object in the document for
editing. For example, ifthe user moves the mouse cursor to a
text portion of the document and selects the text portion of the
document for editing, the user interface 300 will be dismissed
and an appropriate user interface 200 associated with editing
the selected text will be displayed, as illustrated in FIG. 4. For
example, as illustrated in FIG. 8, the picture object has been
deleted and the cursor is situated in the text portion of the
document. Accordingly, the user interface 300, containing
functionality particular to editing a picture object is dismissed, and the user interface 200, containing task-based tabs
and associated selectable functionality controls, groupings or
sections is displayed for providing the user necessary functionality for editing the text portion of the document.
As described above, one method for deploying the user

interface 300 for providing selectable functionality associated with a particular object is to select a particular object
within a given document. Alternatively, the user interface
300, containing functionality associated with a particular
object may be deployed by inserting an object of a given type
into a document. For example, referring to FIG. 9, if a user
decides to insert a table object into the document illustrated in
FIG. 9, the user may select the "Insert" task-based tab 220
from the user interface 200 for deploying selectable functionality controls associated with inserting text or objects into the
document. If the user then decides to insert a particular object,
for example, a table object, into the document, the user may
utilize one or more selectable functionality controls presented
in the user interface 200, or the user may launch a dialog 900,
as illustrated in FIG. 9, for creating and inserting a desired
object, for example a table object, into the selected document.
According to embodiments of the present invention, once
the user selects for inserting the desired object into the document, the object 1050 is inserted into the document, as illustrated in FIG. 10. Simultaneously, the user interface 200 is
replaced with a user interface 300 for displaying selectable
functionality for editing the now-selected table object 1050.
For example, referring to FIG. 10, the user interface 300 now
includes task-based tabs associated with editing a table
object. For example, task-based tabs, illustrated in the user
interface 300, include "Style Gallery," "Effects," "Borders
and Shading," "Table Layout," and "Date." As described
above with reference to FIGS. 2 and 3, selection of one of the
task-based tabs, for example the "Style Gallery" tab, causes a
display of individual or groupings of selectable functionality
controls 1020, 1030, 1040 for editing the selected object
according to the selected task-based tab.
FIGS. 11 through 15 illustrate aspects of an alternate
embodiment of the present invention. Referring now to FIG.
11, aspects of this embodiment of the present invention are
illustrated and described with reference to a spreadsheet
application140.As illustratedinFIG.11, a spreadsheet document is displayed having an example table of data 1150. A
user interface 1100 similar to the user interface 200 described
above with reference to FIG. 2 is disposed above the spreadsheet workspace for providing spreadsheet application functionality. A plurality of task-based tabs are provided at the top
of the user interface 1100 for selectively displaying logical
groupings of selectable functionality controls associated with
given task-based functionality tabs. For example, task-based
functionality tabs included in the user interface 1100 include
"Insert," "Page Layout," "Analysis," etc.
According to aspects of this embodiment, when an object is
selected for editing, such as the table object 1150 illustrated in
FIG. 11, the selectable functionality controls associated with
the selected object do not replace the tabs displayed in the
user interface 1100, but are appended to the user interface
1100 beneath the tabs displayed in the user interface 1100.
The controls associated with the selected object are automatically displayed in the appended orientation relative to the tabs
of the user interface 1100 upon selection or insertion of a
given object. Selection of any of the tabs in the user interface
1100 dismisses the controls displayed for the selected or
inserted object that are appended beneath the user interface
1100. For example, a "Styles" section 1110 is provided for
applying spreadsheet workspace styles to the document, a
"Properties" section 1120 is provided, an "Actions" section
1130 is provided, and a "Publish to Server" section 1140 is
provided. According to embodiments of the present invention, because a table object is embedded in the spreadsheet
workspace, a "Table Tools" tab is exposed adjacent to the
10
15
20
25
30
35
40
45
50
55
60
65

US 7,703,036 B2
11
12
task-based functionality tabs 1100. As should be appreciated,

upon receiving the indication of the selection of the object
selection of the "Table Tools" tab may cause a display of
for editing, providing additional selectable controls repselectable functionality controls associated with table objects
resenting a first subset of the plurality of functionalities,
in the lower portion of the user interface.
wherein the first subset of the plurality offunctionalities
allows for editing the selected object;
As illustrated in FIG. 12, selection of the "Table Tools" tab
causes display of the selectable functionality controls associgrouping the selectable controls into logical groupings,
wherein each of the logical groupings combines the first
ated with the selected table. Alternatively, the display of the
selectable functionality controls associated with the selected
subset of the plurality of software functionalities, and
wherein the textual representation of each selectable
table may be automatically displayed upon selection of the
table object without use of the "Table Tools" tab.As should be 10
control and the graphic representation of each selectable
understood, description of the table object 1150 and use of the
control is varied to accommodate a display size of the
"Table Tools" tab are for purposes of example only and are not
logical groupings; and
limiting of operation of embodiments of the present invention
when the user interface lacks sufficient space for displaywith respect to other objects that may be inserted into or
ing selectable controls of a given logical grouping,
15
edited in the spreadsheet workspace.
reducing the display size of each of the logical groupings
Referring to FIG. 13, if a user decides to create a chart, for
until each of the logical groupings may be displayed in
example, using data contained in the selected table object, the
the user interface.
user may select one of the chart-type images "Controls" illus2. The method of claim 1, further comprising upon receivtrated in the user interface of FIG. 12. Upon selection of a
ing an indication of the selection of a first user interface tab,
chart for inserting into the spreadsheet workspace, an "Insert 20 providing in selectable controls for selecting functionalities
Chart" dialog 1310 may be displayed for allowing the user to
organized under a first task associated with the selected first
specify attributes of the selected chart. As illustrated in FIG.
user interface tab.
14, once particular chart attributes are selected, a correspond3. The method of claim 2, further comprising upon receiving chart is drawn and is displayed in the spreadsheet working an indication of a selection of a second user interface tab,
space. According to embodiments of the present invention, 25 providing selectable controls for selecting functionalities
insertion of the selected chart automatically causes functionorganized under a second task associated with the selected
ality of the previously displayed user interface (see FIGS. 12
second user interface tab.
and 13) to be replaced with selectable functionality controls
associated with editing the selected and inserted chart. For
interface lacks sufficient space for displaying selectable conexample, a "Chart Structure" section 1410, a "Chart Options" 3o trols of a given logical grouping, collapsing the given logical
section 1420, a "3D View" section 1430, and an "Axis Scale"
grouping into a single selectable control for accessing the
section 1440 are displayed in a lower portion of the user
selectable controls grouped under the given logical grouping.
interface to provide particular selectable functionality con5. The method of claim 4, further comprising upon receivtrols associated with editing the selected chart.
ing a selection of the single selectable control, providing a
Referring now to FIG. 15, if the user selects a different 35 menu of the selectable controls grouped under the given logifunctionality for application to the spreadsheet workspace,
cal grouping.
for example, inserting a pivot table, the particular function6. The method of claim 1, further comprising rearranging a
ality displayed in the user interface associated with editing the
layout of individual selectable controls grouped in a given
chart, as illustrated in FIG. 14, is replaced with functionality
associated with inserting the selected or desired pivot table. 40 grouping.
Accordingly, functionality controls are made available and
7. The method of claim 6, further comprising amending a
displayed to the user according to the nature of the user's
display of individual selectable controls grouped in the given
work, for example, selection of a particular object in a doculogical grouping for reducing the display size of the logical
ment for editing.
grouping.
As described herein, an improved user interface is provided 45
8. The method of claim 2, further comprising:
for displaying selectable functionality controls that are relupon receiving an indication of a mouse-over of a second
evant to a selected object and that remain persisted for use
user interface tab, providing selectable controls reprewhile the selected object is being edited. It will be apparent to
senting a second subset of the plurality of functionalthose skilled in the art that various modifications or variations
ities; and
may be made in the present invention without departing from 50
upon cessation of the mouse-over of the second user interthe scope or spirit of the invention. Other embodiments of the
face tab, providing selectable controls representing the
invention will be apparent to those skilled in the art from
first subset of the plurality of functionalities.
consideration of the specification and practice of the inven9. The method of claim 8, further comprising after providtion disclosed herein.
55 ing selectable controls representing a second subset of the
plurality of functionalities, receiving an indication of a selecWe claim:
tion of one of the selectable controls representing the second
subset of the plurality of functionalities; and
application that is relevant to a selected object via an
improved user interface, the method comprising:
when the second user interface tab is not selected for persisting a provision of selectable controls representing
providing, by a computer, a plurality of software function- 60
alities in a task-based interface presented in tab format,
the second subset of the plurality of functionalities, prowherein each of the plurality of functionalities are previding selectable controls representing the first subset of
the plurality of functionalities.
sented as selectable controls, each selectable control
being presented by a graphic representation and a textual
10. The method of claim 1, wherein receiving the indicarepresentation;
65 tion of the selection of the object for editing includes receivreceiving an indication of a selection of an object for editing an indication of an insertion of an object for editing into a
ing via the software application;
document object.

US 7,703,036 B2
13
11. The method of claim 1, further comprising upon receiv-
14
selected object for selectively causing provision of the selecting an indication of a selection of one of the selectable conable controls representing the first subset of the plurality of
trols, applying functionality associated with the selected one
functionalities.
of the selectable controls to the selected object.
15. The computer readable storage medium of claim 13,
12. A computer implemented method for providing an
further comprising when the user interface lacks sufficient
space for displaying selectable controls of a given logical
improved user interface that provides functionality from a
software application that is relevant to a selected object, the
grouping, collapsing the given logical grouping into a single
method comprising:
selectable control for accessing the selectable controls
grouped under the given logical grouping.
displaying, by a computer, tabs identified textually and
disposed in an upper row of the user interface, each of 10
the tabs identifying a task operatively associated with
further comprising upon receiving a selection of the single
objects of a same type as the selected object, wherein
selectable control, providing a menu of the selectable controls
each of the tabs displayed by the computer are operative,
upon selection, to cause a display of selectable function15 further comprising rearranging a layout of individual selectality controls associated with the selected tab;
able controls grouped in the given logical grouping for reducdisplaying, by the computer, the selectable functionality
controls disposed in a row underneath the disposition of
ing the display size of the logical grouping.
the tabs, each of the functionality controls being pre18. The computer readable storage medium of claim 17,
sented by a graphic representation and a textual reprefurther comprising amending a display of individual selectsentation and being operative to cause an instance of an 20 able controls grouped in the given logical grouping for reducing the display size of the logical grouping.
associated functionality of the software application to
the selected object;
displaying, by the computer, the selectable functionality
further comprising:
controls in logical groupings, wherein each of the logical
upon receiving an indication of a mouse-over of a second
groupings combine a subset of the selectable function- 25
user interface tab, providing selectable controls repreality controls associated with the selected tab and the
senting a second subset of the plurality of functionalselected object, and wherein the textual representation
ities; and
upon cessation of the mouse-over of the second user interof each selectable control and the graphic representation
of each selectable control is varied to accommodate a
face tab, providing selectable controls representing the
30
display size of the logical groupings; and
first subset of the plurality of functionalities.
when the user interface lacks sufficient space for displayfurther comprising after providing selectable controls repreing selectable controls of a given logical grouping,
senting a second subset of the plurality of functionalities,
receiving an indication of a selection of one of the selectable
the user interface.
35 controls representing the second subset of the plurality of
13. A computer readable storage medium containing comfunctionalities; and
when the second user interface tab is not selected for perputer executable instructions which when executed by a computer perform a method for providing functionality from a
sisting a provision of selectable controls representing
software application that is relevant to a selected object via an
the second subset of the plurality of functionalities, proimproved user interface, the method comprising:
40
viding selectable controls representing the first subset of
providing a plurality of software functionalities in a taskthe plurality of functionalities.
based interface presented in tab format, wherein each of
the plurality of functionalities are presented as selectwherein receiving the indication of the selection of the object
able controls, each selectable control being presented by
for editing via the software application includes receiving an
a graphic representation and a textual representation;
45 indication of the insertion of the object for editing into a
receiving an indication of a selection of an object for editdocument object via the software application.
ing via the software application;
further comprising upon receiving an indication of a selection
upon receiving the indication of the selection of the object
of one of the selectable controls, applying functionality assofor editing, providing additional selectable controls representing a first subset of the plurality of functionalities, 50 ciated with the selected one of the selectable controls to the
wherein the first subset of the plurality offunctionalities
selected object.
allows for editing the selected object;
application that is relevant to a selected object via an
grouping the selectable controls into logical groupings,
improved user interface, comprising:
wherein each of the logical groupings combines the first
receiving an indication of a selection of a first object for
subset of the plurality of software functionalities, and 55
editing;
upon receiving the indication of the selection of the first
object for editing, displaying user interface tabs associlogical groupings; and
ated with tasks that are particular to operations on a
second object of a same type as the selected first object;
when the user interface lacks sufficient space for display- 60
ing selectable controls of a given logical grouping,
displaying selectable controls associated with a first user
interface tab, each of the selectable controls being operauntil each of the logical groupings may be displayed in
tively associated with the selected first object for applying functionalities of the software application associated
the user interface.
14. The computer readable storage medium of claim 13, in 65
with a first task, wherein each of the selectable controls
response to receiving the indication of the selection of the
is presented by a graphic representation and a textual
object for editing, providing a selectable control at the
representation;

US 7,703,036 B2
15
16

selectable controls, wherein each of the logical groupings combine a subset of the selectable controls, and
when the user interface lacks sufficient space for displaying selectable controls of a given logical grouping,
reducing the display size of eachofthe logical groupings
the user interface.
24. The method of claim 23, in response to receiving the
indication of the selection of the first object for editing via the
software application, providing a selectable control at the
selected object for selectively causing provision of tasks that
are particular to operations on the second object of the same
type as the selected first object.
25. The method of claim 23, further comprising upon
receiving an indication of a selection of a second user interface tab, providing selectable controls representing the second user interface tab.
26. The method of claim 23, further comprising when the
user interface lacks sufficient space for displaying selectable
controls of a given logical grouping, collapsing the given
logical grouping into a single selectable control for accessing
the selectable controls grouped under the given logical grouping.
receiving a selection of the single selectable control, providing a menu of the selectable controls grouped under the given
logical grouping.
28. The method of claim 23, wherein receiving the indication of the selection of the first object for editing includes
receiving an indication of an insertion of an object for editing
into a document object via the software application.
receiving an indication of a selection of one of the selectable
controls, applying functionality associated with the selected
one of the selectable controls to the selected first object.
30. A computer readable storage medium containing computer executable instructions which when executed by a computer perform a method for providing functionality from a
software application that is relevant to a selected object via an
improved user interface, the method comprising:
receiving an indication of a selection of a first object for
editing;
upon receiving the indication of the selection of the first
object for editing, displaying user interface tabs associated with tasks that are particular to operations on a
second object of a same type as the selected first object;
displaying selectable controls associated with a first user

interface tab, each of the selectable controls being operatively associated with the selected first object for applying functionalities of the software application associated
with a first task, wherein each of the selectable controls
is presented by a graphic representation and a textual
representation;
selectable controls, wherein each of the logical groupings combine a subset of the selectable controls, and
when the user interface lacks sufficient space for displaying selectable controls of a given logical grouping,
the user interface.
31. The computer readable storage medium of claim 30, in
response to receiving the indication of the selection of the first
object for editing via the software application, providing a
selectable control at the selected object for selectively causing provision of tasks that are particular to operations on the
second object of the same type as the selected first object.
of a second user interface tab, providing selectable controls
representing the second user interface tab.
further comprising when the user interface lacks sufficient
space for displaying selectable controls of a given logical
grouping, collapsing the given logical grouping into a single
selectable control for accessing the selectable controls
further comprising upon receiving a selection of the single
selectable control, providing a menu of the selectable controls
wherein receiving the indication of the selection of the first
object for editing includes receiving an indication of an insertion of an object for editing into a document object via the
software application.
of one of the selectable controls, applying functionality associated with the selected one of the selectable controls to the
selected first object.
10
15
20
25
30
35
40
45
50
* * * * *
Exhibit C

US007047501B2
c12)
(54)
(75)
(10)
Morcos et al.
(45)
METHOD FOR DISPLAYING CONTROLS IN

A SYSTEM USING A GRAPHICAL USER
INTERFACE
(56)

(US)
( *)
Notice:
4,931,783
5,644,738
5,760,768
5,801,701
5,828,376
(22)
Filed:
Primary Examiner-Cao (Kevin) Nguyen

(74) Attorney, Agent, or Firm-Merchant & Gould
(57)
Jun. 13, 2002

(63)
Continuation of application No. 08/891,945, filed on

Jul. 14, 1997, now Pat. No. 6,384,849.
(51)
Int. Cl.
G06F 13100
(52)
(58)
(2006.01)
U.S. Cl. ....................... 7151779; 715/810; 715/843

Field of Classification Search ... ... ... ... .. .. 715/810,
715/841, 764, 781,821,840, 843, 779
Word-container
File
B-~
Viewl100%
New
Open
Save
Save All
Print
ABSTRACT
In a computer employing a graphical user interface (GUI),

a method for displaying controls in command bars, which
replace conventional menu bars and toolbars. Command
bars employ a unified data structure that allows all types of
controls to be included in both menu-like command bars and
toolbar-like command bars. Command bars may be customized by dragging controls from a list of available commands
or from another command bar. By not restricting the types
of controls that can appear in each command bar, controls
may be grouped to associate drop down menu controls with
pushbutton controls. Menu-like command bars and toolbarlike command bars may be merged in a way that provides an
intuitive and advantageous listing of commands. Menu
popups may be tom off using a clearly indicated drag handle.

US 2002/0070977 Al
Atkinson
Goldman et al.
Gram ......................... 715/747
Koppolu et al.
Solimene et al. ........... 715/821
* cited by examiner
Feb. 13, 2002
(65)
611990
7/1997
6/1998
9/1998
10/1998
Microsoft Word: The World's Most Popular Word Processor,

Version 6.0 User's Guide, Microsoft Corporation, 19931994, pp. xi, 737-758.
Brockschmidt, Kraig, Inside OLE 2: The Fast Track to
Building Powerful Object-Oriented Applications, Microsoft
Press, 1994, pp. v-xiv, 843-905. 969.
"DECwindows User's Guide" Product Version: Digital
UNIX Version 4.0 or Higher, Digital Equipment Corporation
(Mar., 1996.).
This patent is subject to a terminal disclaimer.

Appl. No.: 10/075,807
A
A
A
A
A
OTHER PUBLICATIONS
Subject to any disclaimer, the term of this

U.S.C. 154(b) by 641 days.
(21)
References Cited
Inventors: Peter G. Morcos, Redmond, WA (US);

Ravindra K. Agrawal, Redmond, WA
(US); Lawrence W. Baldwin, Seattle,
WA (US); Tjeerd S. Hoek, Kirkland,
WA (US); David C. Parker,
Woodinville, WA (US)
(73)
Patent No.:
US 7,047,501 B2
Date of Patent:
*May 16, 2006
Zoom
~t
Ruler
Window
-1100
New
Arrange
1 loo.doc
2. bar.doc
Excel-server
);116:'.~
Edtt
Undo
Redo
Cut
File
,,-,4
Copy
Vlew~Tools
Data
Help
Formula Bar
View Manager
Filter
Sort
Form
About
Contents
Search
Data
Window
Help
Filter
New
Arrange
1 loo.doc
2. bar.doc
About
Contents
Search
Paste
B-~e
New
Open
Save
Save All
Print
Edit
r.4
Undo
Redo
Cut
Copy
Paste
Vlewf100%
ffl Tools
Formula Bar
View Manager
Zoom
Rufer
Spelling
Solver
Macro
Options
Spelling
Solver
Macro
Options
Sort
Form
'-1105
1110
~-------------~~----~~-~~~~-~--~---------~-----~--~~------.
---------I ___261....
(ROM)
"'C
'
24
Monitor
BIOS
'
48
21
25
{RAM)
47
20.
SYSTEMMEM:>R'I'
Cj
00
VIDEO
ADAPTER
22
371
OPTICAL
DtSK
INTEAFAOE
Pom
INTERFACE
,_.
51
WIDEAAEA
54
Mouse
OPEAAllNG
SYSTEM
36 DYMMOAPPLICATION
POOGFW.6
LAYER
37
DATA
PrmtW.1
ft>
=
"'*"
SERIAL
- - - .. -.. --- -
35
=
"'*"
38
F/G.1
....
,200
Afe Edit
220
De
View
rnsert Format
Times New Roman
235
210
215
'"'C
=
tt)
~ ~ Jo~~~~~ I Ix ~J ~J ~Ci 4 100% v Q \?

tlv <t:J~"flv
J)O
ll II: :fl e!1 $ " ' .ooJJ
'* .."'
=
~
=
....
FIG.2
F"
310
CtrJ+O
00
~
Window Help
Ctrl+N
1 v
' 2
0-.,
rJ1
=-
BI .U -=11~
N
Q
Q
('!)
('!)
"""
N
0
-.
QO
S ve...
Save As...
Save As f:ffML. ..
Ctrl+S
D Ie7~fB&~I
-;;:~,,, Q~f~
. ,
335
EJ 11 1:12s% lvD 9iJ
V~sions
335
Pa~e
Setup...
320
.-........830
FIG.3
rJ).
._J
=
""'
"'tit
=
"'
._J
""""
O::j
U.S. Patent
May 16, 2006
Sheet 3 of 8
US 7,047,501 B2
400
MICROSOFT
MICROSOFT
WORD
EXCEL
OFFICE .DLL
OFFICE.DLL
410
SHARED
MEMORY
(COMMANDSt ICONS,
TEXT, ETC.)
FIG.4
file
~ Edit
rmat m:mes New Rman
(fJ!
<ff,....... r.. View

I1o : l!J B / ll
Insert ~
I fx
s: s
Tools ~ Data ~i
fl
Help Q
\?
$ % , ~.:.8 I:l v <tJ ~ 11 v
FIG.5
File Edit View Insert Format Tools Data Window Help
c.9
JTimesNewRoman :
~ ~ Jo ~ ~ ~ _.. ~ ! Ix ~t lt ~ ii iij 118

110
B I .u ~ :; 9 $ % ' ~.f.8 Ov
m en
:CO: (2roup
IO !Jngroup
.dl Flip ttorlzontal

~
Fllp yertical
~~Rotate ~lght
JiS. Rotate ~eft
620
FIG.6
IYJ! Q \?
<tJ v 1J v
U.S. Patent
May 16, 2006
US 7,047,501 B2
Sheet 5 of 8
700
710
Ctrt+B
720
715
Ltalic
Ctrl+I
ll
~nderline
Ctrl+U
font Size 11
Grow Font
At/\
AM. hrink Font
725
CtrI+>
Ctrl+<
[!]
to
Automatic
DDOODOOO
735
DDDDDDOD
FIG.7
805
Edit
Vie!N
Insert
Format
Tools
Table
WrdoN
ra Save
v
1===-=====~~
.0 SaveAs
f~~
Description I Properties:
I
til
Cofoolns: I3
l@I
Sa~ In: INormal.dot fy1
J Keyboard J
FIG.8
Close
U.S. Patent
May 16, 2006
US 7,047,501 B2
Sheet 6 of 8
START
,900
YES
920
TAKE ..ASIS"
FROM DONATING
APP
TAKE COPY OF
oBJECrs RJLL
COMMAND BAR
930
PLACECARST
IN MERGED
COMMAND&\R
940
PlACECIN
SAME
LOCATION ASS
950
Pl.ACEC
AT END
FIG.9
00
Container
Object (server)
N
~
1000---
u
1010--- u
1015-.. u
1005-...
1020-..
1025-....
....
~~
v
v
v
v
x
x
N
0
0
1J1
=-
('D
('D
.....
-....J
0
.....
QO
N
d
rJl
;-l
=
-....l
u.
=
~
FIG.10
"'""
=
N
~
C/1
Word- container
~ ~
File
G/J
View
New
[f0o% till
Zoom
Open
1100
New
~t
Save
Save All
Window
=
~
Arrange
Ruler
1 too.doc
2.bar.doe
Print
a:
.....
Excel- server
);ltt( ~
Edft
}i
Undo
r. -t$
Redo
Cut
Copy
Paste
Viewl1Qtii&1 Tools
'"Cl\
Data
Formula Bar
Speflfng
Filter
View Manager
Solver
Sort
Form
Macro
Options
Help
1105
About
Contents
Q
Q
Cl\
00
Search
::r
('!)
('!)
"""
00
<:>
'""'
00
Fiie
e~e
New
Open
Save
Save All
Print
Edit '"'
Undo
Redo
.q
Vfewl100%
CI Tools
Data
Window
Help
About
Spelling
Fiiter
New
Cut
Copy
Formula Bar
View Manager
Solver
Sort
Arrange
Zoom
Macro
Form
1 too.doc
Paste
Ruler
Options
2.bar.doc
Contents
Search
1110
d
00
-.l
-.l
FIG.11
'"UI
Q
I--"
=
N

US 7,047,501 B2
1
METHOD FOR DISPLAYING CONTROLS IN

A SYSTEM USING A GRAPHICAL USER
INTERFACE
toolbars is that exposing a large number of commands

requires displaying a large number of controls, which
require a relatively large amount of screen space. Another
disadvantage is that conventional toolbars require the use of
a pointing device and may not be operated using a keyboard.
Although toolbars and drop down menus both provide
ways to display controls (many of which are associated with
the same command), they look and feel very different. In
drop down menus, commands are usually represented by
simple menu items, such as text without icons. In toolbars,
commands are often represented by icons without text. This
difference presents a disadvantage for users (especially new
users) because there are no common visual cues to alert a
user to the connection or linkage between identical commands that appear in a drop down menu and on a toolbar.
As application programs have incorporated ever increasing numbers of commands, drop down menus have become
full and software developers have relied more heavily on
toolbars as the primary means for exposing some of the
commands to the user. Unfortunately, a command that is
only available on a toolbar may be somewhat obscure and,
in many cases, not easily discovered or understood by the
user because the command is represented by only a small
icon.
In some programs, a user may customize the drop down
menus and toolbars. This allows a user to add controls
(which represent commands) to or delete controls from
menus and toolbars. In the prior art, drop down menus and
toolbars are customized using different processes. Some
toolbars may be customized using a drag and drop process
to drag controls from a list of available commands to a
toolbar. Drop down menus typically require the use of dialog
boxes and other techniques to add or delete controls. In
addition, although some commands may be represented on
menus or in toolbars or both, other commands are restricted
to one or the other. This difference results in several drawbacks. First, limiting some commands to drop down menus
and others to toolbars restricts the user's ability to efficiently
and conveniently group commands. Second, treating drop
down menus and toolbars differently requires the program to
maintain different lists of available commands for menus
and toolbars. This results in duplication and larger program
code, which requires more memory to store and more time
to load.
In the prior art, tool bars have contained a variety of rich,
interactive controls, such as buttons, combo boxes, text
boxes, etc. However, drop down menus have been restricted
to representing commands with simple menu items, such as
a text string. Therefore, if an application was to provide one
of these rich controls, it had to use a toolbar to do so.
Another feature associated with drop down menus and
toolbars has to do with OLE menu merging, which occurs
when one application displays an embedded object in
another application's document. For example, a Microsoft
Excel spreadsheet (the object) may be embedded and displayed in a Microsoft Word document (the container). When
the embedded object is activated, it may be edited. In order
to facilitate this process, Microsoft's Object Linking and
Embedding (OLE) interface merges the menus from the
spreadsheet and word processing programs, thereby providing relevant commands to the user. However, in the prior art,
menu merging required an application to contribute its entire
menu. In addition, toolbars were not merged, which resulted
in only those toolbars provided by the embedded object
being displayed and the controls representing client-type
functions (e.g., print) being disabled. This results in several
drawbacks. First, some useful commands may be not be
This application is a continuation of application Ser. No.:

08/891,945, filed Jul. 14, 1997 now U.S. Pat. No. 6,384,849,
which is expressly incorporated herein by reference.
TECHNICAL FIELD
10
The present invention relates to the display and manipulation of command-related items in a graphical operating
system, and more particularly relates to an improved method
for displaying and manipulating various controls in a system
that uses a graphical user interface.
15

Most modern computer software employs a graphical user
interface (GUI) to convey information to and receive commands from users. A graphical user interface relies on a
variety of GUI objects or controls, including icons, text,
drop down menus, toolbars, dialog boxes, buttons, and the
like. A user typically interacts with a graphical user interface
by using a pointing device (e.g., a mouse) to position a
pointer or cursor over an object and "clicking" on the object.
An example of an operating system that employs a graphical
user interface is the "WINDOWS 95" operating system,
which is manufactured and sold by Microsoft Corporation of
Redmond, Wash.
In a program module (e.g., an operating system or application program) that employs a graphical user interface,
commands are typically represented by controls that are
displayed in drop down menus and toolbars. Drop down
menus, which may also be referred to as popup menus or
menu popups, are used to organize numerous controls under
major headings, which are displayed in a menu bar that
appears along the top of a window. Each heading is a "menu
control" that represents a drop down menu. A menu drops
down when the user selects the associated menu control in
the menu bar, thereby allowing access to the controls that are
included in the drop down menu. A user may select or invoke
a command by clicking on the menu control, dragging the
pointer down to the control associated with the desired
command, and releasing the mouse button. Alternatively, the
user may click on the menu control and release the mouse,
then click and release on the appropriate control in the drop
down menu. The primary advantage of drop down menus is
that they can be used to contain and organize a large number
of controls, but take up very little screen space when not in
use. In addition, menus can also be operated using the
keyboard when a pointing device is unavailable or unusable.
Toolbars usually include buttons, which are arranged in
one or more rows or colunms. Each button is associated with
a command, and is identified by an icon that represents or
depicts that command. For example, the "print" command
may be invoked by clicking on a button whose icon depicts
a printer. Significantly, a user can invoke commands on the
toolbar by clicking once on the associated button. In addition
to buttons, toolbars can also include other interactive controls, such as text boxes, combo boxes, etc. Some toolbars
can be turned on or off, and can be oriented horizontally or
vertically. Although most toolbars are visually attached to a
window, some may float above a window. The primary
advantage oftoolbars is that they present a set of buttons or
controls that are only one click away while the user is using
the associated program. A corresponding disadvantage of
20
25
30
35
40
45
50
55
60
65

US 7,047,501 B2
3
available while the embedded object is activated. In addition, some of the available commands may not be useful or
intuitive.
In another aspect, prior art menus have provided tear off
menus, which may be torn off by moving the mouse cursor
past the edges of the displayed menu. However, the prior art
method did not include any visual cue that a menu could be
torn off, and was therefore not easily discoverable. In
addition, these menus are prone to being torn off accidentally if the user tries to close the window by the common
practice of moving the cursor beyond the window border
and releasing the mouse button.
In summary, prior art drop down menus and toolbars
provide a good way to display controls and expose commands. However, there are several disadvantages that flow
from the fact that drop down menus and toolbars are treated
differently, and may include different controls. Furthermore,
menu merging has been limited to menus, and requiring an
application to contribute an entire menu has resulted in the
unavailability of some useful commands.
Therefore, there is a need in the art for an improved
command bar that overcomes these drawbacks. An
improved command bar would allow all controls to be
included in either menu-type containers or toolbar-type
containers and would include visual cues that indicate the
linkage between similar commands. In addition, an
improved command bar would allow the user to have greater
control over what commands can be put where, thereby
allowing commonly used controls to be placed in a toolbartype container and less commonly used controls to be placed
in a menu-type container. This would allow rich, interactive
controls to be placed in a menu popup, and would increase
efficiency of use and of screen space. An improved command bar would eliminate the use of different customization
procedures and would be operable from the keyboard
regardless of whether it is a menu-type container or a
toolbar-type container. With respect to menu and toolbar
merging, an improved command bar would allow each
application to contribute individual commands to both
menu-type containers and toolbar-type containers, and
would arrange them in a user-friendly and intuitive manner.
This would ensure that both container and object-related
buttons come from the appropriate source and operate
properly when selected. Finally, an improved command bar
would provide an improved method for tearing off tearable
menus. This method would provide visual cues that the
menu can be separated from the menu or toolbar and would
prevent the menu from being torn off accidentally.
indication that the menu control has been selected, a menulike command bar is displayed. The menu-like command bar
includes at least one interactive control.
In another aspect, the present invention provides a data
structure for providing controls in a command bar. A computer-readable medium includes a plurality of data fields
stored on the medium and representing a data structure. The
data fields include first, second, and third data fields. The
first data field including data identifying a command bar.
The second data field contains data representing a plurality
of controls included in the command bar, where the controls
are chosen from a group including simple menu items and
interactive controls. The third data field contains data representing the display state of the command bar. The display
state may include data representing a menu-like display state
or a toolbar-like display state. When the command bar is a
toolbar-like command bar, the control may includes at least
one popup menu control. When the command bar is a
menu-like command bar, the controls may include a simple
menu item and at least one interactive control.
In another aspect, the present invention provides a method
for implementing command bars in an application program
module. The method is implemented in a computer system
including a shared program module that includes functions
for manipulating the command bars and shared memory for
storing data associated with the command bars. The method
includes, in the application program module, calling the
functions in order to display a menu-like command bar
including an interactive control. In response to an input
signal, the application program module receives from the
shared program module an indication of the selection of the
interactive control. In response to the indication, the application program module determines a function associated
with the control and performs the function.
In another aspect, the present invention provides a method
for customizing a command bar that includes a menu
control. The method includes displaying a first command bar
including a menu control and displaying a container including an available control. The method includes receiving
from an input device an indication that the available control
has been moved to the menu control. In response to the
available control being moved to the menu control, a menu
popup associated with the menu control is displayed. The
method includes receiving from the input device an indication that the available control has been moved to a position
in the menu popup. In response, the available control is
displayed in the position in the menu popup.
In yet another aspect, the present invention provides a
method for merging a first set of items from a first container
in a first program module and a second set of items from a
second container in a second program module. The method
includes determining which of the first set of items are
eligible to be donated and which of the second set of items
are eligible to be donated. The eligible items from the first
set of items are combined with the eligible items from the
second set of items. A merged command bar, including at
least one item from the first set of items and at least one item
from the second set of items, is displayed.
In yet another aspect, the present invention provides a
method for removing a menu popup from a command bar.
The method includes displaying a command bar and displaying a menu popup including a drag handle. The menu
popup is connected to the command bar. The method
includes receiving from the input device an indication that
the drag handle has been dragged away from the command
bar. The menu popup is moved away from the command bar
in response to the indication. In response to an indication

The present invention satisfies the above-described needs
by providing an improved method for displaying controls in
a system using a graphical user interface. Controls are
displayed in command bars, which may be displayed as both
menu-like containers and toolbar-like containers. Controls
may be included and arranged in either type of command bar
container, regardless of whether they are simple menu items
or interactive controls. When an application embeds an
object in another application, each application contributes
individual commands to the merged menu-type containers
and toolbar-type containers, and arranges then in a useful,
intuitive order.
Generally described, the present invention provides a
method for providing command bars. The method includes
the steps of displaying a toolbar-like command bar that
includes at least one menu control. Upon receiving an
10
15
20
25
30
35
40
45
50
55
60
65

US 7,047,501 B2
5
that the menu popup has been dropped, the menu popup is
displayed in a position corresponding to the drop indication.
In this manner, the menu popup is removed from the
command bar.
Alternatively, a menu popup may be removed from a
command bar by displaying a command bar and displaying
an original menu popup including a drag handle. The
original menu popup is connected to the command bar. In
response to an indication that the drag handle has been
selected, the removed menu popup is displayed in a default
position separate from the command bar.
The various aspects of the present invention may be more
clearly understood and appreciated from a review of the
following detailed description of the disclosed embodiments
and by reference to the appended drawings and claims.
Exemplary Operating Environment
10
15

FIG. 1 is a block diagram of a personal computer that
provides the operating environment for an embodiment of
the present invention.
FIG. 2 illustrates a group of command bars that look like
a conventional menu bar and conventional toolbars.
FIG. 3 illustrates various aspects of command bars,
including a menu popup and a floating command bar.
FIG. 4 illustrates the use of a dynamic-link library to
implement the command bar code.
FIG. 5 illustrates a docked command bar in which menu
controls are positioned with pushbutton controls.
FIG. 6 illustrates a floating command bar in which a menu
control is positioned next to pushbutton controls.
FIG. 7 illustrates the inclusion of a variety of control types
in a menu popup.
FIG. 8 illustrates a dialog that is used in the command bar
customization process.
FIG. 9 is a flow diagram illustrating an exemplary method
for merging command bars.
FIG. 10 is a example of how command bar elements may
be merged.
FIG. 11 is an example of how two command bars may be
merged.
20
25
30
35
40
45
The present invention is directed to an improved method
for displaying various controls in command bars, which may
be displayed as both popup menu-like containers and toolbar-like containers. The controls, which are associated with
a single list of available commands, may be included and
arranged in either type of command bar container, regardless
of whether the controls are popup menu controls or pushbutton controls (e.g., text, buttons, or other rich controls).
When an application embeds an object in another application, each application contributes individual commands to
the merged command bars and arranges then in a useful,
intuitive order. In addition, some popup controls can be torn
off to create separate, floating command bars. The tearable
popup controls include visual clues that the menu can be torn
off.
represent like elements throughout the several figures,
aspects of the present invention and an exemplary operating
environment will be described.
50
55
60
65
FIG. 1 and the following discussion are intended to

provide a brief, general description of a suitable computing
environment in which the invention may be implemented.
While the invention will be described in the general context
of an application program that runs under an operating
system in conjunction with a personal computer, those
skilled in the art will recognize that the invention also may
be implemented in combination with other program modules. Generally, program modules include routines, programs, components, data structures, etc. that perform particular tasks or implement particular abstract data types.
Moreover, those skilled in the art will appreciate that the
invention may be practiced with other computer system
systems, microprocessor-based or progrannnable consumer
like. The invention may also be practiced in distributed
computing environments where tasks are performed by
remote processing devices that are linked through a communications network. In a distributed computing environment, program modules may be located in both local and
remote memory storage devices.
With reference to FIG. 1, an exemplary system for implementing the invention includes a conventional personal
computer 20, including a processing unit 21, a system
memory 22, and a system bus 23 that couples the system
memory to the processing unit 21. The system memory 22
includes read only memory (ROM) 24 and random access
memory (RAM) 25. A basic input/output system 26 (BIOS),
containing the basic routines that help to transfer information between elements within the personal computer 20,
such as during start-up, is stored in ROM 24. The personal
computer 20 further includes a hard disk drive 27, a magnetic disk drive 28, e.g., to read from or write to a removable
disk 29, and an optical disk drive 30, e.g., for reading a
CD-ROM disk 31 or to read from or write to other optical
media. The hard disk drive 27, magnetic disk drive 28, and
optical disk drive 30 are connected to the system bus 23 by
a hard disk drive interface 32, a magnetic disk drive interface 33, and an optical drive interface 34, respectively. The
drives and their associated computer-readable media provide
nonvolatile storage for the personal computer 20. Although
the description of computer-readable media above refers to
a hard disk, a removable magnetic disk and a CD-ROM disk,
it should be appreciated by those skilled in the art that other
types of media which are readable by a computer, such as
magnetic cassettes, flash memory cards, digital video disks,
Bernoulli cartridges, and the like, may also be used in the
exemplary operating environment.
A number of program modules may be stored in the drives
and RAM 25, including an operating system 35 (e.g.,
Microsoft Corporation's "WINDOWS 95" operating systern), one or more application programs 36, a shared
dynamic-link library 37, and program data 38. A user may
enter commands and information into the personal computer
20 through a keyboard 40 and pointing device, such as a
mouse 42. Other input devices (not shown) may include a
microphone, joystick, game pad, satellite dish, scanner, or
the like. These and other input devices are often connected
to the processing unit 21 through a serial port interface 46
that is coupled to the system bus, but may be connected by
other interfaces, such as a game port or a universal serial bus
(USB). A monitor 47 or other type of display device is also
connected to the system bus 23 via an interface, such as a
video adapter 48. In addition to the monitor, personal

US 7,047,501 B2
7
computers typically include other peripheral output devices

(not shown), such as speakers or printers.
The personal computer 20 may operate in a networked
environment using logical connections to one or more
remote computers, such as a remote computer 49. The
remote computer 49 may be a server, a router, a peer device
or other common network node, and typically includes many
or all of the elements described relative to the personal
computer 20, although only a memory storage device 50 has
been illustrated in FIG. 1. The logical connections depicted
in FIG. 1 include a local area network (LAN) 51 and a wide
area network (WAN) 52. Such networking environments are
commonplace in offices, enterprise-wide computer networks, intranets and the Internet.
When used in a LAN networking environment, the personal computer 20 is connected to the LAN 51 through a
network interface 53. When used in a WAN networking
environment, the personal computer 20 typically includes a
modem 54 or other means for establishing communications
over the WAN 52, such as the Internet. The modem 54,
which may be internal or external, is connected to the system
bus 23 via the serial port interface 46. In a networked
environment, program modules depicted relative to the
personal computer 20, or portions thereof, may be stored in
the remote memory storage device. It will be appreciated
that the network connections shown are exemplary and other
means of establishing a communications link between the
computers may be used.
simpler and more compact. The unified data structure also

results in additional advantages, such as a unified customization procedure and improved command merging. These
features are discussed below.
FIG. 2 illustrates a group of command bars that look like
a conventional menu bar and conventional toolbars and
would be displayed at the top of an application window. The
illustrated command bar structure 200 includes three toolbar-like command bars. The toolbar-like command bar 210
which resembles a conventional menu bar and includes a
group of popup menu controls 215. The toolbar-like command bars 220, 225 resemble conventional toolbars and
include buttons 230 and combo boxes 235.
FIG. 3 depicts the upper, left portion of a document
window 300, and illustrates various features of command
bars. In this embodiment, the command bar structure
includes a toolbar-like command bar 310, which resembles
a conventional menu bar, an attached toolbar-like command
bar 315, and a floating toolbar-like command bar 320.
For the purposes of this description, the following terminology will be used to describe the features of the command
bars. The toolbar-like command bar 310 includes a plurality
of menu controls 325. When a menu control is activated by
a user (typically by selecting, or clicking on, the menu
control), an associated menu popup 330 is displayed. The
menu popup 330 is a menu-like command bar, and may also
be referred to as a popup bar or command bar popup. In
general, a menu popup is a transient command bar that is
displayed only long enough for a single command to be
chosen by the user. In contrast, top level command bars,
such as command bars 310, 315, 320, are displayed until
they are explicitly dismissed. The illustrated menu popup
330 and toolbar-like command bars 315, 320 include push
button controls 335, which are selected the same as conventional toolbar buttons and menu items. The term "highlighted control" is used to refer to a control that has been
highlighted as the user is in the act of choosing a control.
One significant advantage of command bars over conventional menu bars and toolbars is that in the menu popup 330,
a command can be represented by both a text string 340 and
an icon 345. Because the icon in the menu popup is the same
icon that is used to represent the command in a toolbar-like
command bar, command bars are able to provide useful
visual cues that allow a user to associate commands in menu
popups with shortcut commands in toolbar-like command
bars. For example, the "SAVE" command is represented by
the same icon in the menu popup 330 and the floating
command bar 320. This allows users to determine the most
efficient way to access a particular command if it is available
in more than one command bar.
In an exemplary embodiment, the program module that
implements the command bar code is stored in the form of
a dynamic-link library, which is included with Microsoft
Corporation's "OFFICE 97" suite of application programs.
Generally described, in the "WINDOWS" family of operating systems, a dynamic-link library (DLL) is a mechanism
for code sharing between program modules. The feature
allows executable routines to be stored separately as files
with DLL extensions, and for multiple applications to run
the same code. These DLL files typically serve a specific
function or set of functions and are loaded by a calling
program only when needed by that program. A dynamic-link
library has several advantages. For example, because a
dynamic-link library is loaded only when it is needed, it does
not consume any memory until it is used. In addition,
because a dynamic-link library is a separate file, a programmer can make corrections or improvements to only that
A Method for Displaying Controls in a Command

Bar
An exemplary method for displaying controls in a command bar is illustrated in FIGS. 2, 3, and 5-7. In this
embodiment, the present invention displays controls in
multiple command bars, which are containers for controls.
Command bars replace conventional menu bars and toolbars. Command bars can include a variety of controls,
including simple menu items and interactive controls.
Simple menu items refer to textual command names that
simply invoke a single command when activated. An
example of simple menu items includes the static text that
typically appears in conventional drop down menus. Interactive controls include edit or text boxes, combo boxes, list
boxes, buttons, expanding grids, static text, menu controls,
color pickers, etc., which typically appear in conventional
toolbars. Some interactive controls allow a user to perform
complex, multi-step actions, such as typing text.
In an exemplary embodiment, command bars may be
displayed in either of two forms. Toolbar-like command bars
resemble conventional docked or floating toolbars, which
typically include interactive controls of the type described
above. Menu-like command bars resemble conventional
drop down menus, which typically include simple menu
items, such as text controls. In this embodiment, the toolbarlike command bars may also resemble conventional menu
bars, which include popup menu controls.
An important advantage of command bars is that although
they may be displayed in different forms, they are identical
with respect to their underlying data structure, and are
treated identically by the underlying command bar program
module. This allows command bars, regardless of their
displayed form, to be implemented and controlled by the
same underlying code, and to employ the same catalog of
commands, icons, text strings, etc. This provides an interface that is more versatile than when using separate menu
bars and toolbars, and allows the underlying code to be
10
15
20
25
30
35
40
45
50
55
60
65

US 7,047,501 B2
9
10
module without affecting the operation of the calling program or any other dynamic-link library. Finally, because a
dynamic-link library often contains related functions, a
programmer can use the same dynamic-link library with
multiple programs.
With this background, FIG. 4 illustrates how a dynamiclink library is used to implement the command bar functionality in one or more application programs. In the illustration of FIG. 4, a dynamic-link library is used to
implement the command bar code. Two application programs 400, 405 each load an instance of the command bar
dynamic-link library, which is also referred to herein as the
Office shared code. Each application calls functions in the
dynamic-link library when it needs to perform a command
bar related task. In addition, the Office shared code manages
a block of memory 410 that is used to store a variety of
command bar-related data. If multiple applications are
simultaneously running Office shared code, the copies cooperate with each other in the management of the shared block
of memory. Similarly, during menu merging, which is discussed below, the application programs' instances of the
dynamic-link library code negotiate with each other to figure
out how the command bars should be merged.
As mentioned above, the block of memory 410 is used to
store command bar-related parameters and data. The stored
data include, for example, the set of available commands, a
unique numeric ID for each command, the bit maps and
default text strings that are associated with each command,
and the default settings for command merging. Other types
of information, such as the state of each command bar, are
different for each program and are stored in the program's
memory.
The role of the command bar dynamic-link library
includes controlling the display of and interaction with the
command bars. This includes a variety of command barrelated functions, such as showing, hiding, resizing, moving,
docking, and undocking the command bars. The command
bar dynamic-link library also handles mouse and keyboard
interaction with the individual controls. It will be appreciated that a different set of command bars can be available for
each document, and that some command bar-related options
are available to all command bar-enabled application programs.
As an illustration of the interaction between an application program and the dynamic-link library, consider an
example in which the "MICROSOFT WORD" application
program 400 employs the functions of the Office shared
code. If the user interacts with the document portion of a
window, the application program handles the interaction and
response by performing the appropriate task. If the user
interacts (e.g., clicks) on a control in the command bar, the
input is handled by the Office shared code. At that point, the
dynamic-link library code determines which button was
selected, how the selected button should be displayed, etc. If
necessary, the dynamic-link library code calls the applicati on program and indicates that a specific button (e.g., button
1234) was selected. When this occurs, the application determines the command associated with button 1234 and performs the command.
Each command bar control is associated with an ID, and
an icon, or text string, or both. In general, each control has
a unique identifier that is used to identify it. Each control is
represented in a command bar by a text string 340 (FIG. 3),
or an icon 345 (FIG. 3), or both.
In an exemplary embodiment, there are three types of
icons: Office icons, Application icons, and Custom icons.
The term Office icons refers to the set of read-only icons that
are used throughout the "MICROSOFT OFFICE" suite of

application programs. These icons are stored centrally as a
resource in the dynamic-link library in order to reduce
memory requirements. Preferably, all command bar-related
icons would be included in this category. Each icon has an
identification number, which is fixed by the publisher of the
software. Those skilled in the art will appreciate that,
preferably, stand alone application programs that are command bar-enabled will include the dynamic-link library and
the complete set of Office icons. This will ensure that no
more than one copy of the Office shared code will ever need
to be stored on the user's hard drive.
Application icons are primarily intended for use by
"MICROSOFT OFFICE"-compatible applications. The
identification numbers for application icons are within a
special range reserved for use by the applications. This type
of icon can be used by revised "OFFICE" applications
without requiring that the dynamic-link library be updated.
In an exemplary embodiment, application icons carmot be
used with menu merging, which is discussed below.
Custom icons are drawn by a user and are stored with
other command bar customizations in an application specific
area. Each application is responsible for making sure custom
icons are saved somewhere. However, the Office shared
code provides an API (application programming interface)
to perform the actual saving of the data.
Menu popups typically include text strings. These text
strings are also stored in the dynamic-link library in order to
further reduce the amount of memory required to store
command bar-related data. The dynamic-link library stores
the default nmemonic for use with each text string (e.g., Eile,
Edit, Yiew, etc.; See FIG. 3). However, the application can
override the default text string and provide a string with a
different nmemonic if the default creates a conflict with
other controls. The same text strings that are used to describe
a menu item when in menu format are displayed as "tooltips" when the mouse hovers over a button in a toolbar-lime
command bar.
Every command bar and control has an identification
number associated with it. Like icons, identification numbers fall into three categories: Office, Application, and
Custom. Office IDs are set by the software publisher and are
the same for every command bar-enabled program. Application IDs are set by an application and are only meaningful
within an application. Application IDs are stored in a range
of memory that is reserved for the application. Those skilled
in the art will appreciate that menu merging, which is
discussed below, relies on identification numbers, names,
other means to determine whether command bars and controls in different application are identical.
As indicated above, an application may simultaneously
display a plurality of command bars. However, in an exemplary embodiment, each application designates one toolbarlike command bar as its "main menu bar." Within each
application, only one command bar at a time may be
designated as the main menu bar. The main menu bar should
be marked as non-hidable, in order to prevent the user from
inadvertently ending up with all command bars being hidden. During menu merging between two applications, the
main menu will come from merging each application program's main menu bar.
Replacing separate menu bars and toolbars with a single
command bar data structure provides several important
advantages over the prior art. First, using a single data
structure to present both toolbar-like command bars and
menu-like command bars allows any control to be included
in any command bar. There are no longer distinctions that
10
15
20
25
30
35
40
45
50
55
60
65

US 7,047,501 B2
11
12
limit which type of controls go on which type of container.

In addition, the use of a single command bar data structure
for all command bars makes it possible to employ a single
customization procedure to customize command bars
regardless of the form in which they are displayed. This is
advantageous from the user's perspective because it simplifies the customization process. This is also advantageous
from the programmer's perspective because it reduces two
different processes to one. In addition, a program only needs
a single way to go from a selected control to the proper
command, and a single mechanism for displaying whether
commands are currently disabled.
These advantages are achieved because the application
and dynamic-link library employ a single code base to
manage all command bars. The application and dynamiclink library maintain a single list of commands, which
reduces the size of the code and its redundancy.
Internally, controls are added to a command bar by storing
the identification numbers of the controls that are included
in that command bar. By managing the command bar data
structure in this manner, it is as easy for the program to add
one type of control as it is to add any other. As a result,
menu-type command bars can includes text boxes, color
pickers, and other controls that were formerly restricted to
toolbars.
FIGS. 5 and 6 illustrate how the versatility of command
bars allows controls to be grouped together in very advantageous ways. FIG. 5 illustrates toolbar-like command bars
in which menu controls 505 are positioned alongside pushbutton controls 510. It will be appreciated that the controls
that are illustrated in FIG. 5 are virtually identical to the
controls that are illustrated in FIG. 2, which was discussed
earlier. Similarly, it will be appreciated that selecting the
menu controls 505 (e.g., "FILE," "DRAWING," etc.) results
in the display of a menu popup (e.g., menu popup 330 (FIG.
3)).
Rearranging the controls in the manner illustrated in FIG.
5 provides several advantages. First, it allows a user to
conserve vertical screen space. In this example, three command bars (as illustrated in FIG. 2) have been reduced to
two. In addition, by grouping a menu control 505 with
related pushbutton controls, it is easier for a user to learn the
meaning of the pushbutton controls. In FIG. 5, the "FILE"
menu control is located next to file-related pushbutton
controls. This makes it easier for the user to relate to and
remember the functions of the pushbutton controls. This
versatility also makes it easier to implement component
software, because a component can contribute a single group
of controls, which may include menu controls and pushbutton controls, instead of scattering its UI controls over
conventional menu bars and toolbars.
FIG. 6 illustrates additional advantages of being able to
combine various types of controls on a command bar. FIG.
6 depicts a floating command bar 605. The command bar
605 includes a "DRAWING" menu control 610 and several
drawing-related pushbutton controls 615. When the menu
control 610 is activated, it results in the display of a menu
popup 620, which includes a variety of pushbutton controls.
By arranging command bars in this manner, the user is able
to place frequently used pushbutton controls on the command bar 605, where they are readily accessible. The user is
also able to locate other drawing related controls, such as
more advanced, but less frequently used advanced drawing
features, on the menu popup 620. This allows all of the
desired drawing-related controls to be grouped together in a
command bar, with the most frequently used controls being
most accessible to the user. The menu control 610 on the
command bar 605 also serves the additional purpose of

acting as a label for the floating command bar. In a typical
use, a command bar may include at its top level a single
menu control and shortcuts (or pushbuttons) for items on
that menu. Those skilled in the art will appreciate that this
type of arrangement is not possible under the data structures
associated with conventional menu bars and toolbars.
FIG. 7 illustrates how command bars allow any type of
control to be included in a menu popup. In this example, a
floating command bar 700 includes a single menu control
705. When the menu control 705 is activated, a menu popup
710 is displayed. In this example, the menu popup 710
includes text strings 715, which were the only items
included in conventional pull down menus. In command
bars, the menu popup 710 also includes icons 720 that
correspond to text strings 715, combo boxes 725, and a color
picker 730.
Those skilled in the art will appreciate that this ability to
include any type of control in any command bar, regardless
of its display state, provides significant advantages over the
prior art method of grouping controls in menu bars and
toolbars. For example, the ability to include text boxes,
combo boxes, and the like in a menu popup, eliminates the
need to use separate dialogs in many cases. For example, in
conventional menu bars, the selection of a command that
required additional input from the user resulted in a dialog
being displayed so the user could enter the required data.
With command bars, the menu popup may include a text box
or other control that allows the user to enter the required
input directly in the menu popup.
In s=ary, the ability to include all types of controls in
all types of command bars is extremely advantageous, and
is a result of the underlying command bar data structure.
This results in controls being included in menu popups
instead of requiring them to be in the top level of a
toolbar-type structure. This also avoids the use of dialogs in
many cases.
10
15
20
25
30
35
Command Bar Customization

40
45
50
55
60
65
Command bars may be customized more easily than

conventional menu bars and toolbars. Generally described, a
user may customize command bars by dragging a control
from a list of available commands to the desired position in
a command bar. This process is employed regardless of
whether the desired position is in a toolbar-like command
bar or in a menu-like command bar. In addition, when the
customize mode is selected, the user may move or copy a
control from one command bar to another. This is possible
because the application and dynamic-link library have a
single list of commands that may be represented by controls
in any type of command bar. In addition, the icons, text
strings, and associated data are stored only once regardless
of the number of applications that use the control.
FIG. 8 illustrates a dialog 800 that is employed in the
process of customizing command bars. This dialog appears
when the user enters the customize mode. The dialog 800
provides a list of categories 805. When the user selects a
category, the corresponding commands are displayed in the
command section 810 of the dialog. At this point, the user
may drag any of the controls in the command section 810 on
to any of the displayed command bars. When the user is
dragging a control, a highlight appears in order to indicate
where the control will be located once it is dropped. If a
control is dropped on a menu popup, it will be displayed
with both a text string and icon, where applicable. As
mentioned above, the user may also move or copy controls

US 7,047,501 B2
13
from one command bar to another. The dialog also provides
commands that allow the user to create new command bars.
A user may delete controls from a command bar by dragging
them off of a command bar.
If the user moves a control over a menu control, the
corresponding menu popup will appear in order to allow the
new control to be positioned on it. If the user drops a control
in a menu popup, it stays popped up so the user can see the
result. If a menu popup pops up during the customization
process, it will be closed when the user clicks the menu's
parent menu control, when the user selects a control not
inside that menu, when the user drags over another customizable bar, or when the user ends customize mode. If a user
has just moused down on a menu control, the menu will
drop. If the user immediately starts dragging the menu
control, the popup closes in order to prevent the user from
dragging the menu control inside its own menu popup.
14
depending on whether the application is acting as container

or server. When merging command bars and individual
commands, the Office shared code must determine whether
command bars and commands are identical. In an exemplary
environment, this is accomplished by comparing the identification numbers that are used to identify each command
bar and commands. Thus, two command bars are "equivalent" and should be merged if they have the same 0 LE group
ID.
10
The method 900 begins at step 905 as the Office shared
code begins the process of merging a command bar. At step
905 the process determines ifthe command bar (as identified
by its OLE group ID) appears in only one of the application
programs. If so, the method proceeds to step 910 and takes
15 the command bar "as is" for inclusion in the merged
command bar set. The controls that are not applicable to the
program's status as client or server are removed from the
command bar prior to display. From step 910, the method
Command Bar Merging
proceeds to step 915 and terminates.
20
If, at step 905, both application programs are donating
As mentioned above, Microsoft Corporation's OLE intercommands to the command bar, the Office shared code must
face allows documents of one type to be embedded in
decide how to order the donated items in the resulting
documents of another type. For example, a spreadsheet may
merged command bar. The first step in this process occurs at
be embedded in a word processing document. Under OLE,
step 920, where the method begins with a copy of the
the embedded spreadsheet object may be activated and 25 server's full command bar (including the commands that
edited from the word processing window. In order to accomwill not be donated).
plish this task, OLE provides merged menus that provide
For each donated container item, C, the method performs
commands from both the container (e.g., the word processeveral steps. If C was the first item in the container's
sor) and the server or object (e.g., the spreadsheet).
command bar (step 925), then C is placed first in the merged
An exemplary embodiment of the command bar architec- 30 command bar (step 930).
ture provides substantial advantages over prior art menu
If the server application has an item S that is equivalent
merging techniques. With command bars, application proto the item C (step 935), the item C is placed in the same
grams are no longer required to donate entire menus.
location as the item S (step 940).
Instead, an application may donate individual commands to
If the server does not have an equivalent item, the method
the merged menus. These merged commands are organized 35 will look at the item in the container's command bar that
in a way that is intuitive and user-friendly. In addition,
precedes the item C, and determine whether the server's
merging between toolbar-like command bars is supported so
command bar contains an equivalent item (step 945). If so,
that each button will be functional and will carry out the
the item C is placed in the position after the equivalent item
expected response. This results in merged menus and toolin the server's command bar (step 950).
bars that provide enhanced functionality, while also being 40
If none of preceding conditions is satisfied, the item C is
user friendly.
placed at the end of the merged command bar (step 955). A
Menu merging raises two issues: (1) what commands are
separator is used to segregate the commands that are placed
merged; and (2) where do the merged items go. With two
at the end of the merged command bar.
command bar-enabled applications, each application
After the item C is placed in the merged command bar, the
donates individual commands to the merged set. The 45
method proceeds to step 960 and determines whether the
donated commands include only those commands that the
container application includes any additional commands that
application program can support in its merged state. In
need to be merged. If so, the method returns to step 925. If
addition, since command bars do not distinguish between
not, the method returns to step 965 and removes any of the
menu bars and toolbars, all types of command bars are
merged in the same marmer. As applications are divided into 50 commands from the object application that are not supposed
to be donated.
smaller and smaller components, this allows their comFIG. 10 illustrates an application of the method of FIG. 9.
mands to be merged into a coherent set.
FIG.
10 depicts command bars from a container application
FIGS. 9-11 illustrate an exemplary method for merging
and a server application (the object). The bold items reprecommand bars. FIG. 9 is a flow diagram illustrating an
exemplary method 900 for merging command bars. FIGS. 55 sent commands that will be donated to the merged command
bar.
10 and 11 illustrate examples of how the method of FIG. 9
At line 1000, the method starts with the object's command
may be applied. The inter-application communication and
bar items. See FIG. 9, step 920.
negotiation is carried out by the Office shared code.
At line 1005, because the item U is the first item in the
Turning now to FIG. 9, an exemplary method of merging
commands will be described. Those skilled in the art will 60 container's command bar, it is positioned first in the merged
command bar. See FIG. 9, step 930.
appreciate that menu merging occurs when an embedded
At line 1010, because the object's command bar contains
object is activated. The method of FIG. 9 is applied to each
an item that is equivalent to the item U, which precedes the
command bar. Each application includes flags that indicate
item V, the item Vis positioned after the item U. See FIG.
which commands it will donate. The flags indicate if a
command will be donated when the application is acting as 65 9, step 950.
At line 1015, because the item X from the container's
a container or as a server (i.e., the embedded object). As a
command bar is equivalent to the item X in the object's
result, some commands may not be considered for merging

US 7,047,501 B2
15
16
command bar, the container's item X is placed in the merged

command bar in the same position as the object's item X.
See FIG. 9, step 940.
At line 1020, because container item Z is preceded by
item Y, and because the object includes an item Y, the item
Z is placed in the merged command bar after the item Y. See
FIG. 9, step 950.
At line 1025, the method removes all of the commands
that are not to be donated to the merged command bar. See
FIG. 9, step 965.
It will be appreciated that although neither application
donates the item Y to the final result in this example, keeping
the item Y around until the last step allows item Z to be
placed in a natural position. This aspect of the process allows
the final result to be closer to the user's expectation.
FIG. 11 is another example of an exemplary method for
merging command bars. FIG. 11 includes a container application's command bar 1100, a server application's command
bar 1105, and the merged command bar 1110 that results
from applying the method of FIG. 9 to the commands.
From the foregoing description and examples, it will be
appreciated that command bars provide improved menu
merging capabilities, as indicated by the preceding
examples. Command bar merging allows container-related
and object-related commands to come from appropriate
sources and to operate properly when selected. The resulting
command bar has commands from both applications. When
a command is selected from the merged command bar, the
Office shared code routes the instructions to the proper
application.
it. This would indicate to the user that the drag handle is an
active control and not just decoration. In addition, when the
cursor is moved over the drag handle, a tip may appear
explaining how to tear off the menu popup.
As yet an additional feature, when the user tears off a
menu popup using the first method, the user can cancel the
tearing off operation by dragging the floating command bar
back to its initial position. This will cause the floating
command bar to snap back into menu popup form if the user
comes within a certain distance of the original position.
Those skilled in the art will appreciate that tear off menu
popups might have been dropped down directly from a top
level menu control on a command bar, or might be one or
more layers deep in cascade form. Once the menu popup is
torn off, it becomes a separate, floating command bar, which
can be separately positioned and customized.
10
15
Summary of the Detailed Description

20
25
30
Tearing off Menu Popups

FIG. 7 illustrates a method for "tearing off' menu popups
and displaying them as floating command bars. Each menu
popup 735 that can be tom off includes a drag handle 740.
The drag handle resembles the title bar that is used to drag
most application windows. The drag handle provides a
distinguishing visual cue for tear-off menus and also provides a cue on how the menu can be tom off.
In an exemplary embodiment, a user has two ways to tear
off a tearable menu popup. In a first method, the user can
click on a menu control and cause the menu popup to be
displayed, as in FIG. 7. The user may then click on the drag
handle 740 and drag the menu popup. This results in the
menu popup being tom off and converted into a floating
command bar. This process is similar to how window are
normally dragged in various GUI operating systems.
Those skilled in the art will understand that the
"removed" menu popup may be a duplicate, and that the
original menu popup may still be available in its original
location. It will be appreciated that the "removed" menu
popup may be displayed as a floating toolbar-type command
bar or as some alternate representation. In other words, the
removed menu popup need not look exactly like the original
menu popup. In addition, the removed menu popup and the
original menu popup need not contain identical controls.
In a second method, the user may keep the mouse button
pressed down after displaying the menu popup, and then
move the cursor over the drag handle 740 and release the
mouse button. This will result in the menu popup being torn
off and placed in a default position.
Addition features can be added to enhance the discoverability and operation of the feature. For example, the drag
handle may change colors when the cursor is positioned over
35
40
45
50
55
60
65
From the foregoing description, it will be appreciated that

the present invention provides an improved system and
method for displaying controls in a GUI system. In an
exemplary system, the invention provides a versatile command bar data structure that may be used to display various
types of controls in a variety of configurations. By relying on
a single data structure, command bars provide a variety of
advantages, including a unified customization procedure, the
ability to includes any control type in any command bar, and
simplified underlying code. In addition, command bars
provide improved command merging and a novel way to tear
off menu popups and convert them to floating command
bars.
The invention may conveniently be implemented in one
or more program modules that are based upon and implement the features illustrated in FIGS. 2-11. No particular
programming language has been described for carrying out
the various procedures described above because it is considered that the operations, steps, and procedures described
above and illustrated in the accompanying drawings are
sufficiently disclosed to permit one of ordinary skill in the art
to practice the present invention. Moreover, there are many
computers and operating systems which may be used in
practicing the present invention and therefore no detailed
computer program could be provided which would be applicable to all of these many different systems. Each user of a
particular computer will be aware of the language and tools
which are most useful for that user's needs and purposes.
Although the invention was described in the context of
one or more application programs using a dynamic-link
library to implement command bar code, including methods
for merging command bars, those skilled in the art will
appreciate that the invention is applicable to other applications and methods. Similarly, the invention may be applied
regardless of whether the GUI elements are implemented in
program modules associated with an operating system or
application program.
The present invention has been described in relation to
particular embodiments which are intended in all respects to
be illustrative rather than restrictive. Alternative embodiments will become apparent to those skilled in the art to
which the present invention pertains without departing from
its spirit and scope. Accordingly, the scope of the present
invention is defined by the appended claims rather than the
foregoing description.

US 7,047,501 B2
17
18
What is claimed is:

in response to the indication, determining a function
associated with the control; and
1. A computer-readable medium having a plurality of data
performing the function.
fields comprising:
8. The method of claim 7, wherein the menu-like coma data structure represented by said plurality of data fields;
mand bar also includes a simple menu item.
a first data field contained in said data structure, said first
9. A method for customizing a command bar including a
data field containing data representing a command bar;
menu control, comprising the steps of:
a second data field contained in said data structure, said
displaying a first command bar including a menu control;
second data field containing data representing a pluraldisplaying a container including an available control;
ity of controls included in the command bar, the con- 10
receiving from an input device an indication that the
trols being chosen from a group including simple menu
available control has been moved to the menu control
items and interactive controls; and
in response to the available control being moved to the
a third data field contained in said data structure, said third
menu control, displaying a menu popup associated with
data field containing data representing the display state
the menu control;
of the command bar.
receiving from the input device an indication that the
15
2. The computer-readable medium of claim 1, wherein the
available control has been moved to a position in the
display state of the command bar is chosen from a group
menu popup;
comprising a toolbar-like display state and a menu-like
displaying the available control in the position in the
display state.
menu popup.
10. The method of claim 9, wherein the container com3. The computer-readable medium of claim 1, wherein the 20
prises a second command bar.
command bar is a toolbar-like command bar and the plural11. The method of claim 9, wherein the container comity of controls include at least one popup menu control.
prises a customize window.
12. A method for removing a menu popup from a complurality of controls include at least one other interactive
control in addition to the at least one popup menu control. 25 mand bar, comprising the steps of:
displaying a command bar;
displaying an original menu popup including a drag
command bar is a menu-like command bar and the plurality
handle, the menu popup being connected to the comof controls include a simple menu item and at least one
mand bar;
interactive control.
30
receiving from the input device an indication that the drag
handle has been dragged away from the command bar;
interactive controls comprise a popup menu control.
receiving from the input device an indication that the drag
7. In a computer system including a shared program
handle has been dropped; and
module including at least one function for manipulating the
displaying a removed menu popup in a position correcommand bars and shared memory for storing data associ- 35
sponding to the drop indication.
ated with the command bars, a method for implementing
13. The method of claim 12, wherein the removed menu
command bars in an application program module, comprispopup is a floating command bar.
ing the steps of:
in the application program module, calling a function to
popup is a duplicate of the original menu popup.
display a menu-like command bar including an inter- 40
active control;
popup is an alternative representation of the original menu
popup.
in response to an input signal, receiving from the shared
program module an indication of the selection of the
interactive control;
* * * * *
Exhibit D

1111
c191
Dazey et al.
COMPUTER APPLICATION WITH HELP
PANE INTEGRATED INTO WORKSPACE
[75]
Inventors: Byron Dazey, Woodinville;

Christopher R. Jones; Paul C. Elliott,
both of Seattle, all of Wash.
[73]
Assignee: Microsoft Corporation. Redmond.

Wash.
[21]
Appl. No.: 6()0,696
[22]
Filed:
Jun. 5, 11)1)6
6
Int.Cl. ........................................................ G06F3/t0

U.S. Cl. .............................................................. 395/338
Field of Search ..................................... 395/336. 338.
395/337
[56]
Patent Number:
Date of Patent:
[11]
[45]
[54]
[51]
[52]
[58]
~1111111111111111111111
m111111111111111111111111111111111m111111
US005715415A
References Cited
4,789,962 12/1988 Berry et al......................... 395/338
5,157,768 10/1992 Roeber et al ...................... 395/338
5,179,654 111993 Richards et al. ....................... 395/338
5,287,448 2/1994 Nicol et al ............. 395/338 X
5,471,575 11/1995 Giansante ............................ 395/338 X
5,481,667 111996 Bieniek et al. .................... 395/338
5,715,415
Feb. 3, 1998
Primary Examiner-Raymond J. Bayerl

Assistant Examiner-A. Katbab
Attorney, Agent, or Firm-Lee & Hayes, Pl.LC
ABSTRACT
[57]
A computing device has a processor, a display. and an

operating system which executes on the processor to provide
a graphical user interface environment capable of presenting
graphical windows on the display. A computer application
runs on the operating system and is presented within a
graphical application window of the graphical user interface.
The computer application is configured to present a help
pane for showing help content to a user without requiring the
user to open a separate graphical window to show the help
content. The help pane is positioned adjacent to a workspace
to assist the user with context specific, step-by-step, instructions. When the help pane is active, the focus remains on the
application and on the work being performed in the
workspace. as opposed to being transferred to the help pane.
As a result. the user can directly implement the instructions
provided in the help pane without having to remember to
switch the focus between the help and application, as is
required when separate help windows are used.
FQ_rmot Iools A!ronge Tq_ble tJelp
72
D
DD
DD
DD
DD
76
64
Reo.dy
50
Step 3
52
U.S. Patent
Feb. 3, 1998
5,715,415
Sheet 1 of 5
10
APP
14
44
......
~~~~~~~~~
221CQ c:JI I
10 qJ o'I B
12
I
I
L-----1
18
I
I
'I
,_ _______ J
I
I
I
I
I
I
I
I
I
I
201ESJ
l
100
15
U.S. Patent
10
5,715,415
Sheet 2 of 5
Feb. 3, 1998
/" 32
I
_ _-J)\
--y
-,
--.,
VOLATILE
MEMORY
/ 30
PROCESSOR
36
/" 34
~(
'--------J
""-
MEMORY
--,
42
/ 15, 16
PUBLISHING
APPLICATION
INPUT DEVICES
l--1/
40
OPERATING
SYSTEM
/
r
--___,)\
DISPLAY
14
U.S. Patent
Feb.3, 1998
5,715,415
Sheet 3 of 5
56
. 44
.....
58
54~-.1::1=p........;;...,,..;"'1-r~~.......-mi'--i-...-=~-.-;it-r-r...,_-=---==-'-----H
60
52
64
eo.dy
50
60
64
D
DD
DD
DD
DD
Reo.dy
72
Step 3
76
U.S. Patent
5,715,415
Sheet 4 of 5
Feb. 3, 1998
,44
58
54
60
ITitle
DD
Step 1
Step 2
Step 3
DD
DD
DD
~I
64
70
ITiil
Re<ldy
50
90
gpws
,44
. ...
D
DD
DD
DD
DD
64
Topic A
To~ic B
teM I
Iter1 2
Iter1 3
To~ic C
L teM 1
ITitle
o
Step 1
Step 2
Step 3
70
ITiil
Ready
50
92
~c
90
U.S. Patent
Feb.3, 1998
II
- IPu 1lica tion 1
5,715,415
Sheet 5 of 5
100
;--44
~ [ile fdit ~ew lnsert Fgrmaf ]ools/ Ar.range Tq_ble fjelp

I II II I II I 11 11 11 I II I t Jl I I I I I
Help
Step 1
Print Error
Step 2
I Help I
Step 3
Step 4 .
D
DD
DD
DD
DD
-I
Message/
'
lI
IError
13J 1
Ciiiiunls 1
IShow 1ftdr3 I
I
r--
lI ,_
I ,_
....,_
...
rnn;
....-
Reo.dy
102
5,715,415
2
might unintentionally change the selection state in the

application if they unexpectedly click at the wrong place,
thereby invalidating the steps that had been previously
performed.
TECHNICAL FIELD
5
In view the these drawbacks, there is a need to improve
This invention relates to computers and applications that
the techniques for offering helpful assistance to computer
run on them. More particularly, this invention relates to
users.
computer-implemented methods for offering helpful instructions to users during execution of the applications.
COMPUTER APPLICATION WITH HELP

PANE INTEGRATED INTO WORKSPACE

Computer users are familiar with electronic help options
that are available with most computer applications. In a
windows operating environment, the user initiates the help
option through a menu option or a special soft button that
timely appears during certain events. Upon activation, the
application opens a separate graphical help window which is
overlaid on the present application window. The help window lists instructions to assist the user in performing a task.
In some applications, the help window is configured to act
as other active windows. When the help window is active, it
appears on top of other windows. When another window is
active. however. the help window is layered and hidden
behind the active window.
This type of help window has a drawback in that the user
can easily lose track of it. The window can be partially or
completely hidden behind other windows. Additionally, this
approach is awkward because the user must toggle between
the help window, where the help tips are shown. and the
application window, where the user performs the task. As a
result of this hassle, the user often does not bother to use the
help feature.
To alleviate this problem of hidden help windows. some
applications have been configured to ''float" the separate
help window atop other windows. In this manner, the help
window always remains above other windows and hence, in
view for the user. The drawback with this approach is that
the floating help window often rests above the workspace,
covering the present work. The user is forced to move the
help window around the display. re-size the workspace,
and/or re-size the help window. Again, to avoid the trouble.
the user often elects not to call the help option.
Another problem experienced by users is that the separate
help window causes loss of focus and attention to the
primary window. A window is said to have "focus" when it
is active and currently designated to receive the user input
from the keyboard or mouse. To navigate in a help window,
the help option is activated and focus is transferred from the
application window to the help window. This shift of focus
makes it confusing for the user to implement the help
instructions. As the user attempts to follow the simple
directions for a help topic. the efforts are not effective
because the keystrokes referenced in the help window are
only valid when the application window has the focus.
At best, a savvy user is forced to click on the help window
to bring it to the foreground (and thereby transfer focus to
that window) and read the first few steps. Then. the user
must remember to click on the application window to return
focus to the application window so that the user may
implement the first few steps. Needing more help. the user
again clicks on the help window, scrolls the help topic to see
the next series of steps, and then clicks back on the application window to perform the steps. This process of actively
switching focus between two windows is repeated until the
task is completed. During this cycle, users often forget to
click back on the application window. or when they do, they
10
15
20
25
30
This invention provides a new technique for offering help

content to a computer user who operates a computer application in a graphical user int.erface windowing environment
The computer application is opened into a graphical window
through normal practice (i.e., clicking an icon. or selecting
the program through a menu option). When the user requires
help, the user activates a button on the user interface to show
the help content. The graphical window containing the
application is partitioned to define a help pane which shows
the help content. The help pane is integrated into and appears
positioned adjacent to a workspace to assist the user with
context specific. step-by-step. instructions. In this manner.
the help is offered to the user without having to open a
separate graphical window to show the help content.
The help pane is advantageous in comparison to traditional help windows because the help pane is part of the
application window and cannot get lost behind other active
windows or float annoyingly over the workspace.
Additionally, when the help pane is activated, the focus is
not shifted from the application to the help pane, but instead
remains with the application. Accordingly, the user can
perform the keystroke instructions provided by the help pane
without having to remember to click the application window
to return focus before proceeding.
35
BRIEF DESCRJPTION OF THE DRAWINGS

FIG. 1 is a diagrammatic illustration of a computer
executing a computer application according to an example
implementation of this invention.
40
FIG. 2 is a block diagram of the FIG. 1 computer.
FIG. 3 is a diagrammatic illustration of a graphical user
interface window of the computer application at an instance
prior to activating a help pane.
45
interface window of the computer application at an instance
after activation of the help pane. FIG. 4 shows the help pane
integrated into a workspace.
FIG. S is a diagrammatic illustration of a graphical user
so interface window of the computer application showing a
re-sizing of a work within the workspace.
interface window of the computer application showing an
expansion of the help pane to include an index to the help
55
content.
interface window of the computer application showing the
help pane converted to a floating or undocked help window
in response to a triggering event. such as the pop-up of a
60
message or dialog box.
DEfAilED DESCRIPTION OF THE
PREFERRED EMBODIMENT
65
FIG. 1 shows a computer 10 in the form of a conventional

desktop IBM-compatible computer. The computer 10 has a
central processing unit (CPU) 12, a display monitor 14. a
5,715.415
keyboard lS, and a mouse 16. The computer 10 also has a

floppy disk drive 18 for interfacing with a compatible floppy
memory diskette 20 (e.g., 3.5'' form factor). and an optical
disk drive 22 for interfacing with a compatible CD-ROM 24.
The computer 10 might also include another input device in
addition to, or in lieu of, the keyboard lS and mouse 16
including such devices as a track ball, stylus. or the like.
FIG. 2 shows a functional block diagram of the computer
10. The computer 10 has a processor 30, a volatile memory
32 (e.g., RAM). and a non-volatile memory 34 interconnected by an internal bus 36. The non-volatile memory 34
can be implemented as integrated circuit chips (e.g., ROM.
EEPROM). disk drive(s) (e.g., floppy. optical, hard), or a
combination. The display 14 is connected to the bus 36
through appropriate hardware interface drivers (not shown).
Additionally, the input devices 15, 16 are connected to
supply data to the bus 36 via appropriate J/O ports. such as
serial RS232 ports.
The computer 10 runs an operating system 40 which
supports multiple applications. The operating system 40 is
stored on the non-volatile memory 34 and executes on the
processor 30. The operating system is preferably a multitasking operating system which allows simultaneous execution of multiple applications, although aspects of this invention may be implemented using a single-tasking operating
system. The operating system employs a graphical user
interface windowing environment which presents the applications or documents in specially delineated areas of the
display screen called "windows." Each window has its own
adjustable boundaries which enable the user to enlarge or
shrink the application or document relative to the display
screen. Each window can act independently. including its
own menu. toolbar. pointers. and other controls. as if it were
a virtual display device. One preferred operating system is
a Windows brand operating system sold by Microsoft
Corporation. such as Windows 95 or Windows NT or
other derivative versions of Windows. However. other
operating systems which provide windowing environments
may be employed. such as the Macintosh OS from Apple
Corporation and the OS/2 Presentation Manager from IBM.
A computer application 42 is stored in the non-volatile
memory 34. When activated, the computer application 42
rims on the operating system 40 while executing on the
processor 30. The application 42 can be loaded into the
memory 34 from the floppy diskette 20 or CD-ROM 24. or
alternatively, downloaded from a network via a network port
(not shown). In this example, the computer program is a
desktop publishing program. For instance, one suitable
publishing program is sold under the name Publisher from
Microsoft Corporation. However, the computer application
can be essentially any application, including word processing programs, spreadsheet prograIDf. database programs.
and the like.
It is noted that the invention is described within the
illustrated context of a familiar desktop computer, as shown
in FIG. 1. An example computer includes a 386-equivalent
microprocessor. or better. with four or more megabytes of
RAM. This example computer is capable of running a
multitasking operating system with a graphical user interface windowing environment However. aspects of this
invention might also be employed in other forms of computing devices, such as laptop computers, hand held
computers, portable personal information managers (PThis ),
and the like. In these devices. the application may be
configured to run on a single-tasking operating system.
With reference again to FIG. l, the user launches the
application in a customary fashion by, for example. clicking
on an icon or choosing the program from a menu. The

graphical user interface of the spreadsheet application is
displayed on the monitor 14 and bounded within a graphical
window 44. as is customary in a graphical user interface
windowing environment. The window 44 is associated with
the publishing application. and is referred to as the "application window" or "publishing window."
FIG. 3 shows the application window 44 in more detail.
For purposes of continuing discussion, the application is
described in the context of the example desktop publishing
application. The application window 44 includes a workspace SO which contains the publication S2. In other computer applications. this workspace might hold a word processing document. a spreadsheet workbook. a database page,
or other types of works.
The application window 44 has an upper toolbar 54
located above the workspace SO. The upper toolbar 54 has
multiple controls in the form of soft buttons 56 which assist
the user in performing routine tasks on the publication. For
instance. the control buttons S6 might include a new document button, an open file button. a save button, a print
button, a spell check button. a cut button, a copy button. a
paste button, and so forth.
A menu bar 58 is positioned above the upper toolbar 54.
The menu bar 58 has an assortment of drop-down menus
labeled "File," "Edit," "View," "Insert," "Format," "Tools."
"Arrange," '"fable," and "Help." The author opens a dropdown menu associated with the label through common
techniques, such as by clicking on the label with a mouse
pointer, or by entering the key letter in the label with an
"ALT+letter" operation on the keyboard.
The application window 44 has a side toolbar 60 which
contains multiple publication control buttons 62. These
control buttons are specific to the publication application.
The side toolbar 60 is shown along the left hand side of the
workspace SO, although it can be moved to other locations
within the application window 44.
The application window 44 also has a status bar 64
situated beneath the workspace SO. The status bar 64 has a
status description "Ready." The application user interface
also supports a movable pointer or other indicator (not
shown) which can be moved across the window 44. The
author manipulates the pointer using a mouse or arrow keys
on a keyboard.
The application is configured to provide help to a user
during creation of the work. For instance, in the desktop
publishing program. the user might be interested in creating
a three-panel brochure. The publishing application is configured to provide help content in the way of step-by-step
instructions for creating the brochure. The help content may
also include an electronic version of the operation manual
that might accompany the software product
According to an aspect of this invention, the help content
is provided in a help pane that is part of the graphical
window 44. The help pane is accessed by a "Show Help"
control button 66 in the status bar 64 of FIG. 3. Upon
activation of the "Show Help" control button 66. the application window 44 is partitioned to define a help pane for
showing the help content without opening a separate graphical window.
FIG. 4 shows a help pane 70 formed as part of the
application window 44. In the illustrated implementation,
the help pane 70 is integrated into and appears positioned
beside the workspace SO within the application window 44.
The help pane 70 includes a top non-scrolling area 72 which
contains a title of the help topic. The top non-scrolling area
10
15
20
25
30
35
40
45
50
55
60
65
5,715,415
5
72 automatically re-sizes to accommodate the font size of

button 90 in the status bar 64. In this illustration, the help
text in this region. When a title is longer and text wraps to
pane 70 is expanded to provide an index area 92 which
fit the horizontal width, the area grows vertically to display
shows the index to the help content. This index allows the
the whole title.
user to easily switch to other related help topics. The index
The help pane 70 has a middle scrolling area 74 which 5 can also include an edit field (not shown) which allows a
shows the instructions of the help content. If the user has not
user to enter a topic and, based on that topic, show an index
received help during the current session, the help pane opens
of topics most closely related to the entered topic. In another
to a main table of contents. As the user begins to perform
implementation, the index and help content can be organized
specific tasks, however, the middle scrolling area 74 of the
as tabbed folders or the like within a static-size help pane.
help pane 70 presents text showing step-by-step instructions, 10 The user switches between the index and help content by
as represented by the bullet steps 1-3. The instructions are
selecting the appropriate tab.
preferably task-oriented which pertain directly to the speFIG. 7 shows another aspect of this invention concerning
cific task that the user is attempting to perform. In the
the impact of pop-up message or dialog boxes. These boxes
brochure example, the instructions pertain to the steps of
are automatically displayed by the operating system or
creating a three-panel brochure. If the instructions exceed
the content space provided in the middle area 74, the 15 application. A message box contains a simple statement to
inform the user of some interrupt or inability to complete a
instructions can be scrolled to view other portions of the
task. The message box might also ask a user to press a key,
instructions. The middle scrolling area 74 can also include
such as the "Fl" key, to receive additional help. A dialog box
buttons that jump to other topics or launch demonstrations.
provides information to the user and contains various
The help pane 70 also includes a bottom non-scrolling
area 76 which includes two navigation buttons 78 and 80. 20 options which solicit a response from the user. The dialog
box might contain a "help" button that the user can activate
The navigation"<" button 78 enables the user to retrace their
to obtain more information regarding the message.
path to previous screens. The "Contents" button 80 provides
In the event that a dialog box or message box 100 opens
a quick jump to the main table of contents for the help
while the application window 44 is active, focus is shifted to
information. The bottom non-scrolling area 76 further
25
the dialog/message box 100 and the user interface foi the
includes a "Print" button 82 which prints the help topic that
application is temporarily disabled. To ensure that the user
is currently displayed in the middle area 74.
can still access help, the computer application is configured
When the help pane 70 is displayed, it encroaches on the
to convert the help pane to a separate graphical help window
workspace SO and may initially cover a portion of the
publication 52. In the illustrated drawing, the help pane 70 30 102. From a user interface perspective, the help pane
appears to automatically undock from its static location
covers almost one-half of the workspace SO. For normal size
within the application window 44 and transform into a
computer monitors, however, the help pane 70 covers a far
movable, self-contained graphical window. If help remained
less percentage of the workspace 50. To ensure that the
in a pane of the disabled application rather than being
entire publication can be viewed when the help pane 70 is
displayed, the publication S2 is re-sized within the work- 35 undocked to a separate window, the user would not be able
to access help because the application user interface is
space SO. FIG. S shows the application window 44 with an
temporarily disabled. Clicking on the application window is
active help pane 70 and the publication S2 re-sized within
generally not permitted until the user has responded to the
workspace SO to be visible to the user.
open
dialog or message box. Accordingly, the temporary
When the help pane is active, the control button 66
changes its label from "Show Help" to "Hide Help" as 40 undock:ing of the help pane renders the help available to the
user when responding to the dialog or message box.
illustrated in FIGS. 4 and S. The user can close the help pane
The help window 102 is preferably made to float to
70 by simply activating the "Hide Help" button 66, at which
remain visible to the user. If the user activates the help
time the "Hide Help" label again toggles back to "Show
button in the dialog or message box, the help window 102
Help."
The application is preferably configured to remember the 45 displays help content related to the event which triggered the
interrupt. The help content may be entirely unrelated to the
present location within the help content that is shown when
application from which the help window was undocked.
the user hides the help pane. For instance, suppose that the
After the user responds to the message or dialog box 100 and
user is performing a rather long task that involves more steps
the pop-up box is closed. the help window 102 is converted
than can be displayed in the middle scrolling area 74.
Further, suppose the user has scrolled down the instructions 50 back to a help pane 70 in the application window. It is noted
that other triggering events, in addition to the message and
to see steps presented farther down in the help content. If the
dialog boxes, can be defined which cause the help pane to
user activates the "Hide Help" button 66 to close the help
undock into an independent window.
pane 70, the applications stores the present location of the
help content. In the event that the user subsequently recalls
Presenting helpful instructions to a user through a help
the help pane 70 by activating the "Show Help" button 66, 55 pane has many advantages. Unlike prior art help windows,
the application returns to the location within the help content
the help pane 70 is part of the active application window. As
a result, the help pane cannot be lost behind the application
that the user last left prior to the help pane being hidden.
window, nor does it float annoyingly over the workspace as
The "Show Help" and "Hide Help" buttons greatly
traditional help windows. Another advantage is that the
enhance usability of the help pane as the user can quickly
and easily show and hide help without losing his/her place 60 focus is not shifted from the application to the help pane 70,
but instead remains with the application. Accordingly. the
in the help dialog. As a result, users will be less hesitant to
user can perform the keystroke instructions provided by the
employ the help pane, as compared to their reluctance to use
help pane 70 without having to remember to click the
traditional help windows, because the user can call upon
application window to return focus before proceeding.
help when needed and safely hide it for immediate retrieval
without fear of losing it.
65
Another advantage of the help pane is that users feel that
As shown in FIG. 6, the help pane 70 can be used to show
the pane is part of tlle user interface presented by the
an index to the help content by activating a "Show Index"
application. as opposed to a separate window which "cov-
5,715,415
ers" their work. Accordingly. the users are more willing to

have the help pane showing while performing their tasks.
particularly when the work is re-sized to fit the work space.
even though the help pane covers approximately the same
screen area as a help window.
In compliance with the statute, the invention has been
described in language more or less specific as to structural
and methodical features. It is to be understood, however, that
the invention is not limited to the specific features described,
since the means herein disclosed comprise preferred forms
of putting the invention into effect. The invention is.
therefore. claimed in any of its forms or modifications within
the proper scope of the appended claims appropriately
inteipreted in accordance with the doctrine of equivalents.
We claim:
1. A computer-implemented method for executing a computer application in a graphical user interface windowing
environment. comprising the following steps:
presenting a workspace within a graphical window; and
displaying help content in a help pane as part of the
graphical window without opening a separate graphical
window to display the help content and without losing
focus to the graphical window the help pane being
displayed irrespective of pointer position.
2. A computer-implemented method as recited in claim 1.
further comprising the step of positioning the help pane
beside the workspace within the graphical window.
further comprising the following steps:
displaying a work in the workspace; and
re-sizing the work within the workspace when the help
pane is displayed.
further comprising the step of expanding the help pane to
show an index to the help content.
S. A computer-implemented method as recited in claim 1.
further comprising the step of selectively displaying and
hiding the help pane.
6. A computer-implemented method as recited in claim 5,
wherein the help content exceeds a content space of the help
pane, further comprising the following steps:
displaying a portion of the help content in the help pane;
enabling a user to scroll through the help content to
display other portions of the help content within the
content space; and
in the event that the help pane is hidden and subsequently
displayed again. displaying the portion of the help
content which was last displayed in the help pane prior
to the help pane being hidden.
further comprising the step of converting the help pane to a
separate graphical window independent of the graphical
window containing the application.
8. A computer-implemented publishing application
executable on a processor to direct the processor to perform
the steps of the computer-implemented method as recited in
claim 1.
9. A computer programmed to perform the steps of the
computer-implemented method as recited in claim 1.
10. A computer-readable memory which directs a computer to perform the steps in the computer-implemented
method as recited in claim 1.
11. In a graphical window containing a computer
application. a computer-implemented method for offering
help content comprises the step of partitioning the graphical
window to define a help pane for showing the help content
without opening a separate graphical window to show the

help content and without losing focus to the graphical
window the help pane being displayed irrespective of
pointer position.
12. A computer-implemented method as recited in claim
11. further comprising the following steps:
defining a workspace within the graphical window;
displaying a work in the workspace; and
re-sizing the work within the workspace when the help
pane is shown.
11, further comprising the step of expanding the help pane
to show an index to the help content.
11. further comprising the step of selectively displaying and
hiding the help pane.
14. wherein the help content exceeds a content space of the
help pane. further comprising the following steps:
displaying a portion of the help content in the help pane;
enabling a user to scroll through the help content to
display other portions of the help content within the
content space; and
in the event that the help pane is hidden and subsequently
displayed again, displaying the portion of the help
content which was last displayed in the help pane prior
to the help pane being hidden.
11. further comprising the step of converting the help pane
to a separate graphical window independent of the graphical
window containing the application.
17. A computer-implemented publishing application
the steps of the computer-implemented method as recited in
claim 11.
19. A computer-readable memory which directs a computer to perform the steps in the computer-implemented
20. A computer-implemented method for executing a
computer application in a graphical user interface windowing environment. comprising the following steps:
presenting the computer application in a graphical window;
displaying help content in a help pane as part of the
graphical window without opening-a separate graphical
window to display the help content; and
subsequently converting the help pane to a separate
graphical window independent of the graphical window containing the application.
20. further comprising the step of automatically converting
the help pane to a separate graphical window upon occurrence of a triggering event.
22 A computer-implemented method as recited in claim
21. further comprising the step of altering the help content
from content related to the application to content related to
issues of the triggering event.
20, further comprising the step of converting the help pane
to a separate graphical window upon occurrence of a triggering event selected from a group of events comprising
activation of a message box and activation of a dialog box.
20. further comprising the step of changing the separate
10
15
20
25
30
35
40
45
50
55
60
65
5,715,415
10
graphical window containing the help content back to a help

29. A computing device as recited in claim 28. wherein the
pane of the graphical window containing the application.
application is selected from a group of applications com25. A computer-implemented publishing application
prising a publishing application. a spreadsheet application. a
word processing application, and a database application.
the steps of the computer-implemented method as recited in s
30. A computing device as recited in claim 28, wherein the
claim20.
application is configured to enable selective display and
hiding of the help pane.
31. A computing device as recited in claim 28. wherein the
27. A computer-readable memory which directs a computer to perform the steps in the computer-implemented 10 graphical application window has a workspace and the help
pane is arranged adjacent to the workspace.
32. A computing device as recited in claim 28, wherein:
28. A computing device comprising:
the graphical application window has a workspace for
a processor;
containing a work; and
a display;
15
the application being configured to enable selective disan operating system executing on the processor which
playing of the help pane and to re-size the work within
provides a graphical user interface environment
the workspace when the help pane is displayed.
capable of presenting at least one graphical window on
33. A computing device as recited in claim 28, wherein the
the display and a pointer; and
an application running on the operating system and being 20 application is configured to expand the help pane to show an
index to the help content.
presented within an application window of the graphi34. A computing device as recited in claim 28. wherein the
cal user interface, the graphical application window
application is configured to convert the help pane to a
having a help pane for showing help content without
separate graphical window independent of the graphical
opening a separate graphical window to show the help
content and without losing focus to the graphical 25 application window.
window, the help pane being displayed irrespective of
where the pointer is positioned.
*
*
* *
Exhibit E
Illlll llllllll Il lllll lllll US005510980A

lllll lllll lllll lllll lllll lllll llllll Ill lllll llll
r19J
[lll
Peters
[45]
[54]
METHOD AND SYSTEM FOR SELECTING

AND EXECUTING ARITHMETIC
FUNCTIONS AND THE LIKE
[75]
Inventor:
[73]
Assignee: Microsoft Corporation, Redmond,

Wash.
Appl. No.: 266,799
[22]
Filed:
5,510,980
Apr. 23, 1996
5,095,429 3/1992 Harris et al ............................. 364/408

5,241,620 8/1993 Ruggiero ................................... 395/22
5,272,628 12/1993 Koss ................................... 364/419.19
5,276,607 1/1994 Harris et al ............................. 364/401
5,339,410 8/1994 Kanai ...................................... 395/600
Chris Peters, Bellevue, Wash.
[21]
Patent Number:
Date of Patent:
OTHER PUBLICATIONS
"In Excelsis" (Microsoft Corp's Excel 3.0 spreadsheet) PC
User, Ziff-Davis Publishing Jan. 16, 1991 issue: nl50 pp.
44-47.
Jun. 27, 1994
Primary Examiner-Donald E. McElheny, Jr.

Attorney, Agent, or Firm-Seed and Berry

[57]
[63]
[51]
[52]
[58]
[56]
Continuation of Ser. No. 800,589, Nov. 27, 1991, abandoned.

6
Int. Cl. ................................................... G06F 159/00

U.S. Cl............................................................... 364/406
Field of Search ................................. 364/419.1, 401,
364/406; 395/13, 51, 148, 155, 157, 161
References Cited
5,021,973 6/1991
5,033,009 7/1991
5,040,131 8/1991
5,055,998 10/1991
Hernandez et al. .................... 340/709

Dubnoff .................................. 395/148
Torres ..................................... 395/156
Wright et al ....................... 364/DIG. 1
ABSTRACT
The present invention provides a method and system for

automating the range selection process involved with arithmetic functions. When the sum function is selected, the
system searches the cells above and to the left of the active
cell to determine which cells the user is most likely attempting to manipulate. The range of cells selected by the system
is marked by a flashing, dashed, bold border line, and is
subject to confirmation by the user. To reject the range of
cells selected by the system, the user only has to select a new
range. The system reduces the steps required to perform an
arithmetic function.
10
User Activates
Autosum Process
Coordinates
al Active Cel
Retrieved
15
User Specifies
Range
16
Arithmetic Completed,
Resutt Displayed
U.S. Patent
Apr. 23, 1996
Sheet 1of8
5,510,980
10
User Activates
Autosum Process
Coordinates
of Active Cell
Retrieved
Figure 1
11
Cells in Current
Column&Row
Examined
12
Range
Ascertainable
?
y
13
Range High-lighted
by
Flashin Border
15
User Given
Range Override
capabilities
User Specifies
Range
16
Arithmetic Completed,
Result Displayed
U.S. Patent
Apr. 23, 1996
5,510,980
Sheet 2 of 8
START
Figure 2
201
(s1111col, 811111'0W)=
(col, row)
208
Cell=
(Col, Row-1)
lF=1
206
N
210
y
211
NF=1
214
y
SF=1
N
U.S. Patent
Apr. 23, 1996
5,510,980
Sheet 3 of 8
Figure 2A
218
217
y
SF?= O
>-y--.iRow Score= 10t-----.
219
~-----Row
Score =8
SF= 1?
221
---------iRow Score = 2
223
222
TF= 1?
Row Score=
Row Score/2
225
RowScore=O
?
RF=1 Range=
((Col, Row+1)
: (Sumcol,
Sumrow-1))
y
226
Row Score = 1O
?
y
END
1------'~
U.S. Patent
5,510,980
Sheet 4 of 8
Apr. 23, 1996
Figure 3
301
(Col, Row)=
(Sumcol, Sumrow)
308
Cell=
(Col-1, Row)
TF =1
304
Cell Contents=
Text, Text Formula,
or Blank?
310
309
Cell Contents =
Number, Constant, or
Non-Sum Formula ?
Cell Contents
- Time or Date?
y
311
NF=1
312
Cell Contents
= Sum Formula
?
N
14
SF= 1
U.S. Patent
5,510,980
Sheet 5 of 8
Apr. 23, 1996
Figure 3A
316
NF= 1
?
317
SF=O
318
Col Score = 1O
N
319
Col Score= 8
y
SF= 1?
321
Col Score= 2
323
Score=
>------------- Col
CoI Score/2
U.S. Patent
Apr. 23, 1996
5,510,980
Sheet 6 of 8
Figure 4
402
401
N
Row Score= O
Row Score
Col Score?
Y
>------.
?
y
403
Col Score= O
?
y
404
RF=1
Range = ((Col+ 1, Row)

,: (Sumcol-1 , Sumrow))
END
U.S. Patent
Apr. 23, 1996
30
5a
Fo1mul
5,510,980
Sheet 7 of 8
Figure 5
t
Q tlon
Mcro
Window
.tlel
Qptlons
M.cro
Window
Help
Qptlons
MsCl'o
Window
.Help
32
5b
38
34
36
32
30
Sc
J;.dlt
Formula
SUM
32
U.S. Patent
Apr. 23, 1996
30
6a
5,510,980
Sheet 8 of 8
Figure 6
ate
jlptlona
Macro
Window
Help
32
6b
.Qptlan
.Maao
Window
Help
30
6c
32
5,510,980
1
METHOD AND SYSTEM FOR SELECTING
AND EXECUTING ARITHMETIC
FUNCTIONS AND THE LIKE
APPLICATION
This application is a continuation of U.S. patent application Ser. No. 07/800,589, filed Nov. 27, 1991, now abandoned.
10
TECHNICAL FIELD
This invention relates generally to the selection and
execution of arithmetic functions and the like in a computer
program and specifically, in a preferred embodiment, to a
method and system for implementing a sum function in an
application program.
15
special symbol in the cell below or to the right of the data

to be manipulated. The user must specify whether the row or
the column of data is to be manipulated, and how much of
the data is to be used in the calculation. Although some of
these methods are somewhat of an improvement over earlier
methods, each existing method requires significant user
effort to select and execute the mathematical operation.
The sum function constitutes the majority of all mathematical operations used in a spreadsheet. When using the
sum function, spreadsheet users invariably put sum formulas
at the bottom of a column of data or to the right of a row of
data. Nonetheless, existing systems require a user to manually specify which cells to add together, by either typing in
the information or by using keyboard arrows or a mouse to
mark the range. It would be desirable for an application
program to have the capability to select and execute an
arithmetic function or the like with minimal user effort.

20
A primary use of computers, especially personal computers, is information processing. There are a wide variety of
It is an object of the present invention to provide an
application programs available that "computerize" informaimproved method and system for selecting and executing an
tion processing tasks that were previously performed manuarithmetic function or the like in a computer program.
ally. One such application program is Microsoft Excel, an 25
It is another object of the invention to provide such an
accounting program for personal or business use. In appliimproved method and system which can efficiently manipucation programs such as Microsoft Excel, a worksheet is the
late numeric data in a computer program such as an elecprimary document used to store and manipulate data. One
tronic spreadsheet.
commonly used type of worksheet is a spreadsheet, which is
It is another object of the present invention to provide an
a two dimensional rectangular grid of a finite number of 30
improved
function in which a plurality of cells are autocolumns and rows. The intersection of each column and row
matically designated as the arguments of the function,
is a cell, the basic unit of a worksheet in which a user stores
subject to acceptance or rejection by the user.
data. A user may move the screen cursor around the spreadIt is another object of the present invention to visually
sheet to select desired cells as the active cell.
Data contained in the worksheet may be manipulated by 35 notify the user which plurality of cells were automatically
designated as arguments of the sum function. These and
functions, which are special pre-written formulas that take a
other objects of the present invention, which will become
value or values, perform an operation, and return a value or
more apparent as the invention is described more fully
values. Using functions simplifies and shortens formulas in
below, are obtained by providing an improved method and
worksheets, especially those that perform lengthy or complex calculations. Data contained in the spreadsheet is 40 system for selecting and executing arithmetic functions. In
a preferred embodiment, arguments for a sum function are
manipulated in part by functions, which are calculation tools
automatically selected using preprogrammed criteria once
that allow a user of a computer system to perform decisionthe user selects the sum function. The automatically selected
making, action-taking, and value-returning operations.
argument cells are preferably visually designated using a
Functions work with arguments, which are the information
that a function uses to produce a new value or perform an 45 marquis display or the like and the user is prompted to
confirm or override the automatic selection.
action. Typically, a function and its arguments are in one of
two forms: FUNCTION (argl, arg2, ... , argN), where the
arguments may be numbers or cell names; or FUNCTION
BRIEF DESCRIPTION OF THE DRAWING
(argl: argN), where argl and argN represent a range of cells.
An example is the sum function, which returns the sum of 50
FIG. 1 is an overview flow diagram of an automated
the arguments specified.
summation process that implements a preferred embodiment
In the past, a user carried out mathematical operations
of the present invention.
(addition, subtraction, division, etc.) on spreadsheet data in
FIG. 2 is a detailed flow diagram of the method used in
a variety of different ways. First, the user could type the
the preferred embodiment described herein to examine the
numbers or cell names to be manipulated along with the 55 cells above and in the same column as the cell where the sum
operators in a formula format, i.e., Al+A2+A3. Second, the
result will be displayed.
user could type in a function name along with a list of
FIG. 2A is a detailed flow diagram of the method used in
numbers and/or cell names to be manipulated as arguments,
the preferred embodiment described herein to establish a
i.e., SUM (Al,A2,A3). Third, the user could type in a
function name with the range of cells to be manipulated as 60 row score.
arguments, i.e., SUM(Al: A3). Fourth, the user could type
the preferred embodiment described herein to examine the
in the function name, then use the keyboard arrows or mouse
cells to the left of and in the same row as the cell where the
to mark a range of cells to be used as arguments. Fifth, the
sum result will be displayed.
user could select a function from a list of functions, then use
the keyboard arrows or mouse to mark a range of cells to be 65
FIG. 3A is a detailed flow diagram of the method used in
the preferred embodiment described herein to establish a
used as arguments. Finally, some systems allow a user to
manipulate an entire column or row of data by typing a
column score.
5,510,980

In block 201, the process stores the coordinates of the
the preferred embodiment described herein to compare the
active cell. These coordinates are where the results of the
row score to the column score to determine whether a row,
addition will be displayed. The active cell becomes the
current cell being examined. In block 202, the process
column, or neither will be summed.
FIGS. 5 and 6 illustrate the screen displays presented to 5 queries whether the active cell is in the top row. If so, the
process concludes that a column of data is not being summed
the user by a preferred embodiment of the present invention.
and the process skips to block 301, otherwise the process
continues at block 203. In block 203, the process changes the
DETAILED DESCRIPTION OF THE
coordinates of the current cell so that the new current cell is
PREFERRED EMBODIMENT
10 one row above and in the same column as the previous
current cell.
The present invention provides a method and system for
In blocks 204 through 215, the contents of the current cell
selecting, and executing arithmetic function and the like
are examined. Based on the contents, the process either stays
with reduced user (fffort. A preferred embodiment for automating a summation process includes automatically selectin a loop, each time through examining the cell above the
ing the plurality of contiguous cells that would most likely 15 last one, or it skips to block 216, where the row scoring
be designated as the range of arguments for a sum function,
computation begins.
based on the location of the user-selected cell where the
In blocks 204 through 208, the process examines the
results of the addition will be displayed.
current cell in search of text, a text formula, or a blank cell.
The operation of the preferred embodiment described
The process remembers whether a cell containing one of
herein will be explained with reference to the overview flow 20 these is encountered before or after a cell containing a
diagram of FIG. 1 and the screen displays of FIGS. 5 and 6.
number or a sum formula. If the process has already encounThe process begins in block 10 when a user activates the
tered a number or sum formula cell when it encounters a text
autosum process by selecting the autosum button 30. At this
cell, then the text cell is treated like a column heading and
the examination process is over. If the process encounters a
time, the active cell 32, where the results of the summation
will be displayed, is already selected. The column and row 25 text cell before any number or sum formula cells, it keeps
of the active cell, also known as the coordinates of the active
examining new cells in the same column until either a
number, a sum formula, or the top of the column is encouncell are input to the autosum process in block 9. In block 11,
the process then examines the cells in the column above the
tered.
active cell 34, and in the row to the left of the active cell 36,
In block 204, the process queries whether the current cell
searching for predetermined criteria. Based on this exami- 30 is empty, contains text, or contains a text formula. If so, the
nation, the system selects, if possible, a group of contiguous
process continues at block 205, where the process checks to
cells as proposed arguments for the sum function. The cell
see if a number has been encountered, else the process
examination process is described in detail below.
continues at block 209. The process would have rememIn block 12 the system determines whether a group of 35 bered if a cell had previously been encountered during this
cells was selected in block 11. If no cells were selected, the
search that contained a number or a nonsum formula. In
process moves to block 15 to await manual selection by the
block 205, if a number has been encountered the examinauser, indicating which group of cells should be summed. As
tion is over and the process skips to block 216, else the
soon an the cells are manually selected, the arithmetic is
process continues at block 206. In block 206, the process
completed and the results are displayed in block 16. If a cell 40 queries whether a sum formula has been previously encounor cells are selected in block 11, the process moves to block
tered. If so, the examination is over and the process skips to
13, where the selected range of cells is displayed in the
block 216, else the process continues at block 207. In block
worksheet bordered by a rotating dashed line 38. The
207, the process queries whether the current cell is still
rotating dashed line visually informs the user which range of
visible to the user. If it is, the process remembers that text
cells the program has selected, allowing the user to verify 45 was found before numbers or sum formulas, and then loops
the accuracy of the automatic selection.
back to block 203, where the coordinates of the current cell
are changed. If the current cell is not still visible to the user,
The process then preferably moves to block 14, where the
the top of the column has been reached, therefore the
user is given the option of overriding the selection. The
examination is over and the process skips to block 216.
process waits for the user to either accept the selected
plurality of cells or reject them by manually selecting a 50
In blocks 209 through 211, as long as numbers, or
plurality of cells.
non-sum formulas are encountered, and they have not been
designated a time or date, the process remembers that a
FIGS. 2, 2A, 3, 3A, and 4 are detailed flow diagrams of
number has been located and loops back to block 203 to
the examination process used in the preferred embodiment
change the coordinates of the current cell. If the cell contents
described herein and referenced by FIG. 1, block 11. FIG. 2
illustrates the row examination section of the process, while 55 are designated as a time or date, the examination is considered over because a time or date is usually is found at the top
FIG. 2A illustrates how the row score is established. In FIG.
of a column. In block 209, the process examines the contents
2, the coordinates of the active cell, where the results of the
of the current cell to determine whether a number or a
addition will be displayed, are input to the examination
non-sum formula has been located. If so, the process conprocess. The process searches the cells in the rows above,
but in the same column as, the active cell for predetermined 60 tinues at block 210, where the process queries whether the
cell contents have been designated a time or date, else the
criteria. Based on the contents of these cells, a row score is
process skips to block 212. If the cell contents have been
determined. Based on the value of the row score, the process
designated as a time or date, the examination is over and the
either makes a cell selection and exits the process, makes a
process skips to block 216, else the process remembers that
cell selection and continues on to the column cell examination part of the process, or continues on to the column cell 65 a number was found then loops back to block 203.
examination section of the process without making a cell
In block 212, the process examines the contents of the
selection.
current cell determine whether a sum formula has been
5,510,980
located. If so, the process then detennines in block 213

FIG. 3 is a detailed flow diagram of the column cell
whether a number or non-sum formula has previously been
examination process. The coordinates of the cell where the
encountered. If so, the process detennines whether a sum
results of the addition will be displayed are recalled to
formula, besides the one found in the current cell, has
initialize the active cell. The process examines the columns
previously been encountered. If so, the process loops back to 5 to the left of, but in the same row as, the active cell for
block 203 where the coordinates of the current cell are
predetennined criteria. Based on the contents of these cells,
changed. If the current cell contains a sum formula and a
a column score is detennined in FIG. 3a. In FIG. 4, the
number or non-sun formula has not previously been encounprocess then compares the row and column scores and
tered, the process remembers a sum formula was found and
makes a determination, based on preselected standards, as to
loops back to block 203. If the current cell contains a sum
10 which contiguous cells, if any, will make up the range.
formula, and either a number or non-sum formula has
In block 301, the process makes the cell where the
previously been encountered, and a sum formula has not
addition results will be displayed the current active cell. In
been previously encountered, the examination is over and
block 302, the process queries whether the active cell is in
the process continues on at block 216. If the current cell does
the first column. If so, the search cannot continue to the left,
not contain a sum formula, the examination is over and the
15 therefore the process skips to block 332, else the process
process skips to block 216.
continues at block 303. In block 303, the process changes the
In blocks 216 through 223, the process detennines the row
coordinates of the current cell so that it is now to the left one
score based on what was encountered during the cell examicolumn, but in the same row.
nation process. If numbers or non-sum formulas were
In blocks 304 through 313, the contents of the current cell
encountered during the examination, the row score is given 20
are examined and remembered. Based on the contents, the
the highest possible value. If a sum formula was encounprocess either stays in a loop, each time through examining
tered, the row score is given the second highest possible
the cell to the left of the last one, or it skips to block 314,
value. If only sum formulas and no numbers, constants, or
where the column scoring computation begins.
non-sum formulas were encountered, the row score is given
the second to lowest possible value. Finally, if text, text 25
In blocks 304 through 308, the process examines the
formulas, or blank cells were encountered before anything
current cell in search of text, a text formula, or a blank cell.
else, the row score is divided in half. In block 216, the
The process remembers whether a cell containing one of
process queries whether numbers, constants or non-sum
these is encountered before or after a cell containing a
formulas were encountered. If the process continues at block
number or a sum formula. If the process has already encoun217, where it queries whether sum formula was encountered,
tered a number or sum formula cell when it encounters a text
30
else the process skips to block 220. In block 217, if no sum
cell, then the text cell is treated like a column heading and
formula was encountered, the process continues at block
the search is over. If the process encounters a text cell before
218, where the row score is made equal to ten. If a sum
any number or sum formula cells, the process keeps searchformula was encountered, the process skips to block 219 and
ing new cells in the same column until either a number, a
the row score is made equal to eight. With this scoring
sum formula, or the top of the column is encountered.
35
methodology, a plurality of cells containing only numbers
In block 304, the process queries whether the current cell
receives the highest possible score, while a plurality of cells
is empty contains text, or contains a text formula. If so, the
containing numbers and sum formulas receives the second
process continues at block 305, where the process checks to
highest scores.
see if a number has been encountered, else the process
From blocks 218 and 219, the process skips to block 224. 40 continues at block 309. The process remembers if a cell had
If it is detennined in block 216 that no numbers were
previously been encountered during this search that conencountered, the process skips to block 220. In block 220,
tained a number or a non-sum formula. In block 305, if a
the process continues on to block 221, where the row score
number has been encountered, the examination is over and
is made equal to two. The process continues on to block 222,
the process skips to block 316, else the process continues at
where it detennines whether text, text formulas, or blanks 45 block 306. In block 306, the process queries whether a sum
were encountered before any numbers, constants or formuformula has been previously encountered. If so, the examilas. If so, the process continues on to block 223, where the
nation is over and the process skips to block 316, else the
row score is divided in half.
process continues at block 307. In block 307, the process
queries whether the current cell is still visible to the user. If
In blocks 224 through 226, the process detennines
whether the range selection should be based on the row 50 it is, the process remembers that text was found before
numbers or sum formulas, and then loops back to block 303,
examination, or whether a column examination should be
where the coordinates of the current cell are changed. If the
performed before the range selection is made. In block 224,
current cell is not still visible to the user, the beginning of the
the process queries whether the value of the row score is
row has been reached, therefore the examination is over and
equal to zero. If the row score is not equal to zero, the
process continues at block 223, where the range selected flag 55 the process skips to block 316.
is set to true, and the range is computed, else the process
In blocks 309 through 311, as long as numbers or non-sum
continues at block 301. In block 223, the range is computed
formulas are encountered, and they have not been designated
based on the cell immediately below the last cell searched
a time or date, the process remembers that a number has
and the cell immediately above where the results of the
been located and loops back to block 303 to change the
addition are to be displayed. After the range is computed, the 60 coordinates of the current cell. In block 309, the process
process continues at block 224, where the process queries
examines the contents of the current cell to detennine
whether the row score is equal to ten. If so, the process is
whether a number or a non-sum formula has been located.
tenninated, else the process continues at block 30L If the
If so, the process continues at block 310, where queries
row score is equal to ten, there is no need to perform a
whether the cell contents have been designated a time or
column search and compute the column score, because the 65 date, else the process skips to block 312. If the cell contents
column will be summed when the row score is greater than
have been designated as a time or date, the search is over and
or equal to the column score.
the process skips to block 316, else the process remembers
5,510,980
7
that a number was found in block 311 and then loops back
to block 303.
current cell to determine whether a sum formula has been
located. If so, the process then determines in block 313
whether a number or non-sum formula has previously been
encountered. If so, the process determines whether a sum
formula, besides the one found in the current cell, has
previously been encountered. If so, the process loops back to
block 303 where the coordinates of the current cell are
changed. If the current cell contains a sum formula and a
number or non-sum formula has not previously been
encountered, the process remembers a sum formula was
found and loops back to block 303. If the current cell
contains a sum formula, and if either a number or non-sum
formula has previously been encountered, and a sum formula has not been previously encountered, the examination
is over and the process continues on at block 316. If the
current cell does not contain a sum formula, the examination
is over and the process skips to block 316.
current cell to determine whether a sum formula has been
located. If so, the process continues at block 313, where it
remembers that a sum formula was found, then the process
loops back to block 303 where the coordinates of the current
cell are changed. If no sum formula is located, the process
continues at block 314.
In blocks 316 through 323, the process determines the
column score based on what was encountered during the
column cell examination process. If numbers or non-sum
formulas were encountered during the examination, the
column score is given the highest possible value. If a sum
formula was encountered, the column score is given the
second highest possible value. If only sum formulas and no
numbers or non-sum formulas were encountered, the column score is given the second lowest possible value. Finally,
if text, text formulas, or blank cells were encountered before
anything else, the column score is divided in half. In block
316, the process queries whether numbers or non-sum
formulas were encountered. If so, the process continues at
block 317, where it queries whether a sum formula was
encountered, else the process skips to block 320. In block
317, if no sum formula was encountered, the process continues at block 318, where the column score is made equal
to ten. If a sum formula was encountered, the process skips
to block 319 and the column score is made equal to eight.
With this scoring methodology, a plurality of cells containing only numbers receives the highest possible score, while
a plurality of cells containing numbers and sum formulas
receives the second highest scores.
From blocks 318 and 319, the process skips to block 324.
If it is determined in block 316 that no numbers were
encountered, the process skips to block 320. In block 320,
the process continues on to block 321, where the column
score is made equal to two. The process continues on to
block 322, where it determines whether text, text formulas,
or blanks were encountered before any numbers or formulas.
If so, the process continues on to block 323, where the
column score is divided in half. In block 31S, no sum
formula was previously encountered, the process continues
at block 316, where the column score is made equal to ten,
else the column score is made equal to eight, and the process
skips to block 322. In block 318, the process checks the
status of the sum formula flag. If it is true, the process
continues at block 319, where the column score is made
equal to two, and the process continues at block 320, else the
process skips to block 320. In block 320, the process checks
10
15
20
25
30
35
40
45
50
55
60
65
the status of the text first flag. If it is true, the process

continues at step 321, where the column score is divided by
two and the process continues at block 322, else the process
skips to block 322.
In FIG. 4, the process determines whether the cell selection should be based on the row cell examination or the
column cell examination, or whether no range should be
selected. In block 401, the process queries whether the value
of the row score is equal to zero. If the row score is not equal
to zero, the process continues at block 402, where it queries
whether the row score is greater than or equal to the column
score. If the row score is greater than or equal to the column
score, the cells selected during the row examination are
displayed to the user. If the row score is not equal to zero,
the process skips to block 403, where it queries whether the
column score is equal to zero. If both the row and column
score are equal to zero, the process is unable to select a range
of cells to add, therefore the process ends without setting the
range selected flag to true. If the column score is not equal
to zero or if the row score is not greater than or equal to the
column score, the process continues at block 404. In block
404, the range selected flag is set to true, and the range is
computed, based on the cell immediately to the right of the
last cell searched and the cell immediately to the left of
where the results of the addition are to be displayed. After
the range is selected, the examination process ends.
FIGS. S and 6 are screen prints of a spreadsheet implementing a preferred embodiment of the present invention.
FIGS. Sa and 6a are screen prints taken immediately after
the user has selected a cell where the results of the addition
are to be displayed. FIGS. Sb and 6b are screen prints taken
immediately after the user has selected the autosum function. A range of cells was automatically selected based on
coordinates of the active cells, and is displayed as a plurality
of contiguous cells bordered by a rotating, dashed, bold line.
The inferred range and the sum function have been entered
on the formula line and the system awaits confirmation or
rejection by the user. FIGS. Sc and 6c are screen prints taken
immediately after the user has confirmed the selection by
pressing enter or by clicking on the enter box. The results of
the addition are displayed.
Although the methods and systems of the present invention have been described in terms of preferred embodiments,
it is not intended that the invention be limited to these
embodiments. Modifications within the spirit of the invention will be apparent to those skilled in the art. It will be
apparent to those skilled in the art that the present invention
can be used in other than spreadsheet systems, and for other
than sum formulas. The invention can be used generally in
systems where arithmetic functions are performed on columns or rows of data. The scope of the present invention is
defined by the claims that follow.
I claim:
1. A method, executed in a computer system, of implementing a sum function in an application program under the
operation of a user during a user session, where the application program uses a worksheet to store and manipulate
data, where the worksheet comprises a two dimensional grid
of intersecting columns and rows, where the intersection of
each column and row is a cell, where a cell may contain data,
and where a plurality of cells is a contiguous range of cells
in the same column or row, the method comprising the steps
of:
(a) during a user session, choosing a cell within the
worksheet where a sum result will be displayed, the
chosen cell having a location in the worksheet,
(b) during the user session, requesting execution of the
sum function;
5,510,980
9
(c) in response to steps (a) and (b), the computer system
automatically determining during the user session,
which of a plurality of cells to select based upon the
location of the chosen cell in the worksheet and without
prior programming or input by a user to explicitly 5
select the plurality of cells; and
(d) responsive to the execution request, calculating the
sum result of data associated with the determined
plurality of cells and displaying the sum result in the
chosen cell.
10
2. The method of claim 1 including:
(a) responsive to the automatic determination of a plurality of cells, visually notifying the user of the determined plurality of cells;
(b) responsive to the visual notification, providing user 15
input accepting the determined plurality of cells; and
(c) responsive to the user input signifying acceptance of
the determined plurality of cells, performing the calculation of the sum result.
3. The method of claim 2 wherein the step of providing 20
user input accepting the determined plurality of cells
includes generating a signal.
4. The method of claim 2 wherein the step of visually
notifying the user further includes displaying a border in a
predefined format around the selected plurality of cells in the 25
worksheet.
5. The method of claim 2 wherein the step of visually
notifying the user further includes displaying a rotating,
dashed, bold border line around the perimeter of the determined plurality of cells in the worksheet.
30
6. The method of claim 1 wherein the step of automatically determining a plurality of cells includes the additional
steps of determining whether a column or a row of data is
being summed and determining which plurality of cells in
that column or row are being summed.
35
7. The method of claim 1 including:
(a) responsive to the automatic determination of a plurality of cells, visually notifying the user of the determined plurality of cells;
(b) responsive to the visual notification, providing user 40
input rejecting the determined plurality of cells by
selecting a new plurality of cells; and
(c) responsive to the user input signifying rejection of the
determined plurality of cells, performing the calculation of the sum result of data associated with the new 45
plurality of cells.
8. A method, executed in a computer system, of implementing a sum function in an application program under the
operation of a user, where the application program uses a
worksheet to store and manipulate data, where the work- 50
sheet consists of a two dimensional grid of intersecting
columns and row, where the intersection of each column and
row is a cell, where a cell may contain data, and where a
plurality of cells is a contiguous range of cells in the same
55
column or row, the method comprising the steps of:
(a) choosing a cell within the worksheet where a sum
result will be displayed, the chosen cell having a
location in the worksheet;
(b) requesting execution of the sum function;
60
automatically determining which of a plurality of cells
to select based upon the location of the chosen cell in
the worksheet and without input by a user to explicitly
select the plurality of cells;
65
10
chosen cell;
wherein the step of automatically determining a plurality
to cells includes the additional steps of:
(e) examining the cells in the rows above and in the same
column as the chosen cell, comparing the cell contents
to predefined criteria, and establishing a row score;
(f) examining the cells in the columns to the left of and in
the same row as the chosen cell, comparing the cell
contents to predefined criteria, and establishing a column score; and
(g) selecting a plurality of cells based on a comparison of
the row score to the column score.
9. The method of claim 8 wherein the step of examining
the cells in the rows above and in the same column as the
chosen cell includes the additional steps of:
(a) initializing a current cell to be the chosen cell where
the sum result will be entered;
(b) establishing a row score of zero when the current cell
is in the top row of the worksheet; and
(c) when the chosen cell is not in the top row of the
worksheet, undertaking a cell examination process by
selecting the cell immediately above the current cell to
be the current cell and examining the current cell until
predefined criteria have been met.
10. The method of claim 9 wherein the step of establishing
the row score includes the additional steps of:
(a) setting the row score to a highest possible value when
only numbers were encountered during the cell examination process;
(b) setting the row score to a second highest possible
value when a mixture of !).umbers and sum formulas
were encountered during the cell examination process;
(c) setting the row score to a third highest possible value
when only sum formulas were encountered during the
.cell examination process;
(d) setting the row score to zero when no numbers or sum
formulas were encountered during the cell examination
process; and
(e) dividing the row score in half when cells containing
text, text formulas, or blanks were encountered during
the cell examination process before any numbers or
sum formulas.
11. The method of claim 9 wherein the step of determining
a plurality of cells based on a comparison of the row score
to the column score includes the additional steps of:
(a) when the row score is greater than or equal to the
column score, selecting the next to the last cell encountered during the cell examination process as the first
cell in the plurality of cells to be summed and the cell
immediately above the chosen cell as the last cell in the
plurality of c.ells to be summed; and
(b) when the column score is greater than the row score,
selecting the next to the last cell encountered during the
cell examination process as the first cell in the plurality
of cells to be summed and the cell immediately to the
left of the chosen cell as the last cell in the plurality of
cells to be summed.
12. The method of claim 8 wherein the step of examining
the cells in the columns to the left of and in the same row as
the chosen cell includes the additional steps of:
(a) initializing a current cell to be the chosen cell where
the sum result will be entered;
(b) establishing a column score of zero if the chosen cell
is in the first column of the worksheet; and
5,510,980
11
(c) when the chosen cell is not in the first column of the
worksheet, undertaking a cell examination process by
selecting a cell immediately to the left of the current
cell to be the current cell and examining the current cell
until predefined criteria have been met.
5
13. The method of claim 12 wherein the step of establishing the column score includes the additional steps of:
(a) setting the column score to a highest possible value
when only numbers were encountered during the cell
examination process;
10
(b) setting the column score a second highest possible
value when a mixture of numbers and sum formulas
were encountered during the cell examination process;
(c) setting the column score to a third highest possible
value when only sum formulas were encountered dur- 15
ing the cell examination process;
(d) setting the column score to zero when no numbers or
sum formulas were encountered during the cell examination process; and
(e) dividing the column score in half when cells contain- 20
ing text, text formulas, or blanks were encountered
during the cell examination process before any numbers or sum formulas.
14. The method of claims 9 or 12 wherein the cell
25
examination process include the additional steps of:
(a) when the current cell contains text or a text formula,
or it is blank, and when a cell that contains numbers or
sum formulas has already been encountered, stopping
the cell examination process;
30
(b) when the current cell contains text or a text formula,
sum formulas has not been encountered, and when the
current cell is still visible on the worksheet, remembering that text. was found before numbers;
35
(c) when the current cell contains text or a text formula,
sum formulas has not been encountered, and when the
current cell is not visible on the worksheet, stopping the
cell examination process;
40
(d) when the current cell contains a number or a formula
that is not a sum formula and the current cell has been
designated as containing a time or date, stopping the
(e) when the current cell contains a number or a formula 45
that is not a sum formula and the current cell has not
been designated as containing a time or date, remembering that a number was found;
(f) when the current cell contains a sum formula, remem50
bering that a sum formula was found; and
(g) when the current cell contains any value other than
text, text formulas, blanks, numbers or formulas, stopping the cell examination process.
15. A method, executed in a computer system, of imple- 55
menting a sum function in an application program under the
worksheet to store and manipulate data, where the worksheet consists of a two dimensional grid of intersecting
columns and rows, where the intersection of each column 60
and row is a cell, where a cell may contain data, and where
a plurality of cells is a contiguous range of cells in the same
column or row, the method comprising the steps of:
(a) choosing a cell within the worksheet where a sum
result will be displayed, the chosen cell having a 65
location in the worksheet;
(b) requesting execution of the sum function;
12
automatically determining which of a plurality of cells
to select based upon the location of the chosen cell in
the worksheet and without input by a user to explicitly
select the plurality of cells;
chosen cell;
(e) examining the cells in the rows above and in the same
column as the chosen cell, comparing the cell contents
to predefined criteria, and establishing a row score;
(f) when the row score is equal to its highest possible
value, setting the column score equal to zero;
(g) when the row score is less than its highest possible
value, examining the cells in the columns to the left of
and in the same row as the chosen cell, comparing the
cell contents to predefined criteria, and establishing a
column score; and
(h) selecting a plurality of cells based on a comparison of
the row score to the column score.
16. A computer system for summing data where the
computer system runs an application program under the
operation of a user during a user session, where the application program uses a worksheet to store and manipulate
data, where the worksheet comprises a two dimensional grid
of intersecting columns and rows, where the intersection of
each column and row is a cell, where a cell contains data,
and where a plurality of cells is a contiguous range of cells
in the same column or row, comprising:
(a) means during a user session for choosing a cell within
the worksheet where a sum result will be displayed, the
chosen cell having a location in the worksheet;
(b) means during a user session for requesting execution
of the sum function;
(c) means for automatically determining during the user
session which of a plurality of cells to select based on
the location of the chosen cell in the worksheet and
without prior programming or input by a user to
explicitly select the plurality of cells; and
(d) means, responsive to the execution request, for calculating the sum result of data associated with the
selected plurality of cells and displaying the sum result
in the chosen cell.
17. The computer system of claim 16 wherein the means
for automatically determining a plurality of cells additional
comprises:
(a) means for visually notifying the user of the determined
plurality of cells in response to the automatic determination of a plurality of cells;
(b) means for providing user input accepting the determined plurality of cells in response to the visual
notification; and
(c) means for calculating the sum of data associated with
the determined plurality of cells and displaying the sum
result in the chosen cell in response to user input
signifying acceptance of the determined plurality of
cells.
for providing user input accepting the determined plurality
of cells comprises means for generating a signal.
for visual! y notifying the user further additional! y comprises
a means for displaying a border in a predefined format
around the determined plurality of cells in the worksheet.
5,510,980
13
for visually notifying the user further additionally comprises
the means for displaying a rotating, dashed, bold border line
around the perimeter of the determined plurality of cells in
the worksheet.
for automatically determining a plurality of cells additionally comprises means for determining whether a column or
a row of data is being summed and for determining which
plurality of cells in that column or row are being summed.
22. The computer system of claim 16 additionally comprising:
(a) means for visually notifying the user of the determined
plurality of cells responsive to the automatic determination of a plurality of cells;
(b) means for providing user input rejecting the determined plurality of cells responsive to the visual notification; and
(c) means for performing the calculation of the sum result
responsive to the user input signifying rejection of the
determined plurality of cells.
23. The compute system of claim 22 wherein the means
for providing user input includes means for manually selecting a second plurality of cells to signify rejection of the
determined plurality of cells.
columns and rows, where the intersection of each column
and row is a cell, where a cell contains data, and where a
column or row, comprising:
(a) means for choosing a cell within the worksheet where
a sum result will be displayed, the chosen cell having
a location in the worksheet;
(b) means for requesting execution of the sum function;
(c) means for automatically determining which of a
plurality of cells to select based on the location of the
chosen cell in the worksheet and without input by a user
to explicitly select the plurality of cells;
in the chosen cell;
wherein the means for automatically determining a plurality of cells additionally comprises:
(e) means for examining the cells in the rows above and
in the same column as the chosen cell, comparing the
row score;
(t) means for examining the cells in the columns to the left
of and in the same row as the chosen cell, comparing
the cell contents to predefined criteria, and establishing
a column score; and
(g) means for selecting a plurality of cells based on a
comparison of the row score to the column score.
for examining the cells in the rows above and in the same
column as the chosen cell additionally comprises:
(a) means for initializing a current cell to be the chosen
cell where the sum result will be entered into;
(b) means for establishing a row score of zero when the
current cell is in the top row of the worksheet; and
14
10
15
20
25
30
35
40
45
50
55
60
65
(c) means for undertaking a cell examination process by

selecting the cell immediately above the current cell to
be the current cell and examining the current cell until
predefined criteria have been met, when the chosen cell
is not in the top row of the worksheet.
for establishing the row score additionally comprises:
(a) means for setting the row score to a highest possible
value when only numbers were encountered during the
(b) means for setting the row score to a second highest
possible value when a mixture of numbers and sum
process;
(c) means for setting the row score to a third highest
possible value when only sum formulas were encountered during the cell examination process;
(d) means for setting the row score to zero when no
numbers or sum formulas were encountered during the
cell examination process; and
(e) means for dividing the row score in half when cells
containing text, text formulas, or blanks were encountered during the cell examination process before any
numbers or sum formulas.
for determining a plurality of cells based on a comparison of
the row score to the column score additionally comprises:
(a) means for selecting the next to the last cell encountered during the cell examination process as the first
immediately above the chosen cell as the last cell in the
plurality of cells to be summed, when the row score is
greater than or equal to the column score; and
(b) means for selecting the next to the last cell encountered during the cell examination process as the first
immediately to the left of the chosen cell as the last cell
in the plurality of cells to be summed, when the column
score is greater than the row score.
for examining the cells in the columns to the left of and in
the same row as the chosen cell additionally comprises:
(a) means for initializing a current cell to be the chosen
cell where the sum result will be entered into;
(b) means for establishing a column score of zero if the
chosen cell is in the first column of the worksheet; and
(c) means for undertaking a cell examination process by
selecting a cell immediately to the left of the current
cell to be the current cell and examining the current cell
until predefined criteria have been met, when the chosen cell is not in the first column of the worksheet.
for establishing the column score additionally comprises:
(a) means for setting the column score to a highest
possible value when only numbers were encountered
during the cell examination process;
(b) means for setting the column score a second highest
possible value when a mixture of numbers and sum
process;
(c) means for setting the column score to a third highest
possible value when only sum formulas were encountered during the cell examination process;
(d) means for setting the column score to zero when no
numbers or sum formulas were encountered during the
cell examination process; and
5,510,980
15
16
(e) means for dividing the column score in half when cells
containing text, text formulas, or blanks were encountered during the cell examination process before any
numbers or sum formulas.
30. The computer system of claims 25 or 28 wherein the
means for undertaking a cell examination process additionally comprises:
(a) means for stopping the cell examination process when
the current cell contains text or a text formula, or it is
blank, and when a cell that contains numbers or sum
formulas has already been encountered;
(b) means for remembering that text was found before
numbers when the current cell contains text or a text
formula, or it is blank, and when a cell that contains
numbers or sum formulas has not been encountered,
and when the current cell is still visible on the worksheet;
(c) means for stopping the cell examination process when
the current cell contains text or a text formula, or it is
blank, and when a cell that contains numbers or sum
formulas has not been encountered, and when the
current cell is not visible on the worksheet;
(d) means for stopping the cell examination process when
the current cell contains a number constant or a formula
that is not a sum formula and the current cell has been
designated as containing a time or date;
(e) means for remembering that a number was found
when the current cell contains a number or a formula
that is not a sum formula and the current cell has not
been designated as containing a time or date;
(f) means for remembering that a sum formula was found
when the current cell contains a sum formula; and
(g) means for stopping the cell examination process when
the current cell contains any value other than text, text
formulas, blanks, numbers, or formulas.
columns and rows, where the intersection of each column
and row is a cell, where a cell contains data, and where a
column or row, comprising:
(a) means for choosing a cell within the worksheet where
a sum result will be displayed, the chosen cell having
a location in the worksheet;
(b) means for requesting execution of the sum function;
(c) means for automatically determining which of a
plurality of cells to select based on the location of the
chosen cell in the worksheet and without input by a user
to explicitly select the plurality of cells;
in the chosen cell;
wherein the means for automatically determining a plurality of cells additionally comprises:
(e) means for examining the cells in the rows above and
in the same column as the chosen cell, comparing the
row score;
(f) means for setting the column score equal to zero when
the row score is equal to its highest possible value;
(g) means for examining the cells in the columns to the
left of and in the same row as the chosen cell, comparing the cell contents to predefined criteria, and
establishing a column score when the row score is less
than its highest possible value; and
(h) means for selecting a plurality of cells based on a
comparison of the row score to the column score.
10
15
20
25
30
35
* * * * *

UNITED STATES PATENT AND TRADEMARK OFFICE
CERTIFICATE OF CORRECTION
PATENT NO.
DATED
INYENTOR(S) :
5,510,980
April 23, l 996
Chris Peters
It is certified that error appears in the above-indentified patent and that said Letters Patent is hereby
corrected as shown below:
In column 8, claim I, line 65, please delete"," and insert therefor--;--.

In column l 0, claim 8, line 4, please delete "to" and insert therefor--of--.
In column 12, claim 15, between lines 9 and l 0, please insert--wherein the step of automatically
determining a plurality of cells includes the additional steps of:-In column 12, claim I 7, line 47, please delete "additional" and insert therefor--additionally--.
In column 13, claim 23, line 22, please delete "compute" and insert therefor--computer--.
In column 14, claim 29, line 52, please delete "26" and insert therefor--28--.
Signed and Sealed this

Third Day of September, 1996
Attesr:
BRUCE LEHMAN
Attesting Officer
Commissioner of Patents and Trademarks
Exhibit F
Illlll llllllll Ill lllll llllll llll lllll lllll 111111111111111111111111111111111

USOOD550237S
c12)
United States Design Patent
c10)
Armendariz
(45)
(54)
USER INTERFACE FOR A PORTION OF A

DISPLAY SCREEN
(75)
Inventor:
(73)

(US)
(**)
Term:
(21)
Appl. No.: 29/246,955
(22)
Filed:
(51)
(52)
(58)
LOC (8) Cl. ................................................. 14-04

U.S. Cl. ..................................................... Dl4/487
Field of Classification Search ....... D14/485-495;
D18/24-33; D19/6; D20/11; 715/700-845,
715/856-867, 973-977
OTHER PUBLICATIONS
www.windowsatoz.com, Microsoft Office 12 Beta 1 review, Nov.
19, 2005.*
* cited by examiner
14 Years
Primary Examiner-Alan P. Douglas

Assistant Examiner-Deanna Fluegeman
(74) Attorney, Agent, or Firm-Banner & Witcoff, Ltd.
May 22, 2006
References Cited

A *
A *
S *
S *
S *
B2 *
Bl*
US DSS0,237 S
** Sep. 4, 2007
D518,487 S * 412006 MacKenzie et al. ....... Dl4/486

D523,443 S * 612006 Hone et al. ................ Dl4/488
D530,338 S * 10/2006 Winjum et al. ............ Dl4/485
Nerea Armendariz, Seattle, WA (US)
(56)
5,6ll,060
5,883,627
D445,427
D460,762
D472,244
6,675,070
6,717,596
Patent No.:
Date of Patent:
3/1997 Belfiore et al. ............. 715/819

3/1999 Pleyer ........................ 715/977
7/2001 Faris et al. ................ Dl4/487
712002 Wasko ....................... Dl4/486
3/2003 Wasko ....................... Dl4/486
1/2004 Lapham ...................... 700/245
412004 Nason et al. ............... 715/788
(57)
CLAIM
The ornamental design for a user interface for a portion of

a display screen, as shown and described.
DESCRIPTION
FIG. 1 is a front view of a user interface for a portion of a

display screen showing my new design; and,
FIG. 2 is an enlarged view of the shaded region in FIG. 1.
The broken line showing of various regions and the
unshaded areas there within form no part of the claimed
design. The broken line showing of the display screen is for
illustrative purposes only and forms no part of the claimed
design.
1 Claim, 2 Drawing Sheets
--------------------------------,--------------------------------r-------------------------------------
1~-----------------------------~I
It
11
11
1 I
1 I
1 I
11
11
11
1 I
11
1 I
: ! ______________________________ :
'I
~
':t.
'I
l!:..: =---= =---= =---= == =---= =---= =---= == =---= =---= =---= == =---= =---= =---= == == =---= == == == =---=== == == == == == ===---= ==== == =---= =::J
U.S. Patent
Sep.4,2007
Sheet 1 of 2
US DSS0,237 S
i;:=:=:=:=:=:=:=:=:=:=:=:=:=:=:=:=:=:=:=:=:=:=:=:=:~
I
,-----,-----------
-----------------------------------------------------
1'1
:I
:I
'11I
I
:
I
I
'I
L----------r------
Ii'I
I.'I
I.'I
I.'I
I.'I
I.'I
I.'I
I.'I
I.'I
I.'I
I.'I
I.'I
I.'I
I.'I
I.'I
I.'I
I.'I
I.'I
I.'I
I.'I
I,'I
I.'I
I.'I
I.'I
I.'I
I.'I
I.'I
I.'I
I,'I
:I
'11I
:I
'11I
r-----------
~-----~-----------~------------------------------------------------------ I.'I
L~-...=-_-...=-_-...=-_-...=-_-...=-_-...=-_-...=-_-...=-_-...=-_-...=-_-...=-_-...=-_-...=-_-...=-_-...=-_-...=-_-...=-_-...=-_-...=-_-...=-_-...=-_-...=-_-...=-_-...=-_-J j
I
0
LL
U.S. Patent
Sep.4,2007
US DSS0,237 S
Sheet 2 of 2
r------------------
(.9
LL
,_ --- -- --- -- --- -- - -
_____________________________ J
Exhibit G

USOOD554140S
c12)
c10)
Armendariz
(45)
Patent No.:
Date of Patent:
US D554,140 S
** Oct. 30, 2007
(54)

DISPLAY SCREEN
(75)
Inventor:
(73)

(US)
(**)
Term:
(21)
Appl. No.: 29/246,936
* cited by examiner
(22)
Filed:
(51)
(52)
(58)
LOC (8) Cl. ................................................. 14-04

U.S. Cl. ..................................................... Dl4/487
Field of Classification Search ....... D14/485-495;
D19/6; D20/11; 715/700-867, 973-977
Primary Examiner---Cathron C. Brooks

Assistant Examiner-Deanna Fluegeman
(56)
Nerea Armendariz, Seattle, WA (US)
14 Years
May 22, 2006
References Cited

5,615,347
D424,543
D426,209
6,489,978
6,760,007
D501,214
D518,829
D525,984
D534,l 77
7,187,884
D539,809
200210012526
A * 3/1997 Davis et al. ................ 715/833

S * 512000 Hodgson ................... Dl4/487
S * 612000 Hodgson ................... Dl4/487
Bl * 12/2002 Gong et al. ................. 715/845
B2 * 7/2004 Iizuka et al. ................ 345/157
S * 1/2005 Melander et al ........... Dl4/487
S * 412006 Hally et al. ................ Dl4/486
S * 8/2006 Hally et al. ................ Dl4/487
S * 12/2006 Gusmorino et al. ....... Dl4/485
B2 * 3/2007 Bardolatzy et al. ........... 399/81
S * 4/2007 Totten et al. .............. Dl4/487
Al* 1/2002 Sai et al. .................... 345/719
2003/0038832
2004/0021678
2005/0086612
2005/0108645
2005/0183017
2006/0143567
200610156236
2006/0218505
2007/0038931
(57)
Al *
Al*
Al*
Al*
Al*
Al*
Al *
Al*
Al*
212003
212004
412005
512005
8/2005
612006
712006
912006
212007
Sobol .........................
Ullah et al. .................
Gettman et al. ............
Prentice et al. .............
Cain ..........................
Chiu et al. ..................
Heller et al. ................
Compton et al. ...........
Allaire et al. ...............
345/722
345/700
715/848
715/722
7151719
715/720
715/716
715/781
715/526
CLAIM

DESCRIPTION

FIG. 2 is an enlarged view of the shaded region in FIG. 1.
The broken line bounding the shaded region represents an
unclaimed boundary of the design. The broken line showing
of various regions and the unshaded areas there within form
no part of the claimed design. The broken line showing of
the display screen is for illustrative purposes only and forms
no part of the claimed design.
U.S. Patent
Oct. 30, 2007
Sheet 1 of 2
US D554,140 S
=====================================11
~
LL..
----------------------------------~
~------------------------------------
--------------------------------------~
U.S. Patent
Oct. 30, 2007
US D554,140 S
Sheet 2 of 2
l9
-I
Exhibit H

USOOD564532S
c12)
c10)
Sadler
(45)
Patent No.:
Date of Patent:
*
*
*
*
*
*
*
*
*
*
US D564,532 S
** Mar. 18, 2008
(54)

DISPLAY SCREEN
(75)
Inventor:
(73)

(US)
(**)
Term:
(21)
Appl. No.: 29/246,978
* cited by examiner
(22)
Filed:
Primary Examiner-Melanie H Tung

(63)

May 22, 2006.
D522,525
D528,549
D529,506
D529,509
D536,342
D541,810
D544,872
D544,878
D550,230
D550,232
Jennifer L. Sadler, Seattle, WA (US)
14 Years
May 23, 2006
S
S
S
S
S
S
S
S
S
S
612006 Melander et al ........... Dl4/487

912006 McLees et al. ............ Dl4/485
10/2006 McLees et al. ............

10/2006 Stabb ........................
212007 Stabb ........................
5/2007 Cummins et al. ..........
6/2007 Sadler et al. ..............
6/2007 Cummins et al. ..........
9/2007 Tolle .........................
9/2007 Tolle .........................
Dl4/485
Dl4/485
Dl4/487
Dl4/487
Dl4/485
Dl4/487
Dl4/487
Dl4/487
(51)
(52)
(58)
LOC (8) Cl. ................................................. 14-04

U.S. Cl. ..................................................... Dl4/487
Field of Classification Search ......... D14/485-95;
D18/24-33; D19/6; D20/11; D21/324-33;
715/700--867, 973-77
(56)
References Cited

D454,138
D470,153
D496,665
D501,214
D513,009
S
S
S
S
S
*
*
*
*
*
3/2002 Imamura et al.

212003 Billmaier et al.
912004 Billmaier et al.
1/2005 Melander et al.
12/2005 Hone ........................
Dl4/486
Dl4/486
Dl4/485
Dl4/487
Dl4/486
(57)
CLAIM

DESCRIPTION

FIG. 2 is an enlarged view thereof, only a portion is shown
for clarity of illustration.
The broken line showing of the elements within the portion
of a display screen and the unshaded areas within them form
no part of the claimed design. The broken line showing of
the display screen is for illustrative purposes only and forms
no part of the claimed design.
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
v~---~,,-----------------------1-----------------------------------1
ii
J~== == 1ill~illill@BJJ@B0ill~1ill~1ill@[illillillillillillill=ill=illillillillillillillillillillillillillillillillillillillillillill~
I
I
I
I
I
I
I
I
I
I
I
I
I
I
I
I
I
I
I
I
I
I
I
I
I
I
I
:
i
i 1i
: ii
r-----------------------------------------------------------------4
i'
II
ii
:
I
'------------------------------------------------------------------~
'
I
I
I
I
I
'
I
I
I
!
'
I
I
I
I
I
I
ii
11
11
,,
L=================================~
U.S. Patent
Mar. 18,2008
Sheet 1 of 2
US D564,532 S
r:====================================1~
11
i!'I
I1
iI
r---T--,-----------T----------------,
I
I
:
Ii
ii
I
I
IiI
i!I
1
l
I
I
I
I
II II
II
i!
I
i!I
I
I1
I
1
I.
iI
i
!j II
I
I
I
I
1
1
I
I
I
I1
I
I
I
Ii
I.
iI
Ii
!I !Ii
I
'I
I1
'I
ii
Ii
I
I
I
I
I
II
'I
I
I
I
I.
I
:
I
I
I
i!
I
I
i!
I
I
I
I
I
I
I
I
I
I
I
I
I
I
I
I
I
II
I
I.
1
i!
I
I.
I
1I
I
,........
I.
(..9
'
1I
I
I
I
I
I
I
I
I
I
I
I
I
IJ
ll
lj
--1!
i1
[Qi
I
I
I
I
I
I
j
_. . _Ji@'''''':L------------'-----------------
I
I.
'II.
I
Ji
i!
iI
l_L_-..=-_-..=-_-..=-_-=--=--=--=--=--=--=--=:=--=--=--=--=--=--=--J
LL..
U.S. Patent
Mar.18,2008
US D564,532 S
Sheet 2 of 2
r-----.,.mnwmmmm
lt@@IIJIJ
1<&@JIIIJ
lI@?IIJIJ
11
1 111111111111111
l<&@JIIIJ
i<&@JIIIH
111111111111111111
1t@&IIJI:i
.
t9
LL
111111111111111111
lIttttttJ
11.1~:1@ifili@i~
Ilidl!
Exhibit I

USOOD570865S
c12)
(54)
c10)
Sadler
(45)

DISPLAY SCREEN
(75)
Inventor:
(73)

(US)
D423,483
D540,341
D551,240
D552,618
D552,619
D556,766
Jennifer L. Sadler, Seattle, WA (US)
(**)
Term:
(21)
Appl. No.: 29/247,012
(22)
Filed:
14 Years

May 22, 2006.
LOC (8) Cl. ................................................. 14-04
U.S. Cl. ..................................................... Dl4/487
Field of Classification Search ......... D14/485-95;
D18/24-33; D19/6; D20/11; D21/324-33;
715/700--867, 973-77
(56)
References Cited

D421,974 S
I
I
I
I
I
I
I
I
I
II
*
*
*
*
*
*
412000 Hodgson ................... Dl4/485
4/2007
9/2007
10/2007
10/2007
12/2007
Cummins et al. ..........

Cummins ..................
Sato et al. .................
Sato et al. .................
Keohane ....................
Dl4/487
Dl4/486
Dl4/486
Dl4/486
Dl4/487
Primary Examiner-Melanie H Tung

CLAIM
May 23, 2006

(51)
(52)
(58)
S
S
S
S
S
S
US D570,865 S
** Jun. 10, 2008
* cited by examiner
(57)
(63)
Patent No.:
Date of Patent:
3/2000 Coleman ................... Dl4/485

DESCRIPTION

FIG. 2 is an enlarged front view thereof, the user interface
is shown separately for clarity of illustration.
In both figure views, the broken line showing of the text
forms no part of the claimed design. The broken line
showing of a portion of a display screen in FIG. 1 is for
illustrative purposes only and forms no part of the claimed
design.
:
:
:I
[------------------------------------------------------------~
I
I
I
I
ii
ii
ii
ii
1
1 1
I__-.:-..::.-.:-..::.-.:-..::.-.:-..::.-.:-..::.-.:-..::.-.:-..::.-.:-..::.-.:-..::.-.:-..::.-.:-..::.-.:-..::.-.:-..::.-.:-..::.-.:-..::.-.:-..::.:-::-..::.-.:-..::.-.:-..::.-.:-..::.:-::-..::.-.:-..::.-.:-..::.-.:-..::.-.:-..::.-.:-..::.-.:-..::.-.:-..::.-.:-..::.-.:-..::.-.:-..::.-.:-'__:
U.S. Patent
Jun.10,2008
Sheet 1 of 2
US D570,865 S
----,-------------------------------------1
I
I
I
I
I
I
-------------------------------------------
I
I
[~=====================~
U.S. Patent
Jun.10,2008
Sheet 2 of 2
FIG. 2
US D570,865 S

Microsoft v. Corel - Complaint

Uploaded by

Document Information

Copyright

Available Formats

Share this document

Share or Embed Document

Sharing Options

Did you find this document useful?

Is this content inappropriate?

Copyright:

Available Formats

Microsoft v. Corel - Complaint

Uploaded by

Copyright:

Available Formats

Case 5:15-cv-05836 Document 1 Filed 12/18/15 Page 1 of 39

Frank Scherkenbach (CA SBN 142549)

UNITED STATES DISTRICT COURT

NORTHERN DISTRICT OF CALIFORNIA

Case 5:15-cv-05836 Document 1 Filed 12/18/15 Page 2 of 39

Plaintiff Microsoft Corporation (Microsoft), for its Complaint against Defendants

between the two entities), alleges as follows:

Asserted Patents), copied by Corel into its infringing products.

Microsoft Word workspace until you are accustomed to work in WordPerfect:

COMPLAINT FOR PATENT INFRINGEMENT

Case 5:15-cv-05836 Document 1 Filed 12/18/15 Page 3 of 39

COMPLAINT FOR PATENT INFRINGEMENT

Case 5:15-cv-05836 Document 1 Filed 12/18/15 Page 4 of 39

WordPerfect X7 offers an option to use it in the Microsoft Word mode:

COMPLAINT FOR PATENT INFRINGEMENT

Case 5:15-cv-05836 Document 1 Filed 12/18/15 Page 5 of 39

COMPLAINT FOR PATENT INFRINGEMENT

Case 5:15-cv-05836 Document 1 Filed 12/18/15 Page 6 of 39

COMPLAINT FOR PATENT INFRINGEMENT

Case 5:15-cv-05836 Document 1 Filed 12/18/15 Page 7 of 39

COMPLAINT FOR PATENT INFRINGEMENT

Case 5:15-cv-05836 Document 1 Filed 12/18/15 Page 8 of 39

hundreds of millions of dollars of investment in those interfaces.

COMPLAINT FOR PATENT INFRINGEMENT

Case 5:15-cv-05836 Document 1 Filed 12/18/15 Page 9 of 39

Microsoft Corporation is a Washington corporation with a principal place of

business at One Microsoft Way, Redmond, Washington 98052-6399.

On information and belief, Corel Corporation is a Canadian corporation with a

customer support or training.

JURISDICTION AND VENUE

jurisdiction pursuant to 28 U.S.C. 1331 and 1338(a).

reasonably expect to be subjected to this Courts jurisdiction.

COMPLAINT FOR PATENT INFRINGEMENT

Case 5:15-cv-05836 Document 1 Filed 12/18/15 Page 10 of 39

wide basis because this is an Intellectual Property Action.

Microsoft and Corel

Microsoft is a technology company whose mission is to empower every person and

Microsoft Office, among many others.

Corel Corporation is a Canadian corporation founded in 1985. Corel initially sold

COMPLAINT FOR PATENT INFRINGEMENT

Case 5:15-cv-05836 Document 1 Filed 12/18/15 Page 11 of 39

The Microsoft Asserted Patents

adjust the layout based on the size of the screen.

The invention of Microsofts 036 patent focuses on another aspect of the

Commands on a graphic user interface may be contained in (i) menus which

drag and drop commands anywhere the user chooses.

Users often welcome helpful instructions or suggestions while working in an

Spreadsheet programs, such as Microsoft Excel, allow users to perform calculations

a sum function and performs the function on appropriate data.

COMPLAINT FOR PATENT INFRINGEMENT

Case 5:15-cv-05836 Document 1 Filed 12/18/15 Page 12 of 39

Each of the Microsoft Asserted Patents is valid and enforceable.

Corels Knowledge of the Microsoft Asserted Patents

Knowledge of the Microsoft Ribbon patents

to the Microsoft Ribbon technology and design.

On October 8, 2009, in Redmond, WA, several members of Microsoft management

concerns regarding potential violation of Microsofts intellectual property rights by Corels

President of Engineering. Microsoft reiterated its concerns regarding Corels violation of

patents if Corel wanted to use the Microsoft technology.

In February 2010, Microsoft contacted Eleanor Lacy, Corels new General

Windows Ribbon Framework opportunity with the vendor.

After Microsoft repeatedly contacted Corel, including Corels technology officers

and belief, Corel reviewed Microsofts related patents and applications.

COMPLAINT FOR PATENT INFRINGEMENT