You are on page 1of 55

02.11.

13

(1994..1995) History of Pen and Gesture Computing

History of Pen and Gesture Computing: Annotated Bibliography in On-line Character Recognition, Pen Computing, Gesture User Interfaces and Tablet and Touch Computers
References from the approximate years 1994 to 1995.
This compilation and all annotations are copyright Jean Renard Ward, 1993, 2004, 2011. Permission is granted to use this information in publication, including confidential reports, provided that accompanying text clearly makes reference to the URL for this page, along with the statement:
S o u r c e :A n n o t a t e dB i b l i o g r a p h yi nO n l i n eC h a r a c t e rR e c o g n i t i o n , P e nC o m p u t i n g ,G e s t u r eU s e rI n t e r f a c e sa n dT a b l e ta n dT o u c h C o m p u t e r s C o p y r i g h tJ e a nR e n a r dW a r d

These are items in my personal collection, either as physical items or (sometimes) as PDF files. I can be contacted at jrward@alum.mit.edu. Copyright T h uO c t2 42 2 : 1 0 : 5 5E D T2 0 1 3.
Mirrors of this page can be found at: http://users.erols.com/rwservices/pens/biblio95.html http://216.15.114.196:81/pens/biblio95.html http://rwservices.no-ip.info:81/pens/biblio95.html (Generally most up-to-date)

Main Reference Page [AbrahamRI95] ( * )Abraham, Robert I; Moore, Richard E.; Rich, William L.; Shackelford, Floyd W.; Tiller, John R. Jr.; and Briggs, Richard S. Jr. "Slot Objects for an Object Oriented Programming System", United States Patent 5,410,702, April 25, 1995
users.erols.com/rwservices/pens/biblio95.html 1/55

02.11.13

(1994..1995) History of Pen and Gesture Computing

Implementation of a slot object: citations back to 1982

[ActiveDesk95a] ( * )Buxton, Bill "The Active Desk and Prototyping the Future", Alias/Wavefront, 1995, Toronto Canada. Link to video on www.buxton.com (2011)
Active Desk whiteboard / collaborative drawing space prototype using large Scriptel digitizer tablet and rear-projection display. Compare with Microsoft Surface, Digital Desk

[Agulnick94] ( * )Agulnick, Todd; Carr, Robert; Hoeber, Tony; Kaplan, S. Jerrold; Low, David R. and Ouye, Michael "Control of a computer through a position-sensed stylus", United States Patent 5,347,295 assigned to GO Corp, Foster city, California, September 13, 1994
Describes using a pen stylus for entering commands via character recognition / gestures into a computer, recognizing and executing command after out-of-proximity/end-of-stroke/time-out. Compare with Ledeen, which did not have gestures made on the display. Specific reference to first, second and third gestures in a sequence for a compound gesture (multiple flicks, multiple taps, etc.). Specific reference to direction of motion of the gesture. Animated marquee on selection after press-and-hold. Describes feedback to user (idealized form of gesture displayed, or question mark in a circle) on what gesture recognized. If gesture not appropriate in context, error returned (displayed). Proximity sensing for termination of gesture.

[AhlbergC94a] ( * )Ahlberg, Christopher and Shneiderman, Ben "The Alphaslider: A Compact and Rapid Selector", Proc. CHI 94, April, 1994, Boston, pp. 365..371
Slider/selector/scrollbar for scrolling through long alphanumeric sorted lists (e.g. rolodex or dictionary): variable-speed scrolling (accelleration) if slider thumb moved more quickly. Acceleration not work well, especially since user could just tap on alphabetical index (linear alphabetically) next to scroll bar. Also micrometer (fine positioning) mode by moving mouse perpendicularly to scroll motion: confusing to users.

[AhmadS95a] ( * )Ahmad, Subutai "A Usable Real-Time 3D Hand Tracker", Proc. 28th Asilomar Conf. on Signals, Systems, and Computers, 1995
Optical (camera) hand tracking system for smart desk: track hand, multiple fingertips, finger joints.

[AllardDJ95a] ( * )Allard, David J.; Beatty, Brent A.; Canova, Francis J. Jr.; DeBauche, Bradley J.; Hsieh, Danile M.; Johnson, Debra A.G., Lanier, Charles S.; Lewis, James R.; Tiller, Byron K.; Villafana, Willam;
users.erols.com/rwservices/pens/biblio95.html 2/55

02.11.13

(1994..1995) History of Pen and Gesture Computing

and Yee, Raymond L. "Personal Communicator Having Improved Contrast Control for a Liquid Crystal Touch Sensitive Display", United States Patent 5,422,656, June 6, 1995
IBM Simon: up/down physical buttons for volume on cell phone switched to contrast-adjustment mode either by pressing both buttons together, or tapping on a particular spot on the touchscreen.

[AllardDJ95b] ( * )Allard, David J.; Beatty, Brent A.; Canova, Francis J. Jr.; DeBauche, Bradley J.; Hsieh, Danile M.; Johnson, Debra A.G., Lanier, Charles S.; Lewis, James R.; Tiller, Byron K.; Villafana, Willam; and Yee, Raymond L. "Personal communicator having a touch sensitive contol panel", European Patent Application 94307982.2, EP0651544A2, May 3, 1995
IBM Simon: cellphone/smartphone with touchscreen, can show screens in both landscape and portrait orientation based on user on-screen rotation button.

[AndrewC94a] ( * )Andrew, Christopher and Bloomfield, Marc. A. "Palette Manager in a Graphical User Interface Computer System", United States Patent 5,371,844, December 6, 1994
Select new color from a palette, drag onto a UI element to change its color in OS/2. Dynamic themes/scheme manager via GUI. File also contains EP published patent application 0 591 571 A1.

[Apple95a] ( * )Apple Computer, Inc. "Apple Outlines Newton Wireless Comm Solutions", Apple Computer press relese, January 30, 1995
Apple Newton support for wireless communications, not on a single-vendor network

[AppleNewton94a] ( * )Apple "Welcome to Newton (promotional video)", Apple computer, Inc. 1994
Video demonstration of Apple Newton user interface, including "heavy mark" gesture. Video in electronic files: transcript fetched from guidebookgallery.org 2010. Text file has complete transcription of text. Zigzag gesture to rubout (gesture). Copy-and-paste by moving text to edge of (small) screen. press-and-hold gesture on Newton "heavy mark", with highlight. Press-and-hold highlight is to move text (12:50), different drag and tap-drag gestures for move and for copy. At 12:20 shows rub-out gesture recognized in inking/writing mode. 12:40 pop-up virtual keyboard.

[AppleNewton94b] ( * )Apple "Apple Newton Connection 2.0 Update", Apple computer, Inc. 1994
File transfer / connection utility between Apple Newton and Apple
users.erols.com/rwservices/pens/biblio95.html 3/55

02.11.13

(1994..1995) History of Pen and Gesture Computing

MacIntosh. Also calendar Date Book syncronization. Network connection? Parallel cable?

[AppleNewton95a] ( * )Apple "Newton: Apple MessagePad Handbook, 1995", Apple computer, Inc. 1995
Apple Newton: describes various gestures and UI features, including "heavy mark" selection gesture: press-and-hold in text? Describes rotate button to change screen orientation

[AppleNewton95b] ( * )Apple "Newton Technology An overview of a new technology from Apple", Apple computer, Inc. 1995
Apple Newton: whitepaper about product concepts for Apple Newton: Apple Newton fax/phone (desktop) with notetaking, Newton Map, fold-out three panel touchscreen pen computer, Newton touchscreen wristwatch (larger panel -- wrist-mounted computer), Newton classroom whiteboard, Newton family message center (Message pad hanging on refrigerator)

[ATT95a] ( * )A.T. & T. "ATT Video of ATT Personal Communicator Videon", AT\&T 1995, fetched from YouTube (URL on file)
Vision of future technology. Shows personal hand-held video communication (like Skype) with pen touchscreen interface.

[Baecker95a] ( * )Baecker, Ronald M.; Grudin, J.; Buxton, W.A.S. and Greenberg, S. "Readings in Human-computer Interaction: Toward the Year 2000, Second Edition", Morgan Kaufmann Publishers, 1995
Case study C: Wang Freestyle, pen-based voice/electronic-ink annotation system. Describes substantial public interest and acclaim when Freestyle released in 1988 (citations) Cited in MyersB96: ITS from IBM Research as automatic generation/generator tool for user interfaces.

[BatesCL94a] ( * )Bates, C.L., Ryan, J.M. and Watts, B.T. "Non-Opaque Selection Method for Concealed Window Resources", IBM Technical Disclosur eBulletin, Vol 37 No 06a, June 1994, pp. 251-256
To see windows underneath/obscured by other windows, user selects a mode whereby all windows become transparent: only the title bar and the frames are drawn. User can click on title bar (or frame) to bring that windows to the top, and transparency dropped.

[BartlettJF94a] ( * )Bartlett, Joel F. "Computer System and Method for Displaying Images with Superimposed Partially Transparent Menus", United States Patent 5,283,560, February 1, 1994
Transparent menus/windows in graphical user interface, does not block view of elements on screen underneath
users.erols.com/rwservices/pens/biblio95.html 4/55

02.11.13

(1994..1995) History of Pen and Gesture Computing

[BedersonB94a] ( * )Bederson, Benjamin B.; Stead, Larry; and Hollan, James D. "Pad++: Advances in Multiscale Interfaces", Proc. CHI '94, April 1994, Short Papers pp. 315-316
Infinite resolution multimedia sketchpad: infinite resolution display windowed into smaller display area: parallel lazy loading, only load/render data that is current viewable: example is browsing photos.

[BedersonB94b] ( * )Bederson, Benjamin B. and Hollan, James D. "Pad++: A Zooming Graphical Interface for Exploring Alternate Interface Physics", Proc. UIST '94, Nov. 2-4, 1994, pp. 17-26
Alternative graphical user interface to icons menus and windows, show small snapshots / postage-stamps of simulated desk objects. Directory browser is array of small thumbnail images of pages/documents.

[BedersonB94c] ( * )Bederson, Benjamin B. and Hollan, James D. "Pad++: A Zoomable Graphical Interface", Proc. CHI 94
Multiple scale / multi-scale data visualization user interface: example is directory browser, with thumbnails inside of thumbnails and multiple levels

[Bederson95] ( * )Bederson, Benjamin B. and Hollan, James D. "Advances in the Pad++ Zoomable Graphics Widget", Third Annual Tcl/Tk Workshop, July 1995, www.usenix.org
Multiple graphical representations of data, constraint-based graphical editing

[BedersonB95a] ( * )Bederson, Benjamin B. and Hollan, James D. "Pad++: A Zoomable Graphical Interaface System", Proc. CHI '95
Zoomable user interface, example is "world view" of documents, similar to thumbnail. Compare with Telesis "world view".

[BierEA94a] ( * )Bier, Eric A.; Stone, Maureen C; Fishkin, Ken; Buxton, William; and Baudel, Thomas "A Taxonomy of See-Through Tools", Proc. CHI '94, pp. 358-364
See-through transparent/translucent tools can be placed over an object without obscuring objects under the tool. One option is a gestureinterpreting tool. (Compare with gesture-buttons.) Two-handed input (trackball and mouse cursor: multitouch?) trackball moves a virtual transparent layer, such as a transparent selection/framing tool and a mouse click to make an action happen.

[BierE94b] ( * )Bier, Eric "Toolglass and Magic Lenses: The See-Through Interface", Shown at CHI '94, available on youtube.com
Video demonstration to accompany paper of same title. At about 2:00 shows dragging a "Fill Color" menu with transparent parts over an image. Dualpane clipboard for picking up divers multiple objects.
users.erols.com/rwservices/pens/biblio95.html 5/55

02.11.13

(1994..1995) History of Pen and Gesture Computing

[BierE94c] ( * )Bier, Eric "A Taxonomy of See-Through Tools (Video Presentation)", Xerox PARC, 1994, available on youtube.com
Video demonstration to accompany paper of same title. At about 0:25 shows a tool sheet (menu with buttons) with transparent sections being dragged over an image. Transparent pie menus / marking menu gestures. Unistroke gestures on a tool: compare with gesture buttons. 3:10 gesture interpreter tool / handwriting pad (Goldberg unistroke recognition). Mnemonic gestures: e.g. "C" for copy, "T" for translate/move --

[BierE94d] ( * )Bier, Eric "Enhanced Dynamic Queries Using Magic Lenses and Magic Lenses as Art (Video Presentation)", Xerox PARC, 1994, available on youtube.com
Video demonstration. Shows tool window with frame and buttons (but most is transparent) being dragged over a map, and certain features of the map are altered (pixels combined?) Also, at about 0:59 shows translucent overlaying of two tool windows.

[BierE94e] ( * )Bier, Eric "The Movable Filter as a User Interface Tool (Video Presentation)", Shown at CHI '94, available on youtube.com
Video demonstration. At about 0:50 shows window tool with circular "view" area that changes color of pixels underneath (combined pixels), with part of tool transparent, also with buttons and controls in the window.

[BlaisG95a] ( * )Blais, Gerard and Levine, Martin D. "Registering Multiview Range Data to Create 3D Computer Objects", IEEE PAMI, Vol 17 No 8, August 1995, pp. 820-824
Mathematical process for aligning/matching portions of surface from multiple views from a single camera. Compare with structure-through-motion.

[BlandfordRR94a] ( * )Blandford, Robert R. "Personal Computer Diary", United States Patent 5,347,579, September 13, 1994
PIM/Diary that keeps change/delta diff record of changed entries so that previous entries can be reconstructed, and automatic monitoring for dates and other phrases to prompt user to add to diary. Compare to marking menus/keyboard?

[Blickenstorfer95] ( * )Blickenstofer, Conrad H. "Editorial: Vertical market hardware manufacturers growing stronger, but they'r enow facing a challenge from consumer electronics giants and their marketing savvy", Pen Computing Magazine, Issue No. 6, August/September 1995
Mentions Scriptel WriteTouch front-mount digitizer for Windows95 and Windows for Pen Computing: cites Windows 95 as having better pencomputing support than Windows for Pen Computing 1.0, although tablet
users.erols.com/rwservices/pens/biblio95.html 6/55

02.11.13

(1994..1995) History of Pen and Gesture Computing

drivers are not included. Norand PEN*KEY6100 vertical market pen tablet device.

[BoieRA95a] ( * )Boie, Robert A.; Ruedisueli, Laurence W.; and Wagner, Eric R. "Computer mouse or keyboard input device utilizing capacitive sensors", United States Patent 5,463,388, October 31, 1995
Capacitive matrix grid digitizer: objects near intersections of wires affect capactiance between wires. Gets area measurement of adjacent intersection points, computes centroid/peak from adjaecent (independent) sensors nodes. Used for mouse and for touch keypad in one device. Compressibility of fingertip to infer pressure (force). multi-touch capable? See also Radio Drum

[Borucki94] ( * )Borucki, Gregory "Surface acoustic wave touchscreen sealing system", United States Patent 5,332,238, July 26, 1994
Sealing for SAW touchscreen tablet: see citations for actual surface acoustic wave touchscreen technologies Elographics IntelliTouch Systems Manual, 1988

[Bosscher94] ( * )Bosscher, Peter J. and Yeazel, Dean "Phase I Report: Using handheld Data Collectors in Highway construction for Accounting and Materials Management", Report to the Wisconsin Department of Transportation, January 10, 1994
Recommends PenRight! Pro as leading pen-centric development environment, Windows for Pen Computing lacks pen-centric features, nonpen-centric development tools are unfeasible. No mention of Newton or PenPoint.

[BritzDM95a] ( * )Britz, David M. "Personal Communicator Having Orientable Video Imaging Element", United States Patent 5,414,444, May 9, 1955
Smartphone / communicator with video camera and display: camera is mechanically steerable

[BurnsJ95] ( * )Burns, John and Lloyd, Sheelagh A. "Position-sensing Apparatus", United States Patent 5,442,147, August 15, 1995
Opticial digitizer tablet: Note similarity to Anoto: printed surface of pattern cells, making use of sub-patterns. Refers also to a "single-pixel" sensor stylus.

[BusinessWeek95] ( * )Business Week "PenRight! launches first cross platform pen-based mobile computing application development tool", Business Week magazine (Business Wire), July 24, 1996
Abstract/Summary only: PenRight cross-platform development environment for pen computing: PenRight! for Windows create Windows and DOS
users.erols.com/rwservices/pens/biblio95.html 7/55

02.11.13

(1994..1995) History of Pen and Gesture Computing

applications for PDAs, tablets, handhelds, etc. from single source code

[Buxton94x] ( * )Buxton, W. "Combined keyboard / touch tablet input device", Xerox Disclosure Journal, 19(2), 109-111.
See also http://www.billbuxton.com: User flips keyboard top over to expose touchscreen: touch tablet is multi-touch sensitive and pressure (force) sensitive, with virtual sliders and further touch elements.

[Buxton94y] ( * )Buxton, W. "Two-handed Document Navigation", Xerox Disclosure Journal, 19(2), 103-108.
Two overlapping operations by user as same time using pointing input in both hands. Describes scrolling gestures: smooth scrolling as touch-sliderelease, page turning with touch-rapid flick-release, and jumping to scrollbar touch location on a touch surface. Also mentions wireless touch tablet PARCtab. See also http://www.billbuxton.com

[Buxton95a] ( * )Buxton, William A.S. and Kurtenbach, Gordon P. "An improved graphical keyboard", European Patent Application 94120248.3, Publication Number 0 660 218 A1, June 28, 1995
Graphical on-screen keyboard using gestures for modifier keys such as shift and control: e.g. tap "a" key for lower-case a, upward flick for Upper case, right flick gesture for Control-a, right-upward angle gesture for control-shiftA, etc. Mentions interchangability of other types of input devices: mouse, tablet, trackball, etc. press-and-wait / PenStill / press-and-hold for marking menu, gesture and wait at end of mark also for multiple heirarchy of menus. Four events: PenDown, PenDrag, PenUp, PenStill (with no movement for a period of time).

[Buxton95x] ( * )Buxton, Bill "Chapter 7: Touch, Gesture and Marking", http://www.dgp.utoronto.ca/OTP/papers/bill.buxton/haptic.html


haptic input overview. Date approximate based on dates of most references, this draft obtained 2002.

[BuxtonWB94c] ( * )Buxton, Bill "Toolglass and Magic Lenses: The SeeThrough Interface", University of Toronto, 1993. Available at billbuxton.com
Video presentation of two-handed user interface with tool in non-dominant hand, tablet stylus in dominant hand. Companion video to "A taxonomy of see-through tools" and "Toolglass and magic lenses".

[CabralAW95a] ( * )Cabral, Authur W. et alet al "Obect-Oriented Graphic System", United States Patent 5,455,599, Oct. 3, 1995
Object-based graphical development system with polymorphic inheritance
users.erols.com/rwservices/pens/biblio95.html 8/55

02.11.13

(1994..1995) History of Pen and Gesture Computing

[CappsS94a] ( * )Capps, Stephen et al "Method and apparatus for correcting words", United States Patent 5,367,453, November 22, 1994
Handwriting recognition that let use display pop-up list of alternative recognition results for words (from spelling dictionary) by entering a gesture to bring it up, user can pick appropriate word, or use virtual keyboard to type in correct word.

[CappsS94b] ( * )Capps, Stephen et al "Method for manipulating objects on a computer display", United States Patent 5,345,543, September 6, 1994
Rotate an object with a stylus by means of a center axle mark, and a handle used to rotate.

[CappsSP94c] ( * )Capps, Stephen P.; Beernink, Ernest H.; Meier, John R.; and Temkin, David "Method and apparatus for correcting words", United States Patent 5,367,452, November 22, 1994
On pen computer or tablet, pop-up list of alternative handwriting recognition results, user can pick from list or enter word via virtual keyboard. Figures show pop-up keyboard of Apple Newton. Correction gestures (insert, delete gesture, etc.). Refers to keyboard gesture (tap on keyboard image), correction gesture (tap on menu of alternative words).

[CappsS95a] ( * )Tchao, Michael C. and Capps, Stephen P. "Pointing gesture based computer note pad paging and scrolling interface", United States Patent 5,398,310
Stephen Capps is listed in over 50 patents for pen-computing user-interface features, mostly from the Apple Newton. Gestures on buttons or command-input areas to edit electronic-ink notes: notes not necessarily ink. Few if any references before. Compare with van Raamsdonk, Pencept, and CIC.

[CappsS95b] ( * )Capps, Stephen, and Beernink, Ernest H. "Method and apparatus for formatting paragraphs", United States Patent 5,479,596, December 26, 1995, Assigned to Apple Computer Inc
Automatic re-flow / formatting of paragraphs from handwritten (or "pointing" input): compare to van Raamsdonk. Stephen Capps is listed in over 50 patents for pen-computing user-interface features, mostly from the Apple Newton. Few references before 1990 Compare with van Raamsdonk, Pencept, CIC

[CappsS95c] ( * )Capps, Stephen et al "Method and apparatus for the manipulation of text on a computer display screen", United States Patent 5,442,742, August 15, 1995
users.erols.com/rwservices/pens/biblio95.html 9/55

02.11.13

(1994..1995) History of Pen and Gesture Computing

Stephen Capps is listed in over 50 patents for pen-computing user-interface features, mostly from the Apple Newton. Patents cite little or no prior art before 1990 ... Compare with van Raamsdonk, Pencept, CIC

[CappsS95d] ( * )Capps, Stephen et al "Visible clipboard for graphical computer environments", United States Patent 5,404,442, April 4, 1995
Stephen Capps is listed in over 50 patents for pen-computing user-interface features, mostly from the Apple Newton. Patents cite little or no prior art before 1990 ... Compare with van Raamsdonk, Pencept, CIC

[CarrDA94a] ( * )Carr, David A. "Specification of Interface Interaction Objects", Proc. CHI '94, Boston Massachusetts
Shows graphical/touchscreen slide switches and toggles, three-state "secure switch" toggle. Compare to Apple slide-to-unlock gesture?

[CarrDA95a] ( * )Carr, David Andrew "A Compact Graphical Representation of User Interface Interaction Objects", Ph.D. dissertation, Dept. of Computer Science, Univ. of Maryland, 1995
User Action Notation for user interface objects. Example: Secure switch graphical object for preventing accidental manipulation of a device under computer control, such as master power switch for factory machinery. Compare to Apple slide-to-unlock gesture?

[CerdaM95a] ( * )Cerda, Michael "EO Interest Document", www.utexas.edu/ftp/microlib/eo/html


Personal note on EO with PenPoint: lists of collected EO/PenPoint materials. EO based in UK?

[ChangL94] ( * )Chang, Larry and MacKenzie, I. Scott "A Comparison of Two Handwriting Recognizers for Pen-based Computers", Proceedings of CASCON '94, pp. 364-371, Toronto: IBM Canada
Compare Pen-Windows and CIC Handwriter recognizers: the CIC handwriting recognizer performed better, both with and without constraints.

[ChattyS95] ( * )Chatty, Stephane; Lecoanet, Patrick; and Mertz, Christophe "Toward pen-based interaction with ATC tools", Air Traffic Control Quarterly, Vol 3 No 4, 1995, pp 205-228
GRIGRI (French slang for "scribble") system using pen-computing gesture recognition in user interface for air traffice control ATC. Modeled on flight strips for air traffic control. See also "Digistrips". Numeric entries for flight numbers via menus. Cites PenPoint. Lists fifteen single-stroke gestures, some of which are alphabetic. Mentions that pen-based computing is bad for
users.erols.com/rwservices/pens/biblio95.html 10/55

02.11.13

(1994..1995) History of Pen and Gesture Computing

large ATC display screens (arm fatigue). Refers to gesture input as "markbased input".

[CloughWA95] ( * )Clough, William A.; Ouelette, Daneil; De La Sablonniere, Serge "Portable Computer with Touch Screen and Computer System Employing Same", United States Patent 5,379,057, January 3, 1995
Portable slate pen-computer using touch screen (not proximity digitizer): Microslate, Inc. of Canada. Describes having an automatic application generator. Refers to drop-down pick list as a "library" of answers for touchscreen selection.

[ComputerBusinessReview94a] ( * )Computer Business Review "Handhelds on the Battlefield: Grunts are to get the Texas Micro Grunt", Computer Business Review, 10 August 1994
The Grunt: Texas Microsystems 3.5 pound Windows for Pen Computing portable computer using MicroTouch touch-screen: pen or special pen/stylus.

[ComputerWoche95a] ( * )Computerwoche "Mobile Computing Griffelcomputer haben sich in einigen Projekten bewaehrt -- Cruisepad, PoqetPad", Computerwoche1995 : available at www.computerwoche.de
Pen-based computers / pen computers useful in data collectin with UPS, engineering maintenance on ships, of immediate access to data (stored in device) and faster to input test or delivery data. Mentions that generally no or little use of handwriting recognition, data entry by picking on pre-designed forms, adjusting sliders, sketches. PoquetPad hand-held pen computer, CruisePad separate tablet/display for wireless access to PC within 100 mete`:wq

[CoronaJ95a] ( * )Corona, James; Henderson, Randal L. and Laib, Gregory D. "Method and System for Independent Control of Multiple Windows in a Graphics Display System", United States Patent 5,475,812, December 12, 1995
Transparent overlay windows in graphical user interface, pixel blending

[Cripps95] ( * )Cripps, Marcus "Introduction to PenWindows", Available at http://tawny.cs.nott.ac.uk/AMI/apprentice/INTERNAL/tech08.htm


Architectural overview of the PenWindows / Windows for Pen Computing system from Microsoft: hedit and bedit controls, Pen Extensions, normal and inking mode, RC handwriting recognition manager, PenWin.dll

[Cubictechcorp95a] ( * )cubictechcorp "LabView User Manuals", cubictechcorp.homestead.com/Manuals.html, fetched 2009


users.erols.com/rwservices/pens/biblio95.html 11/55

02.11.13

(1994..1995) History of Pen and Gesture Computing

LabView manuals from early 1990's for visual programming language. Shows slide switches, manuals for sale?

[DarwinI95a] ( * )Darwin, Ian; Quercia, Valerie; and O'Reilly, Tim "X Window System User's Guide - OPEN LOOK Edition", Open-Source publication of manuscript originally for O'Reilly publishers, 1995
Open Look windows management system / user interface. Drag-RightDistance to select sub-menu. MoveThreshold, MouseDamping system properties. Compare with press-and-hold

[DeTar94] ( * )DeTar, Jim "NCR, Scriptel push cordless digitizer - NCR Microelectronic Products and Scriptel Holding Inc. develop WriteTouch cordless electrostatic digitizer", Electronic News, Nov 14, 1994, Available on http://findarticles.com
Electrostatic / capacitive digitizer from Scriptel, can sense finger input as well as stylus

[DrummDE94a] ( * )Drumm, Donald E. "Computer Input Device using an Orientation Sensor", United States Patent 5,297,119, February 15, 1994
Donald Drumm "Orb" project from Wang Freestyle: pointing device for accessibility, uses head-mounted tilt sensor to push cursor position, simple voice detection circuit that detects fricatives "s" sound versus vocalized sounds.

[EatonJK94a] ( * )Eaton, John K. and Eaton, Laura "LabTutor: A Friendly Guide to Computer interfacing and LabVIEW Programming", Oxford University Press, 1994
LabVIEW graphical programming language.

[ECMA95a] ( * )ECMA/European Computer Manufacturers Association "Application Programming Interface for Windows", Standard ECMA-234, Decmeber 1995. www.ecma.ch
Standardization functional specification of Microsoft Windows 3.1 application programming interface. WS_EX_TRANSPARENT creates transparent window. Also GetBkMode TRANSPARENT parameter for drawing. Transparent windows are included in windows hit testing.

[EliensA95a] ( * )Eliens, A. "Hush -- a C++ API for Tcl/Tk", The X Resource, Issue 14, April 1995, O'Reilly & Ass., pp 111-155
Refers to mapping of events to mouse buttons in user interface. Compare to press-and-hold.

[EloTouch95] ( * )Elo TouchSystems, Inc. "DOS and Windows Driver Guide, version 2.0", Elo TouchSystems, Inc. 105 Randolph Road, Oak Ridge, Tennessee 37830. Copyright 1987..1995
users.erols.com/rwservices/pens/biblio95.html 12/55

02.11.13

(1994..1995) History of Pen and Gesture Computing

Contains description of touchscreen implementation of mouse menus for DOS application which are not "mouse-aware". See also Microsoft documentation on MENU.COM and mouse menus. Tablet drivers for mouse emulation in DOS and Windows.

[Essex95] ( * )Essex, David "Rewriting Handwriting Recognition", Byte Magazine, June 1995
Refers to reduced expectations on handwriting recognition accuracy, not to read human-illegible handwriting. Reference to Doonesbury commentary, use of point-and-tap selections and digital ink. Shows modified Graffiti character set (neography), Lexicus Cursive Recognition

[FaughnanJ95] ( * )Faughnan, John "Bar coding journal articles DataGlyphs", Posting to ftp.org/mailmain discussion list, December 29, 1995
Proposal to use a DataGlyph (two-dimenstional barcode) to having indexable/scannable information at the start of published articles. Compare to Silverbrook patents of 2004, and to Anoto. Note: there was a similar technology for a 2D barcode date for articles already in place in the 1980's?

[Fenwick95] ( * )Fenwick, Daniel J. "Generation of Interdependent Font Characters Based on Ligature and Glyph Categoriations", United States Patent 5,412,771, May 2, 1995, assigned to Signature Software Inc., Hood River, Oregon
Creating of a "handwriting-looking" font from samples of someone's handwriting: refers in claims to automatic classification/categorization based on slope and other characteristics of the characters

[FitzmauriceG95a] ( * )Fitzmaurice, George W.; Ishii, Hiroshi; Buxton, William "Bricks: laying the Foundations for Graspable User Interfaces", Proc. CHI 1995
GraspDraw project: Physical devices coupled to "virtual" objects via position sensors: blocks (bricks) that may be moved on a position-sensing surface. Refers to multiple-value input being either time-multiplexed (one mouse or stylus) or space-multiplexed (two hands).

[Frankish95] ( * )Frankish, Clive; Hull, Richard; Morgan, Pam "Recognition Accuracy and User Acceptance of Pen Interfaces", CHI '95 Proceedings, available at http://www.acm.org/sigchi/chi95/Electronic/documnts/papers/crf_bdy.htm
Short study of Windows for Pen Computing handwriting recognition accuracy, compares to Neisser60, cites also LaLomia94

[Fried-Nielson94a]
users.erols.com/rwservices/pens/biblio95.html

( * )Fried-Nielsen,

Lars K. "Symbol Browsing in an


13/55

02.11.13

(1994..1995) History of Pen and Gesture Computing

Object-Oriented Development system", United States Patent 5,339,433


IDE development environment with object, code browser, links reference to source code. No layout editor for GUI shown.

[FriendJ95a] ( * )Friend, John; Freedman, Mike; Bricklin, Dan "Input Device with Deferred Translation", United States Patent 5,455,901
Delayed translation/Deferred recognition of electronic ink, part of Slate/Bricklin thinking of ink as a data type. Implemented for PenPoint and Pen Windows in PenApps, a Visual-Basic like language. Refers to leaving electronic ink displayed if handwriting not recognized, or handwriting recognition result not found in dictionary. User can also display ink instead of recognized text. Gestures?

[GarfinkelS95a] ( * )Garfinkel, Simson "PGP Pretty Good Privacy: Encryption for Everyone", O'Reilly, 1995
Guide to PGP public/private key cryptography and PKI

[Garnet94a] ( * )Brad A. Myers, Dario Giuse, Andrew Mickish, Brad Vander Zanden, David Kosbie, James A. Landay, Richard McDaniel, Rajan Parthasarathy, Matthew Goldberg, Roger B. Dannenberg, Philippe Marchal, Ed Pervin "The Garnet Reference Manuals: Revised for Version 3.0", CMU Computer Science report CMU-CS-90-117-R5, December 1994, and additional materials
Collection of reference manuals and papers for Garnet IDE (see other refs) from CMU archive web site: includes directory listings.

[GeisslerJG95a] ( * )Geissler, Joerg "gedrics: The Next Generation of Icons", Proc. 5th Int'l Conf. on Human-Computer Interaction (INTERACT '95), Lillehammer, Norway, June 27-29 1995, pp. 73-78
Critique of Pen Windows / W4PC as only encompasing double-click, not drawing of gestures. Gedrics: gesture-driven icon. Gestures (of single stroke, to be fast) are performed on an icon: tab to activate, right-left to open, single-stroke question mark for help menu, closed "X" to delete, press/hold or hold/drag for copy/paste/move-to-parent, etc. circle left and circule right. Implementation on Newton. Does not mention "marking menus".

[GeneralMagic94a] ( * )General Magic "General Magic Phone Predates Smartphones", General Magic Corporation. Video available at http://www.youtube.com/watch?v=wko0m6XA9yg, Fetched 2011
Video presentation of General magic smart phone / PDA. Slate computer with stylus touchscreen from Sony. Appears to be resistive film tablet. Calendaring, virtual keyboard, electronic ink for notetaking, Personal Link communiation network services from AT&T for email, etc.
users.erols.com/rwservices/pens/biblio95.html 14/55

02.11.13

(1994..1995) History of Pen and Gesture Computing

[GeneralMagic94b] ( * )General Magic "Video Telescript General Magic: A 1994 Vision of the Future", General Magic Corporation. Video available at http://www.youtube.com Fetched 2011
Video presentation of General magic smart phone / PDA. Slate computer with stylus touchscreen from Sony. Appears to be resistive film tablet. Focus is on Telescript: early messaging/email service?

[GeneralMagic95a] ( * )General Magic "Telescript Language Reference, October 1995", General Magic Corporation
Telescript: Prototype-based programming language for pen-centric pen computing applications for General magic platform.

[GeoWorks94a] ( * )GeoWorks "GEOS Concepts Version 3.0", Geoworks, Incorporated 1994


GEOS/Geoworks system documentation for pen-computing operating system on Nokia 9000. Includes discussion of electronic ink, handwriting recognition, API for gesture recognition.

[GeoWorks94b] ( * )GeoWorks "GEOS Objects Version 3.0, Nokia 9000 Communicator SDK", Geoworks, Incorporated 1994
GEOS/Geoworks system documentation for pen-computing operating system on Nokia 9000. Class heirarchy and messages.

[GerlachJD94a] ( * )Gerlach, John D. and Weiblen, Michael E. "System for Relocating a Multimedia Presentation on a Different Platform by Extracting a Resource Map in Order to Remap and Relocate Resources", United States Patent 5,317,732, May 31, 1994
Visual programming language / GUI for creating programmed multimedia presentations

[GerpheideGE94a] ( * )Gerpheide, George E. "Methods and apparatus for data input", United States Patent 5,305,017, April 19, 1994
Capacitive/electrostatic grid tablet ("dipole electrodes"), finger affects capacitance at intersections. Coarse position is the grid crossing point with the highest value for change of capactance. Interpolates between two adjacent grid crossing points for higher fine resolution to determine centroid of finger position. Proximity sensing. Says Rympalski measures changes in capacitance as conductive object comes near. Compare with multi-touch?

[GesslerS95a] ( * )Gessler, Stefan and Kotulla, Andreas "PDAs as mobile WWW browsers", Proc. WWWF '94, Computer Networks and ISDN Systems, 1995. Available at ww.teco.unikarlsruhe.de/~stefan/papers/wwwf94/www_pda.html
Speculative (forward-looking) paper on web-browser for PDA Apple Newton:
users.erols.com/rwservices/pens/biblio95.html 15/55

02.11.13

(1994..1995) History of Pen and Gesture Computing

advantage is ubiquity and portability, disadvantage was high wireless data charges while mobile, small display and small memory.

[Greanias95] ( * )Greanias, Evon C.; Verrier, Guy F.; Donaldson, Robert L. "Touch Overlay for Improved Touch Sensitivity", United States Patent 5,386,219, January 31, 1995
Capacitive grid digitizer, transparent on top of display

[GreenbergS94] ( * )Greenberg, Saul "HCI Video Resources", Available at http://www.cpsc.ucalgary.ca/~saul/hci_topics/hci_resources/videos.html


Extensive list of video tapes from ACM CHI, CSCW, and ACM SIGGRAPH Vieo Review relating to handwriting recognition, sketch input, signature verification, and pen-computing: 1983 to 1994. 1963 Video: Videotape of Sketchpad system by Sutherland 1985 Video: Software Control at the Stroke of a Pen - Pencept - CHI '85 1989 Video: The Paper-Like Interface, IBM Watson Research Center - CHI '89 1989 Video: Freestyle - Wang Labs - CHI '89 1992 Video: Combining Gesture and Direct Manipulation - CMU 1992 Video: Touchscreen Toggle Design - Univ. of Maryland 1992 Video: Tactile Manipulation on a Digital desk - Rank Xerox EuroPARC Video: Alternate Reality Kit - Xerox PARC Video: The Lapidary Graphical User Interface Design Tool - Univ. of Tennesee

[GreysonAM95a] ( * )Greyson, Ann M.; Hokit, Jeffrey D.; Kaptanoglu, Marjory; Wagner, Annete M.; and Capps, Stephen P. "Method and apparatus for the manipulation of text on a computer display screen", United States Patent 5,442,742, August 15, 1995
Apple Newton: selected text in text editor can be copied/pasted by drag-anddrop: shaded image of text is what user drags around. Compare with floating icon for drag-and-drop in PenPoint?

[HarrisonBL95a] ( * )Harrison, Beverly L.; Kurtenbach, Gordon; and Vincente, Kim J. "An Experimental Evaluation of Transparent User Interface Tools and Information Content", Proc. UIST 95, Pittsburgh, USA, November 1995,
Show semi-transparent pop-up menus (including pie menus or context menus) semi-transparent or wire-frame over object, so that user can still see context, underlying image/object not obscured. See-through UI tools.

[HarrisonBL95b] ( * )Harrison, Beverly L.; Ishii, Hiroshi; Vicente, Kim J. and Buxton, William A.S. "Transparent Layered User Interfaces: An
users.erols.com/rwservices/pens/biblio95.html 16/55

02.11.13

(1994..1995) History of Pen and Gesture Computing

Evaluation of a Display Design to Enhance Focused and Divided Attention", Proc. CHI 95, May 7-11, November 1995, pp. 317..324
User interface with semi-transparent windows, menus, dialogue boxes, other objects with attention to "layered" interface objects, click-through tools. Cites to Knowlton on dynamically re-labelled buttons and keys.

[HayesP94] ( * )Hayes, P. "NameFinder: software that finds names in text", Proc. of RIAO '94, pp 762-774
Abstract only: Commercial product that finds literal names based on capitalization, and dictionary, plus knowledge engineering rules. Compare with regex expressions to find phone numbers. Finding names, combine with UI?

[HenckelJDD95] ( * )Henckel, Jonathan D. and Hospers, Paul A. "Data Processing System Graphical User Interface which Emulates Printed Material", United States Patent 5,463,725, October 31, 1995
Gesture (?) for turning a page by touching edge of page in a simulated book, and moving animated page(s) to the left or right. Compare with flick gesture, PenPoint OS metaphor of notebook pages?

[HenshawSF94a] ( * )Henckel, Jonathan D. and Hospers, Paul A. "Translucent Windows: Dragging an Image without Obscuring the Desktop", IBM Technical Disclosure Bulletin, Vol 37 No 10, October 1994
Translucent/semi-transparent window on OS/2 so as not to obscure image underneath (touchscreen/mouse). Blending for transparency is done by checkerboard of BITBLT, so that background image with colors appears visible.

[HinckleyK94a] ( * )Hinckley, Ken; Pausch, Randy; Goble, John C.; and Kassell, Neal F. "A Survey of Design Issues in Spatial Input", Proc. UIST '94, November 1994, Marian del Rey, California, pp. 213-222
Hybrid user interface: touchscreen UI can be combined with 3-D input device, because user can reach out to touch touchscreen with the 3-D input device in their hand. Relative vs. Absolute gestures: hard to perform gestures in absolute coordinates. Bi-manual/two-handed input advantageous over sequential single-hand input, because user can (e.g.) position a tool with one hand and use the tool with the other. Mentions using multiple pointing devices in a prototype (trackball and mouse, or two mice). User's spontanteous use two hands for combining translation/rotation/scaling gesture (direct manipulation). Compare with multi-touch.

[HinckleyKP95a]
users.erols.com/rwservices/pens/biblio95.html

( * )Hinckley,

Kenneth P.; Bathiche, Steven N.; Cauthorn,


17/55

02.11.13

(1994..1995) History of Pen and Gesture Computing

James H.; and Sinclar, Michael J. "Automatic Scrolling", United States Patent 6,975,306, December 13, 2005
Scroll to line, paragraph, or other document boundary. Scrolling initiated by minimum gesture movement, with second threshold to stop autoscrolling or scroll back if touch location has not moved on touch-sensitive surface.

[HopkinsT95] ( * )Hopkins, Trevor and Horan, Bernard "Smalltalk: An Introduction to Application Development using Visualworks", Visualworks Object-Oriented Programming Series, 1995
Introduction to Smalltalk language and environment. (Electronic file.)

[HoYL95] ( * )Ho, Yung-Lung, and Li, Hwok-Leung "Track Pad Cursor Positioning Device and Method", United States Patent 5,424,756, June 13, 1995
Touchpad controller for very small touchpad: uses (optical) sensing of velocity to position cursor faster if touch is moving fast.

[HP95a] ( * )Hewlett-Packard "HP OmniGo 100 PDA product information", Hewlett-Packard


Touchscreen PDA with full keyboard, swivel/convertible/clamsheel display. Rotate screen between horizontal for keypad input and vertical orientation for pen input. Graffiti Handwriting recognition software, GEOS operating system. Paper file contains additional materials.

[HP95b] ( * )Hewlett-Packard "HP OmniGo 100 Organizer Plus pencomputer PDA (physical device)", Hewlett-Packard
Functional touchscreen PDA with full keyboard, swivel/convertible/clamsheel display. Rotate screen between horizontal for keypad input and vertical orientation for pen input. (Screen is square, rotation is immediate.) Pop-up tools have window frame and draggable title bar. Graffiti Handwriting recognition software, GEOS operating system. Paper file contains additional materials.

[HP95c] ( * )Hewlett-Packard "Geoworks Organized Extras for the HP OmniGo 100", Hewlett-Packard, included with OmniGo devices
Touchscreen PDA with full keyboard, swivel/convertible/clamsheel display, penGEOS osftware. Front cover shows OmniGo 100 with both portrait and landscape screen orientation. Trademark on "hotsync" "hot-sync" (?) via OmniGo connectivity pack (Windows software plus serial RS-232C cable). GeoWorks Bindery for electronic books with hyperlinks in text. IZL (Interpreted Zoomer Language) programing environment for GeoWorks. Septor wireless pager/news-alerts services .

[HP95d]

( * )Hewlett-Packard

"HP OmniGo 100 Connectivity Pack File


18/55

users.erols.com/rwservices/pens/biblio95.html

02.11.13

(1994..1995) History of Pen and Gesture Computing

Management Tool", Hewlett-Packard, included with OmniGo devices


Windows software and serial cable for syncing and transfering between OmniGo pen PDA and a Windows PC. Trademark on "hotsync" "hot-sync" (?) via OmniGo connectivity pack (Windows software plus serial RS-232C cable).

[HP95e] ( * )Hewlett-Packard "HP OmniGo 100 Quick Start and User's Reference Guide", Hewlett-Packard, included with OmniGo devices
Pen GEOS operating system documentation.

[Hu95] ( * )Hu, Jianying, Brown, Michael K., and Turin, William "Invariant Features for HMM Based On-Line Handwriting Recognition", in "Image Analysis and Processing", Braccini, C., DeFloriani, L. and Vernazza, G. (Ed.), Springer Verlag, 1995, pp. 588-593, Lecture Notes in Computer Science #974.
Invariant handwriting features (independent of rotation, translation, scale) are ratio of tangents and normalized curvature, for Hidden Markov Model recognizer

[HuangHC95a] ( * )Huang, Hung-Chih and Stein, Robert A. "Frontally Shielded Capacitive Touch Sensor System", United States Patent 5,457,289, October 10, 1995
Resistive-film capacitive touchscreen with front shield to protect from stray capacitance

[HuangJ95a] ( * )Huang, Jianming and Knowles, Terence J. "Acoustic Wave Touch Panel for use with a non-active stylus", United States Patent 5,451,723, September 19, 1995
Acoustic wave touchscreen: hard stylus presses on top elastomeric layer, which then absorbs acoustic energy of wave propogating in layer underneath

[IBM94] ( p a r t i a l )IBM ""Redbook" IBM Pen for OS/2 and PenDOS", IBM Form Number GG24-4217-00
Architecture of IBM Pen for OS/@ V1.0 and PenDOS from IBM, version 2.2: Lists gesture assignments by Session Type, Gesture Commands and Sessions

[IBM94b] ( p a r t i a l )IBM "Simon Says "Here's How!", Simon Mobile Communications Made Simple, Users Manual", IBM Corp., 1994
IBM Simon user manual. Touch screen uses plastic stylus or finger. PredictaKey keyboard shows six most likely characters on virtual keyboard, Other shows next six most likely. User can hightlight numbers in messages and they are dialed from a pop-up menu. Physical slide switch p. 4 for
users.erols.com/rwservices/pens/biblio95.html 19/55

02.11.13

(1994..1995) History of Pen and Gesture Computing

On/Off / Resume/Suspend, p. 8 Simon is not completely off. If not off, touching screen turns unit on. Buttons with broken-line edge are not available: drag stylus across screen to highlight button, then lift stylus to select that feature. Some buttons display check mark on/off on touch. Folder-shaped buttons contain additional buttons. Has search function for address book p 35. Specifically states that operations happen "when you release the button" e.g. pen/stylus lift, not on pen/stylus down -- carry-over from mouse development?

[IBM94c] ( p a r t i a l )IBM "AIX Version 4 Desktop Handbook", IBM Corp. Document Number GG24-4451-00, December 1994
Windowing system uses different control layout from Microsoft Windows. Drag-and-drop to printer icons. Style manager allows color palette for all windows to be updated. Three button mouse, pop-up menu button can be rightmost of leftmost button depending on handedness of user.

[Impedovo94] ( p a r t i a l )Impedovo, Sebastiano, editor "Fundamentals in handwriting recognition", Proceedings of the NATO Advanced Study Institute on Fundamentals in Handwriting Recognition, Chateau de Bonas, France, June 21-July3, 1993 [Inforite94] ( p a r t i a l )Inforite "MP100 Writing Pad, Rite-Expressions annotation software for handwriting", BYTE Magazine product announcement, May 1994
Appears to have no relation to Inforite82 product, separate company? Several companies have used the name "Inforite"?

[Intel95a] ( * )Intel "Intel386 EX Embedded Miroprocessor MHT9000 Handheld Terminal", Intel Application Note AP-719, August 1, 1995
Intel386 embedded processor, includes registers and MTL6560 digitizer controller for resistive touchscreen (digital voltage measurement), controller/co-processor for LCD

[InterLink94a] ( * )InterLink Electronics "InterLink Electronics FSR Force Sensing Resistors -- VersaPad USB Integration Guide", InterLink Electronics Sensor Technologies, 1994
resistive touchpad using two sheets separated by an air gap, four-wire sensor. Based on contact resistance, also determines touch pressure (force). Tap-and-drag gestures. Drag Edge lock: if drag to edge, maintains drag gesture status for three seconds after release so that drag can be continued/extended with an additional drag/wipe gesture. Further gestures include right-click by tapping in upper right corner region of touchpad digitizer, right edged border scrolling for up/down scrolling.
users.erols.com/rwservices/pens/biblio95.html 20/55

02.11.13

(1994..1995) History of Pen and Gesture Computing

[Isaacson94] ( * )Isaacson, Portia "The Power of 'EINK'", OEM Magagzine, February 1994, Page 93
States large hardware business for specialize electronic chips for PDAs with electronic ink, handwriting recognition coprocessor. Mentions immaturity (performance defects) of digitizer tablets. e-ink.

[IsenseeSH95a] ( * )Isensee, Scott Harlan and Poston, Ricky Lee "Graphical User Interface Using Transparent Windows", European Patent Applcation 95303142.4, Pub No 0684542A1, Novembeer 29, 1995
User interface, set windows to tranparent so that user can see the information they have selected.

[Ishigaki94] ( * )Ishigaki, Kawasaki Kazushi "Handwriting Entry Processing System Using Keyboard and Mouse Interfaces Requiring No Modification of an Application Program", United States Patent 5,361,310, November 1, 1994
Handwriting recognition UI characters translated to keyboard input: no references to Sklarew/Linus or Ward/Pencept?

[IshiiH94a] ( * )Ishii, Hiroshi; Kobayashi, Minoru; and Arita, Kazuho "Iterative Design of Seamless Collaboration Media", CACM, Vol 37 No 8, August 1994, pp. 83-97
TeamWorkStation-1/ClearBoard: Whiteboard systems: Combined videoconference image in shared drawing space on workstation display. Using transparent display, other user appears in video on through transparent display, writing reversed. Cites to Media Space shared drawing space from 1988. "Transparent digitizer sheets" -- does not say what touchscreen technology used.

[JacobRJK94a] ( * )Jacob, Robert J.K.; Sibert, Linda E.; McFarlane, Daniel C.; and Mullen, M. Presont Jr. "Integrality and Separability of Input Devices", ACM Transactions on Computer-Human Interaction, Vol 1 No 1, March 1994, pp. 3-26
Describes mouse as absolute position device if not lifted from pad (sic), thus a three-dimensional digitizer is equivalent for two dimensions. Refers to device-independent API interfaces such as ACM CGS. But in practice, practical attributes of input devices are not separable from types of user interfaces and interactions.

[JanikCM94a] ( * )Janik, Craig M. "Flexible Wearable Computer", United States Patent 5,285,398, Feburary 8, 1994
Wearable computer, a PC (with standard PCMCIA cards, etc.) with components distributed in pockets in a "utility belt", cables/connectors for
users.erols.com/rwservices/pens/biblio95.html 21/55

02.11.13

(1994..1995) History of Pen and Gesture Computing

system bus etc. running through belt (or suspenders). Refers to foldable/portable input/output device for pen-based LCD (or keyboard/touchscreen).

[JohnsonGW94a] ( * )Johnson, Gary W. "LabVIEW Graphical Programming: Practical Applications in INstrumentation and Control", McGraw-Hill, INc. 1994
LabView graphical programming language for software simulation and control of virtual laboratory instruments, describing dataflow programming. Text refers to RUN switch in examples (p84/92). Introduction gives history of LabVIEW to 1986. User interface: notes that scroll bar on MacIntosh and Windows effectively halts asyncronous/multi-tasking operation.

[KabbashP94a] ( * )Kabbash, Paul; Buxton, William; and Sellen, Abigail "Tow-Handed Input in a Compound Task", Proc. CHI '94, Boston, Massachusetts, April 1994. pp. 417-423
Toolglass two-handed/bimanual user interface: non-dominant hand positions an object or tool, dominant hand uses or manipulates the object or tool.

[KajlerN95a] ( * )Kahler, Norbert and Soiffer, Neil "A Survey of User Interfaces for Computer Algebra Systems", J. symbolic Computation, Vol 11 no 1, 1995.
Survey of mathematical expression editing, mostly from a keyboard (and mouse?). Section 4.10 talks about pen computing user interfaces: twodimensional input is good, but large number of symbols used is problematic for handwriting recognition

[KanoS94a] ( * )Kano, Shigeru; Nakada, Yasuhiro; and Usuda, Yutaka "System for editing characters and graphics by pen point entry", UK Patent Application GB 2274186 A, July 13, 1994
User interface with touchscreen, electronic ink, gesture commands, and handwriting recognitions. System determines how to interpret user input based on context such as size relative to known characters, location of input on/over/awa-from existing ink or characters, whether the input document already exists, and relative priority of gestures.

[Kaplan94] ( * )Kaplan, Jerry "Startup: A Silicon Valley Adventure", Penguin Books, ISBN 0-395-71133-9, ISBN 0 14 02.5731.4, 1994
History of GO Corporation and PenPoint, experience with IBM and Microsoft, from point of view of CEO of GO. Compare to account of same events by Marlin Eller in "Barbarians led by Gates" about PenWindows. Additional materials in file: winster.com, etc.

[KasselRH95a]

( * )Kassel,

Robert Howard "A Comparison of Approaches


22/55

users.erols.com/rwservices/pens/biblio95.html

02.11.13

(1994..1995) History of Pen and Gesture Computing

to On-Line Handwritten Character Recognition", Ph.D. Thesis, Dept. of EECS, M.I.T., May 12, 1995
Study of testing handwriting recognition algorithms using some 87,000 characters from 150 writers. Supported by Microsoft Pen Computing Group: Greg Slyngstad and Sunh Rhee. (Cites variability models of Ward and Kuklinski, but does not derive implications about 97,000 being a small sample size.)

[KreegarJW95a] ( * )Kreegar, Jeffrey W. "Non-modal Method and Apparatus for Manipulating Graphical Objects", United States Patent 5,396,590, Mayrch 7, 1995
User interface to select objects using selection rectangle (objects may intersect edges), the selected a tool: Scale, Skew, Rotate, etc. Moving rotate tool changes/sets pivot/rotation point.

[KelleyAJ94a] ( * )Kelley, A.J. and Salcudean, S.E. "MagicMouse: Tactile and Kinesthetic Feedback in the Human-Computer Interface using an Electromagnetically Actuated Input/Output Device", Technical Report, Dept. of E.E., Univ. of Briish Columbia, October 19, 1993
Haptic mouse with force feedback, integrated with X windows. Electromagnetic actuator in mouse, feedback provided external to host CPU because control loop through host application too slow or too low in bandwidth. Turns mouse into absolute position device?

[Kempf94a] ( * )Kempf, James "HRE API: A Portable Handwriting Recognition Engine Interface", Available at http://playground.sun.com/pub/multimedia/handwriting/hre.html
Proposed API for handwriting recognition systems, using pen strokes optimized for point vectors in the X window system, but otherwise independent of OS or windowing system Incremental translation/recognition of handwriting support for context as for Japanese and Cursive English API for character prototype files and dictionaries Data structures for gestures and arbitrary objects Data structures correlations between recognized objects and pen strokes

[Kempf94b] ( * )Kempf, James "Preliminary Handwriting Recognition Engine Application Program Interface for Solaris 2", Available at http://playground.sun.com/pub/multimedia/handwriting/hre.html [Kim94] ( * )Kim, Joonki; Teibman, George J.; and Tappert, Charles C. "Method and Apparatus for Improving Prototypes of Similar Characters in On-line Handwriting Recognition", United States Patent 5,285,505, February 8, 1994.
users.erols.com/rwservices/pens/biblio95.html 23/55

02.11.13

(1994..1995) History of Pen and Gesture Computing

Averaging out the prototypes in adaptive handwriting recognition system

[KingmanJA95a] ( * )Kingman, John A.; Larky, Steven P.; and Vanover, Michael T. "Window specific control of overlay planes in a graphics display system", United States Patent 5,469,541, November 21, 1995
Transparent overlay windows in a user interface

[KnabeK95a] ( * )Knabe, Kevin "Apple Guide: A Case Study in User-Aided Deisng of Online Help", Proc. of CHI '95, Short Papers
On-line help, with hypertext linking and search for related topics by text

[KnappAG94a] ( * )Knapp, Alan G. "Fingerprint sensing device and recognition system having predetermined electrode activation", United States Patent 5,325,442, June 28, 1994
Capacitive grid/matrix of conductors used for touchpad sensor for fingerprint scanning. Compare to grid arrangement of Rekimoto.

[KnowltonKC94a] ( * )Knowlton, Kenneth C. "Computer Apparatus and Method for Graphical Flip Book", United States Patent 5,283,864, February 1, 1994
Simulation of indexed flip book / rollodex in Wang Freestyle, with small edges of pages shown.

[KodoskyJL94a] ( * )Kodosky, Jeffrey L, Truchard, James J.; and MacCrisken, John E. "Graphical Method for Programming a Virtual Instrument", United States Patent 5,301,336, April 5, 1994
Feature in LabView visual programming language for virtual laboratory instruments. Fig. 5 , text page 70 refers to slide switch: compare to Apple slide-to-unlock?

[KontarinisDA95a] ( * )Kontarinis, Dimitrios A. and Howe, Robert D. "Tactile Display of Vibratory Information in Teleoperation and Virtual Environments", Presence: Teleoperators and Virtual Environments, vol. 4 no. 4, pp. 387-402, 1995
Vibration haptic feedback on remote-manipulation display, combined with/without force feedback. Illustration is two finger "waldos" to prevent user pressing too hard.

[KunoY95a] ( * )Kuno, Yoshinori; Tanabe, Noboru; and Hasebe, Koichi "Portable display device with at least two display screens controllable collectively or separately", United States Patent 5,467,102, November 14, 1995
Dual-display device, two displays can be used as one (two pages of a book), or used separately. Compare with devices like Reefalo? Uses term "electronic pen" for touchscreen. May be used as add-on display to desktop
users.erols.com/rwservices/pens/biblio95.html 24/55

02.11.13

(1994..1995) History of Pen and Gesture Computing

computer. Thumbnails of document pages on one display, full page on other. Can display virtual keyboard on one display or portion.

[Kurtenbach94] ( * )Kurtenbach, G.; Moran, T.P.; and Buxton, W. "Contextual Animation of Gestural Commands", Computer Graphics Forum, Volume 13 (1994), Number 5 pp 305-314.
Use of pop-up radial menus to train users to "gestures" which match the motion used to select from a radial menu. Also display of images of gestures in menus, and pop-up text giving name/meaning of gesture recognized. Circle/lasso gesture around an object brings up a pop-up menu of actions that may be applied to the object. Also shows pig-tail gesture for delete/erase, scroll-up and scroll-down (flick?), lasso gesture for select. Gestures may be recognized using velocity: e.g. Slow flick moves to next page, fast flick to end of document. press-and-hold/"pressing and waiting"

[Kurtenbach94b] ( * )Kurtenbach, G.; and Buxton, W. "User Learning and Performance with Marking Menus", Proc. CHI '94, pp. 258-265
Marking menus on MacIntosh/Apple. (pop-up pie menus when user hold stylus still, selectedable without first lifting pen). Zig-zag gestures for navigation. press-and-hold / press-and-wait for 0.3 second.

[KusumotoH94a] ( * )Kusumoto, Hiroki and Hasuhara, Hiroshi "Image drawing apparatus for displaying input image on display means", Unite States Patent 5,311,207, May 10, 1994
Pressure sensitive tablet digitizer using two conductive sheets and conductive rubber

[LaLomia94] ( * )LaLomia, Mary "User acceptance of handwritten recognition accuracy", Conference on Human Factors in Computing System, Boston, Massachusetts, 1994, pp 107-108.
Cited along with Neisser (93% recognition success for humans without context), that users not satisfied with 97% correct character-to-character handwriting recognition success.

[LambAC94a] ( * )Lamb, Arthur C. Jr. "Pop-up Keyboard System for entering Handwritten Data into Computer Generated forms", United States Patent 5,276,794, January 4, 1994
pop-up virtual keyboard in GridPad computer, in a particular form application. Compare to Soft input panel SIP?

[LandmeierWL95a] ( * )Landmeier, Waldo L. "See-through Digitizer with Clear conductive Grid", United States Patent 5,381,160, January 10, 1995
Front-mounted electromagnetic digitizer (CalComp) with a display: gives
users.erols.com/rwservices/pens/biblio95.html 25/55

02.11.13

(1994..1995) History of Pen and Gesture Computing

long description of Scriptel front-mounted electrostatic display, discussion of problems of rear mounting. Uses term "pen-driven computing". Two layers of grid are fabricated on two layers of transparent mylar.

[LeeJ94] ( * )Lee, Jack "Pen-based form computer", United States Patent 5,347,477, September 13, 1994
Forms-based inputing gestures to control recognition, insert, delete scroll -compare with GO Refers to smoothing (and averaging?) to obtain the non-distortion point on stylus input filtering?

[LeedhamCD94] .Leedham, C.G. "Historical perspectives of handwriting recognition systems", IEEE Colloquium on Handwriting and Pen-Based Input, 1994, pp 1..13.
Abstract only: history of handwriting recognition (?) back to 1950's.

[Lexicus95] ( * )Lexicus "Lexicus' Cursive Recognition", Byte Magazine, June 1995: available at http://www.byte.com/arg/9506/img/501026j0.htm
Lexicus neural network handwriting cursive recogition: 25,000-word dictionary and statistical methods (compare with Viterbi algorithm?)

[LiebermanH94a] ( * )Lieberman, Henry "Power of Ten Thousand: Navigating in Large Information Spaces", Proc. UIST '94, November 2..4, 1994, pp. 15-16
When zooming on graphical image/map, show birds-eye or world or greater context view as translucent overlay on window, so that user can maintain visual context. Zooming on file system heirarchy zooms into files, without explicit opening of file. Cites to Bier for "see-through" interface (transparent pixels instead of translucent overlay).

[LoganJD94a] ( * )Logan, James D. and Evans, Blair "System and Method for Emulating A Mouse Input Devices with a Touchpad Input Device", United States Patent 5,327,161, July 5, 1994
Microtouch touchpad digitizer: press-and-drag distance is a minimum distance threshold before user input does drag automatically by simulating mouse button action. Dwell/press-and-hold for minimum distance threshold.

[LoprestiD94a] ( * )Lopresti, Daniel P. and Tomkins, Andrew "On the Searchability of Electronic Ink", 4th International Workshop on Friontiers in Handwriting Recognition, Taipei, Taiwan, December 1994
Avoid need for handwriting recognition when indexing documents by approximate matching of hand-drawn pictograms. Mentions difficulty of handwriting recognition of (Asian) languages. Compare with Slate DayTimer/PenScheduler for ink indexing, Windows for Pens NoteTaker.
users.erols.com/rwservices/pens/biblio95.html 26/55

02.11.13

(1994..1995) History of Pen and Gesture Computing

[Lopresti95] ( * )Lopresti, Daniel P.; Aref, W.G.; Kamel, I. "On handling Electronic Ink", ACM Computing Surveys, vol 27, no 4, December 1995, pp. 564..567
Searchability of electronic ink; approximate matching of hand-drawn pictograms, not just comparing with character recognition results to index handwritten text

[LouieJ95] ( * )Louie, Jim "An Analysis of a Pen-Based Tool for Acquiring Engineering Design Information", Master's Thesis, University of Toronto, 1995
Review of pen-based computer (PenPoint) with applications for engineering: notetaking, engineering design. Applications written in Slate PenApps. Generally, paper fared better than electronic notebook, in part because notebook was not perfect writing surface and was a bit small (6" by 9"). Notes that engineers dislike doing documentation, in part because words are not the natural medium of expression -- diagrams/sketches are preferred. Cites several other electronic/virtual notebook systems, but most not portable.

[LowreyG94a] ( * )Lowrey, Gwen "Managing Projects with Microsoft Project 4.0", John Wiley & Sons, Inc., 1994
Project planning/project management application. Tasks, Milestones, assignment of resources and personnel, project tracking. Supports critical path method CPM. Views include PERT charts, Gantt charts, Detail charts, Calendar views.

[LucenteM95a] ( * )Lucente, Mark and Galyean, Tinsley A. "Rendering Interactive Holographic Images", Proc. SIGGRAPH 95, Los Angeles, Aug. 6-11, 1995, pp. 387-394
Computational rendering and display of holographic (stereo vision: full 3D possible) images in "patient" real-time (2 seconds). Uses interometer grids. Can also render a real-world scene captured from a linear array of cameras.

[LucenteSAM95a] ( * )Lucente, Samuel A.M.; Balasubramanian, Peruvemba S.; Sapper, Richard F.; and Lee, Nathan J. "Rotatable penbased computer", United States Patent 5,432,720, July 11, 1995
Pen computer can be rotated so that screen orientation is portrait or landscape, for right-handed or left-handed user. Mechanical button to select orientation.

[LuciwWW95a] ( * )Luciw, William W; Capps, Stephen; and Tesler, Lawrence G. "Method and apparatus for deducing user intent and providing computer implemented services", United States Patent
users.erols.com/rwservices/pens/biblio95.html 27/55

02.11.13

(1994..1995) History of Pen and Gesture Computing

5,390,281, February 14, 1995


Determine user intent by applying a pattern template to user interactions in a pen user interface, and then carry out an operation automatically. Also check Capps file

[MagicLink94a] ( * )Sony "Video: Magic Link Sony PDA PIC-1000 running Magic Cap OS (General Magic)", Sony circa 1994: Video fetched from YouTube 2011
Shows pen/stylus based PDA with office desk / office room and hallway metaphor. Appears to be a resistive touchscreen, looks like it might be a Data Rover 840.

[MarcusA95a] ( * )Marcus, Aaron; Smilonich, Nick; and Thompson, Lynne "The Cross-GUI Handbook For Multiplatform User Interface Design", Addison-Wesleyy/Unisys, 1995
GUI frameworks comparisons: Macintosh Desktop, OSF/Motif Desktop (with three-button mouse operations BSelect, BTransfer, BMenu right button), NeXTSTEP Desktop, IBM CUA Workplace Shell, Microsoft Windows Desktop Environment. Does not cover PenPoint, page 191-ff covers Microsft Pen Windows extensions: press-hold-drag is a selection operation, PenWindows 1.0 gestures Extende Backspace, etc. Direct manipulation. Pop-up menus on page 34 and 202. Describes drag-and-drop and pop-up menus as OOUI, object-oriented user interface, not GUI.

[MartinD95] ( * )Martin, David A. "Interactive Display System", United States Patent 5,448,263, September 5, 1995
Projection whiteboard system with LCD project panel, overhead projector, digitizer. See other references to MartinD. Describes alignment/calibration method for display and projection vs. tablet, similar to that of PenCept/CIC/etc. for paper versus tablet.

[MartinT95a] ( * )Martin, Teresa A. "The Tablet Newspaper: A Vision for the Future", Proc CHI '95 "Mosaic of Creativity", Video presentation, May 7..11, 1995, p. 425
Knight-Ridder Information Design Lab: electronic newspaper on a pen computer, with pen/touch user interface

[Maryland95] ( * )Maryland, Universtify of at College Park "DOCBIB through 1994: Document Understanding Blibliography", http://documents/cfar.umd.edu/biblio/DOCBIBpre95.ps
Bibliography of papers relating to document understanding, starting about 1980. Sections include: On-line character recognition; Gestures and Sketches; Script; Foreign optical character recognition; Recognition of
users.erols.com/rwservices/pens/biblio95.html 28/55

02.11.13

(1994..1995) History of Pen and Gesture Computing

mathematics and Formulas; Line drawings; Signature verification; Writer Identification; Synthetic data; Forms processing; Shorthand; Music recognition

[MasuiT95a] ( * )Masui, Toshiyuki; Kashiwagi, Kouichi; and Borden, George R. IV "Elastic Graphical Interfaces for Precise Data Manipulation", Proc. CHI '95, May 7-11, 1995, pp. 143-144
scollbar slider: user can control speed of scrolling (for finger control) based on pulling a virtual elastic line farther or less (or changing direction of pull). Cites to AlphaSlider. Note: cited in at least one scroll/bounce patent by Apple.

[MaulsbyD94a] ( * )Maulsby, David "Instructible Agents", Ph.D. Thesis, Univ. of Calbary, Canada, June 1994
(partial copy) Chapter 5: Interactive learning / Concept learning system Cima, Turvy, and Moctec. Example is teaching system to find phone numbers in notes, in different contexts and in various canonical forms, and second component that learn so intract with users and application programs, (dialing numbers)

[McKeehan94] ( * )McKeehan, Julie and Rhodes, Neil "Programming for the Newton: Software Development with NewtonScript", AP Professional Press, division of Academic Press, 1994, ISBN 0-12-484800-1
Newtonscript Language

[McQueenJC95a] ( * )McQueen, J. Craig; MacKenzie, I. Scott; and Zhang, Shawn X. "An Extended Study of Numeric Entry on Pen-based Computers", Proc. of Graphics Interface '95, Toronto, pp. 215-222
Pie-pad pop-up menu for numeric input, pop-up circular menu with digits. Marking menus. Mentions Goldberg 93 paper on unistroke.

[MeyerA95] ( * )Meyer, Andre "Special Feature: Pen Computing - A Technology Overview and a Vision", ACM SIGCHI Bulletin, July 1995. Also available at http://www.amug.org/amug/sigs/newton/nanug/PenReport/References.html
Includes reviews of several experimental systems of the early 1990's, and a lengthy bibliography: several German references included. Almost all the references are from 1991 to 1995, very little before that. Unistrokes. Jotted notes: implying electronic ink as a data type. PenPoint, Windows for Pen Computing. Cites Alan Kay for early visition of handwriting computer (although no such device was ever built?). Cites early paper by Ward, but not the on-line bibliography (1995). Rotatable orientation of pen computers: landscape/portrait.
users.erols.com/rwservices/pens/biblio95.html 29/55

02.11.13

(1994..1995) History of Pen and Gesture Computing

[Microsoft94a] ( * )Microsoft "Tap and Tap-and-Hold Pointer Events", Article 86921, formerly Q86921, support.microsoft.com: Microsoft Corporation, 1995, last reviewed January 9, 2003
Tap and hold (TapNHold) gesture: tap analogous to clicking left mouse button: TapNHold click tip of pen on tablet and holding for a specified amount of time. German edition of (discontinued) support article documents Windows for Pen Computing 1.0, prior to Windows95. Tap/press-and-hold on Pen Windows

[Microsoft94b] ( * )Microsoft "Information At Your Fingertips", Transcript of Bill Gate's Keynote Speech at Fall/COMDEX Nov. 14, 1994: from microsoft.com 2008
Windows for Pen Computing as portable information at your fingertips: reference "vision" video of Information at your Fingertip in 2005, with face-toface video in mobile settings, pen computing, video conferencing.

[Microsoft94c] ( * )Microsoft "Windows for Pen Computing User's Manual 1.0", User manual for Toshiba TC 200 80 pen computer with Pen Windows, 1994
Windows for Pen Computing version 1.0 user manual. Pen tools group includes Pen Pallete (soft input panel for writing/keyboard), on-screen virtual keyboard. Sample form has boxed handwriting input, unboxed input with timeout for word segementation.. Checkmark gesture to edit text (similar to PenPoint), pigtail gesture to delete, space-insert gesture with hotpoint. Tap and hold gesture (press-and-hold) to start selection stroke. Newline, copy (sideways pigtail), paste (inverted V), delete, delete word (right-leftcombined), extend, tab gestures. Cursor automatically turns to pen for handwriting input in application when cursor is in a text-input field. User-defined gestures are circled letter gestures. Trainable recognition (note that Toshiba unit ships with CIC recognition). Control panel settings for double-tap gesture time and area settings, press-and-hold delay. Press-and-hold is effectively a separate gesture recognized by distance threshold and time threshold: moving before time threshold starts a gesture or ink (with recognition). Handedness setting changes location of menus. Control panel rotate setting to switch orientation of display landscape/portrait. Notebook application: barrel button on pen to display ink eraser; deferred recognition: select ink (by tapping) then select text tool. Recognized text optionally sized according to ink dimensions. Shape recognition (circles, squares). Equations (= at end) automatically calculated; outline indexing of notes. Chart of recommended printing styles.
users.erols.com/rwservices/pens/biblio95.html 30/55

02.11.13

(1994..1995) History of Pen and Gesture Computing

[Microsoft94d] ( * )Microsoft "Accessibility Products for Microsoft Windows and Microsoft Windows NT", "MS_ACCES.TXT", Microsoft, 1994
List of third-party accessbility extensions for Windows and Windows NT. Screen reader / screen review, screen enlarger, on-scrren keyboard / virtual keyboard. Vendors include Magic Deluxe / Microsystems Software, MAGNUM Deluxe / Artic Technologies, MagniPORT / Microsystems Software, Number Nine (hardware pan and zoom in display card), Vista / Telesensory Inc., Zoom Text / Ai Squared, JAWS, outSPOKEN . On-screen keyboards include word prediction, click or dwell mode / AutoClick. Screen Keyboard (SKB) in Windows for Pen Computing.

[Microsoft94e] ( * )Microsoft "Microsoft Windows "Chicago" Reviewer's Guide: Beta-1", Microsoft, 1994
Microsoft Pre-release feature description for Chicago / Windows95. Plugand-play, Toolbar (for cut-and-paste, etc.) in MS-DOS command window. Support for multiple pointing devices (mostly for accessibility: alternative head mouse, etc.). Nothing on SIP Soft Input Panel, PenWindows or tablets.

[Microsoft95a] ( * )Microsoft "The Windows Interface Guidelines - A Guide for Designing Software", Microsoft Corporation, Feb. 1995
UI guidelines include keyboard, mouse, and Windows for Pen Computing / PenWindows gestures: General circle-around-UC-letter gestures, has circleM/M-circle pop-up "context menu gesture" / "pen menu gesture". Fundamental behaviors defined for a Pen are Pressing/Tapping/Doubletapping/Dragging. Gestures leave ink. Lasso-tap (circle-tap) selection gesture. Tap on text box brings up text-input handwriting window, with alternative word list or alternative character list from recognizer. Partial print copy in physical file -- see electronic copy at http://www.ics.uci.edu/~kobsa/courses/ICS104/coursenotes/Microsoft_WindowsGuidelines.pdf (fetched 2010) stylus or finger, pen can perform equivalent operations of mouse.

[Microsoft95b] ( * )Microsoft "WD: Known Issues Using "Windows 95 for Pen Computing"", support.microsoft.com, article Q164505 / 164505, last Review November 5, 2000 (1995)
Defect in tablet/pen driver in Windows for Pen Computing: circle-m context menu gesture does not emulate right mouse button, other problems with barrel button on stylus

[Microsoft95c] ( * )Microsoft "The Windows Interface Guidelines for Software Design", Microsoft Corporation, 1995
Similar topic to Microsoft95a -- includes section on special design
users.erols.com/rwservices/pens/biblio95.html 31/55

02.11.13

(1994..1995) History of Pen and Gesture Computing

considerations of Accessibility. Some sections on pen input. Guidelines on targeting of electronic ink to fields. Lasso-tap gesture to select. Need larger tapping (double-tapping) target with stylus than with mouse, similar considersations for targeting of lasso-tap selection gesture on text. Pen menu (context menu) gesture is circle-m. Describes activate-on-lift of mouse being applied for pen: "Do not activate the window unless the user releases the mouse button (the pen tip is lifted) in that window." Press-hold-drag for select instead of barrel button. Auto-scrolling based on velocity. Mentions accessibility "Screen Review Utilites" (screen readers) for the bling, onscreen keyboards. Pop-up/context menus synonymous: refers to contextual interfaces such as pop-up menus, property sheets, and OLE drag and drop. pop-up (context) menu handlers. Press-and-hold for select, p. 55. Partial print copy in physical file -- electronic image file.

[Microsoft95d] ( * )Microsoft "penwin.h Pen Windows functions, types, and definitions Version 1.0", Microsoft Corporation, 1995
#include definitions file for Windows for Pen Computing Version 1.0 -- 1992? Pen tablet data OEMPENINFO include pressure (force), height (proximity), angle X/Y and Z, barrel rotation. Standard gestures for clear, extendSelection, undo, copy, cut, paste, clearword, kkconfer; AnsiGestures (ASCII?) backspace, tab, return, space; application gestures circle a-Z and circle A-Z; shapes line, ellipse, rectangle, min and max See also penwin.h for version 2.0

[Microsoft95e] ( * )Microsoft "Accessibility Products for Microsoft Windows: On-Screen Keyboard Utilities", Microsoft Corporation, 1995
Accessbility on-screen visual/virtual keyboard systems for accessibility: compares to single-switch Morse code. Eek!; Microssytems Software HandiKey; My-T-Mouse; SAW Switch Access to Windows; SoftType; WiViK2 Windows Visual Keyboard; Features include word prediction, dwell-mode pointing, access grids, mouse emulators (head-mouse, etc.), keyboard macros See also similar Microsoft technical notes from other years

[MicroTouch95a] ( * )MicroTouch Systems Inc. "MicroTouch Touch Controllers References Guide, 1995", MicroTouch Systems Inc., Methuen Massachusetts
touchscreen/tablet/digitizer: mentions dual sensing of stylus/pen or finger or both, with positions of each.

[Mikan94] ( * )Mikan, Peter J. "Computer Mouse Simulator Device", United States Patent 5,376,946, December 27, 1994
Device to convert absolute co-ordinates of touchscreen to mouse relativemotion coordinates, and having "buttons" recognized on the touchpad for the
users.erols.com/rwservices/pens/biblio95.html 32/55

02.11.13

(1994..1995) History of Pen and Gesture Computing

mouse button: prior art include MicroTouch Unmouse cited 1990 Compare to Schumer patent on tablet controller, where driver functions are claimed if located in an external controller for a tablet (or mouse?)

[MinasM95a] ( * )Mina, M. and Viehstaedt, G. "DiaGen: A Generator for Diagram Editors Providing Direct Manipulation and Execution of Diagrams", Proc. of VL Visual Languages 95, Darmstadt, Germany
Sketch/diagram editor employing constraints, and dealing with inconsistent state during direct manipulation editing: flowchart, hypergraphs

[MinskyMDR95a] ( * )Minsky, Margaret Diane Rezvan "Computational Haptics: The Sandpaper System for Synthesizing Texture for a ForceFeedback Display", Ph.D. Disseration, M.I.T, June 1995
Force-feedback joystick, with multiple force actuators. Software to create feel of textures, virtual spring and inverse spring forces, etc. Includes reference manual for Sandpaper software.

[MoranTP95a] ( * )Moran, Thomas P.; Pedersen, Elin R.; McCall, Michael K.; and Halasz, Frank G. "Time-Space Object Containment for Graphical User Interface", United States Patent 5,404,430, April 4, 1995
When selecting objects by selecting a range (drag selection rectangle?), take into account time ordering of when objects were created: user is likely to want to select objects created by the user at about the same time. Uses a white board with rear projection.

[MoranTP95b] ( * )Moran, Thomas P.; Chiu, Patrick; van Melle, William; and Kurtenbach, Gordon "Implicit structures for pen-based systems within a freeform interaction paradigm", Proc. CHI '95, (preprint)
Whiteboard system (Xerox Live-Board Tivoli / MeetingBoard on Windows PC) with free-form interaction -- primarily electronic ink scribbling: recognized rough layout of lists, text, tables, and indented outlines in electronic ink, based on informal structure or "visual grammars". Mentions aha! InkWriter which formats/indexes ink based on handwriting recognition, but does not compare with van Raamsdonk which edits directly electronic ink. Selection via various bracket and corner gestures, insert via caret gesture. Has "table clean-up" function to align slanted writing lines of electronic ink.

[Mosaic95] ( * )Mosaic Input Technologies, Inc. "Gesture Mosaic User Guide", www.amtelcom.com/Mosaic/UserGuide.html
Simplified unistroke-like gestures, as substitute for writing full characters. User writes on a 12-segment outline of characters, outline in shape of figure eight, similar to seven-segment display. Punctuation and some other
users.erols.com/rwservices/pens/biblio95.html 33/55

02.11.13

(1994..1995) History of Pen and Gesture Computing

characters input via pop-up keyboard. For Apple Newton. (See also AlphaPad00)

[MossNN95a] ( * )Moss, Nicolas, N and Marianetti, Ronald II "Movement and Redimensioning of Computer Display Windows", United States Patent 5,434,964, July 18, 1995
Radius Inc. Display: rotating display between landscape and portrait orientation results in all windows being rotated, windows may also automatically layout GUI elements.

[Motif94a] ( * )X Window System, Open Source Edition "The Definitive Guides to the X Windows System, Vol. 6a: Motif Programming Manual for Motif 2.1, Open Source Edition", www.opencontent.org/openpub
Motif Window Manager: 1994 version, updated as of 2001. resource XmNsnapBackMultiple sets snap-back/bounce distance if use moves mouse cursor too far outside of bounds of scrollbar widget. Automatic Layout of GUI elements? XmNselectThrehold: click and drag minimum distance that pointer must move to select text on a drag.

[MyersBA94a] ( * )Myers, Brad A. "Challenges of HCI Design and Implementation", Interactions: ACM Trans. on Inf. Systems, Jan. 1994, pp. 73-84
in Garnet system papers: Prototyping user interfaces can be difficult, because test-subject users may not behave like real users, may even have a hidden agenda. Coupling of user-interface to application is a nightmare in maintainability. Shows dynamic menus.

[MyersBA94b] ( * )Myers, Brad A.; Guise, Daria A.; Mickish, Andrew; and Kosbie, David S. "Making Structured Graphics and Constraints Practical for Large-Scale Applications", Carnegie Mellon University Report CMUHCII-94-100
Garnet system: Contraint toolkit for UIMS, including object management in user interface

[MyersBA94c] ( * )Myers, Brad A.; Dario Giuse; Andrew Mickish, Brad Vander Zanden, David Kosbie, James A. Landay, Richard McDaniel, Rajan Parthasarathy, Matthew Goldberg, Roger B. Dannenberg, Philippe Marchal, Ed Pervin "The Garnet Reference Manuals: Revised for Version 3.0", Carnegie Mellon University Report CMU-CS-90-117-R5, December 1994
Garnet system: Contraint toolkit for UIMS, including object management in user interface

[MyersBA94d]

( * )Myers,

Brad A.; Giuse, Dario; Mickish, Andrew;


34/55

users.erols.com/rwservices/pens/biblio95.html

02.11.13

(1994..1995) History of Pen and Gesture Computing

Vander Zanden, Brad; Kosbie, David; McDaniel, Richard; Landay, James; Goldberg, Matthew; and Parthasarathy, Rajan "The Garnet User Interface Development Environment: Video Abstract", Proc. CHI '94, April 24-28, 1994, Boston, pp. 457-458
Garnet system: Direct manipulation user interface and IDE with Interactor objects for mouse, rotating, text editing, gesture recognition. Include Lapidary to create widgets or objects, Marquise tool to demonstrate/animate user interface behavior of applications

[MyersBA94e] ( * )Myers, Brad A. "User Interface Software Tools", CMU School of Computer Science, Technical Report CMU-CS-94-182, August 1994
Garnet system: supersedes CMU-CS-92-114. States gesture UIs used since 1970's in commercial CAD tools.

[MyersBA95a] ( * )Myers, Brad A. "User Interface Software Tools", ACM Trans. on Computer-Human Interaction, March 1995, Vol. 2 No. 1, pp 64103
in Garnet system papers: describes X-Windows lack of agreement on widgets, therefore Xt instrisics so support. 3-D GUI toolkits: Brown Animation Generation System, Silicon Graphic's Inventor toolkit. See also Myers 93 reference, same title.

[MysliwiecTA94a] ( * )Mysliwiec, Thomas A. "FingerMouse: A Freehand Computer Pointing Interface", Vision Interfaces and Systems Laboratory Technical Report VISLab-94-001, Univ. of Ill. at Chicago, October, 1994
FingerMouse: Hands-free/Glove-free pointing input: downward-looking cameras (stereo) recognizes pointing finger when held above keyboard. Shift key used for mouse click (one-button mouse). Concept originated with Francis K.H. Quek.

[NabeshimaS95a] ( * )Nabeshima, Shinji; Yamamoto, Shinichirou; Agusa, Kiyoshi; and Taguchi, Toshio "MEMO-PEN: A New Input Device", Proc. CHI '95, May 7-11, 1995 Denver CO, pp. 256-257
Optical pen stylus digitizer that takes CCD images of physical ink trail of pen near tip, whole image and writing dynamics cna be reconstructed from the sequences of images. 80% (40/50) success rate on reconstructing whole images. Difficulty reconstructing long straight lines. Stress sensor (force sensor) for detecting when writing. Sampling/data rate 10 snapshots/second. Compare with Anoto.

[NagaokaM95a] ( * )Nagaoka, Makoto and Sugiyama, Soka "Information Input Device", United States Patent 5,440,080, August 8, 1995
users.erols.com/rwservices/pens/biblio95.html 35/55

02.11.13

(1994..1995) History of Pen and Gesture Computing

Transparent X/Y digitizer/touchscreen using transparent electrode wires of ITO indium tin oxide. Stylus/pen uses a plastic film coating to get appropriate writing friction on a metal core stylus.

[NationalInstruments94a] ( * )National INstruments "LabVIEW Graphical Programming for Instrumentation: Student Edition (Software+Documentation)", National Instruments Corporation, 1994(?)
LabVIEW Graphical programming language and software for Windows 3.1: Date approximate. Contains Wells book.

[NeXT95a] ( * )NeXT Computer "The Project Builder Application", NeXT Computer, 1995
Part of NeXT Computer SDK. Overview of GUI tool for building/making applications. There may be an ealier version: this appears to be 3.X circa 1995. refers to bundles (which can be applications or collections of resources), and projects contained within other projects.

[NeXT95b] ( * )NeXT Computer "The Interface Builder Application", NeXT Computer, 1995
Part of NeXT Computer SDK. Overview of GUI tool for building GUI user interfaces. There may be an earlier version: this appears to be 3.X circa 1995. See also "Working with Interface Builder": build UI from palette of icons/views/components.

[NovakJL94a] ( * )Novak, James L. and Wiezer, James J. "Non-contact Capacitance Based Image Sensing Method and System", United States Patent 5,281,921, January 25, 1994
Electrostatic/mutual capacitance imaging proximity sensor for objects: single pair of electrodes to sense distance, pair of electrodes moved over object in a known plane (or otherwise)

[Panasonic94a] ( * )Panasonic "User's Guide CF-V21P Series Personal Computer", Matsushita Electric Industrial Company, 1994
Pen Computer for Windows for Pen Computing. Special VGA display drivers (for inking functionality?) for screen rotation at 0,90,180,270 degrees orientation.

[Paul95] ( * )Paul, Lauren Gibbons "Keeping secrets", Ziff-Davis Publishing Company, PC Week
Press report on trade-secret theft lawsuit between VMI and Autodesk, concerning Otto Berkes, later director of UMPC/Origami project at Microsoft

[PenComputing95a] ( * )Pen Computing Magazine "Gesture Mosaic: Newton Software Review", Pen Computing Magazine, Issue #6 August/September 1995
users.erols.com/rwservices/pens/biblio95.html 36/55

02.11.13

(1994..1995) History of Pen and Gesture Computing

Review of Mosaic Input, Zone-based handwriting recognition using figureeight overlay. Awkward to learn, vendor claims 40 words per minute input rate with practice.

[PenComputing95b] ( * )Pen Computing Magazine "IBM ThinkPad 730TE: Product Review", Pen Computing Magazine, Issue #7 November/December 1995
Pen tablet PC using Wacom digitizer. Mentions "Dynapad" by Alan Kay: Mistaken reference to Dynabook? Provided with choice of PenPoint, PenDOS, Pen for OS/2 Warp, PenRight!, or Windows for Pen Computing 1.0. Uses ThinkWrite handwriting recognition instead of Microsoft MARS recognizer. Windows has option in Control Panel to set screen orientation, but off-screen controls more suitable to portrait mode orientation.

[PenComputing95c] ( * )Pen Computing Magazine "Casio DT-9000 Product Review", Pen Computing Magazine, Issue #7 November/December 1995
Casio PDA: does not mention pen or handwriting input. "handy terminal" vendor description. Comparison with Panasonic JT-900PT. Includes printer.

[PenComputing95d] ( * )Pen Computing Magazine "Pen Computing and Windows 95", Pen Computing Magazine, Issue #7 November/December 1995
Windows for Pen Computing version 1.0 not easily upgradable to Windows 95 -- now refereed to as pen service Windows for Pen. Windows for Pen Computing development environment: Visual Basic with version 2.0 pen services penctrl.vbx updated to pen2ctrl.vbx.

[PenComputing95e] ( * )Pen Computing Magazine "Programming Visual Basic for Pen Input", Pen Computing Magazine, Issue #6 September 1995
Mentions HEDIT and BEDIT (boxed edit) handwriting input controls shipped with Visual Basic. Windows for Pen Computing development environment: Visual Basic with version VB3.0/Pro with provided HEDIT and BEDIT controls.

[PenComputing95f] ( * )Pen Computing Magazine "PenRight! for Windows", Pen Computing Magazine, Issue #5 June/July 1995
PenRight by Philip Shoemaker: MSDOS, MSDOS DPMI, and MSWindows pen-enabled platforms. Includes cross-platform support for Graffiti. Windows for Pen Computing development environment: PenRight! for Windows with integrated graphical environment, update to earlier PenRight! Pro SDK. Cross-platform to GEOS (MSDOS based), Casio Z-7000 and Tandy Zoomer
users.erols.com/rwservices/pens/biblio95.html 37/55

02.11.13

(1994..1995) History of Pen and Gesture Computing

PDAs. States that Palm Computing has a handwriting recognizer for MS Windows (Graffiti), but not shipping.

[PenComputing95g] ( * )Pen Computing Magazine "HOPE! Development Environment", Pen Computing Magazine, Issue #7 December 1995
HOPE! for porting applications from Visual Basic to a PDA that does not run Windows: emulated Windows user interface. Pen Computing development environment: supports Casio Z-7000 PDA and Casio PA100 pen computing products, which run GEOS OS.

[PenComputing95h] ( * )Pen Computing Magazine "First Look: Newton OS 2.0", Pen Computing Magazine, Issue #7 December 1995
Description of Newton OS NOS ("Dante") 2.0. Mentions selection and dragging of one icon, or of multiple icons. Feature also in Windows desktop?

[PenComputing95i] ( * )Pen Computing Magazine "Motorola Forte Mighty pen computer with tightly integrated wireless capabilities", Pen Computing Magazine, Issue #7 December 1995
Windows for Pen Computing with integrated wireless radio. Handwriting recognition by ART, or cursive recognition by Lexicus.

[PenPoint94a] ( * )PenPoint "Video: 1994 Demo 1 PenPoint for ATT/ EO", wanderbookman.com, posted September 25 2008 on Youtube.com (three parts)
1994 Video: Demonstration of PenPoint / EO unit. Youtube comments mention direct maniupation and gesture UI, also demonstration of convertible tablet computer before Microsoft did a convertible. Shows landscape mode versus portrait orientation/rotation

[PenWindows95a] ( * )PenWindows: Microsoft Corporation "Pen Computing and Windows 95", Pen Computing, Number 7, December 1995
Windows for Pen Computing version 1.0 versus version 2.0, boxed edit control, hedit handwriting edits Lisa Sampfli, PenFact Inc. in Boston Massachusetts

[PenWindows95b] ( * )PenWindows: Microsoft Corporation "Programmer's Guide to Pen Services for Microsoft Windows95", Microsoft Press, ISBN 1-55615-835-1
Gestures p. 61: Circle gestures with letter: Lasso: p. 481 shows list of circle gestures by shape, using mnemonic characters -- compare to "recognition macros" of PenCept; HPENDATA object holds chunks of electronic ink data, separate from mouse messages. WM_LBUTTONDOWN / IsPenEvent() / DoDefaultPenInput: electronic ink data is associated as extra data (HPENINFO) attached to a mouse event. Defines stroke pen data between
users.erols.com/rwservices/pens/biblio95.html 38/55

02.11.13

(1994..1995) History of Pen and Gesture Computing

two pen tip transitions, hence touching strokes and in-air/proximimity strokes. (What about out of proximity?) Context menu in bedit (boxed handwriting edit) controls. Single tap and double tap on character bring up a (context) menu/list of alternative characters/words. Page 41 portrait/landscape rotation of orientation mode

[PLDOS95] ( * )www.pldos.pl "PC Dos 2000 Details", www.pldos.pl/pcdos


General information on PC DOS and PenDOS: mentions "mouse emulation" in PenDos, separate from tablet/stylus driver: limited use of Gestures in penaware Mouse applications. (Web site partially in Polish)

[PierK94a] ( * )Pier, Ken and Landay, James A. "Issues for Proximate User Interfaces", Xerox PARC Technical Report, April 19, 1994, available via internet
User-interface for large surfaces needs UI without static-placed element (e.g. pull-down menus). Pop-up pie menus, hierarchical menus, pop-up handwriting recognition pads, gestures, vocal user interface. Problems studied in example of Xerox Liveobard whiteboard system. Cites pop-up menus to moveable menus of Wiseman, Xerox Alto 1976. PenPoint, GO, PenWindows, Momenta.

[Primax95a] ( * )Primax Electronics Ltd. "Primax DataPenPersonal Text Scanner, physical device", Primax Electronics Ltd.
DataPen hand-held text scanner. Functional, in original packaging. Compare with Anoto pen.

[Primax95b] .Primax Electronics Ltd. "DataPen User's Guide", Primax Electronics Ltd.
Cited in Arai 1997 paper for hand-held optical digitizer: appears to be a text scanner. No copy, file is alternative references.

[PiwetzC95a] ( * )Piwetz, Christian; Eiffert, Frank; Heck, Helmut; and Mueller-Clostermann, Bruno "An Adjustable User Interface Providing Transparent Access to Application Programs for the Physically Disabled", ACM SIGCAPH Newsletter, January 1995
Graphical/virtual/synthetic keyboard on-screen keyboard on Apple MacIntosh, usable with mouse without physical keyboard. Also includes predictive type-ahead. Main use is as accessiblity technology, combined with dwell-mouse for handicapped use.

[Poyner94] ( * )Poyner, Rick "Wintab Backgrounder", LCS/Telegraphics, Cambridge Massachusetts, 1994


Industry-standard driver from www.pointing.com/LCS-Telegraphics to allow
users.erols.com/rwservices/pens/biblio95.html 39/55

02.11.13

(1994..1995) History of Pen and Gesture Computing

all (DOS) applications to use pointing devices (mouse/tablet/touchscreen/joystick/etc.) interchangeably. Wintab/Windows/Pen Windows: mentions tablet sharing, multiple application accessing tablet at once with different services: different tablet context objects for different (concurrent) applications, tablet packets with data for a high report rate. Driver supports command-input area, WT_PACKET window messages. Wintab also mentioned in Windows95/W4PC/TabletPC documents. Also exists in version from about 2003 with minor updates from Wacom (see file)

[Psion94a] ( * )Psion Teklogix "Workabout Pro MC hand-held computer Quick Start Guide", Psion/Teklogix, 1994
Hand-held computer -- format is like hand-held terminal, running Windows CE, touchscreen used as mouse replacement.

[QuekF95a] ( * )Quek, F.; Mysliwiec, T.; and Zhao, M. "FingerMouse: A Freehand Pointing Interface", Proceedings of the International Workshop on Automatic Face- and Gesture-Recognition, Zurich, Switzerland, June 26-28, 1995, pp. 372-377. Also VISLab Report: VISLab-95-02
(Abstract only) Optical image detection of finger pointing instead of mouse, using color mapping for detection. Mouse click by tapping shift key on the keyboard. Pointing mode for finger tracking by recognizing "pointing gesture" of hand.

[Quinnell95] ( * )Quinnell, Richard A. "Cover Story: Touchscreen Technology", EDN Magazine, November 9, 1995. Available from http://www.end.com/archives
Technology review of touchscreens: flexible resistive film (a la Elographics), Capacitive, Capacitive zone, SAW surface acoustic wave or SAW guided acoustic wave, IR infra-red touchscreens, strain gauge. Refers to problems with capacitive touchscreens. Mentions that acoustic SAW screens can sense multi-touch more than one point of contact. Capacitive proximity sensing (Microtouch zones). Does not use the word tablet. Cites Scriptel/Symbios electrostatic tablet with proximity sensing. Describes fabrication expense of rear-mounted electromagnetic digitizers. Electronic ink in windows 95.

[RankinR94a] FAQ, 1994

( * )Rankin,

R. "Accessing the Internet by E-mail", UseNet

What it says: publics FTP servers on internet accessible by eMail.

[RedmayneDV94a] ( * )Redmayne, Derek Vincent "Extended Touch Screen", PCT Patent Application WO 94/22069, February 25, 1994
users.erols.com/rwservices/pens/biblio95.html 40/55

02.11.13

(1994..1995) History of Pen and Gesture Computing

Touchscreen sensor extends past edges of display for fixed buttons or keyboard. Touch sensor can be opaque on edges/margins. Compare with Wang Freestyle "The Guide"?

[RegisterDS95a] ( * )Register, David S. "Stylus Operable Computer with Wireless Keyboard in Storage Bay", United States Patent 5,440,502, August 8, 1995
Handheld computer with slide-out/detachable keyboard: Mentions Momenta

[RubinSM94] ( * )Rubin, Steven M. "Computer Aids for VLSI Design, Chapter 10: Human Engineering", Web reference at www.rulabinsky.com/cavd/text/chap10-6.html
Bibliography only: contains reference to Ledeen Recognizer in Newman/Sproull textbook, other interactive editors (without character recognition): Application GUI using Ledeen recognizer

[RuggedWare94a] ( * )RuggedWare " Using Pen on the Road: Apparel Version 2.0 Sales Automation Software", RuggedWare Ltd., Denver Colorado, 1994
Sales Automation application using Windows-based pen computer. Input into "letter guides", boxed character recognition input, makes distinction between character cells which are empty, and those which contain a space. Compare with Ward patent on simulated keyboard input using handwriting input.

[RusD94a] ( * )Rus, Daniela and Subramanian, Devika "Designing structure-based information agents", Report SS94-03-012, Working Notes of 1994 AAAI Spring Symposium on Software Agents, pp. 79-86
Automatic software agents recognize text, but also figures, tablet, paragraphs of interest, via detectors and add information links (actions).

[SachGM95a] ( * )Sach, Gary M., Bromage, Bruce K. and Purpura, Don F. "Touch Control Panel", United States Patent 5,398,045, March 14, 1995
Touch panel displaying different pop-up menus depending on where it is touched: entry is selected by separate button when desired item is displayed.

[SakamotoH95a] ( * )Sakamoto, Hiroyuki "Handwriting input apparatus for inputting handwritten data from unspecified direction", United States Patent 5,389,745, February 14, 1995
Rotatable handwriting input widget/panel so that user can write/input from various directions, separate from orientation of touchscreen display. Compare with SIP panel?

[SakamotoK94a]
users.erols.com/rwservices/pens/biblio95.html

( * )Sakamoto,

Kohichiro; Murashima, Yoshiyuki;


41/55

02.11.13

(1994..1995) History of Pen and Gesture Computing

Nishida, Hiroshi; and Shibata, Yukihiro "Data Processor with Rotatable Display", United States Patent 5,329,289, July 12, 1994
Display can be rotated to laterally elongated position (landscape mode) or vertically elongated (portrait mode), control unit sets display format for windows. Saves orientation information when turned off. Compare with Radius Technology, Masimo 93?

[SatoF95a] ( * )Sato, Fumitaka and Kishida, Ken "Data processing apparatus for editing image by using image conversion", United States Patent 5,428,721, June 27, 1995
Trapezoidal/rotational editing of part of a picture by defining four points of a trapezoid, and moving the four corners.

[SatohY95a] ( * )Satoh, Yasuhiro; Kiyosawa, Yoshiyaki; and Kimura, Yuichi "Pen Input Device", United States Patent 5,444,193, August 22, 1995
Optical mouse in pen/stylus form: light sensor in stylus, two colors of lights (or two filters), surface has grid of horizontal lines and vertical lines of different colors so that stylus/mouse can detet movement in X and Y by counting lines. States that can be used for writing (unlike mouse) because can detect movement in proximity, like many tablets.

[SaundE94a] ( * )Saund, Eric and Moran, Thomas P. "A PerceptuallySupported Sketch Editor", Proc. UIST '94 (preprint)
Parsing of informal structure in electronic ink sketching in an electronic blackboard (whiteboard) system.

[ScattolinP95a] ( * )Scattolin, Patrice "Recognition of Handwritten Numerals uising Elastic Matching", Master's Thesis, Concordia Universtity, Montreal Canada, November 1995
Elastic matching (see Tappert) applied to OCR of handwritten numerals, after thinning and line tracing.

[SchneidermanR94a] ( * )Schneiderman, Ron "Wireless Personal Communications: The Future of Talk", IEEE Press, 1994
Business tutorial on wireless, cellular, and other technologies: includes notes on EO/Hobbit pen computing, IBM Simon, PDAs with wireless communications

[Schomaker95] ( * )Schomaker, L., Nijtmans, J., Camurri, A., Lavagetto, F. Morasso, P., Benoit, C., Guiard-Marigny, T., Le Goff, B., RobertRibes, J., Adjoudani A., Defee, I., Muench, S., Hartung, K., Blauert, J. "A Taxonomy of Multimodal Interaction in the Human Information Processing System: A Report of the ESPRIT Project 8579, in "Multimodal Integration
users.erols.com/rwservices/pens/biblio95.html 42/55

02.11.13

(1994..1995) History of Pen and Gesture Computing

for Advanced Multimedia Interfaces" (MIAMI project)", http://hwr.nici.kun.nl/~miami/taxonomy/taxonomy.html


schomaker@nici.kun.nl: long bibliography of pen/handwriting input and other GUI technologies

[SchwarzPM94a] ( * )Schwarz, Peter M. and Shoens, Kurt A. "Managing Change int he Rufus System", Proc. 10th Intl' Conf on Data Engineering, IEEE, 1994, pp. 170-179
Rufus language: Indexing of document (for retrieval) by parsing for implicit or semantic structure in the document: d.g. Jimmy Carter in Title, rather than Author or mentioned in passing.

[Scriptel95a] ( * )Scriptel Corporation "WriteTouch: Digital Pen and Touch Technology Overview", Scriptel Corporation, 1995 (date approximate)
Electrostatic/capacitive digitizer with cordless stylus or finger touch: mentions shielding between LCD and sensor (front-mounted), greater optical transmissivity due to optical properties of ITO shielding compared to touchscreens. Cordless stylus requires battery. References Windows 95 with Pen Extensions (Pen Windows). Joint product with NCR? (Date approximate)

[Scriptel95b] ( * )Scriptel Corporation "Scriptel Digitizer for Pen-Based Computers", Scriptel Corporation, 1995 (date approximate)
Electrostatic/capacitive digitizer with cordless stylus or finger touch. Describes capacitive sheet digitzer as "non-contacting resistive digitizer". Has good simplified description of resistive sheet tablets, ratiometric / normalizing coordinates. (Date approximate)

[Sekendur95] ( * )Sekendur, Oral F. "Optical position determination", United States Patent 5,477,012, December 19, 1995
Optical digitizer on "smart paper", with a (passive) pattern printed on the paper -- Compare to Anoto technology. Appears to use a something similar to a circular barcode / ringcode: provenance not given, might be interesting to find. Digitizer tablet "smart paper" that puts a printed code on paper, position is read by optical sensor in the stylus tip. Compare with technology by Anoto et al. Shows circular barcode optical target, doubled 1d Barcode target, square matrix target for "smart paper" Two styli pictured, no parallax correction (?) to optitical image in optical digitizer

[SelkerEJ94a] ( * )Selker, Edwin Joseph "Tactile feedback mechanism for cursor control", European Patent Application 93120305.3, December 16, 1993
Haptic/tactile feedback to a mouse, joystick, or other pointing device based
users.erols.com/rwservices/pens/biblio95.html 43/55

02.11.13

(1994..1995) History of Pen and Gesture Computing

on storing the window handle or other information in the input device and generating the feedback locally: faster than basing it on the information sent to the host

[SerranoJA95a] ( * )Serrano, J. Artur "The Use of Semantic Constraints on Diagram Editors", Proc. of VL '95, September 1995, Aarmstadt, Germany
Semantic constraints may interfere during editing of diagrams / sketch editing / Visual languages, as editing may leave state inconsistent: proposes incremental validation of constraints.

[ShaferD94a] ( * )Shafer, Daniel G. "The Power of Prograph CPX", Prograph International, 1994
Prograph graphical programming language.

[Sharp95a] ( * )Sharp IQ-9200 PDA product information "Sharp.co.jp", Sharp IQ-9200 product information
Sharp IQ-9200 PDA, dates approximate (1995)? has full keyboard in clamshell design, touchscreen with stylus for sketch input.

[ShipmanFM95a] ( * )Shipmann, Frank M. III; Marshall, Catherine C; and Moran, Thomas P. "Finding and Using Implicit Structure in HomanOrganized Spatial Layouts of Information", Proc. CHI '95, pp. 346-353
"spatial parser" to attempt to recognize implicit structures in how people lay out information: example is paper notecards, organized as horizonal and vertical lists, stacks, composite (list with additional "title card"), heaps. Compare with visual languages and 2D/two-dimensional parsing of mathematical expressions.

[SiioI95a] ( * )Siio, Itiro "InfoBinder: A Pointing Device for a Virtual Desktop System", Proc. HIC '95, July 1995, pp. 261-264
In a Wellner-type optical/augmented desk / touchscreen, a tag with a button and an LED flasher. The LED position can be determined iin the camera image, the LED is modulated to send a recognizable ID, and the button can be used as user input. Used to tag physical objects so that they can have augmented virtual capabilities (e.g. tag on phone ties it to on-line dialer director).

[SilverbrookK95a] ( * )Silverbrook, Kia "Method and apparatus for providing transparency in an object based rasterized image", United States Patent 5,428,724, June 27, 1995
Using pixel data to render transparent/overlay images in windows and objects, according to Z level of the windos or objects.

[SinclairMJ95a]
users.erols.com/rwservices/pens/biblio95.html

( * )Sinclair,

Michael J. "Video based 3D tactile


44/55

02.11.13

(1994..1995) History of Pen and Gesture Computing

reconstruction input device having a deformable membrane", United States Patent 5,459,329, October 17, 1995
Touch sensor that makes 3D images of surfaces: rather than a thin sensor membrane, uses a tank or container filled with a liquid with a conformable membrane on top: pressed on an object, membrane with liquid conforms to shape of surface, video camera captues image of reflected light depending on angle of incidence with the (conformed) surface.

[Sklarew94a] ( * )Sklarew, Ralph "Handwritten Keyboardless Entry Computer System", United States Patent 5,297,216, assigned to AST Research, Inc., Irvine, California, March 22, 1994
Abstract refers to transparent sensing surface over display, electronik ink, character recognition, and learning mode Abstract reads almost identically to Sklarew patent 4,972,496: this one refers to "terminal disclaimer" Forms entry in handwriting recognition user interface, where a data-entry form field window pops up for entry, after entry of a pre-determined command using command/gesture symbols

[Sklarew94b] ( * )Sklarew, Ralph "Handwritten Keyboardless Entry Computer System", United States Patent 5,365,598, assigned to AST Research, Inc., Irvine, California, November 15, 1994
Abstract refers to transparent sensing surface over display, electronik ink, character recognition, and learning mode Abstract reads almost identically to Sklarew patent 4,972,496: this one refers to "terminal disclaimer" Sklarew/Grid very specific to resistive digitizer, no proximity sense (?)

[SmithAR95a] ( * )Smith, Alvy Ray "Image Compositing Fundamentals", Microsoft Research Technical Memo 4, August 15, 1995
Tutorial on pre-multiplied and not pre-multiplied alpha blending, producing a shaped image with partial transparencies. Treatment of "over" operator (transparency) in Porter paper of 1984. Alpha is a fourth value "transparency" or "opacity" in addition to RGB values. Discussion of pixels modeled as points, or as square windows to which an object may partially contribute by crossing part of the square.

[SmithAR95b] ( * )Smith, Alvy Ray "A Pixel is Not a Little Square and a Voxel is Not a Little Cube", Microsoft Research Technical Memo 6, July 17, 1995
A pixel is a point sample, not a square or rectangle. Must represent contribution of all graphics that are behind it: may be overlapping circle with region of adjacent pixels, or of broader nearby pixels for reconstruction of
users.erols.com/rwservices/pens/biblio95.html 45/55

02.11.13

(1994..1995) History of Pen and Gesture Computing

image. Argument applies also to scanning and printing. Should not refer to shape of pixels (e.g. rectangular, non-square) but to non-suqre/non-uniform spacing of pixels.

[SmithAR95c] ( * )Smith, Alvy Ray "Alpha and the History of Ditial Compositing", Microsoft Research Technical Memo 7, August 15, 1995
Alpha belnding: integral alpha, premultiplied alpha, digital printing, graphical compositing, matte / masking / matting. Traces history to analog-film compositing using a physical matte to combine images. History of bluescreen/green-screen matting, Petro Vlahos. Digital compositing an obvious simulation of known analog-film techniques, but digital matting (using alpha blending) not obvious.

[SmithRB95a] ( * )Smith, Randall B.; Maloney, John; and Ungar, David "The Self-4.0 User Interface: Manifesting a System-wide Vision of Concreteness, Uniformity, and Flexibility", Proc. OOPSLA '95, Austin Texas, 2005, pp. 47-60
Self-4.0 user interface: object-oriented programming originated in attempt to make software model real-world behaviors, need to apply those principles more closely. reification of layout constraints (automatic layout) for user interface, composition through embedding. Software can be modified while running. Slots for actions on an object. Graphical objects referred to as morphs. Cites to Visual Basic, but not to PenApps by Slate.

[SmithWR94a] ( * )Smith, Walter R. "The Newton Application Architecture", Proc. 39th IEEE Computer Society International Conf., Sanfrancisco 1994, pp 156-161
Description of Newton application and OS architecture: slots, packages, interpreted bytecodes, no separate address spaces for different applications. Describes Newton as simplified version of "Self", frames take place of Self objects. Defines View system (Smalltalk 80), and MacApp. Newton applications delivered in packages, containing parts dispatched to the appropriate part of the OS when installed: e.g. application part, font use by application, special communications driver. Pages in virtual memory are compressed, and decompressed when loaded. Picture from Newton Toolkit: cites MacApp for views.

[SmithWR94b] ( * )Smith, Walter R. "SELF and the Origins of NewtonScript", PIE Developers magazine, July 1994
Discussion of NewtonScript for the Newton pen-computing PDA, based on prototype-based inheritance language SELF. Note: NewtonScript adapted from SELF's "parent slots". Self based on SMALLTALK.
users.erols.com/rwservices/pens/biblio95.html 46/55

02.11.13

(1994..1995) History of Pen and Gesture Computing

[SmithWR95a] ( * )Smith, Walter R. "Using a Prototype-based Language for User Interface: The Newton Project's Experience", SIGPLAN Notices, Vol 30 No 10, Oct 1995, pp 61-72.
NewtonScript prototype-based language for Newton development: describes historical antecedants. Visual Pen development environment for Newton Toolkit: view system and collection of slots. Browser weak at supporting non-UI code, really just a "frame hierarchy" editor. Inheritance (packages?) inspired by HyperCard. Also cites to Bay-Wei Change, 1993, Smalltalk-80, Self

[SochaJ94] ( * )Socha, John and Hall, Devra "teach yourself ... Visual Basic 3.0", MIS Press, 1994
Tutorial on Visual Basic language and development environment

[SoftwareIndustryReport95] ( * )SoftwareIndustryReport "New cordless digtal pen product enables both pen and finger touch input", Software Industry Report, Millin Publishing, July 24, 1995. Available at www.allbusiness.com/technology
WriteTouch electrostatic/capacitive digitizer from Scriptel supports either finger or stylus input: can do multi-touch? Announcement of cordless electrostatic digital pen using Symbios Logic mixed signal design with Scriptel.

[Sony94a] ( * )Sony Corporation "Sony Magic Link PIC-1000 product information", Sony Corporation
References, Product information on Sony Magic Link PIC-1000 PDA "Personal Intelligent Communicator": hands-free cellphone option, touchscreen, but virtual keyboard only, no handwriting recognition. Magic Cap OS from General Magic.

[Sony94b] ( * )Sony Corporation "Sony Magic Link User's Guide PIC-1000 Personal Intelligent Communicator", Sony Corporation
Sony Magic Link PIC-1000 PDA "Personal Intelligent Communicator"

[SpeeterTH95a] ( * )Speeter, Thomas "Intelligent Work Surfaces", United States Patent 5,479,528, December 25, 1995
Force/touch touchpad sensors on desktop/tabletop, may be used to create virtual input devices (virtual keyboard, menu, tablet, etc.), sense location of physical objects (phicons?). Identify/authenticate user by forceimage/biometrics of palmprint, etc. Instrument/augment objects such as locks, floor.

[StahovichTF95a] ( * )Stahovich, Thomas F. "SketchIT: A Sketch Interpretation Tool for Conceptual Mechanical Design", Ph.D. thesis,
users.erols.com/rwservices/pens/biblio95.html 47/55

02.11.13

(1994..1995) History of Pen and Gesture Computing

Massachusetts Institute of Technology, Cambridge, Massachusetts, May 1995


Cited in Arvo00

[SteinRA94a] ( * )Stein, Robert A.; Logan, James D.; and Woringer, Charles A. "Position Sensing Computer Input Devices", United States Patent 5,365,461, Novembeer 15, 1994
Electrostatic resistive sheet touchscreen digitizer, can sense both a stylus by a particular signal and a finger touch by capacitance at the same time: e.g. write with stylus while selecting menu with finger. Gives formula for shift and scale correction/calibration, but not quadrilateral calibration correction. multi-touch capable?

[StoneMC94a] ( * )Stone, Maureen C.; Fishkin, Ken; and Bier, Eric A. "The Movable Filter as a User Interface Tool", Proc. CHI '94, pp. 306-312
Semi-transparent "filter" viewer window can be dragged over other objects to show further/other information. Example: definitions of words in text, type of whitespace, zoomed view, additional information on a map. Figures show transparent window over text.

[StoneMC95a] ( * )Stone, Maureen C. and DeRose, Anthony "Method for operating on objects in a first image using an object-based model data structure to produce a second contextual image", United States Patent 5,467,441, November 14, 1995
Semi-transparent "filter" viewer window has VOR "Viewing Operation Region", can be dragged over other objects to show further/other information. Example: definitions of words in text, type of whitespace, zoomed view, additional information on a map. Figures show transparent window over text.

[StoneMC95b] ( * )Stone, Maureen C.; Bier, Eric A.; Fishkin, Kenneth P.; and DeRose, Anthony "Method and apparatus for producing a composite second image in the spatial context of a first image", United States Patent 5,479,603, December 26, 1995
MagicLens: visual transformations of part of a lower window when a second window is over it. Gives the effect of the second window being a lens: e.g. shade the color, magnify, show hidden lines/wirefram, show streets on a map, etc.

[StoneTL94a] ( * )Stone, Thomas L. "Stylus switch status determination in a digitizer having a cordless stylus", United States Patent 5,369,227, November 29, 1994
Cordless digitizer pen, sense stylus buttons by button changing resonance
users.erols.com/rwservices/pens/biblio95.html 48/55

02.11.13

(1994..1995) History of Pen and Gesture Computing

frequency of stylus.

[StreitzNA94a] ( * )Streitz, Norbert A.; Geissler, Joerg; Haake, Joerg M.; and Hol, Jeroen "DOLPHIN: Local and Integrated Meeting Support across Remote Desktop Environments", Proc. ADM CSCW '94, October, 1994, Chapel Hill NC, pp. 345-358
Remote whiteboard touchscreen system combining LiveBoard and networked personal computers.

[TamaruH95a] ( * )Tamaru, Hideshi; Togawa, Kazuo; Sakano, Akio; and Yoshida, Kimiyoshi "Touch Panel Apparatus", United States Patent 5,414,413, May 9, 1995
Optical touchscreen, LED light emitters and photodetectors are arranged diagonally instead of X/Y. Light intensity reduced on corner emitters to reduce reflections.

[TapiaMA95a] ( * )Tapia, Mark A. and Kurtenbach, Gordon "Some Design Refinements and Principles on the Appearance and Behavior fo Marking Menus", Proc ACM UIST '95, pp. 189-195
Marking menus with stylus: animation feed back to user if mark (inadvertently) triggers a command gesture. Compare with press-and-hold, and stroke if do not wait.

[TaylorR95a] ( * )Taylor, Robert "Requirements and Availability of Application Programmer's Interfaces for Virtual-Reality Systems", UNC Technical Report TR95-009, April 1995
Re-mapping of UI events (mouse button clicks) to other application events (or system events). Compare to press-and-hold event mapping in later Windows version.

[Tognazinni94a] ( * )Tognazinni, Bruce "The "Starfire" Video Prototype Project: A Case History", Proc CHI '94, Boston Massachusetts, pp. 99105
Report on Starfire video project, showing speculative multi-touch user interfaces. Primary concerned with virtual video prototyping by means of "special effects" dramatized video production, which forces one to consider actual use cases in the course of building a shooting script for a film.

[Tognazinni95a] ( * )Tognazinni, Bruce "Tog on Software Design", Addison-Wesley, Pub. December 1995
Essays on user-interface design, mentions 1994 "Starfire" video speculating on future touch-input portable computers, including a demonstration of a multi-touch (bimanual/two-hand) zoom gesture. Discussion on handwriting only mentions Graffiti by Palm. On touchscreens, states that poor accuracy
users.erols.com/rwservices/pens/biblio95.html 49/55

02.11.13

(1994..1995) History of Pen and Gesture Computing

(or visual parallax) causes users to slow down in an attempt to be more accurate: speculates on fiber-optic coupling plate (?) to reduce visual parallax.

[Toshiba94a] ( * )Toshiba Corp. "Dynapad T200 Series Pen Computer User's Manual", Toshiba Corp., 1994
Hardware user's manual for Toshiba T200 and T200CS pen computers -mentions screen rotation, handwriting, etc. but does not name the operating system (PenPoint or Windows for Pen Computing).

[Toshiba95a] ( * )Toshiba Corp. "Toshiba T200 80 PenWindows 1.0, physical device", Toshiba Corp., 1995
Physical operational unit of Toshiba pen computer running Windows for Pen Computing 1.0 on top of MS/DOS 6.22. Photographs of screen rotation between landscape and portrait orientation, on-line gesture tutorials (with examples), Pen Palette pop-up handwriting bar for text entry, virtual keyboard in multiple configurations. SideKick 2.0. Base is Windows 3.1, with pen extensions.

[Toshiba95b] ( * )Toshiba Corp. "Toshiba T200 CS 80 PenWindows 1.0, physical device", Toshiba Corp., 1995
Similar unit to Toshiba T200 80 Pen Windows 1.0, but color screen (better contrast on physical deviceand in photographs)

[TowRF94a] ( * )Tow, Robert F. "Methods and Means for Embedding Machine Readable Digital Data in Halftone Images", United States Patent Patent 5,315,098, May 24, 1994
DataGlyphs: see other references. Compare to Anoto Shows square matrix optical target, with asymmetric halftone dot patterns in cells of a digital halftone image

[vanHulzenJA94] ( * )van Hulzen, J.A., Chair "Annual Report of De Stichting Computer algebra Nederland 1994", De Stichting Computer Algebra Nederland
Mentions papers and work direct manipulation / pen / stylus interfaces for mathematical input and editing.

[VenoliaD94a] ( * )Venolia, Dan and Neiberg, Forrest "T-Cube: A Fast, Self-Disclosing Pen-Based Alphabet", Proc. CHI94, April 1994, Boston, Massachusetts. pp. 265-270
Marking menu: get a pop-up of a rotary/pid menu with letters/characters, arranged concentrically in multiple rings, or set of characters is magnified in the direction you move the stylus from the center. Hand occlusion / obscuring of menu dealt with by showing pop-up menu at an offset from pen
users.erols.com/rwservices/pens/biblio95.html 50/55

02.11.13

(1994..1995) History of Pen and Gesture Computing

tip. Audio feedback (clicks) on the flick gestures at start and end. Visual feedback of selected character and idealized form of the flick gesture. Target can also be displayed continually, like a floating graphical keyboard.

[VogelL94a] ( * )Vogel, Les "Newton Program T-Cube submission", Internet posting 1994: available 2010 from welovegod.org/macos_files/macos_files/Sounds_of_Music/t-cube10.hqx.desc
Installation instructions for Apple T-Cube pie-menu (unistroke handwriting) text input.

[WantR95a] ( * )Want, Roy; Schilit, Bill N.; Adams, Norman I.; Gold, Rich; Petersen, Karin; Goldberg, David; Ellis, John R.; and Weiser, Mark "The PARCTAB Ubiquitous Computing Experiment", Xerox PARC Technical Report CSL-95-1, March 1995
ParcTab hand-held PDA with touchscreen and three physical buttons, designed to be held in the palm. Uses Unistroke character recognition, click/tap gestures on heirarichal menus. Tracks users by identifying location in office to a particular room via local infrared network. User can execute setup command to flip/rotate display by 180 degrees for left- or right-handed operation.

[WantR95b] ( * )Want, Roy; Schilit, Bill N.; Adams, Norman I.; Gold, Rich; Petersen, Karin; Goldberg, David; Ellis, John R.; and Weiser, Mark "An Overview of the ParcTab Ubiquitous Computing Experiment", Xerox PARC Technical Report CSL-95-1, March 1995
ParcTab hand-held PDA with touchscreen and three physical buttons, designed to be held in the palm. "Tab" refers to "small tablet computer" -touchscreen computer. Uses Unistroke character recognition, click/tap gestures on heirarchical menus. Tracks users by identifying location in office to a particular room via local infrared network. User can execute setup command to flip/rotate display by 180 degrees for left- or right-handed operation.

[WellandR94a] ( * )Welland, Robert; Seitz, Greg; Wang, Lieh-Wuu; Dyer, Landon; Harringotn, Tim; and Culbert, Daniel "The Newton Operating System", Proc. 1994 IEEE Computer Conference, San Francisco, 1994
Newton OS, much is on details of memory management Memory space is a single (large) linear address space but mapped in pages, protection among tasks: because not context mapping among multiple address spaces, thread/task switching is very fast, object IDs are just their linear address. (Novel at the time?) downloading of system updates, other software.
users.erols.com/rwservices/pens/biblio95.html 51/55

02.11.13

(1994..1995) History of Pen and Gesture Computing

[WellnerPD94a] ( * )Wellner, Pierre David "Interacting with Paper on the DigitalDesk", Univ. of Cambridge Technical Report UCAM-CL-TR-330, ISSN 1476-2986, March 1994
Mentions Freestyle, and asserts that people "like" paper compared to electronic documents. Cameras view paper desktop, read paper, also project images onto the desktop on top of the paper. Mostly a user-interface experiment in combining electronic simulation with real paper documents. Image subtraction and motion detection to locate hands etc. (Longish discussion of problem using a standard "C" image processing library from Modula, due to garbage collection).

[WellsLK94a] ( * )Wells, Lisa K. "LabVIEW Graphical Programming for Instrumentation: Student Edition User's Guide", National Instruments Corporation, 1994
LabVIEW Graphical programming language "G" for virtual instruments: has simulated mechanical action of boolean switches, both switching and latching (when pressed, when released, until released). Example of Global Switch.

[WexelblattA94a] ( * )Wexelblatt, Alan "A Feature-Based Approach to Continuous-Gesture Analysis", Master's Thesis, M.I.T. School of Architecture and Planning, Cambridge Massachusetts, June, 1994
About hand and body gestures of the form "put-that-there" gesticulation, rather than handwritten gestures as part of a computer GUI: refers in contrast to pen-based gestures with hand-held objects, instead of openhand gestures (topic of thesis)

[WexelblattA95a] ( * )Wexelblatt, Alan "Bibliography of Natural-Gesture Related Research", web.media.mit.edu/~wex/home-gesture.html


Bibliography of gesture recognition research: primarly about hand and body gestures of the form "put-that-there" gesticulation, rather than handwritten gestures as part of a computer GUI

[WexelblattA95b] ( * )Wexelblatt, Alan "Summary of CHI'95 "Gesture at the User Interface" Workshop", web.media.mit.edu/~wex/CHI95workshop-writeup.html
Panel discussion on gesture recognition research: primiarly about hand and body gestures of the form "put-that-there", rather than handwritten gestures as part of a computer GUI. Edward Altman, Jelle Coutax, Sidney Fels, Wen Gao, Nobuo Hataoka, Bernard Hibbits, Volker Kuehn, Christoph Maggioni, Axel Mulder, Polly Pook, Alan Wexelblatt.

[WexelblattA95c]
users.erols.com/rwservices/pens/biblio95.html

( * )Wexelblatt,

Alan "An Approach to Natural Gesture in


52/55

02.11.13

(1994..1995) History of Pen and Gesture Computing

virtual Environments", ACM Transactions on Computer-Human Interaction, Vol 2 No 3, 1995, pp. 179-200
Gesture recognition for natural gestures (whole body gesticulation, emptyhanded gestures/gesticulation), rather than pen-input gestures or handwriting recognition

[WhitakerRD95a] ( * )Whitaker, Randall D.; Longinow, Nicholas E.; and McNeese, Michael D. "Group Interfaces: A Profile and a Prototype", Interim Report AL/CF-TR-1995-0069, April 1995, Armstrong Laboratory, Air Force Material Command, Wirte-Patterson AFB, Ohio,
Multi-user information system, to use cordless pens, simultaneous tracking of multiple pens: 2..3 users enough in ptractice. Prototype uses resistive film with corded pen. Text handwriting recognition using CIC MacHandwriter. Wall mounting of prototype more awkward than original MacHandwriter hardware with desktop tablet. multi-touch with styli.

[WhittakerS94a] ( * )Whittaker, Steve; Hyland, Patrick; and Wiley, Myrtle "Filochat: Handwritten notes provide access to recorded conversations", Proc. CHI 94, pp. 271-277
Simultaneous voice and electronic ink / handwriting recording in portable device: indexing of handwritten notes to audio recording. Compare with Wang Freestyle (cited) and to Anoto SmartPen/LiveScribe (later).

[Wikipedia95a] ( * )en.Wikipedia.org "Dylan (programming language)", en.wikipedia.org/wiki/Dylan_programming_language: reference fetched in 2009


Competing language and IDE to NewtonScript for the Newton PDA: IDE released as technology release in 1995

[Wired94a] ( * )Wired Magazine: Steven Levy "Bill and Andy's Excellent Adventure II: General Magic", Wired Magazine, 1994. Available at wired.com
General Magic development of pen-based PDA/pocket digital communicator, using Telescript programing language to implement software agents. Compared to Apple Newton. Bill Atkinson, Andy Hertzfeld.

[WolfeA95] ( * )Wolfe, Andrew and Barrett, Gary L. "Touch Panel", United States Patent 5,438,168, August 1, 1995
Resistive film digitizer, voltage gradient. Correction for edge / pincushion distortion by using a variety of connectors at the edges, with resistance corrections on the connectors.

[Wroblewski94] ( * )Wroblewski, David A.; Hill, William C.; McCandless, Timothy P. "Computer Display Unit with Attribute Enhanced Scroll Bar",
users.erols.com/rwservices/pens/biblio95.html 53/55

02.11.13

(1994..1995) History of Pen and Gesture Computing

United States Patent 5,339,391, August 16, 1994


Scrollbar display highlight marks corresponding to where text had been found in a document. Compare with Russian patent to Gorvunov on the same feature.

[Xerox94a] ( * )Xero Corporation "The Xerox PARCTAB", Available from nano.xerox.com


Xerox PARCTAB palm-sized mobile computer / PDA, worn like a pager. Three function buttons and stylus user interface on display touchscreen.

[Zenith95a]

( * )Zenith

"Zenith CruisePad", Zenith Corp, 1991-1996

Integrated touchscreen/display device, connects wirelessly to Windows PC (Windows 95, Windows 3.1, PenWindows?). Image from billbuxton.com, 2012. Electronic file has additional references.

[ZettsJM95b] ( * )Zetts, John. M "Recognizing the Cessation of Motion of a Pointing Device on a Display by Comparing a Group of Signals to an Anchor Point", United States Patent 5,404,458, April 4, 1995
Recognize dwell/press-hold in stylus and distinguish between mouse / gesture / handwriting input mode: press-and-hold

[ZhaiS94a] ( * )Zhai, Shumin; Buxton, William; and Milgram, paul "The "Silk Cursor": Investigating transparency for 3D target acquisition", Proceedings of CHI '94, April 24-28, 1994, Boston, pp.458-464
Silk Cursor using "silk stocking" effect: partial transparency to simulate (noncontinuous) difference in depth instead of stereoscopic views.

[ZhaoR95] ( * )Zhao, R.; Kaufmann, H.J.; Kern, T.; and Mueller, W. "Penbased Interfaces for Engineering Environments", Proceedings of HCI 6th Human-Computer Interaction Internaltional, Tokyo, July 9-14. Elsevier
Handi: handsketch-based diagram editor in Express-G language, userdefined an pre-programmed unistroke gestures: one-stroke "T", circle, square, semicircle left/right gestures

[ZimmermanTG95a] ( * )Zimmerman, Thomas G.; Smith, Joshua R.; Paradiso, Joseph A.; Allport, David; Gershenfeld, Neil "Applying Electric Field Sensing to Human-Computer Interfaces", IEEE SIG CHI May 1995 (Preprint copy)
Human touch sensing on touchpad and other objects (furniture, location in room) using capacitance: field shunted to ground by human body, and field transmitted through conductive human body to stationay receivers. General remarks on capacitive sensing in general. Used to implement capacitive touchscreen ("finger-pointing mouse"). Can distinguish multiple persons (multi-touch)
users.erols.com/rwservices/pens/biblio95.html 54/55

02.11.13

(1994..1995) History of Pen and Gesture Computing

Main Reference Page

users.erols.com/rwservices/pens/biblio95.html

55/55

You might also like