Home
Patent Search
IMT Blog
REGISTER
|
SIGN IN
United States Patent Application
20020163544
Kind Code
A1
Baker, Bruce R. ; et al.
November 7, 2002
Computer device, method and article of manufacture for utilizing sequenced symbols to enable programmed application and commands
Abstract
A computer device, such as a mobile phone or PDA for example, is able to access an application program or command, based upon selection of corresponding sequences of symbols. Such symbols can be polysemous in nature and thus be associated with a plurality of different meanings depending upon other symbols sequenced therewith. By utilizing polysemous symbols, a relatively large number of sequences can be developed and associated with programs and/or commands of the computer device, with only a relatively small number of symbols displayed. In devices such as PDAs and mobile phone where display space is a premium, such access to commands and programs can be invaluable.
Inventors:
Baker; Bruce R.
(Pittsburgh, PA)
, Codol; Michael
(Wexford, PA
)
, McGrath; Thomas J.
(Pittsburgh, PA
)
, Conti; Robert V.
(Bethel Park, PA
)
, Cross; Russell T.
(Wooster, OH
)
, Hershberger; Dave H.
(Millersburg, OH
)
Correspondence Name and Address:
PO BOX 747
BIRCH STEWART KOLASCH & BIRCH
FALLS CHURCH
VA
22040-0747
US
Series Code:
797179
Filed:
March 2, 2001
U.S. Current Class:
345/835
U.S. Class at Publication:
345/835
Intern'l Class:
G06F 003/00
Claims
What is claimed is:
1. A method comprising: providing a plurality of polysemous symbols for selection; storing a plurality of sequences of the selectable polysemous symbols, each stored in association with an application program; and enabling one of the application programs in response to receiving selection of an associated polysemous symbol sequence.
2. The method of claim 1, wherein each stored sequence includes at least three symbols.
3. The method of claim 2, wherein the first symbol in each sequence corresponds to an application program category, the second symbol corresponds to a sub-category within the application program category of the first symbol, and the third symbol corresponds to an application program within the sub-category of the second symbol.
4. The method of claim 1, further comprising: displaying the plurality of polysemous symbols within an enabled application program; storing a plurality of sequences of the displayed polysemous symbols, each stored in association with a command; and executing one of the commands in response to receiving selection of an associated polysemous symbol sequence.
5. The method of claim 4, wherein the commands include navigation commands.
6. The method of claim 4, wherein the commands include intra-application commands for navigating within the enabled application program.
7. The method of claim 4, wherein the commands include inter-application commands for navigating between the enabled application program and another application program.
8. The method of claim 1, wherein the plurality of polysemous symbols are displayed as a virtual keyboard.
9. The method of claim 8, wherein the virtual keyboard occupies no more than 1/3 of a display screen.
10. The method of claim 8, wherein, upon receiving selection of a symbol, differentiating the display of valid polysemous symbols which occur as a next symbol in a stored sequence including selected symbol, from invalid polysemous symbols.
11. The method of claim 10, wherein valid symbols are highlighted.
12. The method of claim 10, wherein invalid symbols are darkened.
13. The method of claim 8, wherein the display of valid polysemous symbols, which occur as a first symbol in a stored sequence upon no symbols being selected and as a next symbol in a stored sequence upon selection of a previous symbol, is differentiated from invalid polysemous symbols.
14. The method of claim 13, wherein valid symbols are highlighted.
15. The method of claim 13, wherein invalid symbols are darkened.
16. The method of claim 1, further comprising: displaying each of a plurality of selected polysemous symbols, in sequence of selection.
17. The method of claim 1, wherein the plurality of polysemous symbols are provided in association with keys of a keypad.
18. The method of claim 1, wherein the storing step includes storing a polysemous symbol sequence in association with a macro, wherein the macro is enabled in response to receiving selection of the stored associated polysemous symbol sequence.
19. The method of claim 8, wherein the plurality of polysemous symbols are displayed in response to entering a symbol sequence mode.
20. The method of claim 1, wherein the method is used to enable application programs of a mobile telephone.
21. The method of claim 20, wherein selectable polysemous symbols are displayed prior to selection.
22. The method of claim 21, wherein an application program is displayed prior to selection of a selectable polysemous symbol that will complete an associated polysemous symbol sequence.
23. The method of claim 21, wherein selectable polysemous symbols are highlighted prior to selection.
24. The method of claim 20, wherein selectable polysemous symbols are highlighted prior to selection.
25. The method of claim 1, wherein, the method is used to enable application programs of a personal digital assistant.
26. The method of claim 1, wherein the method is used to enable application programs of a personal computer.
27. The method of claim 1, wherein the symbols are selectable using voice recognition.
28. The method of claim 23, further comprising: displaying each of a plurality of selected polysemous symbols, in sequence of selection.
29. The method of claim 8, wherein the symbols are selectable using voice recognition.
30. The method of claim 29, wherein the display of valid polysemous symbols, which occur as a first symbol in a stored sequence upon no symbols being selected and as a next symbol in a stored sequence upon selection of a previous symbol, is differentiated from invalid polysemous symbols.
31. The method of claim 30, wherein valid symbols are highlighted.
32. The method of claim 30, wherein invalid symbols are darkened.
33. The method of claim 1, wherein the application programs include a macros, with a polysemous symbol sequence being stored in association with the macro and with the macro being enabled in response to receiving selection of an associated polysemous symbol sequence.
34. The method of claim 1, wherein the application program is an existing previously stored program.
35. A method comprising: providing a plurality of polysemous symbols for selection; and storing a plurality of sequences of the selectable polysemous symbols, each stored in association with a command for execution; and executing one of the commands in response to selection of an associated polysemous symbol sequence.
36. The method of claim 35, wherein the polysemous symbols are displayed as a virtual keyboard.
37. The method of claim 35, wherein the commands include intra-application commands.
38. The method of claim 35, wherein the commands include navigation commands.
39. The method of claim 35, wherein each of the plurality of sequences include a sequence of at least two symbols.
40. The method of claim 35, wherein at least one sequence includes one symbol repeated a plurality of times.
41. The method of claim 36, wherein the polysemous symbols are displayed as a virtual keyboard on less than 1/3 of a display screen.
42. The method of claim 36, wherein the display of valid polysemous symbols, occurring as a first symbol in a sequence upon no symbols being selected and a next symbol in a sequence upon selection of a previous symbol, is differentiated from invalid polysemous symbols.
43. The method of claim 42, wherein valid symbols are highlighted.
44. The method of claim 42, wherein invalid symbols are darkened.
45. The method of claim 35, wherein the storing step includes storing a polysemous symbol sequence in association with a macro, wherein the macro is enabled in response to receiving selection of an associated polysemous symbol sequence.
46. The method of claim 36, wherein the virtual keyboard is displayed upon an application program being enabled.
47. The method of claim 45, wherein the commands include inter-application commands for operating between two application programs.
48. The method of claim 47, wherein the inter-application commands transfer information from one application program to another.
49. The method of claim 36, wherein the virtual keyboard is displayed in response to entering a symbol sequence mode.
50. The method of claim 46, wherein the display of valid polysemous symbols, occurring as a first symbol in a sequence upon no symbols being selected and a next symbol in a sequence upon selection of a previous symbol, is differentiated from invalid polysemous symbols.
51. The method of claim 50, wherein valid symbols are highlighted.
52. The method of claim 50, wherein invalid symbols are darkened.
53. The method of claim 36, wherein the virtual keyboard includes no more than two rows of polysemous symbols.
54. The method of claim 36, wherein the virtual keyboard includes no more than eighteen polysemous symbols.
55. The method of claim 35, wherein the method is used to execute commands on a mobile telephone.
56. The method of claim 55, wherein selectable polysemous symbols are displayed prior to selection.
57. The method of claim 56, wherein a command is displayed prior to selection of a selectable polysemous symbol that will complete an associated polysemous symbol sequence.
58. The method of claim 56, wherein the selected polysemous symbols are highlighted prior to selection.
59. The method of claim 55, wherein the selected polysemous symbols are highlighted prior to selection.
60. The method of claim 35, wherein the method is used to execute commands on a personal digital assistant.
61. The method of claim 35, wherein the method is used to execute commands on a personal computer.
62. The method of claim 35, wherein the symbols are selectable using voice recognition.
63. The method of claim 62, further comprising: displaying each of a plurality of selected polysemous symbols, in sequence of selection.
64. The method of claim 36, wherein the symbols are selectable using voice recognition.
65. The method of claim 64, wherein the display of valid polysemous symbols, which occur as a first symbol in a stored sequence upon no symbols being selected and as a next symbol in a stored sequence upon selection of a previous symbol, is differentiated from invalid polysemous symbols.
66. The method of claim 65, wherein valid symbols are highlighted.
67. The method of claim 65, wherein invalid symbols are darkened.
68. The method of claim 35, wherein the commands include a macro, with a polysemous symbol sequence being stored in association with the macro and with the macro being enabled in response to receiving selection of an associated polysemous symbol sequence.
69. The method of claim 35, wherein the command is an existing previously stored command.
70. An article of manufacture, comprising: a first code segment for causing a computer device to display a virtual keyboard including a plurality of polysemous symbols; a second code segment for causing the computer device to store a plurality of sequences of the displayed polysemous symbols, each stored in association with a command; and a third code segment for causing the computer device to execute a command in response to selection of an associated polysemous symbol sequence.
71. The article of manufacture of claim 70, further comprising a computer usable medium containing each of the first, second and third code segments.
72. The article of manufacture of claim 70, wherein the article of manufacture is a computer usable medium.
73. The article of manufacture of claim 70, wherein the commands include intra-application commands for navigating within an application program.
74. The article of manufacture of claim 70, wherein the commands include inter-application commands for navigating between two application programs.
75. The article of manufacture of claim 73, wherein the first code segment causes the computer device to display the virtual keyboard upon an application program being enabled.
76. The article of manufacture of claim 73, wherein the intra-application commands include navigation commands.
77. The article of manufacture of claim 70, wherein each of the plurality of sequences include a sequence of at least two symbols.
78. The article of manufacture of claim 70, wherein at least one sequence includes one symbol repeated a plurality of times.
79. The article of manufacture of claim 70, wherein the first code segment causes the computer device to display the virtual keyboard on less than 1/3 of the display screen.
80. The article of manufacture of claim 70, wherein the first code segment causes the computer device to display valid polysemous symbols, occurring as a first symbol in a sequence upon no symbol being selected and as a next symbol in a sequence upon selection of a previous symbol, differentiated from invalid polysemous symbols.
81. The article of manufacture of claim 80, wherein valid symbols are highlighted.
82. The article of manufacture of claim 80, wherein invalid symbols are darkened.
83. The article of manufacture of claim 74, wherein the first code segment causes the computer device to display the virtual keyboard upon an application program being enabled.
84. The article of manufacture of claim 74, wherein each of the plurality of sequences include a sequence of at least two symbols.
85. The article of manufacture of claim 70, wherein the computer device is a mobile telephone.
86. The article of manufacture of claim 70, wherein the computer device is a personal digital assistant.
87. The article of manufacture of claim 70, wherein the computer device is a personal computer.
88. The article of manufacture of claim 70, wherein selection of an associated polysemous symbol sequence occurs through voice recognition.
89. The article of manufacture of claim 74, wherein the commands include a macro, with the second code segment causing the computer device to store a polysemous symbol sequence in association with the macro and with the third code segment causing the computer device to execute the macro in response to selection of an associated symbol sequence.
90. The article of manufacture of claim 74, wherein the command is an existing prestored command.
91. An article of manufacture, comprising: a first code segment for causing a computer device to display a virtual keyboard including a plurality of polysemous symbols; a second code segment for causing the computer device to store a plurality of sequences of the displayed polysemous symbols, each stored in association with an application program; and a third code segment for causing the computer to enable one of the application programs in response to selection of an associated polysemous symbol sequence.
92. The article of manufacture of claim 91, further comprising a computer usable medium containing each of the first, second and third code segments.
93. The article of manufacture of claim 91, wherein the article of manufacture is a computer usable medium.
94. The article of manufacture of claim 91, wherein each of the plurality of sequences include a sequence of at least two symbols.
95. The article of manufacture of claim 91, wherein at least one sequence includes one symbol repeated a plurality of times.
96. The article of manufacture of claim 91, wherein the first code segment causes the computer device to display the virtual keyboard on less than 1/3 of the display screen.
97. The article of manufacture of claim 91, wherein the first code segment causes the computer device to display valid polysemous symbols, occurring as a first symbol in a sequence upon no symbol being selected and as a next symbol in a sequence upon selection of a previous symbol, differentiated from invalid polysemous symbols.
98. The article of manufacture of claim 91, wherein each stored sequence includes at least three symbols.
99. The article of manufacture of claim 98, wherein the first symbol in each sequence corresponds to an application program category, the second symbol corresponds to a sub-category within the application program category of the first symbol, and the third symbol corresponds to an application program within the sub-category of the second symbol.
100. The article of manufacture of claim 91, further comprising: a fourth code segment for causing the computer device to display the plurality of polysemous symbols within an accessed application program; a fifth code segment for causing the computer device to store a plurality of sequences of the displayed polysemous symbols, each stored in association with a command; and a sixth code segment for causing the computer to execute one of the commands in response to receiving selection of an associated polysemous symbol sequence.
101. The article of manufacture of claim 100, wherein the commands include navigation commands.
102. The article of manufacture of claim 100, wherein the commands include intra-application commands for navigating within the enabled application program.
103. The article of claim 92, wherein the commands include inter-application commands for navigating between the enabled application program and another application program.
104. The article of manufacture of claim 91, wherein the computer device is a mobile telephone.
105. The article of manufacture of claim 91, wherein the computer device is a personal digital assistant.
106. The article of manufacture of claim 91, wherein the computer device is a personal computer.
107. The article of manufacture of claim 91, wherein selection of an associated polysemous symbol sequence occurs through voice recognition.
108. The article of manufacture of claim 91, wherein the application programs include a macro, with the second code segment causing the computer device to store a polysemous symbol sequence in association with the macro and with the third code segment causing the computer device to execute the macro in response to selection of an associated symbol sequence.
109. The article of manufacture of claim 91, wherein the application program is an existing prestored application program.
110. A computer device, comprising: a keyboard, including keys associated with a plurality of polysemous symbols, adapted to provide symbol input; a memory, adapted to store a plurality of sequences of the polysemous symbols, each sequence stored in association with at least one of a program and a command; and a controller, adapted to execute at least one of a program and command in response to receiving input of an associated polysemous symbol sequence.
111. The computer device of claim 110, wherein the keyboard is a virtual keyboard.
112. The computer device of claim 110, further comprising a display, wherein the keyboard is displayed on the display.
113. The computer device of claim 110, further comprising an integrated input and display device, adapted to provide input and display, wherein the keyboard is displayed as a virtual keyboard on the integrated input and display device.
114. The computer device of claim 112, wherein the keyboard is displayed on less than 1/3 of the display.
115. The computer device of claim 113, wherein the keyboard is displayed on less than 1/3 of the integrated input and display device.
116. The computer device of claim 110, wherein the keyboard includes no more than two rows of polysemous symbols.
117. The computer device of claim 110, wherein the keyboard includes no more than eighteen polysemous symbols.
118. The computer device of claim 112, wherein the keyboard includes no more than two rows of polysemous symbols.
119. The computer device of claim 112, wherein the keyboard includes no more than eighteen polysemous symbols.
120. The computer device of claim 113, wherein the keyboard includes no more than two rows of polysemous symbols.
121. The computer device of claim 113, wherein the keyboard includes no more than eighteen polysemous symbols.
122. The computer device of claim 110, further comprising: a display, adapted to display input polysemous symbols.
123. The computer device of claim 122, wherein, upon inputting a sequence of polysemous symbols matching a stored sequence, the display displays both the polysemous symbol sequence and a name of the associated program or command.
124. The computer device of claim 110, wherein the computer device is a mobile phone.
125. The computer device of claim 124, wherein the selectable polysemous symbols are displayed prior to selection.
126. The computer device of claim 125, wherein a program or command is displayed prior to selection of a selectable polysemous symbol that will complete an associated polysemous symbol sequence.
127. The computer device of claim 125, wherein selectable polysemous symbols are highlighted prior to selection.
128. The computer device of claim 124, wherein selectable polysemous symbols are highlighted prior to selection.
129. The computer device of claim 110, wherein the computer device is a hand-held computer.
130. The computer device of claim 129, wherein the hand-held computer is a personal digital assistant (PDA).
131. The computer device of claim 110, wherein the computer device is a personal computer.
132. The computer device of claim 113, wherein each stored sequence includes at least two symbols.
133. The computer device of claim 110, wherein the commands include navigation commands.
134. The computer device of claim 110, wherein the commands include intra-application commands for navigating within an application program.
135. The computer device of claim 110, wherein the commands include inter-application commands for navigating between one application program and another application program.
136. The computer device of claim 112, wherein the controller is adapted to differentiate display of valid polysemous symbols, which occur as a first symbol in a stored sequence upon no symbols being input and as a next symbol in a sequence upon input of a previous symbol, from invalid polysemous symbols.
137. The computer device of claim 113, wherein the controller is adapted to differentiate display of valid polysemous symbols, which occur as a first symbol in a stored sequence upon no symbols being input and as a next symbol in a sequence upon input of a previous symbol, from invalid polysemous symbols.
138. The computer device of claim 136, wherein the controller is adapted to highlight displayed valid symbols.
139. The computer device of claim 137, wherein the controller is adapted to highlight displayed valid symbols.
140. The computer device of claim 136, wherein the controller is adapted to darken displayed invalid symbols.
141. The computer device of claim 137, wherein the controller is adapted to darken displayed invalid symbols.
142. The computer device of claim 110, wherein at least one stored sequence includes one symbol repeated a plurality of times.
143. The computer device of claim 112, wherein the keyboard is displayed on the display upon executing an application program.
144. The computer device of claim 113, wherein the keyboard is displayed on the display upon executing an application program.
145. The computer device of claim 112, wherein the keyboard is displayed on the display upon entering a symbol sequence mode.
146. The computer device of claim 113, wherein the keyboard is displayed on the display upon entering a symbol sequence mode.
147. The computer device of claim 110, wherein the memory is adapted to store a polysemous symbol sequence in association with a macro, and wherein the controller is adapted to execute the macro in response to receiving selection of an associated polysemous symbol sequence.
148. The computer device of claim 112, wherein the memory is adapted to store a polysemous symbol sequence in association with a macro, and wherein the controller is adapted to execute the macro in response to receiving selection of an associated polysemous symbol sequence.
149. The computer device of claim 113, wherein the memory is adapted to store a polysemous symbol sequence in association with a macro, and wherein the controller is adapted to execute the macro in response to receiving selection of an associated polysemous symbol sequence.
150. A method comprising: providing a plurality of polysemous symbols for selection; storing a plurality of sequences of the selectable polysemous symbols, each stored in association with a computer network command; and executing one of the computer network commands in response to receiving selection of an associated polysemous symbol sequence.
151. The method of claim 150, wherein the computer network commands include navigation commands.
152. The method of claim 150, wherein the computer network commands include hypertext links.
153. The method of claim 150, wherein the plurality of polysemous symbols are displayed as a virtual keyboard.
154. The method of claim 153, wherein upon receiving selection of a symbol, differentiating the display of valid polysemous symbols which occur as a next symbol in a stored sequence including selected symbol, from invalid polysemous symbols.
155. The method of claim 154, wherein valid symbols are highlighted.
156. The method of claim 154, wherein invalid symbols are darkened.
157. The method of claim 153, wherein the display of valid polysemous symbols, which occur as a first symbol in a stored sequence upon no symbols being selected and as a next symbol in a stored sequence upon selection of a previous symbol, is differentiated from invalid polysemous symbols.
158. The method of claim 157, wherein valid symbols are highlighted.
159. The method of 157, wherein invalid symbols are darkened.
160. The method of claim 150, further comprising: displaying each of a plurality of selected polysemous symbols, in sequence of selection.
161. The method of claim 150, wherein the plurality of polysemous symbols are provided in association with keys of a keypad.
162. The method of claim 150, wherein the storing step includes storing a polysemous symbol sequence in association with a macro, wherein the macro is enabled in response to receiving selection of the stored associated polysemous symbol sequence.
163. The method of claim 150, wherein the computer network commands include world wide web address links.
164. The method of claim 150, wherein the computer network commands include search engine links.
165. The method of claim 150, wherein the method is used to execute computer network commands from a mobile telephone.
166. The method of claim 150, wherein the method is used to execute computer network commands from a personal digital assistant.
167. The method of claim 150, wherein the method is used to execute computer network commands from a personal computer.
168. The method of claim 150, wherein the symbols are selectable using voice recognition.
169. An article of manufacture, comprising: a first code segment for causing a computer device to display a virtual keyboard including a plurality of polysemous symbols; a second code segment for causing the computer device to store a plurality of sequences of the displayed polysemous symbols, each stored in association with a computer network command; and a third code segment for causing the computer device to execute a computer network command in response to selection of an associated polysemous symbol sequence.
170. The article of manufacture of claim 169, further comprising a computer usable medium containing each of the first, second and third code segments.
171. The article of manufacture of claim 169, wherein the article of manufacture is a computer usable medium.
172. The article of manufacture of claim 169, wherein the computer network commands include navigation commands.
173. The article of manufacture of claim 169, wherein the computer network commands include hypertext links.
174. The article of manufacture of claim 169, wherein the computer network commands include world wide web address links.
175. The article of manufacture of claim 169, wherein the computer network commands include search engine links.
176. The article of manufacture of claim 169, wherein the first code segment causes the computer device to display the virtual keyboard.
177. The article of manufacture of claim 169, wherein the first code segment causes the computer device to display valid polysemous symbols, occurring as a first symbol in a sequence upon no symbol being selected and as a next symbol in a sequence upon selection of a previous symbol, differentiated from invalid polysemous symbols.
178. The article of manufacture of claim 177, wherein valid symbols are highlighted.
179. The article of manufacture of claim 177, wherein invalid symbols are darkened.
180. A computer device, comprising: a keyboard, including keys associated with a plurality of polysemous symbols, adapted to provide symbol input; a memory, adapted to store a plurality of sequences of the polysemous symbols, each sequence stored in association with a computer network command; and a controller, adapted to execute a computer network command in response to receiving input of an associated polysemous symbol sequence.
181. The computer device of claim 180, wherein the keyboard is a virtual keyboard.
182. The computer device of claim 180, further comprising an integrated input and display device, adapted to provide input and display, wherein the keyboard is displayed as a virtual keyboard on the integrated input and display device.
183. The computer device of claim 180, wherein the computer network commands include navigation commands.
184. The computer device of claim 180, wherein the computer network commands include hypertext links.
185. The computer device of claim 180, wherein the computer network commands include world wide web address links.
186. The computer device of claim 180, wherein the computer network commands include search engine links.
187. The computer device of claim 180, wherein the computer device is a mobile phone.
188. The computer device of claim 180, wherein the computer device is a hand-held computer.
189. The computer device of claim 180, wherein the computer device is a personal computer.
190. The computer device of claim 180, wherein the controller is adapted to differentiate display of valid polysemous symbols, which occur as a first symbol in a stored sequence upon no symbols being input and as a next symbol in a sequence upon input of a previous symbol, from invalid polysemous symbols.
191. The computer device of claim 190, wherein the controller is adapted to highlight displayed valid symbols.
192. The computer device of claim 190, wherein the controller is adapted to darken displayed invalid symbols.
193. A method comprising: providing a first set of symbols for selection; storing a plurality of sequences including the selectable symbols and additional symbols, each stored in association with a command; displaying a second set of symbols for selection in response to selection of a symbol of the first set; and executing a command in response to receiving selection of a second symbol completing an associated stored symbol sequence.
194. The method of claim 193, wherein the first set of symbols and the second set of symbols include symbols which have a single assigned meaning.
195. The method of claim 193, wherein the commands include computer commands.
196. The method of claim 193, wherein the first set of symbols are displayed as a virtual keyboard.
197. The method of claim 193, wherein the second set of symbols are displayed as a tool bar, in response to selection of a symbol of the first set.
198. The method of claim 197, wherein the first set of symbols are displayed as a virtual keyboard.
199. The method of claim 197, wherein the second set of symbols is dependent upon a selected symbol of the first set.
200. The method of claim 198, wherein the second set of symbols is dependent upon a selected symbol of the first set.
201. The method of claim 193, wherein the command is a macro.
202. The method of claim 193, wherein the method is used to execute commands on a mobile telephone.
203. The method of claim 193, wherein the method is used to execute commands on a hand-held computer.
204. The method of claim 193, wherein the method is used to execute commands on a personal computer.
205. The method of claim 193, wherein the symbols are selectable using voice recognition.
206. A computer device comprising: a keyboard, including keys associated with a first set of symbols for selection, adapted to provide symbol selection; a memory, adapted to store a plurality of sequences including the selectable symbols and additional symbols, each stored in association with a command; and a controller, adapted to control display of a second set of symbols for selection in response to selection of a symbol of the first set, and adapted to execute a command in response to receiving selection of a second symbol completing an associated stored symbol sequence.
207. The computer device of claim 206, wherein the first set of symbols and the second set of symbols include symbols which have a single assigned meaning.
208. The computer device of claim 206, wherein the commands include computer commands.
209. The computer device of claim 206, further comprising: a display, wherein the display displays the first set of symbols as a virtual keyboard.
210. The computer device of claim 209, wherein the display further displays the second set of symbols as a tool bar, in response to selection of a symbol of the first set.
211. The computer device of claim 206, wherein the second set of symbols is dependent upon a selected symbol of the first set.
212. The computer device of claim 206, wherein the command is a macro.
213. The computer device of claim 206, wherein the computer device is a mobile phone.
214. The computer device of claim 206, wherein the computer device is a hand-held computer.
215. The computer device of claim 206, wherein the computer device is a personal computer.
216. The computer device of claim 206, wherein the symbols are selectable using voice recognition.
217. A method comprising: storing a plurality of polysemous symbols for selection via voice input, each symbol being stored in associated with a name; storing a plurality of sequences of the selectable polysemous symbols, each stored in association with at least one of an application program and a command; and enabling one of the application programs or commands in response to receiving voice input selection of names of an associated sequence of polysemous symbols.
218. The method of claim 217, further comprising; displaying each symbol, in sequence, in response to its associated name being selected via voice input.
219. The method of claim 217, wherein the commands include computer commands.
220. The method of claim 217, wherein the commands include computer network commands.
221. The method of claim 217, wherein the commands include navigation commands.
222. The method of claim 217, wherein the commands include intra-application commands for navigating within an application program.
223. The method of claim 217, wherein the commands include inter-application commands for navigating between an application program and another application program.
224. The method of claim 217, wherein the plurality of polysemous symbols are displayed as a virtual keyboard.
225. The method of claim 224, wherein the virtual keyboard occupies no more than 1/3 of a display screen.
226. The method of claim 224, wherein, upon receiving input selection of a symbol, differentiating the display of valid polysemous symbols which occur as a next symbol in a stored sequence including the input selected symbol, from invalid polysemous symbols.
227. The method of claim 226, wherein valid symbols are highlighted.
228. The method of claim 226, wherein invalid symbols are darkened.
229. The method of claim 224, wherein the display of valid polysemous symbols, which occur as a first symbol in a stored sequence upon no symbols being selected and input and as a next symbol in a stored sequence upon selection and input of a previous symbol, is differentiated from invalid polysemous symbols.
230. The method of claim 229, wherein valid symbols are highlighted.
231. The method of claim 229, wherein invalid symbols are darkened.
232. The method of claim 217, wherein the method is used to enable at least one of application programs and commands of a mobile telephone.
233. The method of claim 232, wherein selectable polysemous symbols are displayed prior to selection.
234. The method of claim 233, wherein an application program is displayed prior to selection of a selectable polysemous symbol that will complete an associated polysemous symbol sequence.
235. The method of claim 233, wherein selectable polysemous symbols are highlighted prior to selection.
236. The method of claim 232, wherein selectable polysemous symbols are highlighted prior to selection.
237. The method of claim 217, wherein, the method is used to enable at least one of application programs and commands of a personal digital assistant.
238. The method of claim 217, wherein the method is used to enable at least one of application programs and commands of a personal computer.
239. A computer device, comprising: a memory, adapted to store a plurality of polysemous symbols for selection via voice input, each symbol being stored in association with a name, and adapted to store a plurality of sequences of the selectable polysemous symbols, each sequence stored in association with at least one of a program and a command; and a controller, adapted to execute at least one of a program and command in response to receiving voice input selection of names of symbols of an associated polysemous symbol sequence.
240. The computer device of claim 239, further comprising a display, wherein the display is adapted to display the plurality of polysemous symbols.
241. The computer device of claim 240, wherein the plurality of polysemous symbols are displayed on the display as a virtual keyboard.
242. The computer device of claim 239, wherein each symbol is displayed on a display device, in sequence, in response to its associated name being selected via voice input.
243. The computer device of claim 241, wherein the virtual keyboard is displayed on less than 1/3 of the display.
244. The computer device of claim 239, wherein the commands include computer commands.
245. The computer device of claim 239, wherein the commands include computer network commands.
246. The computer device of claim 239, wherein the commands include navigation commands.
247. The computer device of claim 239, wherein the commands include intra-application commands for navigating within an application program.
248. The computer device of claim 239, wherein the commands include inter-application commands for navigating between an application program and another application program.
249. The computer device of claim 239, wherein the computer device is a mobile phone.
250. The computer device of claim 249, further comprising: a display, adapted to display selected polysemous symbols.
251. The computer device of claim 249, further comprising a display, wherein the selectable polysemous symbols are displayed prior to selection.
252. The computer device of claim 251, wherein a program or command is displayed prior to selection of a selectable polysemous symbol that will complete an associated polysemous symbol sequence.
253. The computer device of claim 250, wherein selectable polysemous symbols are highlighted prior to selection.
254. The computer device of claim 250, wherein selectable polysemous symbols are highlighted prior to selection.
255. The computer device of claim 239, wherein the computer device is a hand-held computer.
256. The computer device of claim 255, wherein the hand-held computer is a personal digital assistant (PDA).
257. The computer device of claim 239, wherein the computer device is a personal computer.
258. The computer device of claim 240, wherein the controller is adapted to differentiate display of valid polysemous symbols, which occur as a first symbol in a stored sequence upon no symbols being input and as a next symbol in a sequence upon input of a previous symbol, from invalid polysemous symbols.
259. The computer device of claim 251, wherein the controller is adapted to differentiate display of valid polysemous symbols, which occur as a first symbol in a stored sequence upon no symbols being input and as a next symbol in a sequence upon input of a previous symbol, from invalid polysemous symbols.
260. The computer device of claim 258, wherein the controller is adapted to highlight displayed valid symbols.
261. The computer device of claim 259, wherein the controller is adapted to highlight displayed valid symbols.
262. The computer device of claim 258, wherein the controller is adapted to darken displayed invalid symbols.
263. The computer device of claim 259, wherein the controller is adapted to darken displayed invalid symbols.
264. An interface comprising: a plurality of polysemous symbols for selection, a plurality of sequences of the polysemous symbols being stored in association with at least one of a command and an application program, wherein an associated one of a command or application is enabled in response to selection of symbols of a stored polysemous symbol sequence.
265. The interface of claim 264, wherein the plurality of polysemous symbols are displayed as a graphical user interface.
266. The interface of claim 265, wherein the interface is displayed on a display of a mobile telephone.
267. The interface of claim 265, wherein the interface is displayed on a display of a portable digital assistant.
268. The interface of claim 265, wherein the interface is displayed on a display of a personal computer.
269. The interface of claim 264, wherein the interface is a voice command interface, with the symbols being selectable in response to receiving an associated symbol name via a voice command.
270. The interface of claim 264, wherein the plurality of polysemous symbols are displayed as a virtual keyboard.
271. The interface of claim 270, wherein the virtual keyboard occupies no more than 1/3 of a display screen.
272. The interface of claim 270, wherein the display of valid polysemous symbols, which occur as a first symbol in a stored sequence upon no symbols being selected and as a next symbol in a stored sequence upon selection of a previous symbol, is differentiated from invalid polysemous symbols.
273. The interface of claim 272, wherein valid symbols are highlighted.
274. The interface of claim 272, wherein invalid symbols are darkened.
275. The interface of claim 264, wherein the symbols are selectable using voice recognition.
276. The interface of claim 270, wherein, prior to selection of a last symbol in a sequence, at least one of a name and a symbol corresponding to at least one of a command and an application program, is displayed in association with the last symbol in a sequence, to thereby facilitate learning of the correspondence between the symbol sequence and the command or application program.
277. The interface of claim 276, wherein the at least one of a name and symbol replaces display of the last symbol in a sequence.
278. The interface of claim 277, wherein the replacement is temporary.
279. A method comprising: providing a plurality of polysemous symbols for selection; storing a plurality of sequences of the selectable polysemous symbols, each stored in association with at least one of a command and an application program; and displaying, prior to selection of a last symbol in a sequence, at least one of a name and a symbol corresponding to at least one of a command and an application program, in association with the last symbol in a sequence, to thereby facilitate learning of the symbol sequence corresponding to the command or application program.
280. The method of claim 279, wherein the display of at least one of a name and symbol replaces display of the last symbol in a sequence.
281. The method of claim 280, wherein the replacement is temporary.
282. The method of claim 280, wherein the replacement is gradual.
283. The method of claim 279, wherein at least one of a name and a symbol are displayed in association with each of a plurality of selectable last symbols in sequences.
284. The method of claim 283, wherein the display of at least one of a name and a symbol replaces the display of each of a plurality of selectable last symbols in a sequence.
285. The method of claim 284, wherein the replacement is temporary.
286. The method of claim 284, wherein the replacement is gradual.
287. The method of claim 279, further comprising: enabling one of the application programs or commands in response to receiving selection of an associated polysemous symbol sequence.
288. The method of claim 279, wherein the plurality of polysemous symbols are displayed as a virtual keyboard.
289. The method of claim 288, wherein the display of valid polysemous symbols, which occur as a first symbol in a stored sequence upon no symbols being selected and as a next symbol in a stored sequence upon selection of a previous symbol, is differentiated from invalid polysemous symbols.
290. The method of claim 289, wherein valid symbols are highlighted.
291. The method of claim 289, wherein invalid symbols are darkened.
292. The method of claim 279, wherein the method is used to enable application programs or commands of a mobile telephone.
293. The method of claim 287, wherein the method is used to enable application programs or commands of a mobile telephone.
294. The method of claim 279, wherein, the method is used to enable application programs or commands of a personal digital assistant.
295. The method of claim 287, wherein, the method is used to enable application programs or commands of a personal digital assistant.
296. The method of claim 279, wherein the method is used to enable application programs or commands of a personal computer.
297. The method of claim 287, wherein the method is used to enable application programs or commands of a personal computer.
Description
FIELD OF INVENTION
[0001] The present application is directed to a computer device, method, and article of manufacture which utilizes sequenced symbols to enable application programs and/or commands. More preferably, the computer device, method, and article of manufacture enable or execute application programs or commands in response to selection of an associated sequence of symbols. This technology is applicable to all areas of computer and electronic devices including but not limited to portable digital assistants (PDAs) mobile telephones, personal computers, internet applications utilizing computers, etc.
BACKGROUND OF THE INVENTION
[0002] PDAs, such as the Palm.TM. devices including the PalmPilot.TM. for example, allow users to catalog and access a great deal of information utilizing a small portable device. The PalmPilot.TM. for example, includes an operating system which allows for navigation through many application programs including ones permitting access to internet applications, utilizing a series of pop-up menus which appear on the screen. These application programs include, for example, programs accessible via hardwired keys ("hardwired programs") such as a calendar, address book, to do list, memo pad, etc.; financial programs such as expense information, charts; informational material programs such as dictionaries, thesauruses, white pages, yellow pages; and programs permitting access to information available through the internet such as ABC news, ESPN, Map Quest, etc. Although a plethora of information and programs are provided by and/or accessible through the PDA, accessing desired information through a pull-down menu system can be slow and cumbersome. Further, it can be difficult to locate desired information through the use of pull-down menus.
[0003] PDAs such as the PalmPilot.TM. for example, also include intra-application commands that permit functionality within a particular application program. These can include basic commands such as new (for creating a new file) open (for opening an existing file), quit, cut, undo, copy, paste, etc., for operating within a particular program. Again, however, these operations are typically performed through sequenced pull-down menus. As such, operating these command functions can be tedious and can involve a large amount of time and effort before the operation is fully performed.
[0004] Finally, within an application program, various movement-type commands can be performed. These commands, such as page up, up, page down, down, etc., can be difficult to access due to display space restrictions and may take some time and effort to be performed.
[0005] Prior art FIG. 1 illustrates a PalmPilot.TM., as an exemplary type of computer device 10 for example. The portable computer device 10
includes a screen area 20, as well as an additional input area 12. The input area 12 includes a plurality of hardwired keys 14a through 14d, each including a single picture: key 14a designating a calculator keypad; key 14b designating a magnifying glass; key 14c designating a house; and key 14d designating a menu. Each of these keys permits immediate access to one of the calculator, find, home and menu programs, respectively.
[0006] With regard to the keys, while they provide quick access to application programs, only a small number of these keys can be included due to the fact that they take up space on the device. Thus, inclusion of these hardwired keys necessarily leads to a decrease in the size of the display 20 as more of a surface area of the PDA is occupied. Display space is a premium in these small devices and thus, while the devices continue to offer more and more functionality, the use of designated hardwired application keys must be restricted in order to maximize display space.
[0007] The PDA 10 further includes an input area 16, wherein handwriting information known as Graffiti.RTM. can be input. These Graffiti.RTM. strokes can be used to enter input characters or symbols, and can be used to input various shortcuts. The Graffiti.RTM. language, however, must first be learned, as well as each of the single meaning strokes in order to access any useful shortcuts.
[0008] Additionally, an area of the PDA 10 below the input area includes an ON/OFF key 40 for powering the device on or off through an internal power source (not shown) or through an external source such as an AC outlet for example (not shown); as well as additional hardwired keys. Each of these keys includes a single symbol and is used to access a single hardwired program/function as follows: key 43 includes a calendar symbol and is used to access a calendar program; key 45 includes a telephone symbol and is used to access an address book; key 47 includes a "list" symbol and is used for accessing a "to do" list; and key 49
includes a pen and paper symbol and is used for accessing a "memo pad" program. Again, these single application hardwired keys limit the overall size of the display 20 and each key can be used to access only a single one of the many applications/programs of the PDA 10. Additionally, UP/DOWN key 42 can be used for scrolling through various application programs for example.
[0009] Display 20 illustrates one example of a screen which could be available on a typical PDA device. The display screen 20 shows six symbols, each of which can be used to access one of a plurality of applications. Again, however, utilizing these single meaning symbols, only a limited number of symbols can be displayed on the screen at any one time to access a limited number of applications, and they do not appear continuously within an application or program to permit switching to another application or program. More symbols can be included and scrolled through, but again, one symbol will access only one application program. For example, the calculator symbol 22a is used to access the calculator program; the date book 22b is used to access the date book program; the diagnostic symbol 22c is used to access wireless diagnostics; the ESPN symbol 22d is used to access the internet site ESPN.com through the internet; the dollar sign symbol 22e is used to access the expense financial application program within the device; and the Fidelity symbol 22f is used to access the Fidelity application program within the device. While these single meaning symbols and associated word messages allow a user to quickly access a particular internal application program of the PDA 10, a desired application must still be located by a user and accessed in some manner. This process can be slow and tedious.
[0010] Other exemplary aspects of the display 20 can include an indication of time 24, an indication of available battery power 26, and other related symbols. It should be understood that the display in prior art FIG. 1 is merely an exemplary display of a typical PDA 10.
[0011] Finally, prior art FIG. 1 illustrates, generically, various internal components of the PDA 10. For example, the PDA 10 includes a central controller (CPU 30) for controlling various functions of the PDA including the receipt of input information from input area 12 and the various keys 42-49; for receiving input from and outputting display information to the display device 20; for executing the various application programs; for accessing the internet through modem 36 and antenna 39 for example, etc. Connected to the CPU 30 are memory elements, such as random access memory (RAM) 34 and read-only memory (ROM) 34 for example. The device 10 can also include an external port 38 for connection to external components through a modem 36 or directly to CPU 30.
[0012] Accordingly, while the PDA provides many applications and various computer command sets available within applications, as well as access to internet applications, locating and particularly using and navigating through a particular application can be tedious and cumbersome. This is true not just with the PDA, described in an exemplary manner above, but is also true with any computer device including personal computers, mobile phones, etc. Further, as more and more functionality is added to the PDA 10, accessing desired application programs and using these application programs in an efficient manner will become more and more difficult. Accordingly, a need exists for a better way to access and use various application programs available in PDAs and other computer devices such as personal computers, mobile telephones, etc. Further, as display screen space is a premium in these portable devices including PDAs, mobile phones, etc., the need exists to maximize display screen availability while minimizing the effort needed to access and use many of the various available commands and applications of these and other computer devices.
SUMMARY OF THE INVENTION
[0013] The present application is directed to a computer device, article of manufacture, interface or method for enabling an application program, and/or for executing a command, based upon selected corresponding symbol sequences. By utilizing these symbol sequences, multiple levels of application programs and commands of the computer device can be accessed. For example, the sequenced symbols can be used as a navigation tool at the operating system level, as a method of selecting and switching in and out of application programs ("applications") ; it can serve as a method of executing available operating system and application commands such as new, open, quit, cut, undo, etc., as well as navigational commands such as page up, page down, etc.; and it can further provide inter-application support from within various available applications such as copy to, paste from, etc., to thus enhance capabilities of the computer device. The methodology can be applied to any computer device including but not limited to PDAs, personal computers, mobile phones, etc., and can be applied to internet navigation as well as voice recognition technology.
[0014] The symbols used are preferably polysemous in nature and can thus be associated with a plurality of different meanings depending upon other symbols sequenced therewith. By utilizing polysemous symbols, a relatively small number of symbols can be used and displayed in a relatively small portion of a display, to thereby provide quick and easy access of a multitude of applications and commands, while utilizing only a small amount of valuable display area. Further, even non-polysemous symbols can be used in certain applications, when sequenced together properly.
BRIEF DESCRIPTION OF THE DRAWINGS
[0015] The present invention will become more fully understood from the detailed description given herein below and the accompanying drawings which are given by way of illustration only and which are not intended to limit the present invention in any way, where in like reference numerals represent like elements and wherein:
[0016] FIG. 1 illustrates a prior art PDA;
[0017] FIG. 2 illustrates the display of a template of polysemous symbols on a computer device of the present application;
[0018] FIG. 3 illustrates the display of a polysemous symbol template in a PDA environment;
[0019] FIG. 4 illustrates the template and an access symbol in a PDA environment;
[0020] FIGS. 5a-5c illustrate symbol prediction and a symbol sequencing for accessing an application program;
[0021] FIGS. 6a-6b illustrate an aspect of intra-application command navigation using symbol sequencing;
[0022] FIGS. 7a and 7b illustrate another aspect of intra-application command navigation using symbol sequencing;
[0023] FIGS. 8a-8g illustrate other aspects of intra-application command navigations utilizing symbol sequencing;
[0024] FIGS. 9a-9c illustrate inter-application navigation utilizing symbol sequencing;
[0025] FIGS. 10a-10h illustrate inter-application navigation utilizing symbol sequencing;
[0026] FIGS. 11a-d illustrate an association of a macro and symbol sequencing;
[0027] FIG. 12 illustrates a mobile telephone application of symbol sequencing;
[0028] FIG. 13 illustrates an application of the present invention techniques to a personal computer;
[0029] FIG. 14 illustrates an article of manufacture of the present application; and
[0030] FIGS. 15a-15d illustrate an application of sequenced single meaning symbols.
DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS
[0031] A method, computer device, interface, and article of manufacture permit the enabling of one or more application programs in a computer device such as a PDA, mobile telephone, personal computer, etc., and/or existing commands, based upon associated and selected sequentially sequenced symbols. Preferably, these symbols are polysemous in nature. By storing a plurality of sequences of selectable polysemous symbols in association with a plurality of application programs and/or commands, the various application programs and/or commands can be enabled or executed in response to receiving selection of an associated polysemous symbol sequence.
[0032] As such, a simple and relatively small interface of multi-meaning symbols can be provided on a relatively small area of a display screen for example, to allow a user to thereby navigate through a plurality of programs, navigate within a program (intra-application navigation such as move up, move down, page up, page down, etc.); and navigate between programs (cross-application navigation such as copy to and paste from as well as providing the ability to build macros such as paste from note pad, etc.). Such a simple symbol interface can thus be used in devices where display space is a premium, such as PDAs, mobile phones, etc.; can be used to quickly access programs in devices with growing capabilities such as PDAs, personal computers (including laptops), mobile phones, etc.; and can be used in internet navigation, as well as provide for efficient use of voice recognition technology. Thus, as capabilities of devices expand, a simple way of accessing and navigating through these capabilities can be utilized, in a manner that is easy to use and easy to quickly comprehend.
[0033] FIG. 2 of the present application illustrates an exemplary computer device 110 of the present application including various components somewhat similar to the PDA of prior art FIG. 1. The computer device, which can be any type of device with a CPU and memory (including but not limited to a PDA, personal computer (both desktop and laptop), mobile phone, etc.), a display 120, an optional input area 112 (which can be omitted to increase display size, for example), and internal components including a CPU (controller) 130; memory such as RAM 132 and ROM 134; modem 136; port 138; and antenna 139. These preferably operate in a manner similar to the previously described with regard to PDA of prior art FIG. 1 and will not be further described for the sake of brevity.
[0034] The computer device 110 of FIG. 2 of the present application further includes a symbol template 130 which can be displayed on display 120. It should be noted that the display 120, somewhat similar to display 20 of prior art FIG. 1, is preferably an integrated input and display device for providing both input of information and display of information. Thus, the template 130 preferably acts as an interface, and provides a plurality of polysemous symbols for selection by a finger or stylus unit for example, which are then input and processed through CPU 130, RAM 132 and ROM 134 as will be explained hereafter. However, it should be understood that the symbols of template 130 can be selected in any manner such as through corresponding keyboard keys, voice recognition technology, etc.
[0035] Preferably, the template 130 includes two rows of polysemous symbols including a first row 132 and a second row 134. The present invention should not be considered to be limited to two rows, and can include more or less rows dependent on the particular use or need. In addition, FIG. 2 includes nine columns of symbols and eighteen symbols in general, which again is merely exemplary and should not be considered to limit the present application.
[0036] Finally, eighteen particular symbols are shown in FIG. 2 of the present application. These symbols have been created for accessing various applications and commands of a PDA, but the present application should not be limited to the particular symbols shown in FIG. 2. Any symbols can be chosen which, for this aspect of the present application, are particularly polysemous in nature to thereby allow for the creation of many easily recognizable symbol sequences to allow a user to easily associate and remember a symbol sequence as corresponding to a particular application program, intra/inter-application navigation command, or other associated command or application.
[0037] When creating the symbol set or template of FIG. 2 (the eighteen symbols of FIG. 2), the full list of commands and/or application programs of the PalmPilot.TM. PDA is preferably first examined. The commands and/or application programs are then semantically grouped using a core set of the most common categories. The core set can include commands or programs found under different menus as these programs/commands can be organized differently based on their similar natural semantic structure. Thereafter, they can be associated with symbol sequences involving a similar first or "category" symbol. Then, second "sub-category" symbols can be developed, as well as sequences.
[0038] The next step involves creating symbols and symbol sequences. Once "categories" and "sub-categories" are established, symbols can be developed to designate both categories and sub-categories of information. These symbols should be polysemous in nature so as to be useable in various sequences to access various types of programs and/or commands. For example, the "money" symbol can represent the category of financial applications, with the "money", "money" and "move" (crossed starting flags) sequence being associated with and enabling the Quicken.RTM. financial application program. Further, the "money" symbol can also be used as a third symbol in a sequence, to designate the "Expense" application program, associated with the symbol sequence of "money", "money" and "money"; and, with the "coins" of the "money" symbol being yellow in color, it can be used as a third symbol to represent and access the "yellow pages" ("find" and "find" and "money"). The same crossed starting flags ("move") symbol as was used in a sequence enabling Quicken.RTM. is also polysemous so as to additionally be used to access the ESPN.com internet application ("globe" and "globe" and "move") since the starting flags represent sports (auto racing and thus the sports network of ESPN); as well as the category of "move" commands--since the starting flags represent movement.
[0039] Similarly, the globe or "all" symbol is used in sequences which access the internet category of application programs ("globe" and "globe" and "move"=ESPN.com), and is also used as a sub-category symbol in sequences accessing the global or "big" moves such as "move to top" ("move" and "globe" and "thumbs up") or "move to bottom" ("move" and "globe" and "thumbs down") commands. Other exemplary category symbols used in sequences for accessing PDA programs and commands in this exemplary aspect of the present application include but are not limited to: the "move" symbol for move menu sequences such as move left ("move" and "left" symbol), move right ("move" and "right" symbol), etc.; the "find" (magnifying glass) symbol for information programs such as "dictionary" ("find" and "find" and "keypad"), HanDBase ("find" and "find" and "file cabinet"), yellow pages ("find" and "find" and "money"), etc.; the "control" (hand on dial mechanism) symbol for built-in applications such as the calendar program ("control" and "control" and "left"), the calculator program ("control" and "control" and "keypad"), etc.; and the "cards" symbol for page move commands of page up ("cards" and "thumbs up"), page down ("cards" and "thumbs down"), etc. Again, these are merely some examples of the polysemous nature of the chosen symbols and should not be considered to limit the application as other symbols, categories, and symbol sequences can be used.
[0040] FIG. 2 illustrates eighteen exemplary symbols. These symbols, starting from the left most symbol in row 132 and moving to the right including the "left" symbol (a hand pointing to the left with a ring on the finger); the "file cabinet" symbol (a hand holding paper in an opened file cabinet); the "find" symbol (a magnifying glass over logs and a fire); the "move" symbol (two starting flags that are crossed); the "Boolean" symbol (the yin-yang symbol); the "new" symbol (a rising sun with a sundial); the "all" symbol (a globe); the "eye" symbol (an symbol of an eyeball); and the "right" symbol (a hand pointing to the right with a ribbon on the finger). Next, in row 134 moving from left to right, the symbols include: the "thumbs up" symbol (a hand with a thumb pointing up); the "draftsman" symbol (a man standing at a draftsman's table with a triangle and a light); the "money" symbol (a dollar and a stack of coins); the "cards" symbol (including two hands with cards); a "key pad" symbol (an electronic card reader with a key pad); the "control" symbol (a hand operating a dial mechanism); the "kill" symbol (a skull and cross bones); the "stop" symbol (an symbol of a stop sign); and the "thumbs down" symbol (a hand with a thumb pointing down). Again, these symbols should not be considered to limit the present application, but have been carefully designed in view of their polysemous nature and in view of their ability to access, in various combinations, application programs, intra-application navigation commands within a program, and inter-application navigation commands across programs, in a typical PDA computer device.
[0041] The use of polysemous symbols allows one symbol to have different meanings when sequenced with other symbols. By using sequenced polysemous symbols, a large number of applications and/or commands can be associated with different symbol sequences; with the actual number of symbols in the pallet or template 130 remaining small. Using two or three symbol sequences (preferred) and an eighteen symbol (for example) template 130
as shown in FIG. 2, an interface is created wherein thousands of applications and/or commands can be associated with different sequences.
[0042] Further, not only can thousands of applications or commands be recalled using simple symbol sequences, but by using a template 130 of only a small number of symbols, display space (at a premium in most computer devices, especially mobile phones, PDAs, laptop computers, etc.), is conserved. Further, the polysemous nature of the symbols makes it easy to correspond symbol sequences to applications and commands. For example, functionality of the computer devices can be grouped into semantic categories such that the "money" symbol is easily associated with and becomes a first sequenced symbol of the category of financial applications; the globe becomes the first sequenced symbol of the category of internet applications; etc. Thereafter, a second symbol can be used to complete a sequence to enable an application program or execute a command; or a third sequenced symbol can fill that role, with the second symbol corresponding to a sub-category within a category. In addition, by adding symbol prediction, valid symbol choices are even further reduced, and the learnability of symbol sequences is even further enhanced. As such, an interface is created which includes a plurality of polysemous symbols for selection, with a plurality of sequences of polysemous symbols being stored in association with at least one of a command and an application program, wherein an associated one of a command or application program is enabled in response to selection of symbols of a stored polysemous symbol sequence.
[0043] FIG. 2 also illustrates another preferred embodiment of Applicant's invention wherein available symbols for selection are identified to the user. This involves symbol prediction. For example, in the template 130
shown in FIG. 2 of the present application, the "file cabinet" symbol 138, as well as the "eye" and "stop sign" symbols 136 are differentiated from the other symbols. Differentiation can occur in the form of highlighting valid symbols for example (and/or darkening an invalid symbol, for example), and can be used in a predictive manner to indicate to the user, symbols which are available for selection (valid) and symbols which are not available for selection, as next or first symbols in a sequence (invalid). This allows the user to quickly and easily access, and also quickly and easily remember various symbol sequences which are associated with various application programs and/or commands. As shown in FIG. 2, a user can easily recognize the differentiated file cabinet, eye and stop sign symbols as valid symbols available for selection.
[0044] The highlighting or other types of differentiating (such as darkening invalid symbols for example) of certain symbols from other symbols is determined based upon available "first" or "next" symbols in symbol sequences. In other words, when the system is initially turned on and the template is initially accessed and displayed, only symbols which begin a stored symbol sequence need be highlighted to the user as only these symbols are valid and can be used to access a symbol sequence. Thereafter, once a particular symbol is selected, only symbols which are "second" symbols in a symbol sequence beginning with the selected first symbol are available "next" symbol symbols for selection. Accordingly, only these symbols will be highlighted, or otherwise differentiated from other symbols, in response to selection of the first symbol. The use of symbol or symbol prediction to aid a user in accessing a storage symbol sequence is discussed in detail in U.S. Pat. Nos. 5,097,425 and 5,297,041, the entire contents of which are incorporated herein by reference.
[0045] As previously stated, the template of symbols 130 is preferably displayed on an integrated input and display device 120 of the overall computer device 110. Even more preferably, the template of symbols 130 is displayed as a virtual keyboard on less than one-third of the display screen 120. As preferably stated, the display of valid polysemous symbols, occurring as a first symbol in a sequence upon no symbols being selected and occurring as a next symbol in a sequence upon selection of a previous symbol, is differentiated from invalid polysemous symbols. Valid symbols are preferably highlighted and/or invalid symbols are preferably darkened, with respect to the valid symbols.
[0046] FIG. 3 illustrates the template 130 displayed on a PDA, somewhat similar to the PDA of prior art FIG. 1. Accordingly, like elements with regard to prior art FIG. 1 will not be explained again for the sake of brevity. FIG. 3 not only illustrates how the template 130 can be displayed on a small portion (preferably less than 1/3 of the display screen) of an integrated input and display screen 120 (including highlighted symbols 138 and 136 differentiated from other symbols of the template 130), but also illustrates an exemplary additional iconicity symbol 200 which will be explained as hereafter.
[0047] In one preferred embodiment, upon initially activating the PDA device, the iconicity symbol 200 can be displayed. The iconicity symbol 200 can be displayed in association with other symbols such as that shown in FIG. 3 for example, or can be displayed alone. In one preferred embodiment, while the iconicity symbol 200 is displayed, the template 130
is not initially displayed. The iconicity symbol 200 can be used, for example, to access the display of the template of symbols 130, if not initially displayed when the device is turned on. This will be explained in more detail with regard to FIG. 4 for example. Of course, it should be understood that the present invention is not so limited, since the template 130 can always be displayed (thereby alleviating the need for the iconicity symbol); another trigger can initiate display of template 130 etc. The use of a symbol 200 to activate a symbol sequence mode display of the template, is merely exemplary.
[0048] FIG. 4 illustrates the PDA wherein the iconicity symbol 200 has been selected. In response thereto, the template of symbols 130 is preferably displayed. Even more preferably, when initially displayed, the template 130 preferably differentiates the display of valid polysemous symbols which occur as a first symbol in a stored sequence for example, from invalid polysemous symbols. This can be done by darkening the invalid symbols, for example; and/or by highlighting the valid symbols; or in some other manner.
[0049] For example, as shown in FIG. 4, upon initially selecting the iconicity symbol 200 and upon displaying the template 130, four symbols are differentiated from the other symbols in the template 130. Each of the "find" symbol 220a, "money" symbol 220b, "control" symbol 220c, and "all" symbol 220d have been highlighted. This is because these symbols have been chosen (in an exemplary format) as first symbols which can be used for enabling or executing exemplary application programs and/or commands of the PDA shown in FIG. 4. The particular symbols selected have been chosen based upon their association with various programs already stored in the PalmPilot.TM. for example, and should not be limited as such.
[0050] Any "first" symbols in stored symbol sequences can be initially differentiated from other symbols upon initially accessing the template 130. Some exemplary symbol sequences, which should not be considered to limit the present application, can include a sequence of the money, money and move symbols to access a "Pocket Quicken" application program in the PDA; the money, money and left symbols to access the "Fidelity" program; the money, money and money symbols to access the "expense" program; the world, world and move symbols to access the "ESPN.com" internet application program/command; and the world, world, and world symbols to access the "ABC news" internet application program/command. Thus, not only can the plurality of symbols be displayed as a virtual keyboard, but the plurality of symbols can be displayed in response to entering a symbol sequence mode, such as by selecting the iconicity symbol 200 for example.
[0051] In one preferred embodiment, each of the stored symbol sequences (stored in a database in association with application programs or commands for example) include at least three symbols, such as the symbols discussed previously related to certain application programs/commands and certain internet applications/commands for example. Even more preferably, in such three symbol sequences, the first symbol in each sequence preferably corresponds to an application program category (such as the "globe" symbol corresponding to an internet application category or the "money" symbol corresponding to a financial application category), the second symbol corresponding to a subcategory within the application program category of the first symbol (wherein the "globe" and "globe" symbols or the "money" and "money" symbols actually enable the subcategory of internet applications or financial applications, respectively); and wherein the third symbol corresponds to an application program within the subcategory of the second symbol such as the specific ESPN.com internet application/command, the ABC news internet application/command, the Pocket Quicken financial application program, or the Fidelity financial application program for example.
[0052] Symbol sequences can be associated with various stored or preaccessible programs to allow easy navigation thereof, and can also be associated with various commands such as intra-application navigation commands and inter- or cross application navigation commands. The commands can include intra-application commands for navigating within an enabled application program and/or inter-application commands for navigating between an enabled application program and another application program, for example. In addition, the present application preferably includes a storage mode which, when accessed, enables a user to store newly input a polysemous symbol sequence in association with a macro (such as "paste from note pad", for example), wherein the macro is executable in response to receiving input of this stored associated polysemous symbol sequence. This will be explained in further detail with regard to FIGS. 11a-d for example.
[0053] Once one of the application programs is enabled (via a selected symbol sequence or in some other manner), intra/inter-application navigation within that program such as move up, move down, move left, move right, page up, etc., can also be performed. Thus, template 130 of the plurality of polysemous symbols can also be displayed, as a virtual keyboard for example, within an enabled application program; a plurality of sequences of symbols can be stored in association with commands, and one of the commands can be executed in response to receiving selection of an associated polysemous symbol sequence.
[0054] Finally, as shown in FIG. 4, the template 130 preferably includes an additional display area 210. This area is preferably used to display each of the plurality of selected polysemous symbols, in sequence of selection. Thus, as each symbol is selected, it is preferably displayed in the small display area 210, so that the user may view each selected symbol. In a preferred embodiment, a selection of a symbol can be canceled, such as by double clicking on the symbol for example. As such, the symbol will preferably disappear from the display 210. Again, it should be noted that each symbol, when selected, will be displayed in the specific sequence as the sequence of symbols can be used to enable one of the plurality of application programs such as any of the presequenced hardwired, financial, info, or internet programs of the computer device, intra-application navigation command programs, or inter-application commands, etc.
[0055] In dealing with stored information in a computer device (such as application programs and/or commands for example) which can be associated with a symbol sequence, different types of information is available to be retrieved in different situations encountered in computer programs and interfaces. Operating systems have built-in computer commands that can be accessed. These commands are usually in the form of categories or libraries of commands, functions, routines or subroutines. These commands are encoded into a machine code that the computer then can understand based upon its operating system. Different categories of commands can further be accessed from other programs.
[0056] Accordingly, sequences of a plurality of polysemous symbols provided for selection are stored in association with an accessible application program or command, preferably in a database or in some type of memory for example. Thus, by storing these sequences of selectable polysemous symbols in association with an application program or command, the application program or command can be enabled/executed in response to receiving selection of an associated polysemous symbol sequence.
[0057] Most operating systems permit access to computer command shortcuts as well as application programs. These shortcuts can be edited and new shortcuts (such as polysemous symbol sequences) can be assigned to various commands. These types of commands are extracted and associated with appropriate symbol sequences. The symbol sequences and their association with commands and/or application programs is then stored, preferably in a database structure. When an associated symbol sequence is selected (via any type of input such as through a stylus or finger selecting a symbol displayed on an integrated input and display apparatus for example, or through the use of other input devices such as a mouse, scroll bar, associated keys on a keypad, etc.), the resulting command and/or application program is then enabled/executed and sent to a new application software or the operating system itself for execution. As such, an alternate method for navigating through application programs such as the hardwired, financial, information, and internet programs of the PalmPilot.TM. for example, as well as a new method for accessing navigation commands within an application or between applications, is made available.
[0058] Each of plurality of methods can be used in the overall storage of information to be retrieved. Any and all such methods are to be encompassed within the scope of the present application. For example, known entities such as various operating system commands and built-in program commands and/or abilities to access these commands if they are already stored, can initially be stored. These can be associated with symbol sequences and stored in memory, within the application software or within a database file, for example.
[0059] In an alternative method, which is also encompassed within the scope of the present application, the software application of the present invention can access available computer commands from within another software application and extract them into a database. If a new application is installed in the system, then the present application software can identify it and proceed to extract the expected commands and put them in database storage. This database can then be cross referenced to another database with symbol sequences.
[0060] With regard to computer commands, they may be found in different software applications and may be named different, but they may perform the same command. These can be assigned the same symbol sequence (commands like "delete item" and "delete object" which do exactly the same thing but are named differently), for example. Other commands, like "new document" and "new picture" which essentially tell the software to do the same thing (create a new document of a file that the software can understand), may be different in actual structural content. These can be assigned or associated with different symbol sequences to better represent what they are doing.
[0061] As another alternative method, commands may be found which were not originally anticipated when designing various symbol sequences to be associated with various commands or application programs. In this instance, an initial database can be created with symbol sequences associated with various application programs and/or commands, and additional symbol sequences can be added at a later time. This will enable the coverage of a much larger area of computer commands and application programs by having an exchangeable storage system for symbol sequences and their associations.
[0062] In regular computer programs, macros can be created using normally separate computer commands and then combining them in a logical way. When the macro is executed, it procedurally executes each separate command that was combined and stored within it. This enables the execution of more than one command through the use of just one macro. In the same sense, individual symbol sequences, namely new symbol sequences, can be used and stored in association with new "macros". When this new sequence of symbols is then selected, it can then execute each individual computer command that makes up the macro. For example, a first symbol sequence can be assigned to the command "paste to"; a new symbol sequence can be developed to create the command "paste from"; and a further symbol sequence can be added to create a macro "paste from note pad" or "paste from hand base". This will be discussed in more detail with regard to FIGS. 11a-d but can, in essence, enable the immediate access of a command within an application program, to thereby eliminate the need to first access the application program and then access the particular command. Thus, generally, application programs and/or commands can include macros, with a polysemous symbol sequence being stored in association with the macros and with the macro being enabled in response to receiving selection of an associated polysemous symbol sequence.
[0063] Once the available computer commands and available application programs are known, a hierarchical list of logically organized command sets is preferably created. However, this list is not inherently the easiest to remember and does not effectively represent a grammatical structure. "File:new" is not an effective grammatical structure like "create a new window" or "create a new document". The proper grammatical structure is much easier to read, make sense of, and remember over time. The logical set is more cryptic and in most situations looses touch with the intended meaning. By organizing commands and programs in a more semantic and grammatical sense, appropriate symbol sequences can be assigned and associated therewith.
[0064] With regard to many of these commands, there is also a common order such as "copy paste". We normally say "copy paste" as one command, but it is actually two commands with totally different meanings, very closely tied to each other in use. The copy occurs first, and then the paste command can be executed. However, using the "macro" concept, the two aspects of "perform a copy" and "perform a paste" can be performed in any order. Thus, new commands such as "paste from an application", which does not change the intended meaning of the individual commands when it is followed by "perform a copy", can be assigned a different symbol sequence than the command involving perform a copy and then perform a paste. This aspect of utilizing a macro to enhance the capabilities of existing systems will be discussed further with regard to FIGS. 10a-10h for example. This is one example of an inter-application command which is accessed utilizing a symbol sequence.
[0065] FIGS. 5a-5c illustrate the use of symbol prediction and illustrate how a symbol sequence is selected and then used to enable an application program for example, such as the HanDBase program of the PalmPilot.TM. for example. Initially, after selecting the iconicity symbol as shown in FIG. 4 for example, the two rows of symbols of the symbol template 130
are preferably displayed as shown in FIG. 5a for example. The available symbols (as first symbols in stored symbol sequences) are the "find" symbol 220a, the "money" symbol 220b, the "control" symbol 220c and the "all" symbol 220d (similar to that shown in FIG. 4). As shown in FIG. 5a, out of these available or valid symbols, differentiated from the other symbols shown in FIG. 5a, a selection represented by arrow 310 is then made (by a user touching the symbol, by input of the stylus, by selection of a corresponding key on the keyboard, by voice recognition, etc.). As shown in FIG. 5a, the selection 310 corresponds to the "find" symbol 220a. Upon selection thereof, the find symbol is then preferably displayed in the display area 210 as the first symbol in the symbol sequence.
[0066] Moving to FIG. 5b, it is noted that only the find symbol 220a remains highlighted. This is because, among the available stored symbol sequences, the only available "next" symbol (after selection of the "find" symbol by selection 310) is another "find" symbol. Thus, a next selection, designated by element 320 of FIG. 5b, is made and a second "find" symbol is displayed in display area 210, along with the first "find" symbol, in a sequence therewith.
[0067] Finally, in response to selecting two "find" symbols in sequence, five symbols remain. The valid "third" symbols in storage symbol sequences as shown in FIG. 5c include the money symbol 220b, the card symbol 220f, the keypad symbol 220g, the Boolean symbol 220h, and the file cabinet symbol 220e. As various three symbol sequences are stored in association with various application programs, selection of any one of these valid "third" symbols in a symbol sequence will enable a particular application program.
[0068] As shown in FIG. 5c, a selection 330 is made and the third symbol selected is the "file cabinet" symbol. Thus, the file cabinet symbol is displayed in area 210, sequenced with the two "find" symbols. The particular application program enabled based upon that symbol sequence is also preferably displayed in display area 210. Specifically, as shown in FIG. 5c, it indicates that the HanDBase program has been launched or otherwise enabled.
[0069] Thereafter, the display will preferably (but need not) maintain display of the template 130 to allow for navigational commands within the HanDBase program, and the HanDBase program will then be displayed in the display area 120. Accordingly, the HanDBase application program is easily accessed by input of three symbols and can be easily remembered through an association between first the "find" symbol and all information category application programs stored within the device, as well as a second association between the file cabinet and the particular HanDBase program itself. Similarly, if other information type application programs were to be accessed, the find symbol would be selected twice, as shown in FIGS. 5a and 5b, and one of the symbols shown in FIGS. 5c would then be selected as follows: the money symbol (wherein the coins could be yellow for example) to access the Yellow Pages; the card symbol (representing randomness for example) to access the thesaurus; the key pad symbol (representing an electronic card reader) to access a dictionary; or the Boolean (yin-yang) symbol to represent the White Pages (wherein the symbol could be displayed in black and white for example).
[0070] As previously stated, the present application applies both to utilizing symbol sequences to enable application programs and to execute commands. Thus, a plurality of polysemous symbols can be provided for selection in a manner similar to that shown by template 130 of FIG. 4 for example; a plurality of sequences of selectable polysemous symbols can be stored, each being stored in association with a command for execution; and one of the commands can be executed in response to a selection of an associated polysemous symbol sequence. These commands can include movement type commands such as move up, move left, move down, move right, page up, page down, etc.; as well as standard computer commands such as new, open, save, quit, undo, etc. Some examples will be discussed regarding FIGS. 6-8.
[0071] Initially, before discussing examples of FIGS. 6-8, it should be noted that "commands" can be executed in response to selection of a corresponding polysemous symbol sequence to execute the command within a particular application program. These can include intra-application commands and inter-application commands among several applications. The application program itself can be enabled utilizing a symbol sequence, or can be enabled in any other fashion such as via hardwired key, a selected single meaning symbol, etc.
[0072] FIGS. 6a and 6b illustrate how the move down command is executed in response to selecting a sequence of the move symbol and the thumbs down symbol. They are shown, for example, within a "FishKeeper" record of the HanDBase application program. Within this particular application program, many first symbols are shown on the symbol template as being available valid symbols, with only the find symbol, eye symbol and stop sign symbol being deactivated (invalid). Thus, all other symbols are available as a first symbol from a sequence symbol for executing some type of command within the particular HanDBase application program.
[0073] In FIG. 6a, as shown by element 410, the move symbol is first selected. Once this symbol is selected, only the available next symbols in a valid symbol sequence are displayed in a differentiated format from the unavailable symbols, or invalid symbols. Accordingly, only five symbols, namely the thumbs up, left, thumbs down, right and all symbols remain valid or active. Thereafter, the "thumbs down" symbol is selected as shown by element 420 and the move down command is executed in response to selection of its associated symbol sequence.
[0074] The executed "move down" command can be derived from the FishKeeper screen shown in FIG. 6a as compared to the FishKeeper screen shown in FIG. 6b. Looking at FIG. 6a, the "John's Camp" entry is the first entry, and the three "Miller's Run" entries are the last three entries shown on the screen. In FIG. 6b, the screen has "moved down" by one line, showing the "Cross Creek" entry as the first entry (John's Camp becomes entry number two), with the last two entries being the Miller's Run entries (the third Miller's Run entry has dropped off of the screen). As such, it can be seen how a user can easily navigate within an application program. This type of "move down" command is a navigation command which can be used for example, as an intra-application command.
[0075] In addition to just moving up and down, for example, by moving one line as shown in FIGS. 6a and 6b, a "page down" command can similarly be accomplished utilizing an associated symbol sequence of the present application. As shown in FIG. 7a, by element 510 for example, at the same first position as shown in FIG. 6b within the FishKeeper HanDBase application, a new symbol "cards" can be first selected. Thereafter, only available or valid second symbols are shown in FIG. 7b, and the user can then select the "thumbs down" symbol as shown by element 520. Upon making this selection, the page down command is executed based upon its association with the symbol sequence of "cards" plus "thumbs down". Using such a command, an entire page of the display can be navigated through. Thus, the first page began with the John's Camp entry (FIG. 7a), and the next page will end with the John's Camp entry and include five new entries (FIG. 7b). Thus, a whole page of information has been provided to the user in an easy accessible form. Thus, simple commands such as move down are not sacrificed, and advanced commands such as page up and page down are easily executed. Of course, it should be understood that execution of the aforementioned commands is merely exemplary, and the present application should not be limited to these commands.
[0076] With regard to specific application programs, it is preferred that at least three symbols are used (however, the present application is not limited as such, as any number of symbols greater or less than three can be used) to thereby expand the number of application programs that can be accessed by a symbol sequence. This is because an indefinite number of application programs could be made available, depending on the particular device itself. However, of course, two symbols can be used if only a few application programs are present (or four or more if many application programs are present).
[0077] With regard to the command sets, however, since most command sets are pretty well defined, most of these command sets can be associated with only two symbols in a sequence. This allows for simple movement through execution of the two symbol commands such as the "page down" sequence and the somewhat similar two symbol "page up" sequence (using the thumbs up symbol instead of the thumbs down); a simple page left and page right sequence (the card symbol along with the left or right symbol, respectively); a simple two symbol sequence for moving down and moving right (with the right symbol instead of the thumbs down); and two similar symbol sequences for moving up and moving down. In addition, printing a record can be a simple two symbol sequence (such as the draftsman and file cabinet symbol sequence for example); new records can be a simple two symbol sequence, including the new symbol and the file cabinet symbol in sequence for example, etc. Other more advanced but less used commands can include three symbols such as go to the top of the page (move+all+thumbs up) or go to the bottom of the page (move+all+thumbs down). Further, in the command sequence, similar to the application program sequences, a sequence can include one symbol repeated a plurality of times (for example, the "about" command can include the eye symbol repeated twice).
[0078] In addition, similar to the sequences associated with application programs, a sequence associated with a command can be newly entered. For example, upon entering a storage mode, a newly input polysemous symbol sequence can be stored in association with a macro, wherein the macro is executable in response to receiving input of an associated polysemous symbol sequence. In this case, the macro can be a new command for example.
[0079] As previously stated, existing commands within a computer device, which can be enabled or executed in response to a selection of an associated polysemous symbol sequence, need not only be navigation commands for moving around within a particular application program. They can also include standard commands such as save (the key pad symbol+the file cabinet symbol, for example); open (the key pad symbol+the move symbol, for example, etc.). Another such example is the "new record" command. As shown in FIG. 8a, two records can initially be available in the FishKeeper program, and when the "new" symbol is first selected as shown by 530 in FIG. 8a and the "file cabinet" symbol is then selected as shown by 535 in FIG. 8b, a new record such as the "Lake Arthur" record as shown in FIG. 8b can be entered.
[0080] In addition, while the FishKeeper database could be one database available in the HanDBase application, a new database can be created utilizing the symbol sequence new+all+file cabinet. As shown by 540 of FIG. 8c, the "new" symbol is first selected; then as shown by 545 in FIG. 8d, the "all" symbol is selected next; and finally as shown by 550 in FIG. 8e, the "file cabinet" is selected to complete the sequence. As such, the "new database" instruction is executed and the FishKeeper database is then be replaced with a new database as shown in FIG. 8e, prompting the user to input a name for the database, fields for the database, etc.
[0081] A further example of a command being executed in response to a selected corresponding symbol sequence is shown in FIGS. 8f and 8g regarding the "undo" command. FIG. 8f shows a prior paste being performed in response to the sequence of the "keypad" symbol as shown by 560 and "draftsman" symbol as shown by 570 being selected. FIG. 8g then shows the execution of the "undo" command in response to selection of the corresponding symbol sequence of "keypad" as shown by 580 and "thumbs down" as shown by 590. In response thereto, the pasted entry of "Lake Erie" of FIG. 8f is "undone" and no longer appears in FIG. 8g.
[0082] Accordingly, "commands" as used through the present application need not include merely navigational or movement type commands, but can also include standard commands available within an application program (intra-application commands), as well as commands utilizable between application programs (inter-application commands). These inter-application commands can transfer information from one application program to another, as will be explained as follows.
[0083] FIGS. 9a-9c illustrate a method for executing an inter-application command, namely a command which operates between two application programs. That particular command being executed in FIGS. 9a-9c is the copy/paste command, an inter-application command which transfers information from one application program to another. The copy/paste command is executed in response to selection of an associated polysemous symbol sequence, wherein a plurality of sequences of selectable polysemous symbols are stored, each being stored in association with a command for execution.
[0084] Initially, as shown in FIG. 9a, the copy is performed. Thus, a record such as that shown in FIG. 9a is opened and an entry is highlighted. Thereafter, the "key pad" symbol is first selected as indicated by arrow 610, followed by the "Boolean" symbol in step 620. This essentially copies the highlighted entry as shown FIG. 9a.
[0085] Thereafter, as shown in FIG. 9b, another application program is selected, such as the calendar, for example. First, the "control" symbol is selected as indicated by arrow 630; the "control" symbol is again selected as shown by arrow 640; and the "left" symbol is finally selected as shown by the arrow 650 in FIG. 9b. As such, the calendar application is enabled and can thus be pasted into. Finally, as shown in FIG. 9c, the paste command is executed in response to selecting the "key pad" symbol as shown by arrow 660 followed by the "draftsman" symbol as shown by arrow 670. Once this paste command is performed after selecting a particular calendar entry, the pasting of the copied entry into the calendar application is then complete. As such, the paste command is an inter-application command which operates between two application programs, namely between an initial record as shown in FIG. 9a and the calendar application shown in FIGS. 9b and 9c. When a copy and then a paste command is performed in this way, the operating system stores the object of the copy command in its memory within an internal clipboard (for example). It is then referred to and deposited through the paste command at the point of entry when and where the paste command is performed. Thus, the symbol sequence acts to initiate the built-in commands of the operating system.
[0086] FIGS. 10a-10h illustrate how the methodology of the present application can be used to access commands which essentially create operations not previously accessible. FIGS. 10a-10h illustrate a new type of "paste from" operation, which is essentially the inverse of the copy/paste command.
[0087] Initially, as shown in FIG. 10a, an entry in an existing application is selected as shown by arrow 700. The entry is selected and then highlighted as shown by the arrow 710 in FIG. 10b. Thus, the field text "Cross Creek" has been highlighted as shown in FIG. 10c. Thereafter, as shown by arrow 722, 724 and 726, the "paste from" command is executed selecting the "key pad", "key pad", and "Boolean" symbols, respectively. Thus, the entry "Cross Creek" will be replaced by another entry placed from another application. Thereafter, as shown in FIG. 10d, a second application program is accessed by selecting the symbol sequence of "control", "control", and "right" as shown by elements 732, 734, and 736, respectively. As such, the memo pad application program is enabled as shown in FIG. 10d.
[0088] Within this program, an area or line is then highlighted as shown by the arrow 740 in FIG. 10d, and a specific part of that highlighted material is further highlighted as shown in FIG. 10f. Thereafter, as also shown in FIG. 10f by the arrows 750 and 755, the sequence corresponding to the "copy" operation is selected. However, the copy operation is not performed and instead, the "paste from" command is executed wherein "Lake Erie" is pasted from the memo pad application and into the initial FishKeeper application as shown by arrow 760 in FIG. 10g. If this is acceptable, the user then hits the okay button as shown by arrow 770, and the Lake Erie entry replaces the Cross Creek entry in the FishKeeper application as shown by element 780 in FIG. 10h.
[0089] As such, when the macro command "paste from" is accessed, the software can store an internal marker, for example, in a built-in storage database that references the area that was selected when the "paste from" command was executed. Later, when a copy (any copy) is performed, the macro can intercept the copy command after the selected item is copied into the built-in clipboard storage area of the operating system (OS). The macro can then retrieve the aforementioned marker and open up the page or record. It can then paste the item located in the OS clipboard storage area into the area defined by the marker, thus completing the macro and clearing any marker set by the macro. Accordingly, such macros can make use of internal computer commands by storing them in an internal database program, retrieving them, and then executing them in a predefined order as set by the program that is storing and building the macro.
[0090] FIGS. 11a-d illustrate a macro command of "paste from memo pad", corresponding to the symbol sequence of "draftsman, control+control+right". This macro is essentially created from the "paste from" command and is one which, in this example, is stored in association with a sequence of four symbols. Similar to the scenario previously discussed with regard to FIGS. 10a-h, when the macro command "paste from memo pad" is accessed, the software can store an internal marker, for example, in a built-in storage database that references the area that was selected when the "paste from memo pad" command was executed. Later, when a copy (any copy) is performed, the macro can similarly intercept the copy command after the selected item is copied into the built-in clipboard of the operating system. The macro can then retrieve the aforementioned marker and open up the page or record. It can then paste the item located in the OS clipboard storage area into the area defined by the marker, thus completing the macro and clearing any marker set by the macro. This will be explained, for example, in association with FIGS. 11a-d.
[0091] As shown in FIG. 11a, an application program which will receive information pasted from the memo pad is initially accessed. As shown in FIG. 11a, the calendar application is accessed or selected by selecting its associated symbol sequence of "control+control+left" as shown by arrows 810, 820 and 830 in FIG. 11a for example. Thereafter, as shown by FIG. 11b, the command "paste from memo pad" is accessed by selecting its associated symbol sequence of "draftsperson, control+control+right" as shown by the arrows 840, 850, 860, and 870, respectively, of FIG. 11b. Thereafter, when a copy is performed as shown in FIG. 11c, by selecting the symbol sequence of "keypad+copy" as shown by arrows 880 and 890 of FIG. 11c, and when an item is selected as shown in FIG. 11c, the selected item is then automatically pasted within the calendar application (at a selected area as shown in FIG. 11d for example), with the pasted information being from the memo pad application. As such, a macro is created and utilized wherein a new command "paste from memo pad" is developed and assigned to a new symbol sequence. As such, these types of macros make use of internal computer commands by storing them in an internal database program, retrieving them, and executing them in a predefined order as set by the program that is storing and building the macro.
[0092] The computer device of the present application may be a PDA such as that shown in FIGS. 2-4 of the present application, or may be any other type of computer device. For example, the computer device may be any type of hand held computer, and can also be a mobile phone. An aspect of the present application, in the context of its use in conjunction with a mobile phone, will be discussed hereafter with regard to FIG. 12 of the present application.
[0093] FIG. 12 provides one application of a template of polysemous symbols applied in the context of a mobile phone. A mobile phone application, somewhat similar to a PDA and even more extreme than a PDA, includes a small display area where display space is a premium. Thus, inst