Information processing apparatus

• US 8,392,852 B2
• Filed: 12/09/2003
• Issued: 03/05/2013
• Est. Priority Date: 12/11/2002
• Status: Expired due to Fees

• Current Assignee: Sony Ericsson Mobile Communications (Sony Group Corp.)
• Original Assignee: Sony Ericsson Mobile Communications (Sony Group Corp.)
• Inventors: Tokashiki, Mamoru
• Primary Examiner(s): PHANTANA ANGKOOL, DAVID
• Application Number:
  US10/730,138
• Publication Number:
  US 20050022134A1
• Time in Patent Office: 3,374 Days
• Field of Search: 715/839, 715/740, 715/741, 345/839
• US Class Current: 715/839
• CPC Class Codes: G06F 3/0362 with detection of 1D translations or rotations of an operating part of the device, e.g. scroll wheels, sliders, knobs, rollers or belts
• CPC Class Codes: G06F 3/0481 based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
• CPC Class Codes: G06F 3/04815 Interaction with a metaphor-based environment or interaction object displayed as three-dimensional, e.g. changing the user viewpoint with respect to the environment or object
• CPC Class Codes: G06F 3/0483 Interaction with page-structured environments, e.g. book metaphor
• CPC Class Codes: G06F 3/0489 using dedicated keyboard keys or combinations thereof
• CPC Class Codes: G08C 17/00 Arrangements for transmitting signals characterised by the use of a wireless electrical link
• CPC Class Codes: G08C 2201/30 User interface
• CPC Class Codes: H04L 12/2805 Home Audio Video Interoperability [HAVI] networks
• CPC Class Codes: H04L 12/282 based on user interaction within the home receiver circuitry for displaying additional information being controlled by a remote control apparatus H04N21/42204
• CPC Class Codes: H04L 2012/2841 Wireless
• CPC Class Codes: H04L 2012/2845 Telephone line
• CPC Class Codes: H04M 1/72415 for remote control of appliances
• CPC Class Codes: H04M 1/72427 for supporting games or graphical animations
• CPC Class Codes: H04M 1/72436 for text messaging, e.g. short messaging services [SMS] or e-mails
• CPC Class Codes: H04M 1/72451 according to schedules, e.g. using calendar applications
• CPC Class Codes: H04N 21/25866 Management of end-user data customer care in data networks H04L41/5077
• CPC Class Codes: H04N 21/25875 involving end-user authentication restricting access to computer systems by authenticating users using a predetermined code G06F21/33; arrangements for secret or secure communication including means for verifying the identity or authority of a user of the system H04L9/32; networks authentication protocols H04L63/08; authentication in wireless network security H04W12/06
• CPC Class Codes: H04N 21/4131 home appliance, e.g. lighting, air conditioning system, metering devices home automation data switching networks exchanging configuration information on appliance services H04L12/2807
• CPC Class Codes: H04N 21/42206 characterized by hardware details
• CPC Class Codes: H04N 21/42209 for displaying non-command information, e.g. electronic program guide [EPG], e-mail, messages or a second television channel
• CPC Class Codes: H04N 21/4222 : Remote control device emulator integrated into a non-television apparatus, e.g. a PDA, media center or smart toy remote control device for a television receiver integrated into a mobile phone H04M1/72415
• CPC Class Codes: H04N 21/42228 : the reprogrammable keys being displayed on a display screen in order to reduce the number of keys on the remote control device itself
• CPC Class Codes: H04N 21/4227 : Providing Remote input by a user located remotely from the client device, e.g. at work
• CPC Class Codes: H04N 21/4312 : involving specific graphical features, e.g. screen layout, special fonts or colors, blinking icons, highlights or animations
• CPC Class Codes: H04N 21/43615 : Interfacing a Home Network, e.g. for connecting the client to a plurality of peripherals home Audio Video Interoperability [HAVI] data switching networks H04L12/2805
• CPC Class Codes: H04N 21/4532 : involving end-user characteristics, e.g. viewer profile, preferences monitoring of user activities for profile generation for accessing a video database G06F16/739; user profiles in network data switching protocols H04L67/306; processing of user preferences or user profiles in wireless networks H04W8/18
• CPC Class Codes: H04N 21/47214 : for content reservation or setting reminders; for requesting event notification, e.g. of sport results or stock market stock exchange data over packet-switching network H04L12/1804; push services over packet-switching network H04L12/1859; notification of incoming messages in packet switching networks H04L51/224
• CPC Class Codes: H04N 21/4751 : for defining user accounts, e.g. accounts for children
• CPC Class Codes: H04N 21/4786 : e-mailing message switching systems, e.g. electronic mail systems H04L51/00
• CPC Class Codes: H04N 21/6131 : involving transmission via a mobile phone network wireless downlink channel access H04W74/006
• CPC Class Codes: H04N 21/6181 : involving transmission via a mobile phone network arrangements for providing broadcast or conference services to substation in data switching networks in combination with wireless systems H04L12/189; wireless uplink channel access H04W74/004
• CPC Class Codes: H04N 21/6543 : for forcing some client operations, e.g. recording remote booting in general G06F9/4416
• CPC Class Codes: H04N 21/6547 : comprising parameters, e.g. for client setup
• CPC Class Codes: H04N 21/658 : Transmission by the client directed to the server
• CPC Class Codes: H04N 7/106 : for domestic distribution

Abstract

An user interface for facilitating user operation. At time of an initial setup, the user selects a desired character, a room, images of items to be installed in the room, such as a television receiver set, a personal computer apparatus, etc. After selection, a user interface is formed in which images of the character and an item are incorporated into an image of the room, such as for example a living room selected by the user. The user may virtually reproduce his or her room at the user interface by imagining his or her room so as to select a room and install items. As a result, it becomes possible to provide the user with a user interface which allows an intuitive and simple operation.

Claims

1. An information processing apparatus comprising:

a room image storage means for storing an image of a structure of a room;

an item image storage means for storing an image of an item to be operated in said room;

a portable communication device comprising a display control means for controlling display of a first image on a display means by reading said image of said item selected by a user from said item image storage means while reading said image of said room selected by said user from said image storage means, and forming said first image such that said image of said item is incorporated in said image of said room,

said display control means configured to transmit control information through a mobile server, over the Internet, and to a home network to communicate with said item to be operated in order to operate said item,

wherein the home network is in communication with and provides said control information to one or more devices in said room including said item to be operated, and

wherein the display control means is in communication with said mobile server and said mobile server is configured to obtain device-related information of said one or more devices in said room from internet-connected servers and transmit the device-related information to the portable communication device.

2. The information processing apparatus according to claim 1, further comprising a character image storage means for storing an image of a character, wherein said display control means controls display of a first image on said display means by reading said image of said character selected by said user from said character image storage means, and forming said first image such that said image of said item read through selection by said user and said image of said character read through selection by said user are incorporated in said image of said room selected by said user.

3. The information processing apparatus according to claim 2, wherein said display control means selectively controls by high luminance, display of an outline of a item from a plurality of items incorporated in said first image according to an operation by an operation means.

4. The information processing apparatus according to claim 3, wherein said display control means supplementarily controls display of a function included in said item having the outline thereof displayed by high luminance.

5. The information processing apparatus according to claim 3, wherein said display control means displays said character so as to have said character located in the vicinity of said item having the outline thereof selectively displayed by high luminance.

6. The information processing apparatus according to claim 2, wherein, when an instruction to copy information of a first item to a second item is issued, said display control means controls display of said character in order to pick up a designated object from said first item and place said picked up object on said second item.

7. The information processing apparatus according to claim 6, wherein, when an instruction to copy information of a first item to a second item is issued, said display control means controls display of said character and displays said information of said first item pasted on an input screen of said second item.

8. The information processing apparatus according to claim 1, wherein said display control means is configured to be in communication with the item to be operated through a home network in communication with the Internet.

9. The information processing apparatus according to claim 1, wherein said display control means is configured to be in communication with a control server providing control commands for the item to be operated.

10. An information processing apparatus comprising:

a room image storage configured to store a structure of a room;

an item image storage configured to store an image of an item to be operated in said room;

a portable display device including a display and a display control configured to display a first image on said display device by reading said image of said item selected by a user from said item image storage while reading said image of said room selected by said user from said image storage, and forming said first image such that said image of said item is incorporated in said image of said room,

said display device configured to transmit control information through a mobile server, over the Internet, and to a home network to communicate with said item to be operated in order to operate said item,

wherein the home network is in communication with and provides said control information to one or more devices in said room including said item to be operated, and

wherein the display control means is in communication with said mobile server and said mobile server is configured to obtain device-related information of said one or more devices in said room from internet-connected servers and transmit the device-related information to the portable communication device.

11. The information processing apparatus according to claim 10, further comprising a character image storage configured to store an image of a character, wherein said display control displays a first image on said display by reading said image of said character selected by said user from said character image storage, and forms said first image such that said image of said item read through selection by said user and said image of said character read through selection by said user are incorporated in said image of said room selected by said user.

12. The information processing apparatus according to claim 11, wherein said display control selectively displays an emphasized item from a plurality of items incorporated in said first image.

13. The information processing apparatus according to claim 12, wherein said display control supplementarily displays a function included in said emphasized item.

14. The information processing apparatus according to claim 12, wherein said display control displays said character so as to have said character located in the vicinity of said emphasized item.

15. The information processing apparatus according to claim 11, wherein, when an instruction to copy information of a first item to a second item is issued, said display control displays said character in order to pick up a designated object from said first item and place said picked up object on said second item.

16. The information processing apparatus according to claim 15, wherein, when an instruction to copy information of a first item to a second item is issued, said display control displays said character and said information of said first item pasted on an input screen of said second item.

17. The information processing apparatus according to claim 10, wherein said display control is configured to be in communication with the item to be operated through a home network in communication with the Internet.

18. The information processing apparatus according to claim 10, wherein said display control is configured to be in communication with a control server providing control commands for the item to be operated.