Controller device, information processing system, and communication method

• US 8,749,489 B2
• Filed: 05/25/2012
• Issued: 06/10/2014
• Est. Priority Date: 05/25/2012
• Status: Active Grant

• Current Assignee: Nintendo Company Limited
• Original Assignee: Nintendo Company Limited
• Inventors: Ito, Kuniaki, Shimohata, Yasuyuki, Ueki, Jumpei
• Primary Examiner(s): Sitta, Grant
• Application Number:
  US13/702,430
• Publication Number:
  US 20130314608A1
• Time in Patent Office: 746 Days
• Field of Search: 345156-173, 463/36
• US Class Current: 345/158
• CPC Class Codes: A63F 13/235 using a wireless connection, e.g. infrared or piconet
• CPC Class Codes: A63F 13/26 having at least one additional display device, e.g. on the game controller or outside a game booth
• CPC Class Codes: G06F 3/0346 with detection of the device orientation or free movement in a 3D space, e.g. 3D mice, 6-DOF [six degrees of freedom] pointers using gyroscopes, accelerometers or tilt-sensors
• CPC Class Codes: H04N 21/41265 having a remote control device for bidirectional communication between the remote control device and client device unidirectional remote control device H04N21/42204
• CPC Class Codes: H04N 21/42204 User interfaces specially adapted for controlling a client device through a remote control device; Remote control devices therefor constructive details of casings for the remote control device H01H9/0235; user interfaces for controlling a tuning device of a television receiver through a remote control H03J9/00; remote control of peripheral devices connected to a television receiver through the remote control device of the television receiver H04B1/205
• CPC Class Codes: H04N 21/42208 Display device provided on the remote control

Abstract

An object is to appropriately transmit operation data from a controller device to an information processing device. The controller device is capable of wirelessly communicating with the information processing device. The controller device includes a generating unit, a communication unit, and a display unit. The generating unit generates operation data based on an operation performed on the controller device. The communication unit receives one image'"'"'s worth of image data from the information processing device with a first frequency, the image data generated in the information processing device through a process performed based on the operation data, and transmits the operation data to the information processing device with a second frequency that is higher than the first frequency. The display unit displays an image based on the image data.

Claims

1. A controller device capable of wirelessly communicating with an information processing device, the controller device comprising:

a generating unit for generating operation data based on an operation performed on the controller device;

a communication unit for receiving image data generated in the information processing device through a process performed based on the operation data, and transmitting the operation data to the information processing device;

an extension communication unit for communicating with another external device different from the information processing device; and

a display unit for displaying an image based on the image data,

wherein the communication unit is capable of operating both in a first communication mode in which the image data is received with a first frequency and in a second communication mode in which the image data is received with a frequency that is half the first frequency,

the communication unit transmits the operation data to the information processing device with a second frequency that is higher than the first frequency both in the first communication mode and in the second communication mode, and

wherein the communication unit transmits, to the information processing device, communication management data together with the operation data, the communication management data representing management information for communication with the external device.

2. The controller device according to claim 1, wherein the communication unit transmits the operation data with a frequency that is an integral multiple of the frequency with which the image data is received.

3. The controller device according to claim 1, wherein:

the information processing device transmits a sync signal to the controller device, and transmits the image data with a timing determined based on the sync signal; and

the communication unit transmits the operation data with the timing determined based on the sync signal transmitted from the information processing device.

4. The controller device according to claim 3, wherein the display unit updates and displays the image data with the timing determined based on the sync signal and with the first frequency.

5. The controller device according to claim 4, wherein the display unit starts rendering the image data transmitted with the timing determined based on the sync signal within an amount of time shorter than an interval of the first frequency since reception of the sync signal.

6. The controller device according to claim 3, wherein the communication unit receives sound data from the information processing device with a timing independent of the sync signal.

7. The controller device according to claim 3, wherein:

the controller device further includes a microphone; and

the communication unit transmits sound data obtained by the microphone to the information processing device with a timing independent of the sync signal.

8. The controller device according to claim 1, wherein

the controller device further includes a camera;

and

the communication unit transmits one image'"'"'s worth of camera image data generated by the camera to the information processing device with a frequency that is lower than the first frequency.

9. The controller device according to claim 1, wherein the communication unit receives one packet of sound data from the information processing device with a frequency that is higher than the first frequency and lower than the second frequency.

10. The controller device according to claim 1, wherein:

the controller device further includes a microphone; and

the communication unit transmits one packet of sound data with a frequency that is higher than the first frequency and lower than the second frequency, the sound data generated by the microphone to the information processing device.

11. The controller device according to claim 1, wherein the communication unit transmits newly-generated operation data for each transmission.

12. The controller device according to claim 1, further comprising a sensor unit including at least one of a touch panel, an acceleration sensor and a gyrosensor,

wherein the generating unit generates operation data including data based on an output of the sensor unit.

13. The controller device according to claim 1, wherein the communication unit is capable of transmitting first-type data of more transmission opportunities and second-type data of fewer transmission opportunities to the information processing device, and transmits the communication management data and the operation data to the information processing device as the first-type data, and transmits data received from the external device to the information processing device as the second-type data.

14. The controller device according to claim 13, wherein the communication unit communicates with the information processing device using a wireless communication method in which the transmission of the first-type data is given a higher priority over the transmission of the second-type data, and the reception of the image data transmitted from the information processing device is given a higher priority over the transmission of the first-type data.

15. The controller device according to claim 1, wherein:

the information processing device transmits a sync signal to the controller device, and transmits the image data with a timing determined based on the sync signal; and

the communication unit transmits the operation data with a timing determined based on the sync signal transmitted from the information processing device and, in the second communication mode, the communication unit is capable of transmitting operation data with a timing that is different from a timing with which operation data is transmitted by another device capable of wirelessly communicating with the information processing device.

16. The controller device according to claim 15, wherein in the second communication mode, the communication unit is capable of operating both in a mode in which the operation data is transmitted with the same timing as the first communication mode, and in another mode in which the operation data is transmitted with a different timing from the first communication mode.

17. The controller device according to claim 1, wherein the communication unit transmits one image'"'"'s worth of camera image data obtained by a camera of the controller device to the information processing device with a predetermined frequency both in the first communication mode and in the second communication mode.

18. The controller device according to claim 17, wherein in the second communication mode, the communication unit transmits the camera image data to the information processing device while reducing an amount of one image'"'"'s worth data as compared with that in the first communication mode.

19. An information processing system comprising an information processing device and a controller device capable of wirelessly communicating with the information processing device, wherein:

the information processing device generates image data through an operation performed based on operation data from the controller device, and transmits the image data to the controller device;

an extension communication unit for communicating with another external device different from the information processing device; and

the controller device comprises;

a generating unit for generating the operation data based on an operation performed on the controller device;

a communication unit for receiving the image data from the information processing device and transmitting the operation data to the information processing device; and

a display unit for displaying an image based on the image data; and

the information processing device is capable of operating both in a first communication mode in which the image data is transmitted to the controller device with a first frequency and in a second communication mode in which the image data is transmitted to the controller device with a frequency that is half the first frequency,

the communication unit is capable of operating both in a first communication mode in which the image data is received with the first frequency and in a second communication mode in which the image data is received with a frequency that is half the first frequency, and the communication unit transmits the operation data to the information processing device with a second frequency that is higher than the first frequency both in the first communication mode and in the second communication mode,

the communication unit transmits, to the information processing device, communication management data together with the operation data, the communication management data representing management information for communication with the external device, and

the information processing device receives the operation data and the communication management data.

20. The information processing system according to claim 19, wherein the communication unit transmits the operation data with a frequency that is an integral multiple of the frequency with which the image data is received.

21. The information processing system according to claim 19, wherein:

the information processing device transmits a sync signal to the controller device, and transmits the image data with a timing determined based on the sync signal; and

the communication unit transmits the operation data with the timing determined based on the sync signal transmitted from the information processing device.

22. The information processing system according to claim 21, wherein the display unit updates and displays the image data with the timing determined based on the sync signal and with the first frequency.

23. The information processing system according to claim 22, wherein the display unit starts rendering the image data transmitted with the timing determined based on the sync signal within an amount of time shorter than an interval of the first frequency since reception of the sync signal.

24. The information processing system according to claim 19, wherein the communication unit is capable of transmitting first-type data of more transmission opportunities and second-type data of fewer transmission opportunities to the information processing device, and transmits the communication management data and the operation data to the information processing device as the first-type data, and transmits data received from the external device to the information processing device as the second-type data.

25. The information processing system according to claim 24, wherein the communication unit communicates with the information processing device using a wireless communication method in which the transmission of the first-type data is given a higher priority over the transmission of the second-type data, and the reception of the image data transmitted from the information processing device is given a higher priority over the transmission of the first-type data.

26. The information processing system according to claim 19, wherein:

the information processing device transmits a sync signal to the controller device, and transmits the image data with a timing determined based on the sync signal; and

the communication unit transmits the operation data with a timing determined based on the sync signal transmitted from the information processing device and, in the second communication mode, the communication unit is capable of transmitting operation data with a timing that is different from a timing with which operation data is transmitted by another device capable of wirelessly communicating with the information processing device.

27. The information processing system according to claim 26, wherein in the second communication mode, the communication unit is capable of operating both in a mode in which the operation data is transmitted with the same timing as the first communication mode, and in another mode in which the operation data is transmitted with a different timing from the first communication mode.

28. A communication method carried out in a controller device capable of wirelessly communicating with an information processing device, the communication method comprising:

a generating step of generating operation data based on an operation performed on the controller device;

a communication step of receiving image data generated in the information processing device through a process performed based on the operation data, and transmitting the operation data to the information processing device;

an extension communication step of communicating with another external device different from the information processing device; and

a display step of displaying an image based on the image data,

wherein in the communication step, the controller device is capable of operating both in a first communication mode in which the image data is received with a first frequency and in a second communication mode in which the image data is received with a frequency that is half the first frequency, and the operation data is transmitted to the information processing device with a second frequency that is higher than the first frequency both in the first communication mode and in the second communication mode,

wherein in the communication step, the controller device transmits, to the information processing device, communication management data together with the operation data, the communication management data representing management information for communication with the external device.

29. The communication method according to claim 28, wherein in the communication step, the controller device transmits the operation data at a frequency that is an integral multiple of the frequency with which the image data is received.

30. The communication method according to claim 28, wherein:

the information processing device transmits a sync signal to the controller device, and transmits the image data with a timing determined based on the sync signal; and

in the communication step, the controller device transmits the operation data with a timing determined based on the sync signal transmitted from the information processing device.

31. The communication method according to claim 30, wherein in the display step, the controller device updates and displays the image data with the timing determined based on the sync signal and with the first frequency.

32. The communication method according to claim 31, wherein in the display step, the controller device starts rendering the image data transmitted with the timing determined based on the sync signal within an amount of time shorter than an interval of the first frequency since reception of the sync signal.

33. The communication method according to claim 30, wherein in the communication step, the controller device receives sound data from the information processing device with a timing independent of the sync signal.

34. The communication method according to claim 30, wherein in the communication step, the controller device transmits sound data obtained by a microphone of the controller device to the information processing device with a timing independent of the sync signal.

35. The communication method according to claim 28, wherein in the communication step, the controller device transmits one image'"'"'s worth of camera image data generated by a camera of the controller device to the information processing device with a frequency that is lower than the first frequency.

36. The communication method according to claim 28, wherein in the communication step, the controller device receives one packet of sound data from the information processing device with a frequency that is higher than the first frequency and lower than the second frequency.

37. The communication method according to claim 28, wherein in the communication step, the controller device transmits one packet of sound data generated by a microphone of the controller device to the information processing device with a frequency that is higher than the first frequency and lower than the second frequency.

38. The communication method according to claim 28, wherein in the communication step, the controller device transmits newly-generated operation data for each transmission.

39. The communication method according to claim 28, wherein:

the controller device includes a sensor unit including at least one of a touch panel, an acceleration sensor and a gyrosensor; and

in the generating step, the controller device generates operation data including data based on an output of the sensor unit.

40. The communication method according to claim 28, wherein in the communication step, the controller device is capable of transmitting first-type data of more transmission opportunities and second-type data of fewer transmission opportunities to the information processing device, and transmits the communication management data and the operation data to the information processing device as the first-type data, and transmits data received from the external device to the information processing device as the second-type data.

41. The communication method according to claim 40, wherein in the communication step, the controller device communicates with the information processing device using a wireless communication method in which the transmission of the first-type data is given a higher priority over the transmission of the second-type data, and the reception of the image data transmitted from the information processing device is given a higher priority over the transmission of the first-type data.

42. The communication method according to claim 28, wherein:

the information processing device transmits a sync signal to the controller device, and transmits the image data with a timing determined based on the sync signal; and

in the communication step, the controller device transmits the operation data with a timing determined based on the sync signal transmitted from the information processing device and, in the second communication mode, the controller device transmits operation data with a timing that is different from a timing with which operation data is transmitted by another device capable of wirelessly communicating with the information processing device.

43. The communication method according to claim 42, wherein in the communication step, the controller device is capable of operating both in a mode in which the operation data is transmitted with the same timing as the first communication mode, and in another mode in which the operation data is transmitted with a different timing from the first communication mode.

44. The communication method according to claim 28, wherein in the communication step, the controller device transmits one image'"'"'s worth of camera image data obtained by a camera of the controller device to the information processing device with a predetermined frequency both in the first communication mode and in the second communication mode.

45. The communication method according to claim 44, wherein in the communication step, in the second communication mode, the controller device transmits the camera image data to the information processing device while reducing an amount of one image'"'"'s worth data as compared with that in the first communication mode.