CN202355828U - Game system and operating device - Google Patents
Game system and operating device Download PDFInfo
- Publication number
- CN202355828U CN202355828U CN 201120378445 CN201120378445U CN202355828U CN 202355828 U CN202355828 U CN 202355828U CN 201120378445 CN201120378445 CN 201120378445 CN 201120378445 U CN201120378445 U CN 201120378445U CN 202355828 U CN202355828 U CN 202355828U
- Authority
- CN
- China
- Prior art keywords
- mentioned
- game
- data
- image
- game device
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Withdrawn - After Issue
Links
Images
Abstract
The utility model provides a game system capable of performing novel game operations and an operating device. The game system comprises an arrangement type game device and a terminal device. The terminal device which comprises a touch panel and an inertia sensor is applied for sending operation data including data output by the touch panel and the inertia sensor to the game device in a wireless way. The game device receives operation data from the terminal device and executes game processing according to the operation data. First game images and second game images are sequentially generated based on the game processing. First game images are sequentially compressed and the compressed image data are sequentially sent to the terminal device in a wireless way. Second game images are sequentially output to an external display device independent of the terminal device and then displayed. The terminal device sequentially receives the compressed image data from the game device and decompresses the received compressed image data. In this way, the first game images are sequentially displayed on the display part of the terminal device. Thus novel game operations are achieved.
Description
Technical field
The utility model relates to a kind of comprising can be by the operating means in the games system of the operating means of player's move operation and this games system.
Background technology
In the past, there was a kind of games system (for example with reference to patent documentation 1) that can carry out game operation by player's mobile actuating device itself.For example in the games system that patent documentation 1 is put down in writing, operating means possesses acceleration transducer, the such parts of imaging apparatus, and game device can utilize these parts to calculate moving of (supposition) operating means.Therefore thus, the player can carry out game operation through mobile actuating device itself, compares with the situation of action button, rocking bar only, can operate more intuitively, more real operation or complicated operations etc. more.
Patent documentation 1: No. 4265814 specification of Japan Patent
The utility model content
The problem that utility model will solve
In the games system that patent documentation 1 is put down in writing, game image is presented on the display unit that is independent of operating means, while the player watches the picture of display unit to utilize hand-held operating means to carry out game operation.Thereby in above-mentioned games system, the player can't carry out direct control to the game image that is shown on the picture.That is, though the player for example can carry out can't for example directly touching the operation of such operation of picture or moving image itself through making operating means indicate the operation of the desired locations on the picture towards the direction of picture.
Therefore, the purpose of the utility model is to provide a kind of games system and operating means that can carry out new-type game operation.
The scheme that is used to deal with problems
In order to address the above problem, the structure of (1)～(10) below the utility model adopts.
(1) example of the utility model is to comprise the game device of arrangement type and the games system of first operating means.
Game device possesses first operand according to acceptance division, game processing portion, image production part, game image compression unit, game image sending part and image efferent.First operand receives the first operand certificate according to acceptance division from first operating means.Game processing portion performs game process according to the first operand certificate.Image production part generates first game image and second game image successively based on game processing.The game image compression unit compresses first game image successively and generates compressing image data.The game image sending part sends compressing image data through wireless to first operating means successively.The image efferent outputs to second game image exterior display device that is independent of first operating means successively.
In addition, first operating means possesses display part, touch panel, inertial sensor, first operand according to sending part, game image acceptance division and game image decompression portion.Touch panel is arranged on the screen of display part.First operand according to sending part through wireless first operand certificate of sending the output data comprise touch panel and inertial sensor to game device.The game image acceptance division receives compressing image data successively from game device.Game image decompression portion decompresses to compressing image data successively and obtains first game image.Display part shows first game image that obtains through decompression successively.
Above-mentioned " game device " just can be any device so long as perform game process and generate the information processor of image based on game processing.Above-mentioned game device both can be the information processor of game-specific, also can be as the such multiduty information processor of personal computer.
Above-mentioned " first operating means " is as long as possess above-mentioned display part, touch panel, inertial sensor, first operand according to sending part, game image acceptance division and game image decompression portion at least; Both can as after possess other structure the terminal installation in the embodiment stated, also can not possess other structure.
Above-mentioned " games system " both can comprise the said external display unit that shows second game image as long as comprise game device and first operating means, also can not comprise this exterior display device.That is, both can games system be provided, also can games system be provided with the mode that comprises this exterior display device with the mode that does not comprise this exterior display device.
Above-mentioned " exterior display device " as long as be independent of first operating means, except after the television set 2 in the embodiment stated, so long as can show the device of second game image that generates by game device, just can be any device.For example, exterior display device also can form as one (in a housing) with game device.
According to the structure of above-mentioned (1), first operating means possesses touch panel and inertial sensor, and game device performs game process according to the first operand certificate of the output data that comprise touch panel and inertial sensor.Thus, the player can carry out game operation through picture or the moving image itself (first operating means itself) that directly touches first operating means.That is, according to the structure of above-mentioned (1), the game image that can on the player provides picture, be shown carries out the so new-type game operation of direct control.
In addition, in the structure of above-mentioned (1), be presented at first game image game image for being used to utilize touch panel to operate mostly on the picture of first operating means.According to game content, also want to show not to be to be used to the image that utilizes touch panel to operate sometimes, but will show also that in the enterprising line operate of touch panel this image is a difficulty comparatively.For this point, in the structure of above-mentioned (1), externally show second game image on the display unit, therefore can present two kinds of different game images to the player.Thereby; For example can first game image of the operation that is suitable for touch panel be presented on the picture of first operating means; It is first-class that second game image that will be suitable for the mastery play space is presented at exterior display device, utilizes two kinds of game images to come with the whole bag of tricks performance gamespace.Thereby, according to the structure of above-mentioned (1), can present the game image that is easier to observe, be easier to carry out game operation to the player.
In addition, according to the structure of above-mentioned (1), first operating means needs only the decompression of carries out image data at least, and game processing is as long as carry out in the game device side.Even game processing is complicated; Also only need to increase the processing of game device side; And hardly the treating capacity of the decompression of the image in first operating means is exerted an influence, therefore, even under the situation of the complicated game processing of needs; Also can the processing load of the first operating means side be suppressed in the prescribed limit, thus can be to the demanding information processing capability of first operating means.Therefore, be easy to make and also become easy with by the hand-held first operating means miniaturization, the lightweight of using of user.
Therefore and according to the structure of above-mentioned (1), first game image sends to first operating means from game device being compressed the back, can transmit wirelessly game image at high speed, thereby can reduce from carrying out game processing to the delay that shows till the game image.
(2) games system also can also comprise second operating means.Second operating means possesses second operand according to sending part, this second operand according to sending part through wireless second operand certificate of sending the operation that expression carries out this second operating means to game device.In addition, game device also possess receive the second operand certificate second operand according to acceptance division.Game processing portion performs game process according to the second operand certificate.
Controller in the embodiment of stating after above-mentioned " second operating means " is not limited to is so long as can get final product to the device that game device transmits wirelessly operating data (second operand according to).
According to the structure of above-mentioned (2), the player not only can use first operating means to carry out game operation, can also use second operating means to carry out game operation.Use the player of second operating means can be while watching the game image that is presented on the exterior display device to play; Therefore according to the structure of above-mentioned (2), can watch the picture of the exterior display device and first operating means to play respectively by two players.
(3) game device also can also possess game sound generation portion, game sound efferent and game sound sending part.Game sound generation portion generates first game sound and second game sound according to game processing.The game sound efferent outputs to second game sound in the external speakers device that is independent of first operating means.The game sound sending part sends first game sound through wireless to first operating means.In addition, first operating means also possesses game sound acceptance division and loudspeaker.The game sound acceptance division receives first game sound from game device.First game sound that loudspeaker output is received by the game sound acceptance division.
In above-mentioned (3), first game sound that is wirelessly transmitted to first operating means from game device both can as after after being compressed, send the embodiment stated, can not compress yet and send.
According to the structure of above-mentioned (3), with game image likewise, also can export two kinds of game sounds for game sound.Thereby, in first operating means, can export the game sound that conforms to first game image, and can export second game sound that conforms to second game image from the external speakers device.
(4) first operating means also can also possess microphone.At this moment, first operand according to sending part also through wireless data of sending the detected sound of microphone to game device.
In above-mentioned (4), be wirelessly transmitted to from first operating means game device sound data both can as after after being compressed, send the embodiment stated, can not compress yet and send.
According to the structure of above-mentioned (4), the detected sound of the microphone of first operating means (microphone voice) is sent to game device.Thereby game device can be used for game sound with microphone voice, and the result that perhaps will carry out obtaining after voice recognition is handled to microphone voice is with the input of playing games.
(5) first operating means also can also possess camera and camera image compression unit.The camera image compression unit compresses the taken camera image of camera and generates the compression camera data.At this moment, first operand also sends compression camera data through wireless to game device according to sending part.In addition, game device also possesses the camera image decompression portion that the compression camera data is decompressed and obtains camera image.
According to the structure of above-mentioned (5), the camera image that is photographed by the camera of first operating means is sent to game device.Thereby game device can be used for game image with camera image, and the result that perhaps will carry out obtaining after the image recognition processing to camera image is with the input of playing games.In addition, according to the structure of above-mentioned (5), camera image is sent after being compressed, and therefore can transmit wirelessly camera image at high speed.
(6) first operating means also can also possess a plurality of front-operated buttons and direction input part that can direction indication.A plurality of front-operated buttons are set at the both sides of this screen on the positive facial plane of the screen that is provided with display part and touch panel.The direction input part is set at the both sides of the screen on the positive facial plane.At this moment, first operand is according to the data that also comprise the operation that expression carries out a plurality of front-operated buttons and direction input part.
According to the structure of above-mentioned (6), at the screen sides setting operation button and the direction input part of first operating means.Thereby; The player can (be typically bimanual thumb) action button and direction input part are operated under the state that grips first operating means; Even therefore in the process of the operation of moving first operating means, also can easily operate to action button and direction input part.
(7) first operating means also can also possess a plurality of back sides action button and a plurality of sides action button.A plurality of back sides action button is set on the back side plane.Back side plane is the face of positive planar opposite side that is provided with screen and the touch panel of display part.A plurality of sides action button is set on the side between positive facial plane and the back side plane.At this moment, first operand is according to the data that also comprise the operation that expression carries out a plurality of back sides action button and side action button.
According to the structure of above-mentioned (7), the back side plane and the side of first operating means are provided with action button.Thereby; The player can (be typically with forefinger or middle finger) under the state that grips first operating means these action buttons are operated; Even therefore in the process of the operation of moving first operating means, also can easily operate to action button.
(8) first operating means also can also possess Magnetic Sensor.At this moment, first operand is according to the data that also comprise the testing result of Magnetic Sensor.
According to the structure of above-mentioned (8), first operating means possesses Magnetic Sensor, and the output result of Magnetic Sensor is used in the game processing in game device.Thereby the player can carry out game operation through moving first operating means.In addition; Game device can be judged the absolute posture of first operating means in real space according to the output result of Magnetic Sensor, the posture that the output result that therefore can be through using inertial sensor for example and the output result of Magnetic Sensor come correctly to calculate first operating means.
(9) inertial sensor can be an inertial sensor arbitrarily, for example can comprise 3-axis acceleration sensor and three-axis gyroscope sensor.
According to the structure of above-mentioned (9),, can correctly calculate mobile, the posture of first operating means through using acceleration transducer and these two kinds of sensors of gyro sensor as inertial sensor.
(10) game device also can also possess reading part, network service portion and electric power provides portion.Reading part reads information from the external recording medium that records games, and this external recording medium can installation and removal with respect to above-mentioned game device.Network service portion can be connected with network, and communicates between the information processor that can communicate through this network.Electric power provides portion from power supply each one in this game device of the outside of game device electric power to be provided.Game processing portion performs game process according to the games that read out by reading part.
According to the structure of above-mentioned (10), record the external recording medium of games through replacing, can easily change the games of in game device, carrying out.Therefore in addition, game device can communicate through network, can be more substantial through the content of the recreation that for example makes the function of game device via the new application program of network download, data or in game device, carry out.In addition, as after " 7. other action example of games system " of stating said, can use the interface of terminal installation 7 when communicating via network and out of Memory treating apparatus.
(11) another example of the utility model also can be an operating means, and it can carry out radio communication with the game device of arrangement type, and this operating means possesses: display part; Touch panel, it is arranged on the screen of display part; Inertial sensor; The operating data sending part, it is through wireless operating data of sending the output data that comprise touch panel and inertial sensor to game device; The game image acceptance division, it receives compressing image data successively from game device, and this compressing image data is in game device, the game image that generates based on the game processing of carrying out according to operating data to be implemented processed compressed to obtain; And game image decompression portion, it decompresses to compressing image data successively and obtains game image, and wherein, display part shows the game image that obtains through decompression successively.
In addition, as an other example of the utility model, also can implement the utility model with the mode of first operating means in above-mentioned (1)～(10).
The effect of utility model
According to the utility model, perform game process based on the operation that the operating means that possesses touch panel and inertial sensor is carried out, can carry out new-type game operation thus.
Description of drawings
Fig. 1 is the outside drawing of games system 1.
Fig. 2 is the block diagram of the internal structure of expression game device 3.
Fig. 3 is the stereogram of the surface structure of expression controller 5.
Fig. 4 is the stereogram of the surface structure of expression controller 5.
Fig. 5 is the in-built figure of expression controller 5.
Fig. 6 is the in-built figure of expression controller 5.
Fig. 7 is the block diagram of the structure of expression controller 5.
Fig. 8 is the figure of the surface structure of expression terminal installation 7.
Fig. 9 is the figure of the situation of expression user's handling terminal installation 7.
Figure 10 is the block diagram of the internal structure of expression terminal installation 7.
Figure 11 is the figure that is illustrated in the various data of using in the game processing.
Figure 12 is the main flow chart that is illustrated in the flow process of the game processing of carrying out in the game device 3.
Figure 13 is the flow chart of the detailed process of expression game control processing.
Figure 14 is the picture of the television set 2 in the expression first recreation example and the figure of terminal installation 7.
Figure 15 is the picture of the television set 2 in the expression second recreation example and the figure of terminal installation 7.
Figure 16 is illustrated in the figure that is presented at an example of the used as television game image on the television set 2 in the 3rd recreation example.
Figure 17 is illustrated in the 3rd recreation to be presented at terminal on the terminal installation 7 in the example with one of game image routine figure.
Figure 18 is illustrated in the figure that is presented at an example of the used as television game image on the television set 2 in the 4th recreation example.
Figure 19 is illustrated in the 4th recreation to be presented at terminal on the terminal installation 7 in the example with one of game image routine figure.
Figure 20 is the figure of the use situation of the games system 1 in expression the 5th recreation example.
Figure 21 is the figure of each included annexation of installing of the games system 1 of expression when being connected with external device (ED) through network.
Description of reference numerals
1: games system; 2: television set; 3: game device; 4: CD; 5: controller; 6: labelling apparatus (marker device); 7: terminal installation; 10:CPU; 11e: inner main storage; 12: external main memory; 19: the controller communication module; 28: the terminal communication module; 35: shooting information operational part; 37: acceleration transducer; 44: wireless module; 48: gyro sensor; 51:LCD; 52: touch panel; 53: analog stick (Analog Stick); 54: action button; 55: labeling section; 56: camera; 62: Magnetic Sensor; 63: acceleration transducer; 64: gyro sensor; 66: codec LSI (Large-scale integration: large scale integrated circuit); 67: loudspeaker; 69: microphone; 70: wireless module; 90: the controller function data; 97: the terminal operation data; 98: the camera image data; 99: the microphone voice data.
The specific embodiment
[the 1. overall structure of games system]
Below, the related games system 1 of an embodiment of the utility model is described with reference to accompanying drawing.Fig. 1 is the outside drawing of games system 1.In Fig. 1, games system 1 comprises that with television receiver etc. be the display unit (below be recited as " television set ") 2 of the arrangement type of representative, game device 3, CD 4, controller 5, labelling apparatus 6 and the terminal installation 7 of arrangement type.Games system 1 performs game process in game device 3 according to the game operation that utilizes controller 5 to carry out, and will be presented at through the game image that game processing obtains on television set 2 and/or the terminal installation 7.
But installation and removal ground inserts CD 4 in game device 3, and this CD 4 is examples of the information storage medium that uses replaceably to this game device 3.Store the message handling program (being typically games) that is used in game device 3 execution in the CD 4.The front surface of game device 3 is provided with the insertion mouth of CD 4.Game device 3 performs game process through reading and carry out 4 the canned data handling procedures of CD that are inserted in the insertion mouth.
Periphery (in Fig. 1, being the upside of screen) at the screen of television set 2 is provided with labelling apparatus 6.User (player) can carry out the game operation of mobile controller 5, and labelling apparatus 6 is used for by the moving of game device 3 computing controllers 5, position, posture etc., and details are narrated in the back.Labelling apparatus 6 possesses two marker (marker) 6R and 6L at its two ends.Marker 6R (marker 6L is also identical) is more than one infrared LED (Light Emitting Diode: light emitting diode), export infrared light towards the place ahead of television set 2 specifically.Labelling apparatus 6 is connected with game device 3, the lighting of each infrared LED that game device 3 can control mark device 6 be possessed.In addition, labelling apparatus 6 is mancarried devices, and the user can be arranged on position arbitrarily with labelling apparatus 6.Labelling apparatus 6 has been shown in Fig. 1 has been set at the state above the television set 2, but the position of labelling apparatus 6 has been set and towards being arbitrarily.
[the 2. internal structure of game device 3]
The internal structure of game device 3 then, is described with reference to Fig. 2.Fig. 2 is the block diagram of the internal structure of expression game device 3.Central processing unit) 10, system LSI 11, external main memory 12, ROM/RTC 13, disk drive 14 and AV-IC 15 etc. game device 3 has CPU (Central Processing Unit:.
CPU 10 performs game process through the games that execution is stored in the CD 4, and this CPU 10 brings into play function as game processor.CPU 10 is connected with system LSI 11.Except being connected with CPU 10, also be connected with external main memory 12, ROM/RTC 13, disk drive 14 and AV-IC 15 on the system LSI 11.System LSI 11 carries out following processing etc.: the transfer of data between coupled each structural element that connects is controlled; Images displayed is wanted in generation; Obtain data from external device (ED).In addition, the internal structure of system LSI 11 is narrated in the back.The external main memory 12 of volatibility is used to store the games that read out from CD 4, from games supervisor or store various kinds of data that flash memory (Flash memory) 17 reads out, this external main memory 12 is used as working region, the buffer area of CPU 10.ROM/RTC 13 have game device 3 is installed startup with the ROM (so-called boot ROM) of program and the clock circuit (RTC (Real Time Clock): real-time clock) that carries out timing.Disk drive 14 is from 4 fetch program of CD data, data texturing etc., among the inside main storage 11e or external main memory 12 that states after the data that read out are written to.
In system LSI 11, be provided with I/O processor (I/O processor) 11a, GPU (Graphic Processor Unit: graphic process unit) 11b, DSP (Digital Signal Processor: digital signal processor) 11c, VRAM (Video RAM: video-ram) 11d and inner main storage 11e.Though omitted diagram, these structural elements 11a～11e interconnects through internal bus.
GPU 11b forms the part of delineation unit, generates image according to the drawing order (Graphics Command) from CPU 10.VRAM 11d storage GPU 11b carries out the required data (data such as polygon data, data texturing) of drawing order.When generating image, GPU 11b uses the data that are stored among the VRAM 11d to make view data.In addition, in this embodiment, game device 3 generate the game image that is presented on the television set 2 be presented on the terminal installation 7 game image the two.Below, the game image that will be presented at sometimes on the television set 2 is called " used as television game image ", and the game image that is presented on the terminal installation 7 is called " game image is used at the terminal ".
Such as stated image that in game device 3, generates and the image that will in television set 2, export in the sound and the data of sound read through AV-IC 15.AV-IC 15 outputs to television set 2 through AV connector 16 with the view data that reads out, and the voice data that reads out is outputed to the loudspeaker 2a that is built in television set 2.Thus, display image on television set 2, and from loudspeaker 2a output sound.
In addition, image that in game device 3, generates and the image that will in terminal installation 7, export in the sound and the data of sound send to terminal installation 7 through I/O processor 11a.The data of utilizing I/O processor 11a etc. that terminal installation 7 is carried out are sent in the back narration.
I/O processor 11a carries out data between the coupled structural element that connects transmission receives, and perhaps carries out from the data of external device (ED) and downloads.I/O processor 11a is connected with flash memory 17, network communication module 18, controller communication module 19, expansion connector 20, connector for memory card 21, codec (codec) LSI 27.In addition, be connected with antenna 22 on the network communication module 18.Be connected with antenna 23 on the controller communication module 19.Codec LSI 27 is connected with terminal communication module 28, is connected with antenna 29 on the terminal communication module 28.
In addition, game device 3 can receive the operating data of self-controller 5.That is, I/O processor 11a receives the operating data that slave controller 5 sends through antenna 23 and controller communication module 19, and this operating data is stored (temporary transient storage) in the buffer area of inner main storage 11e or external main memory 12.
In addition, game device 3 can and terminal installation 7 between send to receive data such as image, sound.Send under the situation of game image (game image is used at the terminal) to terminal installation 7, I/O processor 11a outputs to codec LSI 27 with the data of the game image that GPU 11b is generated.27 pairs of processed compressed of stipulating from the view data of I/O processor 11a of codec LSI.Carry out radio communication between terminal communication module 28 and the terminal installation 7.Thereby, will be sent to terminal installation 7 by terminal communication module 28 by the view data after codec LSI 27 compressions through antenna 29.In addition, in this embodiment, the view data that sends to terminal installation 7 from game device 3 is the data that are used to play, if images displayed takes place to postpone then can cause harmful effect to the operability of recreation in recreation.Therefore, preferably,, avoid postponing about from the transmission of game device 3 to the view data of terminal installation 7 as far as possible.Thereby in this embodiment, H.264 codec LSI 27 for example uses this efficient compression technology of standard to come compressing image data.In addition, also can use compress technique in addition, under the enough fast situation of communication speed, can also constitute compressing image data not and the structure of sending.In addition; Terminal communication module 28 for example is to receive Wi-Fi (wireless fidelity: the wireless compatibility authentication) communication module of authentication; For example both can use the MIMO that adopts under the IEEE 802.11n standard (Multiple Input Multiple Output: technology multiple-input and multiple-output) come to carry out at high speed and terminal installation 7 between radio communication, also can use other communication mode.
In addition, game device 3 also sends to terminal installation 7 with voice data except view data being sent to the terminal installation 7.That is, I/O processor 11a outputs to terminal communication module 28 through codec LSI 27 with the voice data that DSP 11c is generated.With view data likewise, 27 pairs of voice datas of codec LSI also carry out processed compressed.Compress mode to voice data can be an any way, the mode that the deterioration of preferred compressed rate height and sound is few.In addition, in other embodiments, also compression sound data and sending not.View data and voice data after terminal communication module 28 will be compressed through antenna 29 send to terminal installation 7.
And except above-mentioned view data with the voice data, game device 3 also sends various control datas to terminal installation 7 as required.Control data is the data of the control indication of expression structural element that terminal installation 7 is possessed, for example representes the indication etc. of shooting of the indication of lighting, the control camera (camera 56 shown in Figure 10) of control mark portion (labeling section 55 shown in Figure 10).The indication of I/O processor 11a and CPU 10 correspondingly sends to terminal installation 7 with control data.In addition, codec LSI 27 does not carry out the processed compressed of data to this control data in this embodiment, but can carry out processed compressed to this control data in other embodiments yet.In addition, can encrypt the above-mentioned data that send to terminal installation 7 from game device 3 as required, also can not encrypt.
In addition, game device 3 can receive various data from terminal installation 7.In this embodiment, terminal installation 7 transmit operation data, view data and voice data, details are narrated in the back.Receive each data of sending through antenna 29 by terminal communication module 28 from terminal installation 7.At this, implemented and the view data and the same processed compressed of voice data that send to terminal installation 7 from game device 3 from the view data and the voice data of terminal installation 7.Thereby, these view data and voice data are sent to codec LSI 27 from terminal communication module 28, implementing to output to I/O processor 11a after the decompression by codec LSI 27.On the other hand, more less from operating data and image, the acoustic phase of terminal installation 7 than data volume, the processing of contracting of therefore also can unreally exerting pressure.In addition, can encrypt as required, also can not encrypt.Thereby operating data outputs to I/O processor 11a via codec LSI27 after being received by terminal communication module 28.The storage that I/O processor 11a will receive from terminal installation 7 (temporary transient storage) is the buffer area of inner main storage 11e or external main memory 12.
In addition, game device 3 can be connected with miscellaneous equipment, exterior storage medium.That is, on I/O processor 11a, be connected with expansion connector 20 and connector for memory card 21.Expansion connector 20 is to be used for USB, SCSI (Smail Computer System Interface: the connector of such interface small computer system interface).Can on expansion connector 20, connect the such medium of exterior storage medium or connect ancillary equipment such as other controller or replace network communication module 18 with connector and communicate with network through connecting wired communication.Connector for memory card 21 is the connectors that are used to connect the such exterior storage medium of storage card.For example, I/O processor 11a can pass through expansion connector 20, connector for memory card 21 visit exterior storage mediums, saves the data in the exterior storage medium or from exterior storage medium and reads data.
In addition, in other embodiments, the several structural elements in each structural element that game device 3 is possessed also can constitute the expansion equipment that is independent of game device 3.At this moment, expansion equipment for example also can be connected with game device 3 through above-mentioned expansion connector 20.Specifically, expansion equipment for example also can possess each structural element of above-mentioned codec L SI27, terminal communication module 28 and antenna 29, but with respect to expansion connector 20 installation and removal.Thus, through above-mentioned expansion equipment being connected on the game device that does not possess above-mentioned each structural element, can make this game device constitute the structure that can communicate with terminal installation 7.
[the 3. structure of controller 5]
Then, with reference to Fig. 3～Fig. 7 controller 5 is described.Fig. 3 is the stereogram of the surface structure of expression controller 5.Fig. 4 is the stereogram of the surface structure of expression controller 5.Fig. 3 is the stereogram that the last proceeds posterolateral of slave controller 5 is observed controller 5, and Fig. 4 is the stereogram of the downside forward observation controller 5 of slave controller 5.
In Fig. 3 and Fig. 4, controller 5 has the housing 31 that for example forms through plastic shaping.It is the roughly rectangular shape of length direction that housing 31 has with its fore-and-aft direction (Z-direction shown in Figure 3), and integral body is the size that adult or child can held.The user can itself change its position, posture (inclination) through pressing the button and the mobile controller 5 that are arranged on the controller 5, carries out game operation.
The back surface of housing 31 is provided with connector 33.Connector 33 is used for miscellaneous equipment (for example other sensor unit, controller) is connected controller 5.In addition, be provided with fastening hole 33a, easily break away to prevent above-mentioned miscellaneous equipment in back lip-deep connector 33 both sides of housing 31.
Be provided with a plurality of (being four in Fig. 3) LED34a～34d at the rear portion of housing 31 upper surfaces.At this, in order to distinguish mutually, to controller 5 dispensing controller classifications (numbering) with other controller.Each LED 34a～34d is used for inferior purpose: to the above-mentioned controller classification of user notification to controller 5 current settings, perhaps to the battery allowance of user notification controller 5.Specifically, when using controller 5 to carry out game operation, with above-mentioned controller classification correspondingly, some the lighting among a plurality of LED 34a～34d.
In addition, controller 5 has shooting information operational part 35 (Fig. 6), and is as shown in Figure 4, and housing 31 front surfaces are provided with the light entrance face 35a of shooting information operational part 35.Light entrance face 35a is made up of the material from the infrared light of marker 6R and 6L of transmission at least.
Between No. 1 button 32b and home button 32f of housing 31 upper surfaces, be formed with and be used for the sound from the loudspeaker that is built in controller 5 47 (Fig. 5) is released to outside phonate hole 31a.
The internal structure of controller 5 then, is described with reference to Fig. 5 and Fig. 6.Fig. 5 and Fig. 6 are the in-built figure of expression controller 5.In addition, Fig. 5 is the stereogram of expression state that the upper shell (part of housing 31) of controller 5 is pulled down.Fig. 6 is the stereogram of expression state that the lower house (part of housing 31) of controller 5 is pulled down.Stereogram shown in Figure 6 is a stereogram of observing substrate 30 shown in Figure 5 from the back side.
In Fig. 5, the internal fixation of housing 31 be provided with substrate 30, the last interarea of this substrate 30 is provided with each action button 32a～32h, each LED 34a～34d, acceleration transducer 37, antenna 45 and loudspeaker 47 etc.(Micro Computer: microcomputer) 42 (with reference to Fig. 6) are connected with microcomputer through being formed at wiring (not shown) on substrate 30 grades for they.In this embodiment, acceleration transducer 37 is configured in the position at the center of departing from controller 5 on the X-direction.Thus, be easy to calculate the mobile of the controller 5 of controller 5 when the Z axle rotates of sening as an envoy to.In addition, acceleration transducer 37 is configured in length direction (Z-direction) and goes up the position on the front, center than controller 5.In addition, utilize wireless module 44 (Fig. 7) and antenna 45, controller 5 is brought into play function as wireless controller.
On the other hand, in Fig. 6, the front edge place on the following interarea of substrate 30 is provided with shooting information operational part 35.The place ahead of shooting information operational part 35 slave controllers 5 rise possess infrared filter 38 successively, lens 39, imaging apparatus 40 and image processing circuit 41.These parts 38～41 are installed in respectively on the following interarea of substrate 30.
And, on the following interarea of substrate 30, be provided with above-mentioned microcomputer 42 and vibrator 46.Vibrator (vibrator) 46 for example is vibrating motor, solenoid (solenoid), is connected with microcomputer 42 through the wiring that is formed on substrate 30 grades.Vibrator 46 moves according to the indication of microcomputer 42, makes controller 5 produce vibration thus.Thus, can realize transmitting the recreation of the so-called support vibration of this vibration to the user's who grips controller 5 hand.In this embodiment, vibrator 46 is disposed at the summary position on the front of housing 31.That is, vibrator 46 is configured in than the center of controller 5 and leans on distolateral position, can make the bigger vibration of controller 5 whole generations thus through the vibration of vibrator 46.In addition, connector 33 is installed in the back edge place on the following interarea of substrate 30.In addition, except that Fig. 5 and shown in Figure 6, controller 5 also possesses the quartz crystal unit of the fundamental clock that generates microcomputer 42, to the amplifier of loudspeaker 47 output sound signals etc.
In addition, the quantity of the shape of the controller 5 of Fig. 3～shown in Figure 6, shape, acceleration transducer and the vibrator of each action button and only example such as position is set also can be other shape, quantity and the position is set.In addition, in this embodiment, the shooting direction of image unit is a Z axle positive direction, but taking direction also can be any direction.That is, the position (the light entrance face 35a of shooting information operational part 35) of shooting information operational part 35 in controller 5 also can not be the front surface of housing 31, as long as can be taken into light from the outside of housing 31, also can be arranged at other face.
Fig. 7 is the block diagram of the structure of expression controller 5.Controller 5 possesses operating portion 32 (each action button 32a～32i), shooting information operational part 35, Department of Communication Force 36, acceleration transducer 37 and gyro sensor 48.The data of the content of operation that controller 5 will be represented this controller 5 is carried out send to game device 3 as operating data.In addition, below, the operating data of sometimes controller 5 being sent is called " controller function data ", and the operating data that terminal installation 7 is sent is called " terminal operation data ".
Operating portion 32 comprises above-mentioned each action button 32a～32i, and whether expression (is supressed each action button 32a～action button data 32i) and outputed to the microcomputer 42 of Department of Communication Force 36 to the input state of each action button 32a～32i.
Shooting information operational part 35 is to be used for the view data analysis that image unit photographs is picked out the high zone of wherein brightness and calculates the system of this regional position of centre of gravity, size etc.Shooting information operational part 35 for example has the sampling period about maximum 200 frame/seconds, even therefore the moving of controller 5 of higher speed also can be followed the tracks of and analyze.
Shooting information operational part 35 comprises infrared filter 38, lens 39, imaging apparatus 40 and image processing circuit 41.Infrared filter 38 only makes the infrared ray in the light of slave controller 5 the place ahead incidents pass through.The infrared ray that lens 39 will pass through infrared filter 38 can make it incide imaging apparatus 40 by coalescence.Imaging apparatus 40 for example is cmos sensor or the such solid-state imager of ccd sensor, receives infrared ray and the output image signal assembled by lens 39.At this, constitute with the marker of labelling apparatus 6 by the output infrared light as the labeling section 55 of the terminal installation 7 of shooting object.Thereby through infrared filter 38 is set, imaging apparatus 40 only receives the infrared ray that has passed through infrared filter 38 and generates view data, therefore can more correctly take the image of shooting object (labeling section 55 and/or labelling apparatus 6).Below, will be called photographed images by the image that imaging apparatus 40 photographs.In image processing circuit 41, the view data that is generated by imaging apparatus 40 is handled.Image processing circuit 41 calculates the position of shooting object in photographed images.The coordinate of the position that image processing circuit 41 calculates expression outputs to the microcomputer 42 of Department of Communication Force 36.By microcomputer 42 data of this coordinate are sent to game device 3 as operating data.Below, above-mentioned coordinate is called " marker coordinate ".Changing accordingly of marker coordinate and controller 5 itself towards (angle of inclination), position, thus game device 3 can use this marker coordinate come computing controller 5 towards, position.
In addition, in other embodiments, controller 5 also can be the structure that does not possess image processing circuit 41, also can the slave controller 5 of photographed images own be sent to game device 3.At this moment, game device 3 also can have circuit or the program that has identical function with image processing circuit 41, calculates above-mentioned marker coordinate.
In this embodiment, it is above-below direction (Y direction shown in Figure 3), left and right directions (X-direction shown in Figure 3) and these three axial linear accelerations of fore-and-aft direction (Z-direction shown in Figure 3) of benchmark that acceleration transducer 37 detects respectively with controller 5.Since acceleration transducer 37 detect with along the relevant acceleration of the rectilinear direction of each, so represent the value of three linear accelerations separately from the output of acceleration transducer 37.That is, to be represented as with controller 5 be the trivector in the XYZ coordinate system (controller coordinate system) that sets of benchmark to detected acceleration.
The data (acceleration information) of expression acceleration transducer 37 detected acceleration are outputed to Department of Communication Force 36.In addition, the changing accordingly of acceleration transducer 37 detected acceleration and controller 5 itself towards (angle of inclination), mobile phase, so game device 3 can use the acceleration information that gets access to come computing controller 5 towards, move.In this embodiment, game device 3 comes the posture, angle of inclination etc. of computing controller 5 according to the acceleration information that gets access to.
In addition; Can by the processor computers such as (for example microcomputer 42) of the processor (for example CPU 10) of game device 3 or controller 5 according to from acceleration transducer 37 (about after the acceleration transducer 63 stated also identical) signal of the acceleration of output handles; Infer thus or calculate (judgement) to go out the more information relevant with controller 5, those skilled in the art can easily understand these according to the explanation of this specification.For example; Remain static with the controller 5 that loads acceleration transducer 37 be under the situation of the prerequisite processing that comes the object computer side (promptly; Be merely acceleration of gravity and carry out under the situation of processing establishing the detected acceleration of acceleration transducer); If in fact controller 5 remains static, then can know whether the posture of controller 5 tilts or how many degree that tilt with respect to gravity direction according to detected acceleration.Specifically; With the detection axle of acceleration transducer 37 when the state of vertical lower direction is benchmark; Can know whether controller 5 tilts with respect to benchmark according to whether being applied in 1G (acceleration of gravity), can also know with respect to benchmark which kind of degree that tilted according to its size.In addition, under the situation of the acceleration transducer 37 of multiaxis, can know in further detail controller 5 is with respect to gravity direction how many degree that tilted through further the signal of acceleration of each being implemented to handle.In this case, processor both can come the angle of inclination of computing controller 5 according to the output from acceleration transducer 37, also can not calculate this angle of inclination and the incline direction of computing controller 5.Like this, use, can judge the angle of inclination or the posture of controller 5 through degree of will speed up sensor 37 and processor combination.
On the other hand; Be in dynamic state (state that controller 5 is moving) with controller 5 is under the situation of prerequisite; Acceleration transducer 37 is gone back detection and control device 5 except detecting acceleration of gravity mobile relevant acceleration; Therefore can come from detected acceleration, to remove the composition of acceleration of gravity through predetermined process, know the moving direction of controller 5 thus.In addition; Even be in controller 5 under the situation that dynamic state is a prerequisite; Also can come from detected acceleration to remove the composition with the mobile relevant acceleration of acceleration transducer, know the inclination of controller 5 thus with respect to gravity direction through predetermined process.In addition; In other embodiments, acceleration transducer 37 also can possess and is used for before will outputing to microcomputer 42 by the detected acceleration signal of built-in acceleration detecting unit, this acceleration signal being carried out the Embedded treating apparatus of predetermined processing or the special processor of other kind.For example be used to detect under the situation of static acceleration (for example acceleration of gravity) at acceleration transducer 37, embedded or special processor also can convert inclination angle (perhaps other preferred parameter) into by degree of will speed up signal.
The angular speed that gyro sensor 48 detects around three axles (being the XYZ axle in this embodiment).In this manual; Shooting direction (Z axle positive direction) with controller 5 is a benchmark; To be called pitch orientation (pitch direction) around the direction of rotation of X axle; Yaw direction (yaw direction) will be called around the direction of rotation of Y axle, inclination direction (roll direction) will be called around the direction of rotation of Z axle.As long as gyro sensor 48 can detect the angular speed around three axles, the quantity of employed gyro sensor can be arbitrarily with combination.For example, gyro sensor 48 can be the three-axis gyroscope sensor, also can dual spindle gyroscopes sensor and single axis gyroscope sensor be made up the angular speed that detects around three axles.Expression is outputed to Department of Communication Force 36 by the data of gyro sensor 48 detected angular speed.In addition, gyro sensor 48 also can detect the angular speed around one or two.
Department of Communication Force 36 comprises microcomputer 42, memory 43, wireless module 44 and antenna 45.Microcomputer 42 when handling with memory 43 as storage area, and 42 pairs of wireless modules 44 of microcomputer control, this wireless module 44 sends to game device 3 with microcomputer 42 accessed data wireless.
The data that output to microcomputer 42 from operating portion 32, shooting information operational part 35, acceleration transducer 37 and gyro sensor 48 temporarily are kept at the memory 43.These data are sent out to game device 3 as operating data (controller function data).That is, when the delivery time that sends to the controller communication module 19 of game device 3 arrived, the operating data that microcomputer 42 will be kept in the memory 43 outputed to wireless module 44.Wireless module 44 for example uses the technology of bluetooth (Bluetooth) (registration mark), with the carrier wave of operating data modulation specifications frequency, from antenna 45 these faintness wave signals of emission.That is, operating data is modulated to the faintness wave signal by wireless module 44 and slave controller 5 sends.The faintness wave signal is received by the controller communication module 19 of game device 3 sides.Through the faintness wave signal that receives is carried out demodulation, decoding, game device 3 can obtain operating data.Then, the CPU 10 of game device 3 operating data of using slave controllers 5 to get access to is carried out game processing.In addition, every cycle at a distance from regulation carries out from the wireless transmission of Department of Communication Force 36 to controller communication module 19 one by one, and the processing of recreation was that unit (as a frame time) carries out with 1/60 second generally, therefore preferably sent with the cycle smaller or equal to this time.The Department of Communication Force 36 of controller 5 for example outputs to operating data with 1/200 second ratio once the controller communication module 19 of game device 3.
As stated, controller 5 can send marker coordinate data, acceleration information, angular velocity data and action button data, is used as representing the operating data to the operation of this controller 5.In addition, game device 3 performs game process the aforesaid operations data with the input of playing games.Thereby through using above-mentioned controller 5, the user can also carry out the game operation of mobile controller 5 itself except the general game operation in the past that can press each action button.For example, can carry out the operation etc. of the operation with posture inclination controller 5 arbitrarily, the operation that utilizes the optional position on the controller 5 indication pictures and mobile controller 5 itself.
In addition, in this embodiment, controller 5 does not have the display unit that shows game image, but can have the display unit that is used to show the image of for example representing battery allowance etc. yet.
[the 4. structure of terminal installation 7]
The structure of terminal installation 7 then, is described with reference to Fig. 8～Figure 10.Fig. 8 is the figure of the surface structure of expression terminal installation 7.(a) figure among Fig. 8 is the front view of terminal installation 7, and (b) figure is a vertical view, and (c) figure is a right view, and (d) figure is a upward view.In addition, Fig. 9 is the figure of the situation of expression user's handling terminal installation 7.
As shown in Figure 8, terminal installation 7 possesses the housing 50 that roughly is the rectangular plate-like shape of growing crosswise.Housing 50 has the size of the degree that the user can grip.Thereby the user can hold and mobile terminal apparatus 7, or change the allocation position of terminal installation 7.
Shown in (a) figure of Fig. 8, terminal installation 7 has touch panel 52 and is used as operating unit on the screen of LCD 51.In this embodiment, touch panel 52 is touch panels of resistive film mode.But touch panel is not limited to the resistive film mode, for example also can use the touch panel of any-modes such as electrostatic capacitance mode.In addition, touch panel 52 both can be the single-point touches mode, also can be the multiple point touching mode.In this embodiment, as touch panel 52, the touch panel of the resolution ratio equal resolution (detection accuracy) of utilization and LCD 51.But the resolution ratio of the resolution ratio of touch panel 52 and LCD 51 may not be consistent.Usually use pointer that touch panel 52 is imported, but be not limited to pointer, the user also can import touch panel 52 by enough fingers.In addition, on housing 50, also can be provided with reception hole, this reception hole is used for taking in and is used for pointer that touch panel 52 is operated.Like this, because terminal installation 7 possesses touch panel 52, so the user can one side mobile terminal apparatus 7 one side operating touch panels 52.That is to say that the user can import this screen direct (through touch panel 52) in the screen that moves LCD 51.
As shown in Figure 8, terminal installation 7 possesses two analog stick 53A and 53B and a plurality of button 54A～54L and is used as operating unit.Each analogy rocking bar 53A and 53B are the equipment of indication direction.Each analogy rocking bar 53A and 53B constitute and can make the rocking bar portion of operating through user's finger slide or tilt along any direction (up and down and the angle arbitrarily of tilted direction) with respect to the surface of housing 50.In addition, left analog stick 53A is arranged on the left side of the screen of LCD 51, and right analog stick 53B is arranged on the right side of the screen of LCD51.Thereby, no matter the user with about which hand can both use analog stick to carry out the input of direction indication.In addition; As shown in Figure 9; Each analogy rocking bar 53A and 53B be arranged on the user can grip terminal installation 7 about the position of they being operated under the state of part; Even therefore the user hold and the situation of mobile terminal apparatus 7 under, also can easily operate each analogy rocking bar 53A and 53B.
Each button 54A～54L is the operating unit of the input that is used to stipulate.As shown below, each button 54A～54L be set at the user can grip terminal installation 7 about the position (with reference to Fig. 9) of operating under the state of part.Thereby, even the user hold and the situation of mobile terminal apparatus 7 under, also can easily operate these operating units.
Shown in (a) figure of Fig. 8, the front of housing 50 is provided with cross button (direction load button) 54A and the button 54B～54H among each action button 54A～54L.That is to say that these buttons 54A～54H is configured in the position (with reference to Fig. 9) of the enough thumb manipulations of user's ability.
In addition, like Fig. 8 (a) figure, (b) figure and (c) shown in the figure, a L button 54I and a R button 54J are set at the oblique upper portion (upper left side part and upper right side part) of housing 50.Specifically, a L button 54I is set at the left end of the upside side of tabular housing 50, exposes from the side in upside and left side.In addition, a R button 54J is set at the right-hand member of the upside side of housing 50, exposes from the side on upside and right side.Like this, a L button 54I is configured in the position of the enough left index finger operations of user's ability, and a R button 54J is configured in the position (with reference to Fig. 9) of the enough right hand forefinger operations of user's ability.
In addition, with (c) shown in the figure, the 2nd L button 54K and the 2nd R button 54L are configured on the 59A of foot and 59B at the outstanding back side (that is, with the positive opposite face that LCD 50 is set) that is arranged at tabular housing 50 like Fig. 8 (b) figure.Specifically, the position of top is leaned in the left side (left side when face side is observed) that the 2nd L button 54K is arranged on housing 50 back sides slightly, and the right side (right side when face side is observed) that the 2nd R button 54L is arranged on housing 50 back sides is slightly by the position of top.In other words, the 2nd L button 54K is arranged on and is set at the roughly position of opposition side of positive left analog stick 53A, and the 2nd R button 54L is arranged on and is set at the roughly position of opposition side of positive right analog stick 53B.Like this, the 2nd L button 54K is configured in the position of the enough left hand middle finger operations of user's ability, and the 2nd R button 54L is configured in the position (with reference to Fig. 9) of the enough right hand middle finger operations of user's ability.In addition, the 2nd L button 54K and the 2nd R button 54L shown in Fig. 8 (c) figure such be set at above-mentioned 59A of foot and 59B on the face of oblique upper, have button cover towards oblique upper.It is generally acknowledged that middle finger moves along the vertical direction under the situation of user's handling terminal installation 7,, be easy to make the user to press the 2nd L button 54K and the 2nd R button 54L therefore through making button cover towards the top.In addition, through the back side at housing 50 foot is set, the user is easy to grip housing 50, and, through button is set in foot, under the state that grips housing 50, operate easily.
In addition; About terminal installation shown in Figure 87; Because the 2nd L button 54K and the 2nd R button 54L are set at the back side, therefore carry under the situation of putting terminal installation 7 at screen (front of housing 50) state up with LCD 51, screen not exclusively is in level sometimes.Therefore, in other embodiments, also can form the foot more than three at the back side of housing 50.Thus, under the screen state up of LCD 51, carry the face of putting, can terminal installation be put carrying in 7 years and put on the face, therefore can carry and put terminal installation 7 with the mode that screen is in level through foot contact.In addition, but also can come flatly to carry to put terminal installation 7 through appending the foot of installation and removal.
Each button 54A～54L is suitably distributed and the games function corresponding.For example, cross button 54A and button 54E～54H also can be used for direction indication operation, selection operation etc., and each button 54B～54E also can be used for confirming operation, cancellation operation etc.
In addition, though do not illustrate, terminal installation 7 has the power knob of the power supply that is used for on/off terminal installation 7.In addition, terminal installation 7 also can have button that the picture that is used for On/Off LCD 51 shows, is used to carry out with the button that is connected setting (pairing) of game device 3, is used to regulate the button of the volume of loudspeaker (loudspeaker 67 shown in Figure 10).
Shown in (a) figure of Fig. 8, terminal installation 7 possesses the labeling section (labeling section 55 shown in Figure 10) that is made up of marker 55A and marker 55B on the front of housing 50.Labeling section 55 is set at the upside of LCD 51.Each the marker 6R and the 6L of each marker 55A and marker 55B and labelling apparatus 6 likewise are made up of more than one infrared LED.With above-mentioned labelling apparatus 6 likewise, usage flag portion 55 when mobile wait of game device 3 computing controllers 5.In addition, each infrared LED of can control mark portion 55 being possessed of game device 3 lights.
In addition, terminal installation 7 possesses the microphone (microphone 69 shown in Figure 10) as the sound input block.Be provided with microphone with hole 60 in the front of housing 50.Microphone 69 is arranged at this microphone with inside in the hole 60, housing 50.Microphone detects user's terminal installations such as sound 7 sound on every side.
In addition, terminal installation 7 possesses and is used for other device is connected the expansion connector 58 on the terminal installation 7.In this embodiment, shown in (d) figure of Fig. 8, expansion connector 58 is arranged on the downside side of housing 50.In addition, other device that is connected with expansion connector 58 can be to install arbitrarily, for example can be input units such as the controller (controller of rifle type etc.) that in specific recreation, uses, keyboard.If need not connect other device, then also expansion connector 58 can be set.
In addition, about terminal installation shown in Figure 87, the shape of each action button, housing 50, the quantity of each structural element and only simple example such as position is set also can be other shape, quantity and the position is set.
The internal structure of terminal installation 7 then, is described with reference to Figure 10.Figure 10 is the block diagram of the internal structure of expression terminal installation 7.Shown in figure 10; Integrated circuit) 68, microphone 69, wireless module 70, antenna 71, infrared communication module 72, flash memory 73, power supply IC 74 and battery 75 terminal installation 7 also possesses touch panel controller 61, Magnetic Sensor 62, acceleration transducer 63, gyro sensor 64, user interface controller (UI controller) 65, codec LSI 66, loudspeaker 67, voice IC (Integrated Circuit: except possessing structure shown in Figure 8.These electronic units are installed on the electronic circuit board and are accommodated in the housing 50.
Acceleration transducer 63 is arranged on the inside of housing 50, detects along the size of the linear acceleration of three (the xyz axle shown in (a) figure of Fig. 8) directions.Specifically, acceleration transducer 63 is the x axle with the long side direction of housing 50, is the y axle with the short side direction of housing 50, is the z axle with the positive vertical direction with housing 50, detects the size of the linear acceleration of each.The acceleration information of representing detected acceleration is outputed to UI controller 65.In addition, the control of acceleration transducer 63 is indicated to acceleration transducer 63 output needles from UI controller 65.Acceleration transducer 63 for example is the MEMS type acceleration transducer of electrostatic capacitive in this embodiment, but also can make acceleration transducer otherwise in other embodiments.In addition, acceleration transducer 63 also can be the acceleration transducer that detects single shaft or biaxially oriented.
Gyro sensor 64 is arranged on the inside of housing 50, detects the angular speed around above-mentioned x axle, y axle and these three axles of z axle.The angular velocity data of representing detected angular speed is outputed to UI controller 65.In addition, the control of gyro sensor 64 is indicated to gyro sensor 64 output needles from UI controller 65.In addition, the quantity of gyro sensor that is used to detect three angular speed can be arbitrarily with combination, and gyro sensor 64 also can likewise be made up of dual spindle gyroscopes sensor and single axis gyroscope sensor with gyro sensor 48.In addition, gyro sensor 64 can also be the gyro sensor that detects single shaft or biaxially oriented.
The operating data that UI controller 65 will comprise the touch position data, rocking bar data, action button data, bearing data, acceleration information and the angular velocity data that receive from above-mentioned each structural element outputs to codec LSI 66.In addition, other device is being connected under the situation on the terminal installation 7, also can making the aforesaid operations data also comprise the data of the operation that expression carries out this other device through expansion connector 58.
As stated, comprise operating data (terminal operation data), view data and voice data from terminal installation 7 to the transmission data that game device 3 sends.In addition, other device is being connected under the situation on the terminal installation 7, also can making above-mentioned transmission data also comprise the data that receive from this other device through expansion connector 58.In addition, carry out for example abideing by IRDA (Infrared Data Association: the infrared communication of standard Infrared Data Association) between infrared communication module 72 and other device.Codec LSI 66 sends to game device 3 after also can making the packet that receives through infrared communication be contained in the above-mentioned transmission data as required.
In addition, as stated, from view data and the voice data of game device 3 after terminal installation 7 sends compression.These data are received by codec LSI 66 through antenna 71 and wireless module 70.66 pairs of view data that receive of codec LSI and voice data decompress.View data after the decompression is outputed to LCD 51, thereby image is displayed on the LCD 51.In addition, the voice data that obtains that decompresses is outputed to voice IC 68, and voice IC 68 is from loudspeaker 67 output sounds.
In addition, the data that receive from game device 3, comprise under the situation of control data, codec LSI 66 carries out the control indication according to control data with 65 pairs of each several parts of UI controller.As stated; Control data is the data of the control indication of each structural element (in this embodiment, camera 56, touch panel controller 61, labeling section 55, each sensor 62～64 and infrared communication module 72) of being possessed to terminal installation 7 of expression.In this embodiment, as the represented control indication of control data, consideration is moved the said structure key element or is made action end the indication of (stopping).That is, also can end obsolete structural element in the recreation, in this case, be made as the data that do not comprise to come the structural element of oneself ending from terminal installation 7 to the transmission data of game device 3 transmissions in order to suppress power consumption.Therefore in addition, labeling section 55 is infrared LEDs, and control only need start/stop electric power providing and get final product.
As stated; Terminal installation 7 possesses the such operating unit of touch panel 52, analog stick 53 and action button 54; But also can be to replace these operating units and possess the structure of other operating unit or both possessed the structure that these operating units also possess other operating unit in other embodiments.
In addition; Terminal installation 7 possesses the sensor that moves (comprising the variation of position, posture or position, the variation of posture) that Magnetic Sensor 62, acceleration transducer 63 and gyro sensor 64 are used as being used for computing terminal device 7; But in other embodiments, also can be the structure that only possesses one or two sensor in these sensors.In addition, in other embodiments, also can be to replace these sensors and possess the structure of other sensor or both possessed the structure that these sensors also possess other sensor.
In addition, terminal installation 7 is the structures that possess camera 56 and microphone 69, but in other embodiments, also can not possess camera 56 and microphone 69, can also only possess some in camera 56 and the microphone 69.
In addition; Terminal installation 7 constitutes possesses the structure that labeling section 55 is used as being used for the position relation (position of the terminal installation 7 that slave controller 5 is observed and/or posture etc.) between computing terminal device 7 and the controller 5; But in other embodiments, also can constitute the structure that does not possess labeling section 55.In addition, in other embodiments, terminal installation 7 also can possess the structure that other unit is used as being used to calculate above-mentioned position relation.For example, in other embodiments, can constitute also that controller 5 possesses labeling section and terminal installation 7 possesses imaging apparatus.And in this case, labelling apparatus 6 also can constitute the structure that replaces infrared LED and possess imaging apparatus.
[5. game processing]
Then, be described in detail in the game processing of carrying out in this games system.At first, describe to the various data of in game processing, using.Figure 11 is the figure that is illustrated in the various data of using in the game processing.Figure 11 is the figure of the key data of being stored in the main storage (external main memory 12 or inner main storage 11e) of expression game device 3.Shown in figure 11, storage games 90, reception data 91 and processing are with data 106 in the main storage of game device 3.In addition, in main storage except storing data shown in Figure 11, the needed data of using in the view data of the various objects that also occur in the storage recreation, the recreation of recreation such as voice data.
To the suitable moment after game device 3 energized from CD 4 read in games 90 part or all and store into the main storage.In addition, also can replace CD 4 and obtain games 90 from the external device (ED) (for example via the internet) of flash memory 17 or game device 3.In addition, also can a part of program that comprise in the games 90 (program that for example is used for the posture of computing controller 5 and/or terminal installation 7) be stored in the game device 3 in advance.
Receiving data 91 is various data that slave controller 5 and terminal installation 7 receive.Receive data 91 and comprise controller function data 92, terminal operation data 97, camera image data 104 and microphone voice data 105.Under the situation that connects a plurality of controllers 5, controller function data 92 also become a plurality of.Under the situation that connects a plurality of terminal installations 7, terminal operation data 97, camera image data 104 and microphone voice data 105 also become a plurality of.
The first action button data 93 are data of representing the input state that is arranged on each the action button 32a～32i on the controller 5.Specifically, whether the first action button data, 93 each action button 32a～32i of expression are pressed.
First angular velocity data 95 is expression data by the 48 detected angular speed of the gyro sensor in the controller 5.At this, 95 expressions of first angular velocity data still in other embodiments, need only expression around the more than one angular speed of axle arbitrarily around XYZ shown in Figure 3 three axial each angular speed.
Marker coordinate data 96 coordinate that to be expressions calculated by the image processing circuit 41 of shooting information operational part 35, be the data of above-mentioned marker coordinate.Be used to represent with the corresponding plane of photographed images on the two-dimensional coordinate system of position show the marker coordinate, the coordinate figure in marker coordinate data 96 these two-dimensional coordinate systems of expression.
In addition, controller function data 92 also can only comprise the part in above-mentioned each data 93～96 so long as the data of the user's of expression operation control 5 operation get final product.In addition, have at controller 5 under the situation of other input block (for example touch panel, analog stick etc.), controller function data 92 also can comprise the data of expression to the operation of this other input block.In addition; As this embodiment with the moving of controller 5 itself as under the situation of game operation, make controller function data 92 comprise the mobile correspondingly data of variation own like first acceleration information 94, first angular velocity data 95 or the such value of marker coordinate data 96 and controller 5.
The second action button data 98 are data of representing the input state that is arranged on each the action button 54A～54L on the terminal installation 7.Specifically, whether the second action button data, 98 each action button 54A～54L of expression are pressed.
Rocking bar data 99 are the rocking bar portion of expression analog stick 53 ( analog stick 53A and 53B) (the perhaps tilting) direction of being slided and the data of amount.Above-mentioned direction for example also can be expressed as two-dimensional coordinate or two-dimensional vector with amount.
Touch position data 100 is the data that are illustrated in the position of importing on the input face of touch panel 52 (touch location).In this embodiment, touch position data 100 expression is used to illustrate the coordinate figure that the two-dimensional coordinate of the position on the above-mentioned input face is fastened.In addition, be under the situation of multiple point touching mode at touch panel 52, touch position data 100 is also represented a plurality of touch locations sometimes.
Second angular velocity data 102 is expression data by gyro sensor 64 detected angular speed.In this embodiment, 102 expressions of second angular velocity data still in other embodiments, need only the angular speed of expression around an arbitrary axis more than the axle around each angular speed of three of xyz shown in Figure 8.
In addition, terminal operation data 97 also can only comprise some in above-mentioned each data 98～103 so long as the data of the user's of expression operating terminal device 7 operation get final product.In addition, have at terminal installation 7 under the situation of other input block (for example image unit of Trackpad, controller 5 etc.), terminal operation data 97 also can comprise the data of expression to the operation of this other input block.In addition; As this embodiment with the moving of terminal installation 7 itself as under the situation of game operation, make terminal operation data 97 comprise the mobile correspondingly data of variation own like second acceleration information 101, second angular velocity data 102 or the such value of bearing data 103 and terminal installation 7.
The data of camera image data 104 image (camera image) that to be expressions photographed by the camera 56 of terminal installation 7.Camera image data 104 are view data that the view data after the compression of self terminal device 7 in the future decompresses and obtains through codec LSI 27, and 11a is stored in the main storage by I/O processor.In addition, in main storage, also can begin the camera image data of store predetermined number in order from up-to-date (getting access at last) data.
Handle with data 106 be after the data of use in the game processing (Figure 12) stated.Handle and comprise control data 107, controller gesture data 108, terminal gesture data 109, image recognition data 110 and voice recognition data 111 with data 106.In addition, except data shown in Figure 11, handle also to comprise and represent various data that the data of the various parameters of the various objects settings that in recreation, occur etc. are used in game processing with data 106.
Then, be described in detail in the game processing of carrying out in the game device 3 with reference to Figure 12.Figure 12 is the main flow chart that is illustrated in the flow process of the game processing of carrying out in the game device 3.When the power supply of game device 3 was switched on, the CPU 10 of game device 3 carried out and is stored in the start-up routine in the not shown boot ROM, thus each unit such as main storage is carried out initialization.Then, the games that are stored in the CD 4 are read in the main storage, begin to carry out these games by CPU 10.In addition; In game device 3; Both can be behind power connection, to carry out the structure that is stored in the games in the CD 4 immediately, also can be behind power connection, at first to carry out the plug-in of the menu screen that shows regulation and when being indicated the recreation beginning by the user, carry out the structure that is stored in the games in the CD 4 after this.Flow chart shown in Figure 12 is the flow chart that is illustrated in the processing of carrying out after above the finishing dealing with.
In addition, the processing of each step of flow chart shown in Figure 12 is an example, as long as can access same result, also can change the processing sequence of each step.In addition, the value of variable, the threshold value of in determining step, using also all are an example, can adopt other value as required.In addition, in this embodiment, be made as the processing of carrying out each step of above-mentioned flow chart by CPU 10 and describe, but also can carry out the processing of a part of step of above-mentioned each step by processor beyond the CPU 10 or special circuit.
At first, in step S1, CPU 10 carries out initial treatment.Initial treatment for example is following processing: make up virtual gamespace and each object that will in gamespace, occur and be configured in initial position, perhaps the initial value of the various parameters in game processing, used is set.
In addition, in this embodiment, in initial treatment, CPU 10 comes lighting of control mark device 6 and labeling section 55 according to the kind of games.At this, games system 1 have labelling apparatus 6 and terminal installation 7 labeling section 55 the two be used as the shooting object of the image unit (shooting information operational part 35) of controller 5.According to the difference of game content (kinds of games), a certain side in usage flag device 6 and the labeling section 55 perhaps uses two sides.In addition, in games 90, include the data whether expression makes each labelling apparatus 6 and labeling section 55 light.CPU 10 reads out these data and judges whether to light.Then, under the situation that labelling apparatus 6 and/or labeling section 55 are lighted, the processing below carrying out.
That is, under the situation that will light labelling apparatus 6, the control signal that CPU 10 lights to each infrared LED that labelling apparatus 6 transmission expressions are possessed labelling apparatus 6.The transmission of this control signal also can only provide the meaning of electric power.Correspondingly each infrared LED of labelling apparatus 6 is lighted therewith.On the other hand, under the situation that will light labeling section 55, CPU 10 generates the control data of the indication that expression lights labeling section 55 and stores in the main storage.The control data that is generated after be sent to terminal installation 7 among the step S10 that states.The control data that is received by the wireless module 70 of terminal installation 7 is sent to UI controller 65 through codec LSI 66, the indication that 65 pairs of labeling section 55 of UI controller are lighted.Thus, the infrared LED of labeling section 55 is lighted.In addition, foregoing has been explained the situation that labelling apparatus 6 and labeling section 55 are lighted, but also can be through carrying out extinguishing of labelling apparatus 6 and labeling section 55 with the same processing of situation about lighting.
The processing of execution in step S2 after above step S1.After, the cycle of treatment that is formed by a series of processing of step S2～S11 repeats with every ratio of carrying out once at a distance from the stipulated time (frame time).
In step S2, CPU 10 obtains the controller function data that slave controller 5 sends over.Controller 5 is to game device 3 transmit control device operating data repeatedly; Therefore in game device 3; Controller communication module 19 receives this controller function data successively, and the controller function data that receive are stored in the main storage through I/O processor 11a successively.It is shorter than the processing time of recreation preferably to send the interval that receives, for example 1/200 second.In step S2, CPU 10 reads up-to-date controller function data 92 from main storage.The processing of execution in step S3 after step S2.
In step S3, CPU 10 obtains the various data that send over from terminal installation 7.Terminal installation 7 sends terminal operation data, camera image data and microphone voice data repeatedly to game device 3, so game device 3 receives these data successively.In game device 3, terminal communication module 28 receives these data successively, implements decompression successively by 27 pairs of camera image data of codec LSI and microphone voice data.Then, I/O processor 11a stores terminal operation data, camera image data and microphone voice data in the main storage into successively.In step S3, CPU 10 reads up-to-date terminal operation data 97 from main storage.The processing of execution in step S4 after step S3.
In step S4, CPU 10 carries out game control and handles.It is to carry out the processing that the object in the gamespace is moved according to the game operation that the user carries out to wait the processing that advances recreation that game control is handled.In this embodiment, the user can utilize controller 5 and/or terminal installation 7 to carry out various recreation.Below, with reference to Figure 13 the game control processing is described.
Figure 13 is the flow chart of the detailed process of expression game control processing.In addition; A series of processing shown in Figure 13 are that controller 5 and terminal installation 7 are being used as the various processing that can carry out under the situation of operating means; But need not carry out the whole of each processing, can only carry out a part and handle according to the kind of recreation, the difference of content.
In game control was handled, at first, in step S21, CPU 10 judged whether to change the marker that will use.As stated, in this embodiment, when the beginning game processing (step S1), carry out the processing of controlling of lighting to labelling apparatus 6 and labeling section 55.At this, also consider the situation that changes (will the light) object that will use among labelling apparatus 6 and the labeling section 55 according to the difference of playing and in recreation midway.In addition, also consider,, then might cause a side marker is detected the marker into the opposing party by error if still two sides are lighted according to difference and the usage flag device 6 of recreation and labeling section 55 these two sides' situation.Therefore, also preferred sometimes in game process, switch to light with the mode of only lighting a certain side use.The processing of step S21 be consider above-mentioned situation and judge the recreation whether change the object that will light midway processing.
For example can carry out the judgement of above-mentioned steps S21 through following method.That is, whether CPU 10 can take place to change and carry out above-mentioned judgement according to game state (platform of recreation or operand etc.).This is because consider under the situation that game state changes, and come the method for operating of operation control 5 towards labelling apparatus 6 and come alter operation method between the method for operating of operation control 5 towards labeling section 55.In addition, CPU 10 can carry out above-mentioned judgement according to the posture of controller 5.That is can be to carry out above-mentioned judgement, according to controller 5 towards labelling apparatus 6 or towards labeling section 55.In addition, can calculate the posture (the step S23 that states after the reference) of controller 5 according to the for example testing result of acceleration transducer 37, gyro sensor 48.In addition, CPU 10 also can indicate according to the change that whether exists the user to carry out and carry out above-mentioned judgement.
Under the judged result of above-mentioned steps S21 is sure situation, the processing of execution in step S22.On the other hand, be under the situation of negating in the judged result of above-mentioned steps S21, the processing of skips steps S22 and the processing of execution in step S23.
In step S22, the lighting of CPU 10 control mark devices 6 and labeling section 55.That is, the illuminating state to labelling apparatus 6 and/or labeling section 55 changes.In addition, can likewise light or extinguish the concrete processing of labelling apparatus 6 and/or labeling section 55 with the situation of above-mentioned steps S1.The processing of execution in step S23 after step S22.
As stated; According to this embodiment; Processing through above-mentioned steps S1; Can with the kind of games luminous (the lighting) of control mark device 6 and labeling section 55 correspondingly, and the processing through above-mentioned steps S21 and S22, can with game state luminous (the lighting) of control mark device 6 and labeling section 55 correspondingly.
In step S23, the posture of CPU 10 computing controllers 5.In this embodiment, come the posture of computing controller 5 according to first acceleration information 94, first angular velocity data 95 and marker coordinate data 96.Below, describe to the computational methods of the posture of controller 5.
At first, CPU 10 comes the posture of computing controller 5 according to being stored in first angular velocity data 95 in the main storage.Method according to the posture of angular speed calculation controller 5 can be an arbitrary method, utilizes last time posture (posture that last time calculated) and this angular speed (angular speed that obtains among the step S2 in this cycle of treatment) to calculate this posture.Specifically, CPU 10 calculates posture through making posture last time with this angular speed rotation unit interval.In addition, utilize the controller gesture data 108 that is stored in the main storage to represent posture last time, utilize first angular velocity data 95 that is stored in the main storage to represent this angular speed.Thereby CPU 10 comes the posture of computing controller 5 from the main storage Read Controller gesture data 108 and first angular velocity data 95.The data of " based on the posture of angular speed " that expression calculates as above-mentioned are stored in the main storage.
In addition, under situation, preferably confirm initial posture in advance according to the angular speed calculation posture.That is to say that under the situation according to the posture of angular speed calculation controller 5, CPU 10 initial calculated in advance go out the initial posture of controller 5.The initial posture of controller 5 can be calculated according to acceleration information, also can the given pose in the moment of having carried out predetermined operation be used as initial posture through under the state that controller 5 is formed specific posture, making the player carry out predetermined operation.In addition; Being calculated as with the prescribed direction in the space in the posture of controller 5 is preferably to calculate above-mentioned initial posture under the situation of absolute posture of benchmark; But for example be calculated as under the situation of relative posture that posture with the controller 5 of recreation zero hour is a benchmark, also can disregard to count in and state initial posture in the posture of controller 5.
Then, CPU 10 utilizes first acceleration information 94 to proofread and correct the posture of the controller 5 of calculating according to turn meter.Specifically, CPU 10 at first reads first acceleration information 94 from main storage, comes the posture of computing controller 5 according to first acceleration information 94.At this, under the almost static state of controller 5, mean that the acceleration that controller 5 is applied is an acceleration of gravity.Thereby; Under this state; Can utilize the direction (gravity direction) of calculating acceleration of gravity by first acceleration information 94 of acceleration transducer 37 output, therefore can according to these first acceleration information, 94 computing controllers 5 with respect to gravity direction towards (posture).The data of " based on the posture of acceleration " that expression calculates as above-mentioned are stored in the main storage.
When the posture that calculates based on acceleration, CPU 10 then utilizes and proofreaies and correct the posture based on angular speed based on the posture of acceleration.Specifically, CPU 10 reads out expression based on the data of the posture of angular speed and the data of expression based on the posture of acceleration from main storage, makes based on the posture of angular velocity data with the ratio of regulation to based on the approaching correction of the posture of acceleration information.The ratio of this regulation can be the fixed value that is predetermined, and also can set according to represented acceleration of first acceleration information 94 etc.In addition, about posture, can't calculate posture to the direction of rotation that with the gravity direction is axle, so CPU 10 can not proofread and correct yet about this direction of rotation based on acceleration.In this embodiment, the data of the posture after the correction that expression obtains as stated are stored in the main storage.
After that kind had been proofreaied and correct the posture based on angular speed as stated, CPU 10 utilized the posture after 96 pairs of corrections of marker coordinate data further to proofread and correct.At first, CPU 10 comes the posture (based on the posture of marker coordinate) of computing controller 5 according to marker coordinate data 96.Therefore marker coordinate data 96 expressive notation device 6R and the position of 6L in photographed images can be calculated the posture of the controller 5 relevant with inclination direction (around the direction of rotation of Z axle) according to these positions.That is to say, can calculate the posture of the controller 5 relevant according to the slope that in photographed images, the position of marker 6R and the position of marker 6L is connected the straight line that obtains with the inclination direction.In addition; Can confirm under the situation of controller 5 with respect to the position of labelling apparatus 6 (for example can be assumed under the situation in front that controller 5 is positioned at labelling apparatus 6); Can be according to the position of labelling apparatus 6 in photographed images, the posture of the controller 5 that calculating is relevant with pitch orientation and yaw direction.For example, under the situation about moving to left in the position of photographed images internal labeling device 6R and 6L, can be judged as controller 5 will become to the right towards (posture).Like this, can calculate the posture of the controller 5 relevant according to marker 6R and the position of marker 6L with pitch orientation and yaw direction.Through above-mentioned processing, can come the posture of computing controller 5 according to marker coordinate data 96.
When the posture that calculates based on the marker coordinate, CPU 10 then utilizes based on the posture of marker coordinate to come the posture after the above-mentioned correction (utilizing the posture after proofreading and correct based on the posture of acceleration) is proofreaied and correct.That is, CPU 10 carries out the posture after proofreading and correct with the ratio of regulation to based on the approaching correction of the posture of marker coordinate.The ratio of this regulation can be the fixed value that is predetermined.In addition, utilizing the correction of carrying out based on the posture of marker coordinate also can be only any direction in inclination direction, pitch orientation and the yaw direction or any both direction to be carried out.For example, under the situation of utilizing marker coordinate data 96, calculating posture, so CPU 10 also can be utilized based on the posture of marker coordinate data 96 and only the inclination direction proofreaied and correct with can being directed against inclination direction pinpoint accuracy.In addition; Do not photograph at imaging apparatus 40 under the situation of labelling apparatus 6 or labeling section 55 by controller 5; Posture can't be calculated, therefore also the treatment for correcting of utilizing marker coordinate data 96 can be do not carried out in this case based on marker coordinate data 96.
According to foregoing, CPU 10 utilizes the prime of the controller 5 that 96 pairs of first acceleration information 94 and marker coordinate datas calculate according to first angular velocity data 95 to proofread and correct.At this, the method for utilizing angular speed of the method for the posture through being used for computing controller 5, no matter how controller 5 moves, and can both calculate posture.On the other hand; In utilizing the method for angular speed; Therefore calculate posture through the detected successively angular speed that adds up, might cause the accuracy variation owing to error accumulation etc., perhaps cause the accuracy variation of gyro sensor owing to the problem of so-called temperature drift.In addition, the method for utilizing acceleration can accumulated error, but makes under the controller 5 violent states that move, and (owing to can't correctly detect gravity direction) can't be calculated posture in pinpoint accuracy ground.In addition, utilize the method for marker coordinate to calculate posture in (particularly about the inclination direction) pinpoint accuracy ground, but under the state of taking less than labeling section 55, can't calculate posture.Therefore to this, according to this embodiment, as above-mentioned, utilize three kinds of different methods of advantage, the posture of computing controller 5 more correctly.In addition, in other embodiments, also can utilize any or any two kinds of methods in above-mentioned three kinds of methods to calculate posture.In addition, in the processing of above-mentioned steps S1 or S22, carry out under the situation of lighting control of marker, preferably, CPU 10 utilizes the marker coordinate to come the posture of computing controller 5 at least.
The processing of execution in step S24 after above-mentioned steps S23.In step S24, the posture of CPU 10 computing terminal devices 7.That is, the terminal operation data of obtaining from terminal installation 7 97 comprise second acceleration information 101, second angular velocity data 102 and bearing data 103, so CPU 10 comes the posture of computing terminal device 7 according to these data.At this, CPU 10 can be known the rotation amount (variable quantity of posture) of terminal installation 7 time per units according to second angular velocity data 102.In addition; Under the almost static state of terminal installation 7; Mean that the acceleration that terminal installation 7 is applied is an acceleration of gravity, therefore can know the gravity direction (that is, with the gravity direction being the posture of the terminal installation 7 of benchmark) that terminal installation 7 is applied according to second acceleration information 101.In addition, can know with terminal installation 7 to be the orientation (that is, the orientation with regulation is the posture of the terminal installation 7 of benchmark) of the regulation of benchmark according to bearing data 103.In addition, under the situation that has produced the magnetic field beyond the earth's magnetic field, also can know the rotation amount of terminal installation 7.Thereby, the posture that CPU 10 can come computing terminal device 7 according to these second acceleration informations 101, second angular velocity data 102 and bearing data 103.In addition, in this embodiment,, but in other embodiments, also can calculate posture according to one or two data in above-mentioned three data according to the posture of above-mentioned three data computing terminal devices 7.
In addition; The concrete computational methods of the posture of terminal installation 7 can be arbitrary method, for example consider to utilize second acceleration information 101 with bearing data 103 posture of calculating according to second angular velocity data, 102 represented turn meters to be carried out method of correcting.Specifically, CPU 10 is at first according to the posture of second angular velocity data, 102 computing terminal devices 7.In addition, the method according to the angular speed calculation posture can be identical with the method among the above-mentioned steps S23.Then; CPU 10 is in the suitable moment (for example under the situation of terminal installation 7 near inactive state), utilizes the posture that calculates according to second acceleration information 101 and/or comes the posture of calculating according to turn meter is proofreaied and correct according to the posture that bearing data 103 calculates.In addition, use that to come carry out method of correcting based on the posture of angular speed based on the posture of acceleration can be the identical method of above-mentioned situation with the posture of computing controller 5.In addition, use come the situation of proofreading and correct based on the posture of bearing data based on the posture of angular speed under, CPU 10 also can make based on the posture of angular speed approaching to the posture based on bearing data with the ratio of regulation.According to above content, CPU 10 is the posture of computing terminal device 7 correctly.
In addition, controller 5 possesses the shooting information operational part 35 as the infrared detection unit, so game device 3 can obtain marker coordinate data 96.Therefore, game device 3 can be known the absolute posture (the coordinate system middle controller 5 at real space set be in which kind of posture) of controller 5 real space from marker coordinate data 96.On the other hand, terminal installation 7 does not possess the infrared detection unit as shooting information operational part 35.Therefore, game device 3 only from second acceleration information 101 and second angular velocity data 102 can't know the real space about with the gravity direction being the absolute posture of the direction of rotation of axle.Therefore, in this embodiment, establish terminal installation 7 for possessing the structure of Magnetic Sensor 62, game device 3 obtains bearing data 103.Thus, game device 3 can according to bearing data 103 calculate in the real spaces about with the gravity direction being the absolute posture of the direction of rotation of axle, thereby the posture of computing terminal device 7 more correctly.
As the concrete processing of above-mentioned steps S24, CPU 10 reads second acceleration information 101, second angular velocity data 102 and bearing data 103 from main storage, according to the posture of these data computation terminal installations 7.The data of the posture of the terminal installation 7 that then, expression is calculated store in the main storage as terminal gesture data 109.The processing of execution in step S25 after step S24.
In step S25, CPU 10 carries out the identification of camera image and handles.That is, the identification of stipulating of 10 pairs of camera image data 104 of CPU is handled.This identification is handled so long as the processing that from camera image, detects some characteristic and export its result just can be to handle arbitrarily.For example, including in camera image under player's the situation of face, also can be the processing of identification face.Specifically, both can be the processing that detects the part (eye, nose, mouth etc.) of face, also can be the processing that detects the expression of face.In addition, the data of expression identification process result are stored in the main storage as image recognition data 110.The processing of execution in step S26 after step S25.
In step S26, CPU 10 carries out the identification of microphone voice and handles.That is, the identification of stipulating of 10 pairs of microphone voice data 105 of CPU is handled.This identification is handled so long as the processing that from microphone voice, detects some characteristic and export its result just can be to handle arbitrarily.For example, both can be the processing that from microphone voice, detects player's indication, also can be the processing that only detects the volume of microphone voice.In addition, the data of expression identification process result are stored in the main storage as voice recognition data 111.The processing of execution in step S27 after step S26.
In step S27, CPU 10 carries out with recreation input corresponding game and handles.At this, recreation input is so long as data that slave controller 5 or terminal installation 7 send over or according to the data that these data obtain, and just can be data arbitrarily.Specifically; Recreation input except be controller function data 92 with terminal operation data 97 in comprise each the data, can also be the data (controller gesture data 108, terminal gesture data 109, image recognition data 110 and voice recognition data 111) that obtain according to these each data.In addition, the content of the game processing among the step S27 can be arbitrarily, for example can be processing, or the processing that the cursor that is presented on the picture is moved of processing that the object (role) that appears in the recreation is moved, control virtual video camera.In addition, can also be with camera image (perhaps its part) as the processing of game image, or with microphone voice as the processing of game sound etc.In addition, about the example of above-mentioned game processing, record and narrate after a while.In step S27, the storage of for example data of the data of the various parameters that the role's (object) who appears in the recreation is set, the parameter relevant with the virtual video camera that is configured in gamespace, the data of score etc. being represented the game control process result is in main storage.After step S27, the game control of CPU 10 end step S4 is handled.
Return the explanation of Figure 12, in step S5, generation is used to be presented at the used as television game image on the television set 2 with GPU 11b by CPU 10.That is, CPU 10 and GPU11b read the data of the game control process result of expression step S4 from main storage, in addition, read the required data of generation game image from VRAM 11d, generate game image.Game image is as long as the game control process result of expression step S4 just can generate through arbitrary method.For example; The generation method of game image both can be that virtual video camera is configured in the method for calculating from the observed gamespace of virtual video camera in the virtual gamespace and generating three-dimensional CG image thus, also can be the method that (do not use virtual video camera and) generates the image of two dimension.The used as television game image that is generated is stored among the VRAM 11d.The processing of execution in step S6 after above-mentioned steps S5.
In step S6, generate the terminal that is used to be presented on the terminal installation 7 by CPU 10 and GPU 11b and use game image.As long as the game control process result of step S4 is also likewise represented with game image in the terminal with above-mentioned used as television game image, just can generate through arbitrary method.In addition, the terminal both can also can generate through diverse ways through generating with the same method of above-mentioned used as television game image with game image.The terminal that is generated is stored among the VRAM 11d with game image.In addition, according to game content, the used as television game image can be identical with game image with the terminal, in this case, also can in step S6, not carry out the generation of game image and handle.The processing of execution in step S7 after above-mentioned steps S6.
In step S7, generate the used as television game sound of the loudspeaker 2a be used to output to television set 2.That is, CPU 10 makes the game control process result corresponding game sound of DSP 11c generation and step S4.In addition, the game sound that is generated for example can be the effect sound of recreation, the sound that appears at the role in the recreation, background sound (BGM) etc.The processing of execution in step S8 after above-mentioned steps S7.
In step S8, game sound is used at the terminal that generates the loudspeaker 67 be used to output to terminal installation 7.That is, CPU 10 makes the game control process result corresponding game sound of DSP 11c generation and step S4.In addition, the terminal can be identical with above-mentioned used as television game sound with game sound, also can be different.In addition, for example also can be like the effect sound difference but BGM identical, only a part is different.In addition, under used as television game sound and the terminal situation identical, also can in step S8, not carry out the generation of game sound and handle with game sound.The processing of execution in step S9 after above-mentioned steps S8.
In step S9, CPU 10 is to television set 2 output game image and game sounds.Specifically, CPU 10 data of sending the used as television game sound that is stored in the data of the used as television game image among the VRAM 11d and in step S7, generates by DSP 11c to AV-IC 15.Therewith correspondingly, AV-IC 15 is through the data of AV connector 16 to television set 2 output images and sound.Thus, the used as television game image is displayed on the television set 2, and from loudspeaker 2a output used as television game sound.The processing of execution in step S10 after step S9.
In step S10, CPU 10 sends game image and game sound to terminal installation 7.Specifically, the terminal that will be stored among the VRAM 11d by CPU 10 sends to codec LSI 27 with the view data of game image and the voice data that in step S8, generated by DSP 11c, and the processed compressed of being stipulated by codec LSI 27.And, implemented the image of processed compressed and the data of sound and sent to terminal installation 7 via antenna 29 through terminal communication module 28.The image that terminal installation 7 utilizes wireless module 70 to receive to send over from game device 3 and the data of sound, the decompression of stipulating by codec LSI 66.Carried out the view data after the decompression and outputed to LCD 51, carried out the voice data after the decompression and outputed to voice IC 68.Thus, the terminal is displayed on the LCD 51 with game image, and uses game sound from loudspeaker 67 outlet terminals.The processing of execution in step S11 after step S10.
In step S11, CPU 10 judges whether Exit Game.The indication of for example whether having carried out ending recreation according to the state that whether has become game over or user waits the judgement of carrying out step S11.Judged result at step S11 is under the situation of negating, the processing of execution in step S2 once more.On the other hand, under the judged result of step S11 was sure situation, CPU 10 finished game processing shown in Figure 12.After, a series of processing of repeated execution of steps S2～S11 are till being judged as Exit Game in step S11.
As stated; In this embodiment; Terminal installation 7 possesses the such inertial sensor of touch panel 52, acceleration transducer 63 or gyro sensor 64; The output of touch panel 52 and inertial sensor is sent to game device 3 as operating data, come with the input (step S3, S4) of playing games.And terminal installation 7 possesses display unit (LCD 51), will be presented at (step S6, S10) on the LCD 51 through the game image that game processing obtains.Thereby the user can utilize touch panel 52 directly to touch the operation of game image, and (because moving by inertial sensor sense terminals device 7) can also make the LCD 51 own operations of moving that show game image.Through these operations, the user can with as directly game image is operated operation feeling play, so for example can provide as after the recreation of new-type operation feeling first and second examples of games stated.
And; In this embodiment; Terminal installation 7 possesses the analog stick 53 and action button 54 that can under the state that grips terminal installation 7, operate, and game device 3 can be with the input (step S3, S4) of playing games is used in the operation of analog stick 53 and action button 54.Thereby under the situation of as above-mentioned, game image directly being operated, the user also can operate through push-botton operation, rocking bar and carry out more detailed game operation.
And in this embodiment, terminal installation 7 possesses camera 56 and microphone 69, the data of the camera image that will be photographed by camera 56 and send to game device 3 (step S3) by the data of microphone 69 detected microphone voices.Thereby game device 3 can be with above-mentioned camera image and/or microphone voice with the input of playing games, so the user can also be through by the operation of camera 56 photographic images, carry out game operation to the operation of microphone 69 sound imports.In addition, owing to can under the state that grips terminal installation 7, carry out these operations, therefore through carrying out these operations under such situation that game image is directly operated as stated, the user can carry out more various game operation.
In addition, in this embodiment, owing on the LCD 51 of mobile terminal device 7, show game image (step S6, S10), so user's configurating terminal device 7 freely.Thereby, with controller 5 under the situation that marker is operated, the user is through being configured in position arbitrarily with terminal installation 7, can controller 5 be played towards direction arbitrarily, can improve the free degree that controller 5 is operated.In addition, owing to can terminal installation 7 be configured in position arbitrarily, so the 5th examples of games of stating for example is such, can the recreation with stronger presence be provided through terminal installation 7 being configured in the position that is suitable for game content.
In addition, according to this embodiment, game device 3 slave controllers 5 obtain (step S2, S3) such as operating datas with terminal installation 7, so the user can be used as operating unit with controller 5 and terminal installation 7 these two devices.Thereby, in games system 1, also can use each device to come many people to play by the multidigit user, can also use two devices to play by a user.
In addition, according to this embodiment, game device 3 generates two kinds of game images (step S5, S6), can make television set 2 and terminal installation 7 show game image (step S9, S10).Like this, show two kinds of game images, the game image of for the user, watching more easily can be provided, can improve the operability of recreation through making different devices.For example; Under the situation that two people play; As after the 3rd or the 4th examples of games stated; Game image through the viewpoint that will for user wherein, watch easily is presented on the television set 2, and the game image of the viewpoint that will for the another one user, watch easily is presented on the terminal installation 7, and each player can play with the viewpoint of watching easily.In addition; Even for example under the situation that a people plays, also as after first, second and the 5th examples of games stated, through showing two kinds of game images with two different viewpoints; The player is the appearance in mastery play space more easily, can improve the operability of recreation.
[6. examples of games]
Then, the concrete example to the recreation of in games system 1, carrying out describes.In addition, also there is the situation of a part of structure of each device do not utilize in the games system 1 in the examples of games that will explain below, also exists and do not carry out the situation that the part in Figure 12 and a series of processing shown in Figure 13 is handled.That is to say that games system 1 also can not possess above-mentioned all structures, in addition, game device 3 also can not carried out the part of Figure 12 and a series of processing shown in Figure 13 and handle.
(first examples of games)
First examples of games is the recreation that object (sword in the hand) is flown out through operating terminal device 7.The player can be through changing terminal installation 7 operation and the operation of setting-out on touch panel 52 of posture, indicate the direction of sword in the chief of breech.
Figure 14 is the screen of the television set 2 in expression first examples of games and the figure of terminal installation 7.In Figure 14, on the LCD 51 of television set 2 and terminal installation 7, show the game image of expression gamespace.On television set 2, show sword 121 in the hand, chain of command 122 and target 123.On LCD 51, show chain of command 122 (and in the hand sword 121).In first examples of games, the player makes in the hand sword 121 fly out through the operation that utilizes terminal installation 7 and hits target 123 and play games.
Make under the situation that sword 121 flies out in the hand, the player at first posture that changes the chain of command 122 that is configured in the virtual gamespace of the posture through operating terminal device 7 makes it become the posture of expectation.That is, CPU 10 changes the posture (step S27) of chain of command 122 according to the posture (step S24) that the output of inertial sensor (acceleration transducer 63 with gyro sensor 64) and Magnetic Sensor 62 comes computing terminal device 7 according to the posture that calculates.In first examples of games, the posture of chain of command 122 is controlled so as to and the corresponding posture of the posture of terminal installation 7 in real space.That is to say that the player can change the posture at gamespace inner control face 122 through changing the posture of terminal installation 7 (being presented at the chain of command 122 on the terminal installation 7).In addition, in first examples of games, the position of chain of command 122 is fixed on the assigned position in the gamespace.
Then, the player utilizes pointer 124 grades on touch panel 52, to carry out the operation of setting-out (with reference to arrow shown in Figure 14).At this, in first examples of games, input face and chain of command 122 corresponding modes with touch panel 52 on the LCD 51 of terminal installation 7 show chain of command 122.Thereby, according to the line that on touch panel 52, draws, can calculate the direction (direction that this line is represented) on chain of command 122.Sword 121 is to the direction emission through decision like this in the hand.According to above content, CPU 10 calculates the direction on chain of command 122 according to the touch position data 100 of touch panel 52, makes the processing that sword 121 moves to the direction that calculates in the hand (step S27).In addition, CPU 10 for example also can control the speed of sword 121 in the hand according to the length of line, the speed of setting-out.
As stated; According to first examples of games; Game device 3 through with the output of inertial sensor with the input of playing games; Can correspondingly move chain of command 122 with move (posture) of terminal installation 7, and through with the output of touch panel 52 with the input of playing games, can confirm the direction on chain of command 122.Thus, the player can move the game image (image of chain of command 122) that is presented on the terminal installation 7 or this game image is carried out touch operation, therefore can play with the new-type operation feeling as game image is directly operated.
In addition, in first examples of games,, can easily indicate the direction in the three dimensions through the sensor of inertial sensor and touch panel 52 is exported with the input of playing games.That is, the player is through with the actual posture of adjusting terminal installation 7 of hand, with another hand mode input direction with line on touch panel 52, and can be through as at the actual ground of the processing ease intuitively direction indication of having imported the direction in the space.And the player can carry out simultaneously therefore can promptly carrying out the operation that the direction in the three dimensions is indicated to the operation of the posture of terminal installation 7 with to the input operation of touch panel 52 concurrently.
In addition, according to first examples of games, in order easily chain of command 122 to be touched the operation of input, full screen display chain of command 122 on terminal installation 7.On the other hand, on television set 2, show the image of the gamespace comprise The whole control face 122 and target 123, make the posture of easy master chain of command 122 and aiming target 123 (with reference to Figure 14) easily.Promptly; In above-mentioned steps S27; First virtual video camera that is used to generate the used as television game image is configured to The whole control face 122 and target 123 are included in the field range, and it is consistent on picture with chain of command 122 with the picture (input face of touch panel 52) that second virtual video camera of game image is configured to LCD 51 to be used to generate the terminal.Thereby, in first examples of games,, carry out game operation more easily through on television set 2 and terminal installation 7, showing image from the different observed gamespaces of viewpoint.
(second examples of games)
In addition, use the recreation of the input of playing games to be not limited to above-mentioned first examples of games sensor output of inertial sensor and touch panel 52, can expect various examples of games.Second examples of games and first examples of games likewise are the recreation that object (artillery shell) is flown out through operating terminal device 7.The player can indicate the direction that fires shells through the operation of the posture of change terminal installation 7 and the operation of the position on the appointment touch panel 52.
Figure 15 is the screen of the television set 2 in expression second examples of games and the figure of terminal installation 7.In Figure 15, on television set 2, show artillery 131, shell 132 and target 133.On terminal installation 7, show shell 132 and target 133.The terminal that is presented on the terminal installation 7 is to observe the image that gamespace obtains from the position of artillery 131 with game image.
In second examples of games, the player passes through the posture of operating terminal device 7, can change as the terminal to be presented at the indication range on the terminal installation 7 with game image.Promptly; The posture (step S24) that CPU 10 comes computing terminal device 7 according to the output of inertial sensor (acceleration transducer 63 with gyro sensor 64) and Magnetic Sensor 62 is controlled according to the posture that calculates and to be used to generate position and the posture (step S27) of terminal with second virtual video camera of game image.Specifically, second virtual video camera is set at the position of artillery 131, controls it towards (posture) according to the posture of terminal installation 7.Like this, the player can change the scope that is presented at the gamespace on the terminal installation 7 through changing the posture of terminal installation 7.
In addition, in second examples of games, the player specifies the transmit direction of shell 132 through the operation (operation of touch) of input point on touch panel 52.Specifically; Processing as above-mentioned steps S27; CPU 10 calculates and the interior position (control position) of the corresponding gamespace of touch location, and calculating is used as transmit direction from the direction of assigned position (the for example position of artillery 131) towards the control position in the gamespace.Then, the processing that shell 132 is moved to transmit direction.Like this, in above-mentioned first examples of games, the player carries out the operation of setting-out on touch panel 52, but in second examples of games, specifies the operation of the point on the touch panel 52.In addition, can calculate above-mentioned control position through setting the chain of command (but in second examples of games do not show chain of command) identical with above-mentioned first examples of games.Promptly; Make the indication range of itself and terminal installation 7 corresponding (specifically through correspondingly disposing chain of command with the posture of second virtual video camera; Chain of command with the position of artillery 131 be the center and correspondingly be rotated mobile with the variation of the posture of terminal installation 7), can calculate with the corresponding chain of command of touch location on the position be used as the control position.
According to above-mentioned second examples of games; Game device 3 through with the output of inertial sensor with the input of playing games; Can correspondingly change the indication range of terminal with move (posture) of terminal installation 7 with game image; And the touch through specifying the position in this indication range is imported with the input of playing games, and can confirm the direction (transmit direction of shell 132) in the gamespace.Thereby; In second examples of games also with first examples of games likewise; The player can move the game image that is presented on the terminal installation 7 or this game image is carried out touch operation, therefore can play with the new-type operation feeling as game image is directly operated.
In addition; In second examples of games also with first examples of games likewise; The player is through the posture with the actual adjustment of a hand terminal installation 7; With the another hand touch panel 52 is touched input, can be through coming direction indication easily like the operation intuitively actual input direction in the space.And the player can carry out simultaneously therefore can promptly carrying out the operation that the direction in the three dimensions is indicated to the operation of the posture of terminal installation 7 with to the input operation of touch panel 52 concurrently.
In addition, in second examples of games, be presented at image on the television set 2 and also can be from the viewpoint observed image identical, but in Figure 15, be made as game device 3 and show from the observed image of different viewpoints with terminal installation 7.That is, be used to generate the terminal and be set at the position of artillery 131 with second virtual video camera of game image, with respect to this, first virtual video camera that is used to generate the used as television game image is set at the position at artillery 131 rears.At this, the scope through being can't see on the picture that makes television set 2 display terminal devices 7 for example can realize seeing that like the player picture of television set 2 aims at the game mode the target of on the picture of terminal installation 7, can't see 133.Like this, different with the indication range of terminal installation 7 through making television set 2, not only the appearance in the easy master gamespace more can also further improve the interest of recreation.
As stated; According to this embodiment; Because can be, therefore can realize the recreation of the operation feeling that game image is directly operated as above-mentioned first and second examples of games with the terminal installation 7 that possesses touch panel 52 and inertial sensor as operating means.
(the 3rd examples of games)
Below, with reference to Figure 16 and Figure 17 the 3rd examples of games is described.The 3rd examples of games is the baseball of the form of two players' fights.That is, first player utilizes controller 5 operation batters, and second player utilizes terminal installation 7 operation pitchers.In addition, on television set 2 and terminal installation 7, show the game image that for each player, carries out game operation easily.
Figure 16 is the figure that is illustrated in an example of the used as television game image that is presented in the 3rd examples of games on the television set 2.Used as television game image shown in Figure 16 is to be mainly the image that first player provides.That is, the used as television game image is represented the gamespace that obtains from the pitcher's (pitcher's object) 142 who observes as batter's (batter's object) 141 sides of the first operation of player object as the second operation of player object.First virtual video camera that is used to generate the used as television game image is to be configured in the position at batter 141 rears towards pitcher 142 mode from batter 141.
On the other hand, Figure 17 is illustrated in the terminal that is presented in the 3rd examples of games on the terminal installation 7 figure with an example of game image.Terminal shown in Figure 17 is to be mainly the image that second player provides with game image.That is, the gamespace that obtains from the batter 141 who observes as pitcher's 142 sides of the second operation of player object as the first operation of player object is represented at the terminal with game image.Specifically, in above-mentioned steps S27, CPU 10 controls in order to generate second virtual video camera that use with game image at the terminal according to the posture of terminal installation 7.With above-mentioned second examples of games likewise, calculate the posture of second virtual video camera accordingly with the posture of terminal installation 7.In addition, the position of second virtual video camera is fixed on the assigned position that is predetermined.In addition, the terminal comprises the cursor 143 of the direction that is used to represent pitcher's 142 pitchings with game image.
In addition, first player can be arbitrary method to batter 141 method of operating and second player to pitcher 142 method of operating.For example, CPU 10 also can detect the shake operation to controller 5 according to the output data of the inertial sensor of controller 5, makes batter 141 brandish the action of club according to shake operation.In addition, for example CPU 10 also can come moving cursor 143 according to the operation to analog stick 53, under the situation that the regulation button in action button 54 is pressed, makes pitcher 142 carry out the action towards the indicated position pitching of cursor 143.In addition, also can replace the operation of analog stick 53 and come moving cursor 143 according to the posture of terminal installation 7.
As stated, in the 3rd examples of games,, provide and for each player, watch easily and maneuverable game image through on television set 2 and terminal installation 7, generating game image with mutually different viewpoint.
In addition, in the 3rd examples of games, in a gamespace, set two virtual video cameras, show respectively from each virtual video camera and observe two kinds of game images (Figure 16 and Figure 17) that gamespace obtains.Thereby; About two kinds of game images that in the 3rd examples of games, generate; Because the game processing (control of the object in the gamespace etc.) to gamespace almost is identical; And just can generate each game image as long as in identical gamespace, carry out describing for twice handling, therefore compare, have the high advantage of treatment effeciency with the situation of carrying out this game processing respectively.
In addition, in the 3rd examples of games, the cursor 143 of expression pitching direction only is presented at terminal installation 7 sides, and therefore first player can't see the indicated position of cursor 143.Therefore, can not produce that first player learns the pitching direction and unreasonable in the unfavorable such recreation of second player.Like this, in this embodiment, if see this game image a player then can produce the another one player under the irrational situation in the recreation, as long as this game image is presented on the terminal installation 7.The strategic degradation problem down that thus, can prevent to play.In addition; In other embodiments; According to the content (even for example being seen that by first player terminal can not produce under aforesaid irrational situation with game image yet) of recreation, game device 3 also can be presented at the terminal on the television set 2 with the used as television game image with game image.
(the 4th examples of games)
Below, with reference to Figure 18 and Figure 19 the 4th examples of games is described.The 4th examples of games is the shooting game of the form cooperated of two players.That is, the operation that first player utilizes controller 5 that aircraft is moved, second player utilizes terminal installation 7 to control the operation of transmit direction of the artillery of aircraft.In the 4th examples of games also with the 3rd examples of games likewise, on television set 2 and terminal installation 7, show the game image that for each player, carries out game operation easily.
Figure 18 is the figure that is illustrated in an example of the used as television game image that is presented in the 4th examples of games on the television set 2.In addition, Figure 19 is illustrated in the terminal that is presented in the 4th examples of games on the terminal installation 7 figure with an example of game image.Shown in figure 18, in the 4th examples of games, aircraft (aircraft object) 151 and target (balloon object) 153 appear in virtual gamespace.In addition, aircraft 151 has artillery (artillery object) 152.
Shown in figure 18, as the used as television game image, show the image of the gamespace that comprises aircraft 151.First virtual video camera that is used to generate the used as television game image is configured to generate the image of observing the gamespace that aircraft 151 obtains from the rear.That is, first virtual video camera is comprised in the position that posture in the camera coverage (field range) is configured in aircraft 151 rears with aircraft 151.In addition, control first virtual video camera and make its mobile along with aircraft 151.That is to say that CPU 10 controls moving of aircraft 151 according to the controller function data in the processing of above-mentioned steps S27, and control the position and the posture of first virtual video camera.Like this, correspondingly control the position and the posture of first virtual video camera with first operation of player.
On the other hand, shown in figure 19, use game image as the terminal, show the image of the gamespace of seeing from aircraft 151 (artillery 152 of more specifically saying so).Thereby, be used to generate the terminal is configured in aircraft 151 with second virtual video camera of game image position (position of the artillery 152 of more specifically saying so).CPU 10 controls moving of aircraft 151 according to the controller function data in the processing of above-mentioned steps S27, and controls the position of second virtual video camera.In addition, second virtual video camera also can be configured on the position (for example leaning on the position at rear than artillery 152 slightly) of aircraft 151 or artillery 152 peripheries.As stated, control the position of second virtual video camera through (operating aircraft 151 move) first operation of player.Thereby in the 4th examples of games, first virtual video camera and second virtual video camera move with linking.
In addition, use game image, show along the image towards observed gamespace of the transmit direction of artillery 152 as the terminal.At this, to control the transmit direction of artillery 152 with the corresponding mode of the posture of terminal installation 7.That is to say that in this embodiment, the posture of controlling second virtual video camera makes that the direction of visual lines of second virtual video camera is consistent with the transmit direction of artillery 152.CPU 10 in the processing of above-mentioned steps S27 with the posture of the terminal installation 7 that in above-mentioned steps S24, calculates correspondingly control artillery 152 towards with the posture of second virtual video camera.Like this, control the posture of second virtual video camera according to second operation of player.In addition, second player can change the transmit direction of artillery 152 through the posture that changes terminal installation 7.
In addition, under situation about firing shells from artillery 152, second player presses the button of the regulation of terminal installation 7.When the button of regulation when being pressed, to artillery 152 towards firing shells.The terminal with game image in, show aiming cursor 154 in the picture of LCD 51 central authorities, fire shells to aiming cursor 154 indicated directions.
As stated; In the 4th examples of games; The main observation television machine of first player is operating aircraft 151 (its direction to the target 153 of expectation is moved) with game image (Figure 18) time, and this used as television game image is represented along the observed gamespace of the direct of travel of aircraft 151.On the other hand, operation artillery 152 when second player mainly observes the terminal with game image (Figure 19), this terminal is represented along the observed gamespace of the transmit direction of artillery 152 with game image.Like this, in the 4th examples of games, can in the recreation of the form that two players cooperate, will for each player, observe easily and maneuverable game image is presented at respectively on television set 2 and the terminal installation 7.
In addition, in the 4th examples of games, control the position of first virtual video camera and second virtual video camera, control the posture of second virtual video camera according to second operation of player according to first operation of player.That is to say, in this embodiment, according to each player separately game operation and the position or the posture of virtual video camera change, its result, the indication range that is presented at the gamespace on each display unit changes.Because the indication range and each operation of player that are presented at the gamespace on the display unit correspondingly change, so each player can actually feel that the game operation of oneself fully is reflected in and play and carry out in the process, can enjoy recreation fully.
In addition, in the 4th examples of games, observed game image is presented on the television set 2 from the rear of aircraft 151, is presented on the terminal installation 7 from the observed game image in position of the artillery of aircraft 151.At this, in other examples of games, game device 3 also can make terminal installation 7 show from the rear of aircraft 151 observed game image, and television set 2 is shown from the observed game image in position of the artillery 152 of aircraft 151.At this moment, each player's role and above-mentioned the 4th examples of games are changed each other, first player utilizes controller 5 to carry out the operation of artillery 152, and second player utilizes terminal installation 7 to carry out the operation of aircraft 151.
(the 5th examples of games)
Below, with reference to Figure 20 the 5th examples of games is described.The 5th examples of games is the recreation that the player utilizes controller 5 to operate, and terminal installation 7 is used as display unit rather than operating means.Specifically, the 5th examples of games is a golf game, the operation (operation swings) of controller 5 being brandished as golf clubs with the player correspondingly, game device 3 makes the player characters who in the virtual gamespace carry out the action that swings of golf.
Figure 20 is the figure of the use situation of the games system 1 in expression the 5th examples of games.In Figure 20, on the screen of television set 2, show the image of the gamespace comprise player characters who (object) 161 and golf clubs (object) 162.In addition, in Figure 20, be not shown owing to be hidden in golf clubs 162 but be configured in ball in the gamespace (object) 163 and be displayed on the television set 2 yet.On the other hand, shown in figure 20, the mode that terminal installation 7 makes progress towards vertical with the screen of LCD 51 is configured on the positive ground, the place ahead of television set 2.On terminal installation 7, show image and the image on ground of expression gamespace of a part (the bar head 162a of golf clubs specifically) of image, the expression golf clubs 162 of expression ball 163.The terminal is the image that obtains on every side of observing ball from the top with game image.
When playing, player 160 stands near the terminal installation 7, carries out the operation that swings that controller 5 is brandished as golf clubs.At this moment, the posture of the controller 5 that in above-mentioned steps S27, calculates with processing through above-mentioned steps S23 of CPU 10 is correspondingly controlled position and the posture of golf clubs 162 in gamespace.Specifically, control golf clubs 162 as follows: the golf clubs 162 in gamespace under the situation of the image of the ball 163 of preceding extreme direction (Z axle positive direction shown in Figure 3) on being presented at LCD 51 of controller 5 hits a ball 163.
In addition, under the situation of LCD 51, the image (bar head image) 164 of the part of expression golf clubs 162 is displayed on (with reference to Figure 20) on the LCD 51 at the preceding extreme direction of controller 5.In addition, use game image about the terminal, in order to increase presence, also can be with the image of natural scale display ball 163, also can with bar head image 164 towards showing around the mode that the rotation of Z axle correspondingly is rotated with controller 5.In addition, the terminal both can utilize the virtual video camera that is arranged in the gamespace to generate with game image, also can utilize pre-prepd view data to generate.Under the situation of utilizing pre-prepd view data to generate, can generate detailed and real image with little processing load, and need not at length to make up the relief model of golf course.
When player 160 hits a ball 163 the time for golf clubs 162 through the result that carries out the above-mentioned operation that swings and brandished golf clubs 162, ball 163 moves (flying out).That is, CPU 10 judges in above-mentioned steps S27 whether golf clubs 162 touches ball 163, under situation about touching, ball 163 is moved.At this, generate the used as television game image with the mode that comprises the ball 163 after moving.That is, CPU 10 control be used to generate the used as television game image first virtual video camera position and posture so that mobile ball be comprised in the camera coverage of first virtual video camera.On the other hand, in terminal installation 7, hit a ball 163 the time when golf clubs 162, the image of ball 163 moves and disappears in outside the picture immediately.Thereby in the 5th examples of games, the situation that ball moves mainly is presented on the television set 2, and player 160 can confirm the track through the ball that flies out of operation that swings through the used as television game image.
As stated, in the 5th examples of games, player 160 can come swings golf club 162 (making player characters who 161 swings golf club 162) through brandishing controller 5.At this, in the 5th examples of games, control as follows: under the situation of the image that is presented at the ball 163 on the LCD 51, make the golf clubs 162 in the gamespace hit a ball 163 at the preceding extreme direction of controller 5.Thereby the player can obtain a kind of as the sensation of brandishing actual golf clubs that kind through the operation that swings, thereby presence can more be arranged swings operation.
In the 5th examples of games, also at the preceding extreme direction of controller 5 towards under the situation of terminal installation 7 bar head image 164 being presented on the LCD 51.Thereby; The preceding extreme direction of player through making controller 5 is towards terminal installation 7; Can obtain the posture of the golf clubs 162 in a kind of Virtual Space and the corresponding sensation of posture of the controller in the real space 5, thereby presence can more be arranged swing operation.
As stated, the 5th examples of games through terminal installation 7 is configured in suitable position, can more have presence ground to utilize the operation of controller 5 in that terminal installation 7 is used as under the situation of display unit.
In addition, in above-mentioned the 5th examples of games, terminal installation 7 configurations show the image of the gamespace of only representing ball 163 peripheries on the ground on terminal installation 7.Therefore, on terminal installation 7, can't show position, the posture of golf clubs 162 integral body in the gamespace, and on terminal installation 7, can't show the situation that the operation back ball 163 that swings moves.Therefore, in the 5th examples of games, before ball 163 moves, golf clubs 162 integral body are presented on the television set 2, the situation that after ball 163 moves, ball 163 is moved is presented on the television set 2.Like this,, can provide the operation of presence, and can come to present the game image of watching easily through two pictures of television set 2 and terminal installation 7 to the player to the player according to the 5th examples of games.
In addition, in above-mentioned the 5th examples of games,, and utilize the labeling section 55 of terminal installation 7 for the posture of computing controller 5.That is, CPU 10 makes labeling section 55 light (labelling apparatus 6 is not lighted) in the initial treatment of above-mentioned steps S1, CPU 10 in above-mentioned steps S23 according to the posture of marker coordinate data 96 computing controllers 5.Whether can judge rightly thus, is the posture of the preceding extreme direction of controller 5 towards labeling section 55.In addition, in above-mentioned the 5th examples of games, also can not carry out above-mentioned steps S21 and S22, but in other examples of games, also can come the marker that to light in recreation change midway through the processing of carrying out above-mentioned steps S21 and S22.For example; Whether CPU 10 also can judge controller 5 according to first acceleration information 94 in step S21 preceding extreme direction is towards gravity direction; In step S22, control as follows: if towards gravity direction; Labeling section 55 is lighted,, labelling apparatus 6 is lighted if not towards gravity direction.Thus; At the preceding extreme direction of controller 5 under the situation of gravity direction; Through obtaining the marker coordinate data of labeling section 55, posture that can pinpoint accuracy ground computing controller 5, and at the preceding extreme direction of controller 5 under the situation of television set 2; Through obtaining the marker coordinate data of labelling apparatus 6, posture that can pinpoint accuracy ground computing controller 5.
As above-mentioned the 5th examples of games was illustrated, games system 1 can be arranged on arbitrarily the position with terminal installation 7 and come as display unit.Thus, under with the situation of marker coordinate data with the input of playing games, except with controller 5 towards television set 2 uses, use controller 5 position that can also be through terminal installation 7 being set in expectation towards direction arbitrarily.That is, according to this embodiment, can use controller 5 towards unrestricted, therefore can improve the free degree of the operation of controller 5.
[7. other action example of games system]
Above-mentioned games system 1 can be like the above-mentioned action that is used to carry out various recreation illustrated.Terminal installation 7 also can be as portable display or second display, on the other hand, also can as touch input, through the mobile controller of importing, according to above-mentioned games system 1, can implement to play widely.In addition, can also be also included within interior following action except that the purposes the recreation.
(the action example that the player only utilizes terminal installation 7 to play games)
In this embodiment, terminal installation 7 is brought into play function as display unit, and brings into play function as operating means.Therefore, do not use television set 2 terminal installation 7 to be used as display unit and operating unit, can also as portable game device, use terminal installation 7 thus with controller 5.
Game processing according to shown in Figure 12 specifically describes; CPU 10 obtains terminal operation data 97 from terminal installation 7 in step S3; In step S4,, perform game process only with the input (not using the controller function data) of playing games of terminal operation data 97 usefulness.Then, in step S6, generate game image, in step S10, game image is sent to terminal installation 7.In addition, at this moment, also not execution in step S2, S5 and S9.According to above content, correspondingly carry out game processing with operation to terminal installation 7, the game image of representing the game processing result is presented on the terminal installation 7.Through like this, (though in fact performed game process by game device) also can be with terminal installation 7 as portable game device.Thereby according to this embodiment, even can't be under the situation of demonstration game image on the television set 2 owing to using television set 2 (for example other people are watching television broadcasting) to wait, the user also can utilize terminal installation 7 to play.
In addition, be not limited to game image, CPU 10 also can send to terminal installation 7 with the image about the above-mentioned menu screen that shows behind the power connection and show.Thus, the player can play with regard to not using television set 2 from beginning most, easily.
And, in foregoing, can also will show in game process that the display unit of game image changes to television set 2 from terminal installation 7.Specifically, CPU 10 outputs to television set 2 with game image and gets final product as long as further carry out above-mentioned steps S9.In addition, it is identical with the game image that in step S10, sends to terminal installation 7 in step S9, to output to the image of television set 2.Thus, switch to the input of demonstration, just can therefore can the display unit that show game image be changed to television set 2 being presented on the television set 2 with terminal installation 7 identical game images from game device 3 through input with television set 2.In addition, can show after the game image on television set 2 also that the picture of the device 7 of closing a terminal shows.
In addition, in games system 1, also can be from the infrared remote control signal of infrared ray output unit (labelling apparatus 6, labeling section 55 or infrared communication module 72) output needle to television set 2.Thus, game device 3 can carry out the operation to television set 2 through correspondingly exporting above-mentioned infrared remote control signal from the infrared ray output unit with the operation to terminal installation 7.In this case, the user can utilize terminal installation 7 operation television sets 2 and need not to operate the remote controller of television set 2, and is therefore very convenient in situation about as above-mentioned, the input of television set 2 being switched etc.
(action via network and other device communicate is routine)
As stated, game device 3 has the function that is connected with network, therefore under situation about communicating via network and external device (ED), also can utilize games system 1.Figure 21 is expression via the figure of each annexation of installing that comprises in the games system 1 under network and the situation that external device (ED) is connected.Shown in figure 21, game device 3 can communicate via network 200 and external device (ED) 201.
As stated, externally install under 201 situation that can communicate with game device 3, can be in games system 1 with terminal installation 7 as communicating between interface and the external device (ED) 201.For example, through externally install 201 and terminal installation 7 between send to receive image and sound, can be with games system 1 as video telephone.Specifically, game device 3 receives image and sound (phone the other side's image and sound) from external device (ED) 201 via network 200, and image that receives and sound are sent to terminal installation 7.Thus, terminal installation 7 will be presented on the LCD 51 from the image of external device (ED) 201, and from the sound of loudspeaker 67 outputs from external device (ED) 201.In addition, game device 3 receives the camera image that photographed by camera 56 and by microphone 69 detected microphone voices, camera image and microphone voice is sent to external device (ED) 201 via network 200 from terminal installation 7.Game device 3 through and external device (ED) 201 between repeat above-mentioned image and sound transmission receive, can be with games system 1 as video telephone.
In addition, in this embodiment, terminal installation 7 is mancarried devices, so the user can use terminal installation 7 in position arbitrarily, or make camera 56 towards direction arbitrarily.In addition, in this embodiment, terminal installation 7 possesses touch panel 52, so game device 3 can also send to external device (ED) 201 with the input information (touch position data 100) to touch panel 52.For example; Send under the situation of external device (ED) 201 will writing on literal on the touch panel 52 etc. through terminal installation 7 outputs and with the user from the image of external device (ED) 201 and sound, also can be with games system 1 as on-line teaching system (E-Learning System) 1.
(routine) with the action that television broadcasting links
In addition, games system 1 also can move with television broadcasting under the situation of watching television broadcasting through television set 2 with linking.That is, watching through television set 2 under the situation of TV programme, games system 1 makes the terminal installation 7 outputs information relevant with these TV programme etc.Below, the action example when games system 1 and television broadcasting are moved with linking is described.
In above-mentioned action example, game device 3 can communicate that (in other words, external device (ED) 201 shown in Figure 21 is servers via network and server.)。Server stores the various information (TV information) that are associated with television broadcasting to each channel of television broadcasting.This TV information can be captions, actor information etc. and program-associated information, can also be the information of EPG (electric program guide), the information broadcasted as data.In addition, TV information also can be the information of image, sound or literal or their combination.In addition, server needs not be one, also can server be set to each channel or each program of television broadcasting, and game device 3 can communicate with each server.
In television set 2, exporting under the situation of image, sound of television broadcasting, game device 3 lets the user utilize the channel of the television broadcasting that terminal installation 7 inputs are watching.Then, send and the corresponding TV information of being imported of channel via the network requests server.Therewith correspondingly, the data of server transmission and the corresponding TV information of above-mentioned channel.When receiving from data that server sends over, game device 3 outputs to terminal installation 7 with the data that receive.Terminal installation 7 is presented at the data of image in the above-mentioned data and literal on the LCD 51, from the data of loudspeaker output sound.According to above content, the user can utilize terminal installation 7 to enjoy the information relevant with current TV programme of watching etc.
As stated, games system 1 is through communicating via network and external device (ED) (server), can also the information that link with television broadcasting be offered the user through terminal installation 7.Especially, in this embodiment, terminal installation 7 is mancarried devices, so the user can use terminal installation 7 in position arbitrarily, thereby convenience is high.
As stated, in this embodiment, the user can also use terminal installation 7 except in recreation, using the terminal installation 7 in various uses, mode.
[8. variation]
Above-mentioned embodiment is an example of implementing the utility model, for example also can implement the utility model through the following structure that will explain in other embodiments.
(variation) with a plurality of terminal installations
In the above-described embodiment, games system 1 is the structure that only has a terminal installation, but games system 1 also can be the structure with a plurality of terminal installations.Promptly; Game device 3 also can be following structure: can carry out radio communication respectively with a plurality of terminal installations; The data of game image, the data and the control data of game sound are sent to each terminal installation, receive operating data, camera image data and microphone voice data from each terminal installation.In addition, game device 3 carries out radio communication respectively with a plurality of terminal installations, and at this moment, game device 3 both can carry out radio communication with each terminal installation in timesharing ground, also can communicate by allocated frequency band.
Have under the situation of a plurality of terminal installations such as stated, can utilize games system to carry out a greater variety of recreation.For example, have at games system 1 under the situation of two terminal installations, games system 1 has three display unit, therefore can generate and be respectively the game image that three players provide, and each display unit is shown.In addition, have at games system 1 under the situation of two terminal installations, with controller and terminal installation as one group of recreation of using (for example above-mentioned the 5th examples of games) in, two players can play simultaneously.And, under situation according to the game processing of carrying out above-mentioned steps S27 from the marker coordinate data of two controller outputs, two game operations that the player can carry out controller is carried out towards marker (labelling apparatus 6 or labeling section 55) separately.That is, a player can make controller carry out game operation towards labelling apparatus 6, and the another one player can make controller carry out game operation towards labeling section 55.
(variation relevant) with the function of terminal installation
In the above-described embodiment, terminal installation 7 is as the so-called thin-client (thin client) that does not perform game process and the performance function.At this, in other embodiments, handle by the part in a series of game processing of game device 3 execution in the above-described embodiment and also can wait other device to carry out by terminal installation 7.For example, also can make terminal installation 7 carry out a part and handle (for example handle with the generation of game image at the terminal).In addition, for example in the games system with a plurality of information processors (game device) that can intercom mutually, these a plurality of information processors also can be shared and performing game process.
Utilizability on the industry
As stated, the utility model is purpose so that the player carries out new-type game operation etc., for example can wait as the terminal installation that uses in games system, the games system and utilize.
Claims (12)
1. a games system is characterized in that, comprises the game device and first operating means of arrangement type,
Above-mentioned game device possesses:
First operand is according to acceptance division, and it receives the first operand certificate from above-mentioned first operating means;
Game processing portion, it performs game process according to above-mentioned first operand certificate;
Image production part, it generates first game image and second game image successively based on above-mentioned game processing;
The game image compression unit, it compresses above-mentioned first game image successively and generates compressing image data;
The game image sending part, it sends above-mentioned compressing image data through wireless to above-mentioned first operating means successively; And
The image efferent, it outputs to the exterior display device that is independent of above-mentioned first operating means successively with above-mentioned second game image,
Above-mentioned first operating means possesses:
Display part;
Touch panel, it is arranged on the screen of above-mentioned display part;
Inertial sensor;
First operand is according to sending part, and it is through wireless first operand certificate of sending the output data that comprise above-mentioned touch panel and inertial sensor to above-mentioned game device;
The game image acceptance division, it receives above-mentioned compressing image data successively from above-mentioned game device; And
Game image decompression portion, it decompresses to above-mentioned compressing image data successively and obtains above-mentioned first game image,
Wherein, above-mentioned display part shows above-mentioned first game image that obtains through decompression successively.
2. games system according to claim 1 is characterized in that,
Above-mentioned games system also comprises second operating means,
Above-mentioned second operating means possesses second operand according to sending part, and this second operand is sent the second operand certificate of operation that expression to this second operating means carry out through wireless to above-mentioned game device according to sending part,
Above-mentioned game device also possesses second operand according to acceptance division, and this second operand receives above-mentioned second operand certificate according to acceptance division,
Above-mentioned game processing portion according to above-mentioned second operand according to performing game process.
3. games system according to claim 1 and 2 is characterized in that,
Above-mentioned game device also possesses:
Game sound generation portion, it generates first game sound and second game sound based on above-mentioned game processing;
The game sound efferent, it outputs to above-mentioned second game sound in the external speakers device that is independent of above-mentioned first operating means; And
The game sound sending part, it sends above-mentioned first game sound through wireless to above-mentioned first operating means,
Above-mentioned first operating means also possesses:
The game sound acceptance division, it receives above-mentioned first game sound from above-mentioned game device; And
Loudspeaker, above-mentioned first game sound that its output is received by above-mentioned game sound acceptance division.
4. games system according to claim 1 is characterized in that,
Above-mentioned first operating means also possesses microphone,
Above-mentioned first operand according to sending part through wireless data of also sending the detected sound of above-mentioned microphone to above-mentioned game device.
5. games system according to claim 1 is characterized in that,
Above-mentioned first operating means also possesses:
Camera; And
The camera image compression unit, it compresses the taken camera image of above-mentioned camera and generates the compression camera data,
Above-mentioned first operand also sends above-mentioned compression camera data through wireless to above-mentioned game device according to sending part,
Above-mentioned game device also possesses camera image decompression portion, and this camera image decompression portion decompresses to above-mentioned compression camera data and obtains camera image.
6. games system according to claim 1 is characterized in that,
Above-mentioned first operating means also possesses:
A plurality of front-operated buttons, above-mentioned a plurality of front-operated buttons are set at the both sides of this screen on the positive facial plane of the screen that is provided with above-mentioned display part and above-mentioned touch panel; And
The direction input part, it is set at the both sides of the above-mentioned screen on the above-mentioned positive facial plane, can direction indication,
Above-mentioned first operand is according to the data that also comprise the operation that expression carries out above-mentioned a plurality of front-operated buttons and above-mentioned direction input part.
7. according to claim 1 or 6 described games systems, it is characterized in that,
Above-mentioned first operating means also possesses:
A plurality of back sides action button, above-mentioned a plurality of back sides action button is set on the back side plane, and this back side plane is the plane of positive planar opposite side that is provided with screen and the above-mentioned touch panel of above-mentioned display part; And
A plurality of sides action button, above-mentioned a plurality of sides action button is set on the side between above-mentioned positive facial plane and the above-mentioned back side plane,
Above-mentioned first operand is according to the data that also comprise the operation that expression carries out above-mentioned a plurality of back sides action button and side action button.
8. games system according to claim 1 is characterized in that,
Above-mentioned first operating means also possesses Magnetic Sensor,
Above-mentioned first operand is according to the data that also comprise the testing result of above-mentioned Magnetic Sensor.
9. games system according to claim 1 is characterized in that,
Above-mentioned inertial sensor comprises 3-axis acceleration sensor and three-axis gyroscope sensor.
10. games system according to claim 1 is characterized in that,
Above-mentioned game device also possesses:
Reading part, it reads information from the external recording medium that records games, and this external recording medium can installation and removal with respect to above-mentioned game device;
Network service portion, it can be connected with network, and communicates between the information processor that can communicate through this network; And
Electric power provides portion, and its power supply each one in this game device from the outside of above-mentioned game device provides electric power,
Wherein, above-mentioned game processing portion performs game process according to the games that read out by above-mentioned reading part.
11. a games system is characterized in that, comprises the game device and first operating means of arrangement type,
Above-mentioned game device possesses:
First operand is according to acceptance division, and it receives the first operand certificate from above-mentioned first operating means;
Game processing portion, it performs game process according to above-mentioned first operand certificate;
Image production part, it generates first game image and second game image successively based on above-mentioned game processing;
The game image compression unit, it compresses above-mentioned first game image successively and generates compressing image data;
The game image sending part, it sends above-mentioned compressing image data through wireless to above-mentioned first operating means successively;
The image efferent, it outputs to the exterior display device that is independent of above-mentioned first operating means successively with above-mentioned second game image;
Game sound generation portion, it generates first game sound and second game sound based on above-mentioned game processing;
The game sound efferent, it outputs to above-mentioned second game sound in the external speakers device that is independent of above-mentioned first operating means;
The game sound sending part, it sends above-mentioned first game sound through wireless to above-mentioned first operating means,
Camera image decompression portion, it decompresses to above-mentioned compression camera data and obtains camera image;
Reading part, it reads information from the external recording medium that records games, and this external recording medium can installation and removal with respect to above-mentioned game device;
Network service portion, it can be connected with network, and communicates between the information processor that can communicate through this network; And
Electric power provides portion, and its power supply each one in this game device from the outside of above-mentioned game device provides electric power, and wherein, above-mentioned game processing portion performs game process according to the games that read out by above-mentioned reading part;
Above-mentioned first operating means possesses:
Display part;
Touch panel, it is arranged on the screen of above-mentioned display part;
Inertial sensor;
First operand is according to sending part, and it is through wireless first operand certificate of sending the output data that comprise above-mentioned touch panel and inertial sensor to above-mentioned game device;
The game image acceptance division, it receives above-mentioned compressing image data successively from above-mentioned game device;
Game image decompression portion, it decompresses to above-mentioned compressing image data successively and obtains above-mentioned first game image, and wherein, above-mentioned display part shows above-mentioned first game image that obtains through decompression successively;
The game sound acceptance division, it receives above-mentioned first game sound from above-mentioned game device;
Loudspeaker, above-mentioned first game sound that its output is received by above-mentioned game sound acceptance division;
Microphone, above-mentioned first operand according to sending part through wireless data of also sending the detected sound of above-mentioned microphone to above-mentioned game device;
Camera;
The camera image compression unit, it compresses the taken camera image of above-mentioned camera and generates the compression camera data, and above-mentioned first operand also sends above-mentioned compression camera data through wireless to above-mentioned game device according to sending part;
A plurality of front-operated buttons, above-mentioned a plurality of front-operated buttons are set at the both sides of this screen on the positive facial plane of the screen that is provided with above-mentioned display part and above-mentioned touch panel;
The direction input part, it is set at the both sides of the above-mentioned screen on the above-mentioned positive facial plane, can direction indication, above-mentioned first operand is according to the data that also comprise the operation that expression carries out above-mentioned a plurality of front-operated buttons and above-mentioned direction input part;
A plurality of back sides action button, above-mentioned a plurality of back sides action button is set on the back side plane, and this back side plane is the plane of positive planar opposite side that is provided with screen and the above-mentioned touch panel of above-mentioned display part;
A plurality of sides action button; Above-mentioned a plurality of sides action button is set on the side between above-mentioned positive facial plane and the above-mentioned back side plane, and above-mentioned first operand is according to the data that also comprise the operation that expression carries out above-mentioned a plurality of back sides action button and side action button;
Magnetic Sensor, above-mentioned first operand is according to the data that also comprise the testing result of above-mentioned Magnetic Sensor;
Above-mentioned inertial sensor comprises 3-axis acceleration sensor and three-axis gyroscope sensor;
Above-mentioned games system also comprises second operating means,
Above-mentioned second operating means possesses second operand according to sending part, and this second operand is sent the second operand certificate of operation that expression to this second operating means carry out through wireless to above-mentioned game device according to sending part,
Above-mentioned game device also possesses second operand according to acceptance division, and this second operand receives above-mentioned second operand certificate according to acceptance division,
Above-mentioned game processing portion according to above-mentioned second operand according to performing game process.
12. an operating means is characterized in that, can carry out radio communication with the game device of arrangement type, this operating means possesses:
Display part;
Touch panel, it is arranged on the screen of above-mentioned display part;
Inertial sensor;
The operating data sending part, it is through wireless operating data of sending the output data that comprise above-mentioned touch panel and inertial sensor to above-mentioned game device;
The game image acceptance division, it receives compressing image data successively from above-mentioned game device, and this compressing image data is in above-mentioned game device, the game image that generates based on the game processing of carrying out according to the aforesaid operations data to be implemented processed compressed to obtain; And
Game image decompression portion, it decompresses to above-mentioned compressing image data successively and obtains above-mentioned game image,
Wherein, above-mentioned display part shows the above-mentioned game image that obtains through decompression successively.
Applications Claiming Priority (4)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| JP2010245298 | 2010-11-01 | ||
| JP2010245299A JP4798809B1 (en) | 2010-11-01 | 2010-11-01 | Display device, game system, and game processing method |
| JP2010-245298 | 2010-11-01 | ||
| JP2010-245299 | 2010-11-01 |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN202355828U true CN202355828U (en) | 2012-08-01 |
Family
ID=46190733
Family Applications (4)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN 201120378445 Withdrawn - After Issue CN202355828U (en) | 2010-11-01 | 2011-09-30 | Game system and operating device |
| CN2011203784544U Withdrawn - After Issue CN202270340U (en) | 2010-11-01 | 2011-09-30 | Display device and game system |
| CN201110303812.XA Active CN102600610B (en) | 2010-11-01 | 2011-09-30 | Display device, game system, and game process method |
| CN201110303972.4A Active CN102600613B (en) | 2010-11-01 | 2011-09-30 | Game system,operation device and game processing method |
Family Applications After (3)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN2011203784544U Withdrawn - After Issue CN202270340U (en) | 2010-11-01 | 2011-09-30 | Display device and game system |
| CN201110303812.XA Active CN102600610B (en) | 2010-11-01 | 2011-09-30 | Display device, game system, and game process method |
| CN201110303972.4A Active CN102600613B (en) | 2010-11-01 | 2011-09-30 | Game system,operation device and game processing method |
Country Status (3)
| Country | Link |
|---|---|
| CN (4) | CN202355828U (en) |
| HK (2) | HK1171401A1 (en) |
| TW (2) | TWI434717B (en) |
Cited By (12)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102600613A (en) * | 2010-11-01 | 2012-07-25 | 任天堂株式会社 | Game system,operation device and game processing method |
| US8684842B2 (en) | 2010-02-03 | 2014-04-01 | Nintendo Co., Ltd. | Display device, game system, and game process method |
| US8702514B2 (en) | 2010-11-01 | 2014-04-22 | Nintendo Co., Ltd. | Controller device and controller system |
| US8814686B2 (en) | 2010-02-03 | 2014-08-26 | Nintendo Co., Ltd. | Display device, game system, and game method |
| US8845426B2 (en) | 2011-04-07 | 2014-09-30 | Nintendo Co., Ltd. | Input system, information processing device, storage medium storing information processing program, and three-dimensional position calculation method |
| US8956209B2 (en) | 2010-08-30 | 2015-02-17 | Nintendo Co., Ltd. | Game system, game apparatus, storage medium having game program stored therein, and game process method |
| US9132347B2 (en) | 2010-08-30 | 2015-09-15 | Nintendo Co., Ltd. | Game system, game apparatus, storage medium having game program stored therein, and game process method |
| US9199168B2 (en) | 2010-08-06 | 2015-12-01 | Nintendo Co., Ltd. | Game system, game apparatus, storage medium having game program stored therein, and game process method |
| CN106537295A (en) * | 2015-06-12 | 2017-03-22 | 任天堂株式会社 | Information processing system, information processing device, operation device, and attached apparatus |
| US9776083B2 (en) | 2010-02-03 | 2017-10-03 | Nintendo Co., Ltd. | Spatially-correlated multi-display human-machine interface |
| US10150033B2 (en) | 2010-08-20 | 2018-12-11 | Nintendo Co., Ltd. | Position calculation system, position calculation device, storage medium storing position calculation program, and position calculation method |
| US11724178B2 (en) | 2015-06-12 | 2023-08-15 | Nintendo Co., Ltd. | Game controller |
Families Citing this family (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103677364B (en) * | 2012-09-14 | 2017-06-16 | 晨星软件研发(深圳)有限公司 | Touch-control system and its control method |
| BR102013007815A2 (en) * | 2012-11-01 | 2016-07-12 | Wikipad Inc | mobile device controller |
| TWI615182B (en) * | 2014-08-15 | 2018-02-21 | Zeroplus Technology Co Ltd | Game system and its location identification and instant notification method |
| CN106485657B (en) * | 2016-09-19 | 2020-06-09 | 天脉聚源(北京)传媒科技有限公司 | Picture processing method and device |
| CN109480359B (en) * | 2018-10-18 | 2020-08-18 | 温州商学院 | VR gloves finger fastener |
| CN111195432B (en) * | 2018-11-20 | 2021-12-07 | 腾讯科技（深圳）有限公司 | Object display method and device, storage medium and electronic device |
Family Cites Families (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JPH09294260A (en) * | 1996-04-26 | 1997-11-11 | Sega Enterp Ltd | Communication processing unit, terminal equipment, communication system, game system participated by many persons using the communication system and communication method |
| JP2004032548A (en) * | 2002-06-27 | 2004-01-29 | Alps Electric Co Ltd | Mobile terminal |
| JP2009178363A (en) * | 2008-01-31 | 2009-08-13 | Namco Bandai Games Inc | Program, information storage medium and content providing device |
| JP4198190B1 (en) * | 2008-07-11 | 2008-12-17 | 任天堂株式会社 | Image communication system, image communication apparatus, and image communication program |
| TWI434717B (en) * | 2010-11-01 | 2014-04-21 | Nintendo Co Ltd | Display device, game system, and game process method |
-
2011
- 2011-07-19 TW TW100125405A patent/TWI434717B/en active
- 2011-07-19 TW TW100125404A patent/TWI541051B/en active
- 2011-09-30 CN CN 201120378445 patent/CN202355828U/en not_active Withdrawn - After Issue
- 2011-09-30 CN CN2011203784544U patent/CN202270340U/en not_active Withdrawn - After Issue
- 2011-09-30 CN CN201110303812.XA patent/CN102600610B/en active Active
- 2011-09-30 CN CN201110303972.4A patent/CN102600613B/en active Active
-
2012
- 2012-11-28 HK HK12112243.6A patent/HK1171401A1/en unknown
- 2012-11-28 HK HK12112244.5A patent/HK1171402A1/en unknown
Cited By (21)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US8684842B2 (en) | 2010-02-03 | 2014-04-01 | Nintendo Co., Ltd. | Display device, game system, and game process method |
| US9776083B2 (en) | 2010-02-03 | 2017-10-03 | Nintendo Co., Ltd. | Spatially-correlated multi-display human-machine interface |
| US9358457B2 (en) | 2010-02-03 | 2016-06-07 | Nintendo Co., Ltd. | Game system, controller device, and game method |
| US8814686B2 (en) | 2010-02-03 | 2014-08-26 | Nintendo Co., Ltd. | Display device, game system, and game method |
| US8961305B2 (en) | 2010-02-03 | 2015-02-24 | Nintendo Co., Ltd. | Game system, controller device and game method |
| US9199168B2 (en) | 2010-08-06 | 2015-12-01 | Nintendo Co., Ltd. | Game system, game apparatus, storage medium having game program stored therein, and game process method |
| US10150033B2 (en) | 2010-08-20 | 2018-12-11 | Nintendo Co., Ltd. | Position calculation system, position calculation device, storage medium storing position calculation program, and position calculation method |
| US8956209B2 (en) | 2010-08-30 | 2015-02-17 | Nintendo Co., Ltd. | Game system, game apparatus, storage medium having game program stored therein, and game process method |
| US9132347B2 (en) | 2010-08-30 | 2015-09-15 | Nintendo Co., Ltd. | Game system, game apparatus, storage medium having game program stored therein, and game process method |
| US8814680B2 (en) | 2010-11-01 | 2014-08-26 | Nintendo Co., Inc. | Controller device and controller system |
| US8827818B2 (en) | 2010-11-01 | 2014-09-09 | Nintendo Co., Ltd. | Controller device and information processing device |
| CN102600613A (en) * | 2010-11-01 | 2012-07-25 | 任天堂株式会社 | Game system,operation device and game processing method |
| US9272207B2 (en) | 2010-11-01 | 2016-03-01 | Nintendo Co., Ltd. | Controller device and controller system |
| US8804326B2 (en) | 2010-11-01 | 2014-08-12 | Nintendo Co., Ltd. | Device support system and support device |
| CN102600613B (en) * | 2010-11-01 | 2014-06-11 | 任天堂株式会社 | Game system,operation device and game processing method |
| US9889384B2 (en) | 2010-11-01 | 2018-02-13 | Nintendo Co., Ltd. | Controller device and controller system |
| US8702514B2 (en) | 2010-11-01 | 2014-04-22 | Nintendo Co., Ltd. | Controller device and controller system |
| US8845426B2 (en) | 2011-04-07 | 2014-09-30 | Nintendo Co., Ltd. | Input system, information processing device, storage medium storing information processing program, and three-dimensional position calculation method |
| CN106537295A (en) * | 2015-06-12 | 2017-03-22 | 任天堂株式会社 | Information processing system, information processing device, operation device, and attached apparatus |
| US11724178B2 (en) | 2015-06-12 | 2023-08-15 | Nintendo Co., Ltd. | Game controller |
| US11951386B2 (en) | 2015-06-12 | 2024-04-09 | Nintendo Co., Ltd. | Information processing system, information processing device, controller device and accessory |
Also Published As
| Publication number | Publication date |
|---|---|
| TWI434717B (en) | 2014-04-21 |
| CN102600613A (en) | 2012-07-25 |
| TWI541051B (en) | 2016-07-11 |
| TW201219092A (en) | 2012-05-16 |
| CN202270340U (en) | 2012-06-13 |
| TW201220108A (en) | 2012-05-16 |
| CN102600613B (en) | 2014-06-11 |
| CN102600610B (en) | 2014-06-11 |
| HK1171401A1 (en) | 2013-03-28 |
| HK1171402A1 (en) | 2013-03-28 |
| CN102600610A (en) | 2012-07-25 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN202355828U (en) | Game system and operating device | |
| CN202398095U (en) | Equipment supporting system and supporting device | |
| CN102462960B (en) | Controller device and controller system | |
| US8684842B2 (en) | Display device, game system, and game process method | |
| US9149715B2 (en) | Game system, game apparatus, storage medium having game program stored therein, and image generation method | |
| JP2012249867A (en) | Information processing program, information processing apparatus, information processing system, and information processing method | |
| JP2012095808A (en) | Display device, game system and game processing method | |
| JP6103677B2 (en) | GAME SYSTEM, OPERATION DEVICE, AND GAME PROCESSING METHOD | |
| JP2012096005A (en) | Display device, game system and game processing method | |
| JP2012249868A (en) | Game program, game apparatus, game system, and game processing method |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C14 | Grant of patent or utility model | ||
| GR01 | Patent grant | ||
| AV01 | Patent right actively abandoned |
Granted publication date: 20120801 Effective date of abandoning: 20140611 |
|
| RGAV | Abandon patent right to avoid regrant |