WO2000014482A1 - System for processing geographic position data and images and circuit for said system - Google Patents

Abstract

The invention relates to a system for processing geographic position data and images, comprising an electronic circuit (5) having a first circuit part (19) for input of geographic position data and for output of position data with image data in an appropriate form for common recording and/or transmission and a second circuit part (30-35) for input of recorded position data with image data and for their output in computer-readable form. The system also comprises a computer program designed to display at least one digital map (44) on a screen (12), to display the recording site of images or image sequences represented by the image data on the at least one map and to display the corresponding images or image sequences when the user selects a recording site. The system makes it possible, for instance, for an amateur film-maker having a camcorder (1), a GPS receiver (2) and a personal computer (10), to relate in a simple manner the recorded image sequences to the recording site.

Description

 System for processing geographic position data and images and circuit for it

Technical field

The invention relates to a system for processing geographical position data and images and to an electronic circuit therefor.

State of the art

Systems that process geographic position data, in particular from satellite navigation, and also images are known. For example, DE-A-19505487 describes a vehicle navigation system that uses image information recorded by a camera as an additional navigation aid.

A vehicle navigation system is known from JP-A-09033271 (abstract from "Patent Abstracts of Japan'VJAPIO), in which, among other things, a camera, a GPS position sensor, a map data memory, a controller and a display are firmly connected to one another via a data line If the display shows a scene captured by the camera, an object contained in the scene can be shown on the display, for example with its name on a card. In use, all of the listed components must be present and switched on since the controller must access them alternately to be able to perform the functions described.

From JP-A-092922245 it is also known to record position data in the form of speech on the sound channel of a camcorder.

Presentation of the invention

The invention has for its object a system for processing geographical position data and images and an electronic circuit for To create such a system that is simple to set up and easy to handle on the go and thus represents useful instruments for photographers or videographers.

A system according to the invention for processing geographic position data and images comprises an electronic circuit which has a first circuit part for entering geographic position data and for outputting the position data in a form suitable for recording together with image data, and a second circuit part for entering position data recorded together with image data and for their output contains in computer-readable form. The first and the second circuit part are each connected or connectable to a video camera or a still camera for the electronic recording and recording of images or image sequences and further information. Furthermore, the system comprises a data processing program which is set up to display at least one digital map on a screen and to display the recording locations of images or image sequences represented by image data on the at least one map. The first circuit part is set up to supply the camera in operation, independently of the second circuit part and independent of the data processing program, for positional data corresponding to the current geographic position of the camera for recording as the further information, and the data processing program is set up for this purpose on a personal computer to be carried out, which can be connected to the camera, in order to receive the image data and position data recorded in the camera, and to display the associated images or image sequences on the screen when the user selects a recording location displayed on the at least one digital map.

An electronic circuit according to the invention includes an input which receives geographic position data, which are encoded as serial digital signals, and an output, which outputs the geographic position data in the form of signals which are suitable for recording on the sound channel of a camcorder, and the circuit consists in essentially from a level converter or from a signal inverter and a level converter, whereby the position data are recorded true to code on the sound channel.

The invention enables e.g. a hobby filmmaker using a camcorder (a portable camera recorder with a digital image sensor and analog or digital recording), a GPS receiver (a satellite navigation device for GPS (Global Positioning System), GLONASS (Global Orbiting Navigation Satellite System) or GNSS (Global Navigation Satellite system), as is also increasingly used in the hobby area), as well as a suitably equipped personal computer, to easily reference the recorded image sequences to the corresponding recording locations.

For this purpose, the user on the go connects the GPS receiver to the camcorder via the first circuit part of the electronic circuit. During filming, the current geographic position of the camcorder on a recording medium such as e.g. recorded on a magnetic tape.

At home, the user connects the video output of the camcorder and the second circuit section to a computer such as a personal computer on which the data processing program is installed. The data processing program makes a map appear on the screen of the personal computer and marks there locations for which film recordings exist and which it has recognized on the basis of the position data recorded in parallel. If you e.g. If you click on a marked location with the mouse, the available film sequences are displayed on the screen.

Since a camcorder normally also records the recording times or the recording times are included in the GPS information, the data processing program can also calculate a route traveled and display it on the screen. If the map material contains traffic routes, the user can, for example, specify that the data processing program for the display of the recording locations and the route traveled to certain destinations. roads or the shortest traffic routes. In other cases or on overview maps, the data processing program, for example, can simply connect the recording locations in chronological order.

With a cutting program, as it is often used by amateur filmmakers for post-processing of film material, the film and card sequences can be put together to form a complete film and output for recording on a conventional video recorder.

The invention is extremely useful not only for amateur filmmakers, but also in the professional field, not only in connection with camcorders, especially journalist camcorders or so-called EFP or ENG camcorders, but also in connection with any digital video cameras with digital or analog recording or transmission of the image data. In the professional field, e.g. for reports, in addition to the transmission of image and position data to a portable storage medium, there is radio transmission in real time or with a time delay e.g. by means of a broadcast van.

The invention is also suitable for still cameras, i.e. Cameras for still images such as cameras with a digital image sensor and with digital and / or analog recording of images and additional information. APS (Advanced Photo System) cameras with a conventional film for the pictures and a parallel magnetic stripe for digital data can also be used. In order to be able to use all the functions offered by the system in this case, the photographs can be scanned into the computer.

The video cameras and still cameras in question are not limited to visible light, but can e.g. thermal cameras for infrared light, with which thermal images of buildings or landscapes can be taken.

In the case of a camcorder, there are several different options for tion data together with the images. A preferred, technically particularly simple method according to the invention is to connect the first circuit part at least temporarily to a microphone or audio input of the camcorder and to record the position data essentially in synchronism with the image data on at least one audio channel of the camcorder, ie on one or more Sound tracks from the recording medium. Mobile devices for automatically determining the current geographical position, such as GPS receivers, normally output the position data in the form of digital signals, which can either be recorded directly digitally or by analogue means using sound modulation and later read out by the electronic circuit.

While cameras with mono sound recording could not record any more sound if the sound channel was permanently assigned GPS coordinates, cameras with stereo sound recording would need one of the two stereo channels for a continuous recording of the GPS coordinates. The sound channel or both sound channels can be available for sound recordings despite the recording of the GPS coordinates if the sound channel is only switched to the GPS receiver for a short time, e.g. for two seconds. Then the normal sound recording is carried out again. This enables an almost trouble-free audio operation. The brief activation can e.g. at the push of a button by the operator (e.g. when pressing the camera recording button), automatically after a waiting period after switching on the camcorder and / or automatically at regular intervals. Since the camcorder is hardly moved in relation to the achievable spatial resolution during a recording phase, one usually gets by with one set of GPS coordinates per recording phase.

The achievable bandwidth allows pure GPS coordinates to be recorded as often as images, but not exactly synchronized. Usually there is little disturbance or it can be easily corrected afterwards if the assignment of the coordinates and the camera images is not exactly synchronous with the image, but due to a lack of synchronization or low bandwidth few pictures is moved.

The circuit and, if applicable, the mobile device for position determination, e.g. a GPS receiver can be powered by the camcorder's internal power supply. A GPS antenna and a GPS receiver, which are also commercially available as an integral component, are preferably located in a small housing together with the electronic circuit and a computer interface RS-232 in between. There are e.g. a status display for the reception quality, setting elements for the data formats and contents of the position data written on the audio track, a connector for connection to the camcorder and a connector for connection to the RS-232 interface of a computer. A version for professional users supports timecodes (distributed codes) for audio or timecode channels such as VITC (Vertical Internal Time Code), LTC (Longitudinal Time Code) by SMPTE (Society of Motion Picture and Television Engineers) or various computer interfaces for output and DGPS (differential GPS).

Not only GPS receivers are suitable as mobile devices for geographic position determination in length, width and height (absolutely to the center of the earth and height to the surface), which includes all receivers for GPS and / or GLONASS as well as GNNS in the future, but also other position determination devices with radio connection to at least three known transmitter or satellite positions and transit time measurement.

Basically, geographic positioning is possible if three fixed points are known and the distances of the fixed points are calculated from the transit time and the speed of light. Corresponding devices are based, for example, on the future possible position determination using terrestrial cell networks, especially in mobile radio technology. Such devices operate at higher frequencies (> 1 GHz) than GPS devices and involve satellite networks on lower orbits than the GPS system. This enables a large number of mobile electronic devices to be positioned determine or calculate.

In the case of terrestrial radio cells of mobile radio networks which are based on digital data exchange, there is the additional advantage that the positions of the at least three fixed points, namely of nearby network station stations, are exactly known and there is even a point-to-point duplex data connection. The computing power e.g. a mobile phone leaves enough power reserves for the necessary calculations. The digital maps required for the invention can even be stored or transmitted in a mobile radio device, and route suggestions or route sequences can be displayed on a small screen of the mobile radio device.

Mobile computers such as e.g. Consider palmtops that are connected to a mobile device or contain a suitable radio receiver. The data processing program according to the invention can also be installed on such a mobile computer, so that the user can make full use of the invention while traveling.

All of these known and future systems for geographic positioning are generally referred to below as GP systems.

In a further development of the invention, a system according to the invention with a GPS receiver also comprises a receiver for G PS reference data which is transmitted terrestrially (for example via the mobile radio network) and which is connected to the mobile device. This allows a difference correction of the GPS coordinates by means of the known DGPS (differential GPS) on the basis of the reference data, whereby a particularly high location accuracy of the order of one meter is achieved. Alternatively, such a difference correction can be carried out by post-processing the position data later. If the system user's computer has a communication connection for, for example, the Internet, the data processing program can call up the required correction data, for example from a server of the system manufacturer, and the difference correction carry it out yourself or alternatively send the positions and the recording times of the images to the server, from which it then receives the corrected data back. Recommended standards for the difference correction are described, for example, in the Word Wide Web on the page http://www.navcen.uscg.mil/ policy / dgps / rtcm104 / defaul.html from July 28, 1998.

To bridge the occasional inadequate reception of transmitters or satellites, e.g. in buildings, a gyro sensor system that contains acceleration sensors based on electromechanical or photoelectric (laser gyro) or conventional gyros can be integrated into the GPS receiver. The gyro sensor system represents an inertial system, with the help of which the position determination can be continued in the meantime.

According to a further development of the invention, the system further comprises an electronic compass, which records the recording direction of images or image sequences represented by image data and which records and / or transmits the corresponding direction data in addition to the position data together with the image data. The electronic compass can be a 2D compass for detecting the direction of the sky, in which the camera lens points during the recording, or a 3-D compass for additionally detecting the camera inclination with respect to the horizon. The directional information simplifies the later evaluation of the captured images or image sequences on the computer and enables useful additional effects.

The position signals of common GPS receivers usually take the form of serial digital signals, for example NRZ (non-return-to-zero) signals. It has been shown that in this case the first circuit part only has to perform an inversion and level conversion on the serial digital signals so that the level-reduced TTL signals obtained in this way can be recorded directly on the audio track of a fully digital camcorder. An inversion can even be omitted, although the data recorded on the audio track no longer represent standard TTL signals. in the In the case of a camcorder with analog recording that cannot easily process the high data frequencies that occur, the signals are stretched in time, ie either a digital speed conversion or an analog frequency conversion is carried out.

In the case of a GPS receiver with NRZ output signals that are computer-readable via an RS-232 interface, it is expedient if the second circuit part restores the original NRZ signal form of the serial digital signals when reading out the position data.

So that the data processing program can process this information directly, it is expedient if the GPS receiver or other GP device delivers the geographic position data in a standardized format. A common format for GP information is the code set NMEA-0183, described e.g. in the Word Wide Web on the page http://www.marinesoft.com/ Navigation / Technical / mse4.html dated July 27, 1998. According to the invention, however, GP information can also be recorded or transmitted by GP devices that offer other standard formats and / or proprietary raw data formats. In the case of device-specific raw data, the data processing program must carry out their interpretation, or the manufacturer of the system according to the invention offers this e.g. as an internet service.

The GP information includes the following information, which is not all required for the invention: date and time in different number systems, position information in different coordinate systems, indication of whether (difference) corrected or uncorrected, number and numbers or names of the receivable and used satellites or radio cells, HDOP (Horizontal Dilution Of Precision = quality value of the length determination), VDOP (Horizontal Dilution Of Precision = quality value of the latitude determination), GDOP (Geocenter Dilution Of Precision = quality value of the determination of the distance from the center of the earth), TDOP ( Time Dilution Of Precision = quality value of the time determination), height unit, age of the correction information, station information, time of the last location determination, checksums, signal strengths, information on the system operating mode, Information on the deviation between GPS and GLONASS or GNSS system, operating state of the satellites and radio cells, the receiver and possibly the reference receiver, error information, area error and correction information (absolute or as quality values), information on the distance from the center of the earth, synchronization information, almanac - and ephimer information of the satellites, direction and speed information, azimuth and elevation information of the satellites, event markings, weekly, daily and time unit counters in various counting systems, epoch information, information on the direction of the magnetic north pole, zone information, information on the generated message format, parameters - and status information.

In a preferred embodiment of the invention, the data processing program is set up to use the recording locations of images or image sequences represented by image data to display a route traveled on the at least one map on the screen and recording locations lying on or next to the route traveled by symbols, inserts or inscriptions sufficient screen resolution - to display individual reduced images from the images or image sequences. If the system e.g. displays symbols first, the user can enter a lettering or a selected image during post-processing that should replace the symbol. By clicking on the symbols or the like, the available pictures or film sequences are displayed in a larger format, or a menu appears first, in which the recording locations or pictures are listed according to adjustable criteria. At the user's choice in accordance with the screen resolution, several maps and corresponding menus can be displayed on the screen either in succession or together.

In a preferred embodiment of the invention, the data processing program has a so-called zoom function, ie the user can, for example, use the mouse to mark any section on any map currently displayed on the screen, which is then shown enlarged on the screen, this process being carried out at will repeated depending on the quality of the map material available can be.

At the beginning, for example after the start of the data processing program, a digital world map is preferably displayed on the screen, into which the user can zoom. A particularly useful world map is in the form of a parallel projection onto the globe, i.e. it corresponds to a lifelike view from a great distance, with the user e.g. using the mouse and cursor, can rotate virtually until the section of the earth that interests him points forward.

In a preferred embodiment of the invention, the data processing program contains an editing program or it can work together with an editing program in such a way that a film is composed from at least one map selected by the user and from images or image sequences selected by the user for recording on a commercially available video recorder.

For the above-mentioned correction of the difference in position data in the context of external post-processing, the data processing program can contain a communication program or cooperate with a communication program such that geographical position data recorded in connection with pictures or picture sequences e.g. sent as electronic mail and the corrected position data can be received again.

The first circuit part of the system according to the invention, i.e. the electronic circuit for recording geographical position data can be implemented in various ways.

A particularly simple circuit which enables the recording of position data, which are represented by serial digital signals, on the sound channel of a camcorder essentially consists of a level converter or a signal inverter and a level converter. Such a circuit can be built in with very little effort from a commercially available integrated circuit energy-saving CMOS technology and some passive electronic components. In a preferred embodiment, the electronic circuit, together with a mobile device for automatically determining the current geographical position and for outputting corresponding position data, for example a GPS receiver, forms a compact integral device which has only three electrically conductive connections to the camcorder, namely a signal conductor, a power supply conductor and an earth conductor.

The second circuit part of the system according to the invention, i.e. a circuit for reading out the position data from the sound channel of the camcorder, in a preferred embodiment restores the original signal form of the serial digital signals. This signal recovery circuit can also be implemented in a relatively simple manner. The signal recovery circuit can either be in the same housing as the signal recording circuit, with an energy-saving circuit being expediently provided for deactivating it when not in use, or in a separate housing that the system user does not have to take with him when traveling, since the signal recovery circuit is only used for dubbing the data the computer is needed.

Other options for storing or transmitting the geographical position data in a different way than on the audio channel of a camcorder are:

1. coded in the return frame for video systems (VITC or similar) 2. coded in the visible image for video systems and still cameras

3. in the control lane with video systems

4. via LTC on the soundtrack

5. via RCTC (Rewritable Time Code) from Sony for Video8 / Hi8

6. in the digital image and sound data used in digitally recording video cameras (here, parts of the image and sound are recorded with a time-division multiplex method). These cameras have enough data bandwidth and memory for their own recording methods for the coordinates and GP Information and even for maps.

7. in the digital storage media used in still cameras. For example, chip cards are suitable as a storage medium.

8. in hybrid still cameras according to the APS method, as mentioned above.

The GP recording can be continuous, in response to an event, or periodically. In addition, consecutive position numbers (and thus scene and picture numbers) can be recorded.

The above storage options 1 to 8 are explained in more detail below:

Re 1 .: VITC is a procedure standardized by the SMPTE for recording hours, minutes, seconds and frame numbers in every frame (full frame) in analog video recording and transmission processes. Here, a memory area of 80 bits is defined in one of the return lines of the television picture. VITC is therefore part of the invisible television picture. The 80 bits are divided into time code bits and user bits. Either you use the entire area or only the user bit area for the coordinates. The restriction to the user bits offers a high degree of compatibility with existing devices, but not enough space for a GP coordinate, so that a GP message must be distributed over several images. It is expedient for the invention to distribute a full “start coordinate” over several images in order to then only save the relative deviations in the following user bits. VITC is rarely offered as an integrated function in cameras from the field of consumer electronics, otherwise only in complex studio cameras. Elaborate video post-processing devices can subsequently apply this code.

Re 2 .: In the visible area of the image, some areas can be defined in a manufacturer-specific manner, in which the GP coordinates and / or GP information can be saved. This process is also synchronous.

Re 3 .: In the control lane (CTL lane) with VHS / SVHS cameras, normal- sync signals recorded parallel to the images. The control signals are received with known time code methods such as RAPID (registered trademark) or the like and information is added with time code. The time code is similar to VITC, but structured with 50 bits and can be assigned at least coordinate part data in the user bits. Basically, however, RAPID requires 50 frames, 2 seconds, for a timecode. The RAPID procedure is only used for PAL procedures. Due to the low bandwidth, the recording according to the invention becomes overlapping and not synchronous.

To 4 .: LTC is also standardized by SMTE and is written in an audio or timecode channel on a video or audio recorder. Can be recorded before, during or after recording with video images. Can only be read when moving the magnetic tape.

5: Similar to RAPID, but accurate in picture, is recorded during the helical trace recording between video signal and PCM (Pulse Code Modulation) sound.

Re 6 .: Digital storage, which is becoming more and more popular with video cameras, offers a multitude of options for storing the digital GP data as an integrated function of the camera and for transferring it digitally to a computer, editing device or recorder. There is sufficient data bandwidth. There are already PC add-on cards on the market with which the digital sound and image data can be transmitted in real time.

Re 7 .: So far there is no way for users to incorporate GP coordinates or GP information from digital still cameras, but suitable connection options could be provided earlier or by the manufacturers. Digital still cameras compress the individual images either losslessly or with loss using suitable compression methods. The GP coordinates or GP information can be easily stored on your digital storage media (often PCMCIA memory cards, standard for mini-PC interface). To 8 .: APS represents a combination of traditional film and a magnetic stripe. The GP coordinates or GP information could also be stored on this magnetic stripe.

In general, the invention relates to the assignment between position data or GP information, moving or still images and maps and the integration or processing and display of these objects on a computer, optionally with video editing. By visualizing the maps provided with the GPS coordinates, the invention makes it easier to answer the question of where the picture in question was taken.

For the transport of the film, image, sound, GP, or compass data material from the recording location to the processing station, i.e. to the computer, one of the following transmission paths is preferred:

A) time-shifted radio transmission (batch data transmission)

B) Real-time radio transmission (live data transmission)

C) Delayed transmission by transporting a storage medium

Which transmission path is chosen essentially depends on the application for which a specific embodiment of the invention is intended.

Professional applications include, for example:

- On-site reports including maps, where time is an important factor. A current film scene is broadcast directly with an OB van (e.g. via SNG, Satellite News Gathering) (transmission route B)).

- By means of so-called ENG, a kind of current acquisition that i.a. from the company

Panasonic is offered within the framework of a system called DVCPRO, with the additional inclusion of maps, whereby a reportage near the recording location is composed as soon as possible / cut and transmitted either by A), B) or C) for post-processing / shipment.

- Stationary film editing applications with or without additional digital animations for the preparation of video recorded primarily by C)

Film

- Applications in accident research, police, fire service, environmental protection, tourism advertising, transport companies, real estate agents, industry information services, urban planning, Internet services, primarily via C).

- Infrared and residual light intensifier cameras with time-delayed integration of maps via A) or C).

- Inclusion of real images and film sequences in the production of virtual worlds via C).

For applications in the semi-professional area and in the area of entertainment electronics, the transmission path C) is predominantly possible. The positions and routes can not only on the home computer, but also on the go e.g. displayed on a palmtop computer or on a mobile phone used to determine the position. Such a mobile phone can also be used to send so-called POI (Point Of Interest) requests and to display the information received. Such information is e.g. Sights, nearest petrol station at the lowest price, hotels, personalized road traffic information, cities, sights, cultural, monumental, industrial and military objects, tree populations for tree registers, road traffic signs, bridges, tunnels and other object coordinates, location of shipwrecks and other underwater objects (Maps are also understood to mean nautical charts and mixed maps), natural phenomena such as Lightning, flora, fauna, astronomy, cyclones, catastrophes.

Suitable digital maps for the system are available in large numbers and in various different formats (e.g. as image, location, raster or vector map material). Suitable maps can be supplied together with the data processing program, or the data processing program can, for example, access map material from common image processing programs or from the Internet.

The computer or the data processing program can e.g. perform the following operations on the coordinates or directions and images recorded on site: record or register, process or edit and combine or mix with existing location, vector and raster information, without visualizing digital maps together with other data and save and integrate, visualize, save and transfer with location, raster and / or other vector maps and other data.

As already mentioned above, the cards can be placed and used alternately or visually mixed with the still or moving pictures on the screen, and camera route and station points can be connected with routes based on real route and route vectors, compared, stored on storage media and be visualized.

If the computer has location points originating from other sources, street, route, route, flight and ship route vectors as well as raster map information with additional information, these elements can be combined, mixed, processed, transmitted and / or stored with the camera coordinates recorded on site .

Useful additional information is, for example, the following: georeferenceable physical-technical information such as absolute or relative height, length, width and height of an object, quantity, speed, direction, density, weight, measure, measurement, seismic, sound -, Age, vegetation, concentration, condition, weight, flow, deviation, temperature, radiation, intensity, limit, usage, statistics and history information. Administration tive information on borders, divisions, classifications, classifications, cultural, linguistic, ethnic and educational classifications. Additional textual information for sights and attractions. Image, sound and video sequences. Symbols (so-called icons), pictograms and holograms, signatures. Coded and uncoded information.

Digital raster maps in various coordinate systems are currently as follows: elevation maps, panchromatic images, aerial photographs in the visible range, satellite images in different frequency ranges, radar images from satellites, magnetoscopic maps / images, land use maps, vegetation, temperature, ore, oil reserves, and other raw material maps and occurrences and seismic maps.

Digital location / POI coordinates in various coordinate systems currently refer to cities, sights and many other objects that have already been listed above.

Digital vector maps in various coordinate systems are currently as follows: occurrences of buildings, borders, ships, roads, railways, water, rivers, forests, agriculture, uses, vegetation, temperature, ore and oil , other commodity maps and deposits.

In terms of hardware, the computer must have an input channel for coded GP information, for example via the RS-232 interface, or a special hardware device for reading the GP information from the film and / or for reception via the transmission paths A) or B). In addition, the computer must have a frame grabber, called frame grabber or video capture, for analog recorded video or an image capture circuit for digitally recorded video. In the case of an image capture circuit for digitally recorded video films, the GP information can also be contained in the digital sound / image data stream and thus be accessible to the computer without a special input channel for this. The software can have at least one or more functions and data from the following:

- Program (s) for reading out, processing, storing (special form known as data logging), georeferencing (information on coordinates in

Set relationship) and, if necessary, display the camera coordinates and / or the other GP information (including time, time zone calculation, world time calculation, summer, winter times etc.), time code and / or user bit evaluation, optionally without maps - the above Functions in connection with raster and / or vector and / or location map data and the following further functions:

- Select from existing location data (e.g. object, city, river names) and vector data (e.g. ship, street, river, border and flight routes) and change, add, process, transfer and save them without your own coordinates

- Via coordinates and approximation of coordinates, location and vector information Select, change, add, process, transfer and save

- Transfer of the uncorrected positions, the time of the position and further GP information about e.g. Internet to the system manufacturer and receipt of the corrected data

- Receiving DGPS information e.g. via the Internet and difference correction of the GP information by post-processing on site

- Geo-referencing objects - Perform calculations for various projection, display and lighting forms from existing digital maps

- Allow different thematic viewing and data levels (so-called layer technology, e.g. switching on streets and sights, activating rails and buses, or activating elevation display and drawing boundaries). The number of combinations increases with

Content of the digital map data and is in principle only limited by the memory and power resources of the computer)

- Zoom and Pan (move) - Sort / group the data elements differently

- Place cards transparently or opaque over pictures / film sequences

- Store and display camera coordinates

- Enter new location or vector coordinates manually and / or change existing coordinates or do this programmatically from other data sources

- Show cards with a hard transition or by so-called fading softly in front of or behind image / film sequences

- Save the results of such functions on analog or digital sequential (linear) storage media (video recorders) or non-linearly on digital storage media and load them again

- Assign text and data to the maps (name of the point of interest or place or comments) and optionally assign, save and play or transmit audio information (voice, music) or video information (image, film) to such objects

- Rotate, mirror, stretch, compress, transform, distort, tighten, alienate, reproject, color, overlay or mix with other data, sounds, images, films, etc., change or improve them visually - Movable and / or illuminated cards and / or animated

Make objects (e.g. projection onto the globe and rotate, change sun / moon position)

- Manually or program-controlled project object names or symbols, pictograms (icons) onto the map, which indicate that images, film sequences, sounds or textual information can be called up here. Such

Load or create symbols, model, place and save. Load, change, display and save pixel coordinates or the various geographic coordinates

- Save and display route or position history, calculate and display route suggestions

- Apply artificial (arithmetic, virtual) surfaces (textures) or real surfaces

- Combine or divide cards by tiling them together - Compress and decompress, load, save and transfer cards with various methods (e.g. JPEG, MJPEG, Wavelet, CinePac, Indeo, fractal) with or without loss

- Overlay grids - Save maps and the above combinations, play them back audiovisually and / or visually, transmit and transmit

- Enable process scripts using macro language (so-called batch or batch processing), control video recorders / cameras, run video material on the computer, save, change and display small sections (so-called thumbnails)

- Generalization of vector and location data with / without true to scale (exaggerated) form, e.g. Represent houses and mountains as large symbols or icons

- Calculate / estimate the position of a given route from the passage of time (after an hour of flight over the Atlantic I was here, no GP reception)

- Exact positioning of a GP coordinate in a less resolved map (e.g. world map in 1 km resolution, then position within the kilometer) - Mix, play, print, export and transfer results.

Integrate traffic information (traffic jams, traffic flow, accident locations, parking information, park & ride information, road conditions, weather, traffic density etc.). Carry out driving and flight simulations by saving and playing back real images and / or video sequences with or without simultaneous display of a map and / or simultaneous display of artificial scenes (primarily train, ship and road trips or flight films)

- Export and transfer of data in accordance with OGC standards (OGC = Open GIS Consortium, GIS = Geographic Information Systems)

- Smoothing the GP coordinates recorded by the camera

- By positioning a screen pointer (mouse / cursor) object details such as travel name (e.g. vacation 1996 in Mallorca), date and time Show. Likewise for sections of a trip (trip from Los Angeles to the Grand Canyon)

- Display the maps in three-dimensional form using elevations of the terrain and / or the buildings - Integrate interior floor plans of buildings in the maps to e.g. the

To position recordings in a museum or in a landmark on the floor plan (without GPS support)

- Mix satellite and flight maps into the maps and / or overlay

- Provide sections of a trip with text and attribute information (flight start, stopover, taxi, bus trip, ship passage, start, stop, break) and save them as database objects and e.g. process with different colors.

Further features and advantages of the invention emerge from the subclaims and from the following description of an exemplary embodiment with reference to the drawings.

Brief description of the drawings

1 is a schematic overview of a system for processing GPS data and images,

Fig. 2 is a block diagram of part of the system of Fig. 1,

3 is a block diagram of another part of the system of FIG. 1;

Fig. 4 is a circuit diagram of a circuit part in Fig. 2,

Fig. 5 is a circuit diagram of a circuit part in Fig. 3, and

6 is an example of a screen display on a computer to illustrate a vacation trip. Ways of Carrying Out the Invention

The arrangement shown in Fig. 1 comprises a commercially available camcorder 1, a GPS receiver 2 with an associated antenna 3, which can be an integral assembly 4, an electronic circuit 5, which receives the GPS data generated by the GPS receiver 2 and into a form suitable for joint recording and / or transmission with image data, and optionally a radio receiver 6 for reference signals, which are supplied by the GPS receiver 2, for immediate or later correction of the difference in the received raw GPS data.

The above components of the arrangement are all portable, whereby the GPS receiver 2, the GPS antenna 3, the electronic circuit 5 and possibly the radio receiver 6 can be installed in a common small housing that can be attached to the camcorder 1. A three-wire connection cable to the camcorder 1 contains a power supply conductor 7, via which the GPS receiver 2 and the other modules (the connections of which are not shown) are connected to an internal voltage source of the camcorder 1, a signal conductor 8, which has a data output of the circuit 5 connects a microphone input 9 of the camcorder 1, and a common earth conductor (not shown in Fig. 1). If the camcorder has an audio input for sound signals from signal sources other than a microphone, this can be used instead of the microphone input 9, with the level conversion described below possibly having to be adapted accordingly. The microphone input 9 of the camcorder 1 or possibly its audio input can be connected to a switch, not shown, via which GPS data from the GPS receiver 2 or sound signals from a microphone, not shown, can optionally be fed to it.

The arrangement shown in Fig. 1 further comprises a stationary part, which is shown in Fig. 1 separated by a dash-dotted line from the above components. The stationary part comprises a personal computer 10, which inter alia with an RS-232 interface (not shown in Fig. 1) and with equipped with an image capture circuit 11 and connected to a graphics screen 12. The personal computer 10 can access an internal or external database 13 for maps and locations. The image capture circuit 11 is, for example, part of a commercially available plug-in card for video editing, and the associated software can access a memory area 14 for film files, which are shorter image sequences or so-called clips, and a commercially available video recorder 15 for storing longer films.

The electronic circuit 5 of the mobile part of the arrangement has a further output which can be connected to the RS-232 interface of the personal computer 10 via a connecting cable 16.

The mobile part to the left of the dash-dotted line is carried on trips or otherwise on the way. Before or during filming with the camcorder 1, the GPS data supplied by the GPS receiver 2 of the current geographic position including the corresponding times are recorded in parallel with the images on the sound channel of the camcorder 1.

The further output of the electronic circuit 5 is later connected to the personal computer 10 and a video output 17 of the camcorder 1 is connected to the image capture circuit 11. The personal computer 1 reads out the stored GPS data and times from the camcorder 1 by means of the circuit 5, places the positions at which there are pictures on a map displayed on the graphic screen 12, e.g. marked with symbols, and he can calculate the route and also display it from the positions and times and, if applicable, predetermined traffic routes. These and other functions that a suitable data processing program can perform have been described above or will be described later.

While the data bandwidth of a fully digital camcorder 1 is sufficient to record the GPS data immediately after the signal conversion, which is described in detail below, directly on the audio track of the recording medium, the camcorder with analog recording will electronic circuit 5 and the camcorder 1 are not directly connected to one another via the signal conductor 8, but via a further electronic circuit 18 for the temporal expansion of the data or signals. The circuit 18, which can also be integrated in the circuit 5, performs either a digital speed conversion or an analog frequency conversion on the data or signals in order to adapt the bandwidth of the GPS data to the recording bandwidth of the camcorder 1.

Fig. 2, in which the same components as in Fig. 1 are designated by the same reference numerals, shows a block diagram of the part 19 of the electronic circuit 5 which is used for recording the GPS data on the camcorder 1 and which is framed by a dashed line.

The GPS receiver 2 outputs the GPS data in NRZ form via an asynchronous RS-232 interface as ASCII (e.g. at 9600 or 4800 bps), often in

Format NMEA 0183. The GPS data are fed to a signal converter 20, which converts the data into the TTL form, which has inverse states with respect to the NRZ form and different earth levels. After a further level reduction in a signal attenuator 21, the GPS data are fed directly to the microphone input 9 of the camcorder 1.

Beneath the various line sections in the chain from the GPS receiver 2 via the signal converter 20 and the signal attenuation member 21 to the camcorder 1 in FIG. 2, the respectively transmitted signal forms of an exemplary bit sequence "10110" are shown, which is transmitted bit-true to the camcorder 1, as you can see in the figure.

A radio receiver 6 for reference signals is optionally provided, which has its own antenna 22 and whose output signal is supplied to the GPS receiver 2 via an RS-232 interface or the like in the standard format RTCM for differential GP or another suitable format.

An electronic 2D or 3D compass 23 can be provided as a further option be, which detects the cardinal direction in which the camera lens points, and in the three-dimensional case also the camera inclination. Since a single GPS data message does not exceed a certain length within the transmission bandwidth and, for example, a message is transmitted once per second, idle times occur on the interface. The compass data, which are very short, can simply be inserted into the interface as a short data record after the GB transmission. For this purpose, the compass 23 can have a special circuit part that detects an idle and then appends its own directional data (either at the RS-232 level as shown in Fig. 2 or at the TTL level) to the directional data together with record the GPS data on the magnetic tape of the camcorder 1.

Power supply connections of the GPS receiver 2, possibly the radio receiver 6 and the electronic compass 23 as well as the switching unit 19 can be switched via a switch 24 either with a positive connection 25 of the internal voltage source of the camcorder 1 (often + 5V) or with an external voltage source 26 get connected. The supply current is returned via an earthed coaxial shield 27 of the connecting line between the circuit part 19 and the camcorder 1.

Fig. 3, in which the same components as in Figs. 1 and 2 are designated by the same reference numerals, shows a block diagram of the part of the electronic circuit 5 used for the transmission of GPS data recorded on the camcorder 1 to the personal computer 10. This signal recovery part can either be integrated with the mobile circuit part 19 or be a separate, stationary component. Incidentally, a power-saving circuit for deactivation when not in use is expedient for the mobile circuit parts.

The signal recovery section includes an impedance adapter 30, an amplifier 31, a pulse divider 32, an inverter 33, a pulse generator 34, which is, for example, a flip-flop, and a signal converter 35 which converts the GPS data from the TTL form into the Implemented NRZ form. All of these components can be switched via a switch 36 either from the terminal 25 of the internal voltage source Camcorders 1 or from an external voltage source 37 are supplied with voltage.

An audio output 38 of the camcorder 1 provides a low-level output signal which is adapted in the impedance matching element 30 to the reference level 0V. The amplifier 31 and the pulse divider 32 generate a positive pulse for each rising edge of this signal and a negative pulse for each falling edge, and from this two parallel signal trains with positive pulses, which are inverted and rectangular-shaped in the inverter 33. The two parallel signals control the pulse generator 34, which generates corresponding TTL pulses from them. After conversion into the NRZ form in the signal converter 35, the GPS data are fed to an RS-232 interface 39 of the personal computer 10.

Below the various line sections in the link chain from camcorder 1 to personal computer 10 in FIG. 3, the respectively transmitted signal forms of an exemplary bit sequence "10110" are shown, which is transmitted to camcorder 1 in a bit-true manner. Note that the output signal of the signal recovery part in FIG. 3 has exactly the same form as the input signal of the circuit part 19 in FIG. 2.

As shown schematically in Fig. 3, the personal computer 10 includes, among other things, the frame grabber 11 connected to the video output 17 of the camcorder 1, the RS-232 interface 39, programs 40, card data 41 and a communication port 42 e.g. for internet. The communication connection 42 enables data exchange with an external computer 43 for a differential correction of the GPS data on the basis of reference data by postprocessing, if the personal computer 10 cannot carry out the differential correction itself due to the lack of reference data or software.

FIG. 4 shows an example of a detailed version of the circuit part 19 from FIG. 2. The GPS data are fed to the RS-232 input of a CMOS-IC MAX 232. Its output is via a capacitor and a potentiometer as a signal attenuator and, if necessary, another RC element with the Microphone input ("Mic") 9 of the camcorder 1 connected.

Fig. 5 shows an example of a detailed embodiment of the signal recovery part of Fig. 3, which is a little more complex than the circuit part 19. In Fig. 5, an operational amplifier LM 324 corresponds to the impedance matching element 30 (see Fig. 3), the following arranged in parallel Operational amplifiers correspond to the amplifier 31 and the pulse divider 32, the IC 7404 corresponds to the inverter 33, the IC 7474 corresponds to the pulse generator 34 and the IC MAX 232 is connected to form the signal converter 35.

An example of the representation and processing of images and GPS data recorded during a trip by means of a corresponding data processing program on the personal computer will now be described with reference to FIG. 6. First a world map 44 is displayed, in this example in the form of a parallel projection onto the globe, e.g. can be rotated in the arrow directions drawn on the world map 44 by means of the cursor and mouse. After the user has turned the part in question, here Europe, forward and the data processing program has read and evaluated the data recorded on the camcorder, an traveled route 45 appears, here for a flight from Hanover in Germany to Mallorca in Spain the

World map 44. The travel route can adhere to predetermined flight routes from existing map material and / or a curve is made through known starting, destination and route points.

On the world map 44, the user marks, for example with a cursor and mouse, a section around the travel route 45, which is shown enlarged in response to a further action, to the right in FIG. 6 below the world map 44, which can optionally remain visible. In the enlargement, the data processing program from the camera coordinates or the user marks the starting point and the destination point of the trip, to which film recordings exist, with symbols. The symbols can be replaced manually or automatically from a location directory stored in the computer with the lettering for the corresponding locations. In this example, the user has also entered that the city of Fulda was overflown, which was accidentally announced during the flight. This means that you can also specify the route more precisely without filming continuously and without GPS reception. The user or the data processing program takes the geographic coordinates of the city of Fulda from the city directory.

The user then selects a map section around the destination and zooms in until, in addition to the maps above or subsequently, the island of Mallorca is shown enlarged on the screen, shown in FIG. 6 below. This map contains larger details such as rivers, isohypses (lines of the same height) 46, individual elevations ("1445 m"), traffic routes, cities and city names. Based on the recording locations and times as well as the traffic routes specified by the user, the data processing program calculates the detailed course of the travel route, here a dashed section 47 for the bus trip from the airport to the hotel and a dashed section 48 for an excursion to the Inca cave. In areas in which the data processing program for the travel route cannot or should not adhere to existing traffic routes, e.g. because you have traveled through a non-mapped area, the isohypses 46 represent advantageous additional information for comparison with the distance from the center of the earth stored during the recording, so that the data processing program can draw the travel route “freehand”.

On the same screen surface as in Fig. 6, e.g. As a window between the maps, or on a new screen interface, tables can also be displayed, in which the single images or film recordings taken during the trip are listed, together with data such as Duration of the respective picture, place name, date, time, geographical longitude and latitude, geographical height, compass direction in which the picture was taken, camera inclination with respect to the horizon, columns for entering your own information etc. From this, the user can create a cut list for a complete film, in which the cards are included for illustration, and output this film on the video recorder 15 (FIG. 1).

Claims

claims

1. System for processing geographic position data and images, with an electronic circuit (5) which a first circuit part (19) for

Input of geographical position data and for outputting the position data in a form suitable for recording together with image data and a second circuit part (30-35) for entering position data recorded together with image data and for outputting them in computer-readable form, the first and the second Circuit part with a video camera (1) or a still camera for electronic recording and recording of images or image sequences and other information are connected or connectable, and with a data processing program, which is set up, at least one digital map (44) to display a screen (12) and to display the recording locations of images or image sequences represented by image data on the at least one map, characterized in that the first circuit part (19) is set up to operate the camera (1) independently of the second circuit part ( 30-35) and independent dependent on the data processing program to supply position data corresponding to the current geographic position of the camera for recording as the further information, and that the data processing program is designed to be executed on a personal computer which can be connected to the camera in order to display the data in the camera to receive recorded image data and position data, and to display the associated images or image sequences on the screen (12) when the user selects a recording location displayed on the at least one digital map (44).

2. System according to claim 1, characterized in that the camera is a camcorder (1) and that the first circuit part (19) is at least temporarily connected or connectable to a microphone or audio input (17) of the camcorder for recording the position data at least one audio channel of the camcorder essentially in sync with the image data.

3. System according to claim 2, characterized in that the first circuit part (19) with one of two stereo channels of the microphone or audio input (17) of the camcorder or is connectable.

4. System according to claim 2, characterized in that the microphone or audio input (17) of the camcorder alternately on the one hand the geographic position data and on the other hand sound signals are supplied by a microphone, the period of time within which the geographic position data are supplied, overall essential is shorter than the time period within which the audio signals are supplied.

5. System according to claim 2, characterized in that at least the first circuit part (19) of the electronic circuit (5) has a power supply connection (V _cc ) which is connected or can be connected to an internal power supply of the camcorder (1).

6. System according to claim 1, characterized in that it further comprises a mobile device (2) for automatically determining the current geographic position of the device and for outputting corresponding position data.

7. System according to claim 6, characterized in that the mobile device is a GPS receiver (2).

8. System according to claim 7, characterized in that the GPS receiver (2) is integrated in a GPS antenna (3).

9. System according to claim 6, characterized in that it further comprises a receiver (6) for terrestrially radioed GPS reference data, which is connected to the mobile device (2).

10. System according to claim 6, characterized in that at least the first circuit part (19) of the circuit (5) in the mobile device (2) is integrated.

11. System according to claim 6, characterized in that it further contains a gyro sensor system for continuing the position determination during phases without position data.

12. System according to claim 1, characterized in that it further comprises an electronic compass (23) which detects the recording direction of images or image sequences represented by image data and which records and / or transmits the corresponding direction data in addition to the position data together with the image data.

13. System according to claim 1, characterized in that the geographical position data are represented by serial digital signals.

14. System according to claim 13, characterized in that the first circuit part (19) only performs a level conversion or an inversion and level conversion on the serial digital signals.

15. System according to claim 13, characterized in that the first circuit part (19) converts the serial digital signals by means of sound modulation into signals which are suitable for analog recording on the sound channel of a camcorder.

16. System according to claim 13, characterized in that the second circuit part (30-35) restores the original waveform of the serial digital signals.

17. System according to claim 1, characterized in that the geographic position data have a standardized format.

18. System according to claim 1, characterized in that the data processing program is set up to use the locations of images or image sequences represented by image data to travel a route (45, 46, 47) on the at least one map (44) on the screen (12 ) and to display location locations on or next to the traveled route by means of symbols, inscriptions or individual reduced images from the images or image sequences.

19. System according to claim 1, characterized in that the data processing program enables the user to mark any section on any map (44) currently displayed on the screen (12), which is then shown enlarged on the screen.

20. System according to claim 1, characterized in that the data processing program contains at least one digital world map (44) or can access at least one digital world map, which it displays as an initial map on the screen (12).

21. System according to claim 20, characterized in that the digital

World map (44) is displayed in the form of a parallel projection onto the globe, the globe being virtually rotatable by the user.

22. System according to claim 1, characterized in that the data processing program contains an editing program or can cooperate with an editing program such that a film for recording from at least one map (44) selected by the user and from pictures or image sequences selected by the user is assembled on a conventional video recorder (15).

23. System according to one of the preceding claims, characterized in that the data processing program contains a communication program or can cooperate with a communication program (42) such that recorded geographic position data is sent for an external difference correction and the corrected position data are received again.

24. Electronic circuit (19) having an input which receives geographic position data, which are encoded as serial digital signals, and an output, which outputs the geographic position data in the form of signals which are suitable for recording on the sound channel of a camcorder (1) , characterized in that the electronic circuit consists essentially of a level converter (20, 21) or of a signal inverter (20) and a level converter (20, 21), whereby the position data are recorded true to the code on the audio channel.

25. Electronic circuit according to claim 24, characterized in that it consists essentially of a commercially available integrated circuit and passive electronic components.

26. Electronic circuit according to claim 24, characterized in that it forms, together with a mobile device (2) for automatically determining the current geographic position of the device and for outputting corresponding position data, an integral device which has exactly three electrically conductive connections to the camcorder ( 1) has a signal conductor (8), a power supply conductor (7) and an earth conductor (27).

27. Electronic circuit according to one of claims 24 to 26, characterized in that a further electronic circuit (30-35) is provided for reading out the geographic position data from the audio channel of the camcorder (1), the further electronic circuit being set up for this purpose, to restore the original waveform of the serial digital signals.