WO2006033626A1

WO2006033626A1 - System for communication and data processing for transmittal and use of digital information in connection with a tangible object

Info

Publication number: WO2006033626A1
Application number: PCT/SE2005/001394
Authority: WO
Inventors: Göran URBY; Mikael Schmidt; Håkan BLOMQVIST; Nils Haga
Original assignee: Urby Goeran; Mikael Schmidt; Blomqvist Haakan; Nils Haga
Priority date: 2004-09-24
Filing date: 2005-09-22
Publication date: 2006-03-30

Abstract

This invention relates to a communication and data processing system and method, for transmittal and use of digital information arranged in connection with a tangible object (1), comprising an information carrier (2) with digital information (3) arranged in connection with said object (1), a mobile terminal (4), a subsystem (5) for data processing, and a communication system (6) for transmittal of information between said terminal (4) and said subsystem (5), wherein said object (1) also exhibits visual information in the form of a symbol (7) arranged to indicate the possibility of interaction between said terminal (4) and said object (1), to achieve transmittal of said digital information (3) to said terminal (4) to initiate some kind of activity by means of said terminal (4). The invention also relates to a tangible object with combined digital and visual information.

Description

SYSTEM FOR COMMUNICATION AND DATA PROCESSING

TECHNICAL FIELD This invention relates to a communication and data processing system, for transmittal and use of digital information arranged in connection with an object, comprising an information carrier with digital information arranged in connection with said object, a mobile terminal, a subsystem for data processing, and a communication system for transmittal of information between said terminal and said subsystem.

BACKGROUND AND PRIOR ART

There is a growing need of arranging product data and information or other types of time accurate information for consumers and professional users. Products adapted for the consumer market typically have a visually recognisable logotype and a text that can provide information about size, content, use, fabrication etc. Another type of information can be of market or use type, such as data sheets for a product or a bar¬ code, for use in production, logistics and/or purchase. Other types of products, such as a pen, can have a logotype, a bar-code or data sheet designations. These are examples of concrete products with a packaging developed in one hand to be attractive to a buyer or user, and to distinguish from competitive products, at the same time as the duty of providing information is fulfilled. Another way of arranging additional information for a product is by using RFID tags. The field of application is wide, such as in logistics but also for example to identify cars in road tolls and other types of ticket systems.

Many other types of objects exist for which the readable content represents the information that is necessary or desirable to provide to the user or buyer. Here, the user can be anyone at any involved level and/or persons throughout the life cycle of an object, from production up to use and disposal.

Market communication takes place by visualising information, by use of for example advertisements, advertising posters, TV commercials etc. This is a typical example of a 1 -to-many communication addressing a large and public audience.

In the world, there has been an enormous development in terms of use and penetration of cellular phones. The number of cellular phones has passed the number of stationary phones among consumers. Investigations have shown that it is more likely that users carry a cellular phone than a wallet or keys. The cellular phone has taken a unique role for the consumer, resulting in that the phone has become the wallet, calendar, personal expression as an ornament etc, of the person in question.

There is a continuing development of the cellular phone, which for 3 G phones includes value-adding services such as internet connection, memory and local working memory enabling the storing of local applications on the cellular phone, as well as built-in camera technology. The latter depends greatly on the development of digital cameras.

Rational production has been achieved for small combined camera lenses and chips, such as CMOS that are optical lenses with chips that are very rational in production and easy to integrate in electronic applications such as cellular phones. Bluetooth has been used in cellular phones for some years and is nowadays used in most phones. Cellular phones with built-in RFID readers also exist today.

There is also an extensive development of cellular phone systems in which hand held terminals can be given access to internet by aid of e.g. GPRS, UMTS etc. Operators have in this connection made large investments in new infrastructure. In order to effect commercial realisation, a gap has formed in respect of offering value-adding services for the new cellular phone platforms.

One aspect of the present invention relates to a system for improved use of modern mobile terminals, e.g. terminals using digital camera functionalities, such as CMOS cameras, in which pixels are used as a basis for parameterising. A further aspect used as one of many starting points is the fact that modern phones have the possibility to transmit and receive data by short-range radio such as Bluetooth and RFID.

Reading of bar-codes is a well known technique for identification of products or objects, or for giving name, URL or web address for a specific product, which we are presupposing to be a well established technique and method. Regarding the latter, there are several actors that have developed various methods such as AirClic or Scanbury.

AirClic has patented its method for use of a bar-code reader with for example a cellular phone, wherein a central register identifies the bar-code of the object where after an URL is transmitted. Reference is made to patents US 6,314,457 and US 6,448,979.

Similar patents are known in the name of PaperClick, e.g. US 5,933,829, US 5,978,773, US 6,108,656, US6,199,048, US 6,430,554, US 6,434,561, US 6,542,933, US 6,651,053, US6,675,165, US6,766,363 and US6,865,608. Other patents, such as US 5,774,583, US 5,481,103, US 6,129,283, US 6,260,760 and US 5,962,839, describe methods for reading optical codes distributed over a plurality of data elements.

A need has been identified for simplifying and automating a user's access to information, when the person in question/the consumer has visual access to an object such as an advertisement.

Also a desire or need has been identified for several actors in the value-chain of an object, of establishing direct communication with an end user. Most often it is the dealer that has a direct communication with the end user, whereas the producer will not achieve any other communication than by advertisements and other messages that are of the type 1 -to-many.

Finally, there is a need for better understanding of how an object is consumed, as seen from purchase, during use and up to disposal.

SUMMARY OF THE INVENTION It is an object of the invention to provide an improved system and method to meet the need mentioned above, which is achieved by a system and method respectively according to the claims.

The invention describes how a tangible object is attributed an added value by use of the appearance/form/condition of the object together with one or more optically or electronically readable symbols. The invention describes how the information is encoded by aid of one or more symbols with the structure of associative images, optionally together with existing techniques such as bar-codes and matrix codes. By encoding data in different elements of the symbol or in several different symbols, more data can be linked to the object or to a series of objects. Decoding of the symbol/symbols will then take place in steps, where information decoded in one step is used to decode information in the next step.

Tangible objects can also be labelled by electronically readable tags (e.g. information in tags by aid of RFID or Bluetooth). Also with electronic tags, additional information and value can be linked with a tangible object by using stepwise reading of several tags in a given order. Also to use optically associative symbols to trigger the user to make a reading will increase the usefulness.

Today, different forms of data carriers exist. For example, data can be represented by aid of a group of parallel lines of different thicknesses and with different distances them between. This is a bar-code that is a 1 -dimensional data carrier. If several bar-codes are arranged over each other, a 2-dimensional data carrier is achieved. This is often called a matrix code. Matrix codes can contain more data than a bar-code. Several different principles exist for building matrix codes, whereof several are intellectually own. Examples of this can be matrix codes: Data Matrix or PDF417. Other data carriers are so called RFID tags, in which stored information can be changed and/or which can transmit information when exposed to given radio waves.

Such RFID tags contain even more information than do matrix codes.

Even more data and intelligence can be linked to tangible objects by use of Bluetooth technique.

The object of the invention is that for example product suppliers should be able to associate data with their products, whereby a terminal used by a user becomes the tool for realisation and use of such data.

The object of the invention can also be to adapt for automated transmission of data from a server to the terminal. By for example scanning and identifying a code or a key, a program can be locked up which is e.g. installed beforehand on the terminal, or it can be transmitted from a server to the terminal. Use of the invention can for example take place in form of games, information about a unique product or a product family, bonus coupon systems, or simply transmission of information from a medium such as a poster, letter, book, CD or e-mail, to a terminal for information or further use. The latter may especially form a basis for automated transmission from a tangible object, such as a letter with a stamp, a sign on a sheet, whereby the user of the cellular phone or PDA equipped with the functionality of a digital camera or radio receiver, can access a content, in the form of an e-mail, a website, a game, or part data that is stored for accumulation of data, before the information is given.

The invention also describes how to create, develop and/or adapt optically readable codes for geometrical shapes of different objects, where account is taken to optically readable conditions and the geometric shape of the object. The invention also discusses how to make data carriers out of existing symbols by addition or association with these optically readable characteristics. The invention also makes use of the scanner's ability to identify features such as a geometrical change of the original shape or condition of the object, and to use this as a logical element or data in an application. The invention also relates to a sequential iteration for an analysis of a visually recognisable symbol that can consist of bar-code(s) and/or matrix code(s), in which adaptation has been made for a simplified identification and analysis of the optical content. The invention is based on use of for example existing codes such as bar-codes (1 -dimensional), matrix codes (2-dimensional, i.e. a group of bar-codes in a given order) and/or 3-dimensional codes (2-dimensional codes that for example include colours!). The invention also comprises use of interactivity with the end user in order to deal with conditions related to the object, the situation of use, the condition of the object etc., as input values for an application, analysis or similar.

The invention relates to a systematic linking of information to a tangible object, and transmission of information from said tangible object to one or more hand held devices such as a cellular phone, RFID reader, Bluetooth receiver, digital camera, scanners in processes, shops etc., consisting of completely integrated or possibility to interconnect with an optically readable instrument such as a CMOS, i.e. a digital camera etc., or to a stationary terminal such as a PC or a server that can communicate with an optical scanner or radio receiver.

By aid of optically readable data such as a symbol of the logotype type, a drawing, a stamp or some other defined visual expression that can form basis for a digitalised identification, and that can result in that the terminal recognises which algorithm to be used for decoding itself, identification, parameterising and interpretation of physical geometrical characteristics based on the given sign, images and/or objects.

The invention also comprises cases in which the tangible object has information linked to itself by aid of electronic tags of the type RFID or Bluetooth.

The invention relates to the following aspects:

Symbols designed such that they are visual and associative to a human, and containing data, and being analysable and recognisable to a computer. - A combination of optical and (to a human) visually recognisable symbols that among other things comprise bar (l-dimensional)/matrix code (2-dimensional) technologies. The symbol has a visual appearance that is easily identifiable to a human, which simplifies algorithms for defining what is up and down on a digital image that has been read. The symbol may e.g. be an existing logotype.

The symbol consists of a frame that acts as a limit and as a support line, since it is dashed, which simplifies linearization and transformation of the digital image into data by converting pixels and/or groups of pixels into digital values. The symbol should be adapted to the geometry of the object and enable a simplified optical scanning with a minimal optical distortion. This is achieved by designing the symbol such that the codes are centralised in the object, if the geometry of the object is circular, or along the longitudinal axis of the object, if it is of tubular shape. Furthermore, the frame and optional support lines or dots of the symbol are designed such that when an object is represented, the 2-dimensional image will be corrected by appearing lines that are parallel to each other. This will simplify transformation of data by pixels or categorising of pixels into bites and finally into information. See Figs. 3 and 4.

Use of existing symbols such as a logotype, whereby by positioning one or more symbols or signs in relation to the logotype, one can give a value to the logotype. The various relative positionings of symbols and/or signs can give different data values by aid of image recognition and decoding algorithms. See Figs. 8 and 9.

- Use of the physical shape of the object as a logical value, i.e. that the profile, contour, colour, pattern etc. of an object can be given a logical value. This can be used to define the condition of the object, such as if a bottle is full, half empty or empty, by scanning the profile such that the liquid level in the bottle can be read. The presence of a readable black hole in the top of a can of soft drink can determine if the can is open or not. The hole if the form of a black mark against the rest of the can's top will mean that the can is open! This represents logical values.

The building of an image recognition system consisting of one or more different types of symbols (mentioned above) or electronic tags "Symbol stacking". By linking the logical value of each symbol/tag to each other, the total sum can give the final information/data set. The various symbols can also contain information on how the other symbols relate to each other in the stacked sequence, in which order they are to be scanned etc. See Fig. 5.

Image analysis can be simplified by use of stepwise analysis. Initially, search is made for a single recognisable feature that signals which type of data that can be expected to be found as a part of the symbol. The symbol can be e.g. one or more bar-codes, one or more matrix codes etc. The feature can be a star, a clear skyline of a building, such as a church spire, a bridge structure etc. Based on this, direction can be made to rules for where data can be expected to be found. A church spire, for example, can provide the image analysis algorithm with information on that the symbol should be a bar-code and two matrix codes, where the bar-code is localised between the matrix codes. The rules can be built of from logical thumb rules based on principles such as "if...then...", associative analyses etc. The image analysis can be supplemented by interactive questions to the user, in order to determine a profile, simplify an image analysis algorithm or verify an analysis.

Definitions

Various terms are used in the description, the definitions of which are described below.

A terminal:

A cellular phone or some other telephone with a built-in or connected camera, or

- A hand-hold computer/PDA having a built-in or connected camera, or A camera with an internet connection, or - A camera mounted on a vehicle (such as in a windscreen or on a grille), or

- A light data pen/digital camera connected to internet, directly or via a computer connection.

An optically readable symbol:

- An image, a logotype or a symbol that can be recognised or decoded by a machine/computer.

- The symbol can contain encoded information such as one-dimensional (ID) bar¬ codes, 2D matrix codes (such as ID codes positioned above each other to form a 2D code) or Radio Frequency Identification (RFID) (which is a chip that can receive and/or transmit data as it receives a radio wave). - Also 3D objects are included, whereby e.g. a car, a house or the silhouette of a human can constitute optically readable symbols. A visual symbol: - A symbol/image that contains encoded or non-encoded data that can be decoded or interpreted by a human and machine/computer.

- A symbol or image designed to be visually informative or associative to a human, i.e. representing something that a human can recognise and refer to. Compare a logotype containing a car with a bar-code. To a human, the logotype with the car contains associative information, while the bar-code does not convey any particular information to a human, but must be decoded by aid of an algorithm.

- The symbol can contain either of one or more associative and informative objects or be built up from different objects that are riot associative as seen individually, but for which the combination thereof forms an associative image. An electronic tag:

- An active or passive RFID tag.

- A tangible object provided with a Bluetooth unit that is able to transmit or receive information.

BRIEF DESCRIPTION OF FIGURES

In the following the invention will be described in greater detail with reference to preferred embodiments, wherein: Fig. 1 is a schematic view of a system according to the invention in connection with a marketing campaign,

Fig. 2 is an example of a visual symbol with encoded information in accordance with the invention,

Fig. 3 is an example of a matrix code incorporated in an existing symbol or image in accordance with the invention wherein use of McDonald's logotype is only intended to exemplify one possible way of use,

Fig. 4 is an example of a further symbol with a matrix code hidden in a symbol/image that is informative and associative to a human,

Fig. 5 is an example of adapting a symbol to a 3 -dimensional object wherein the code is concentrated towards the centre of the symbol,

Fig. 6 is an example of process flow from information to symbols, logotypes, bar¬ codes, and scanning, transforming etc., to having a game on the cellular phone.

Fig. 7 shows a preferred princip data structure in a symbol,

Fig. 8 shows an example of stepwise image identification and analysis in a visual symbol in accordance with the invention,

Fig. 9 shows recognisable symbols placed in relation to other recognisable symbols or codes in accordance with the invention, and Fig. 10 shows a further recognisable symbol in relation to another recognisable symbol or code.

DETAILED DESCRIPTION In Fig. 1 there is shown an example according to the invention for establishing a new market campaign, in which large placards/advertising pillars/boards 1 are used as means of communication, i.e. the board 1 is the object. Prior to the campaign, the responsible campaign supervisor (or some other function) will obtain a software from Briscan AB (the owner of the patent), into which basis values are incorporated, such as the number of boards (placards) to be used in the campaign, and defining the object type to form basis for the scanning, i.e. boards (placards), and defining what type of symbol 2, 7 to be generated. Furthermore, it is defined whether the symbol 2, 7 should be unique to every single object or typically generic to a category of products during a campaign, if other symbols or features at the board object or other supplementary objects should be included as data carriers 3, dedication of which data elements to be generated by the features of these objects etc.

As is schematically shown in Fig. 1, a campaign for trousers 9 for young people for example, can result in thousands of boards 1 on which a symbol 7 (here a so called Briscan symbol where an information carrier 2 is embedded into a visual symbol 7) is printed besides the brand 10 of the trousers 9, wherein the boards 1 are to be distributed in shops, malls, streets, bus stops etc. In this case, the symbol 2, 7 contains a centrally positioned circular information carrier 2, comprising matrix code 3 having a generically identical content, providing the consumer 8 a possibility to partake in a lottery. Outside of the information carrier 2, in an integrated manner to form a joint symbol 27, there is an eye-shaped contour 7 signalising visual information for interaction, in this case that a picture of the symbol 2, 7 shall be taken, e.g. by a cellular phone 4, and sent to a specific number, e.g. as a mms. Data 3 is then transmitted to a central server which processes it and retransmits a message 11 to scan the brand 10 of the board 1. Thereafter, the user will get a further message informing that he/she can partake in the lottery in which the prize is a pair of trousers as shown, if he/she buys any article of clothing in that shop and by presenting that message.

Before the above activities may be undertaken by the user, he/she shall preferably install the Briscan software/application on his/her terminal 4, e.g. a Nokia 7610 cellular phone, e.g. a software that wholly or partly assist in performing an image analysis . This may be done e.g. by loading down from the Briscan website. Alternatively, the application can be installed already when purchasing the terminal 4, be part of the SIM card or be part of the hardware solution of the terminal.

There are numerous ways of using the system exemplified by Fig. 1. For example, the user 8 may receive instructions given by the cellular phone 4, in the shop to scan the receipt (preferably including a symbol 7 and digital data 3) whereby the cellular phone 4 undertakes a preliminary image identification and recognition, e.g. locally on the terminal 4. Here, the recognition has been done to identify which Briscan symbol 2, 7 that is used. Thereafter, a Briscan algorithm is activated, which has communicated with the user and asked for additional scannings such as of the logotype etc. The Briscan application has, by aid of the cellular phone 4 and by aid of an available communication system 6, transmitted an extract of the Briscan symbol 2, 7 to the central server 5 for further analysis. The Briscan application on the terminal 4 has established a temporary stacking, in which various data elements are put in as they come up when scannings have been performed and results of image identifications and analyses have been performed locally on the terminal 4, or results of analyses on the server 5 have been returned. The stacking sorts and administers different scannings and any optional manual input on the terminal 4, until completed, and transforms itself for example to an executable code, a weapon included in a local game, a bonus coupon that can be transformed into a real value in e.g. a bank account, a telephone subscription etc.

The example above only describes how to use optical symbols, but also works with electronic tags such as RFID or Bluetooth chips.

Starting out from the needs mentioned above, an invention has been made that makes it possible to create rational and visually attractive symbols 2, 7 containing data 3, and to use existing symbols 10 and characteristics at an object 1 as a basis for logical contexts and thereby data. Furthermore, the invention comprises a system/method for designing optically readable symbols on objects of various geometrical shapes, materials etc., as well as a method for converting physical characteristics at an object into logical data for further processing, by aid of optical identification and analysis. An optical lens will give a certain degree of distortion at photographing. When the object is relatively far away, the optical distortion will be marginal. When the distance is reduced, such as at a distance between the object and lens of 10 cm or 5 cm etc., the optical distortion will be more marked. Optical scanning is used primarily in industrial contexts, and then it is performed with very controlled forms of scanning, i.e. with optimal lighting, known distances etc. Industrial use can e.g. be the putting together of car parts, where each individual part is marked by bar codes (1 -dimensional) or matrix codes (2-dimensional) and where it is robots that use scanners to identify the accurate component. Another industrial field of use is in connection with consumer-purchasing in a shop, where the bar-code of the product is read at the moment of buying.

Fig. 2 shows an example of a visual symbol 7 with encoded information 30, 31.

Here a preferred embodiment of the invention is shown, depicting a symbol 7 having a visual expression, i.e. giving a human an association to something known, at the same time as it has simple features 73 that are easily identifiable in image analysis. According to a preferred embodiment one or more information carriers 2 are embedded into the symbol 7 to form an integrated symbol 2, 7. The information carrier 2 contains digital information, e.g. bar-code 30 and/or matrix code 31, preferably in a manner so as to match the visual "message" of the general symbol 7, and preferred in a manner to enhance the visual "message". The symbol 7 should have a well defined border line 71, and contain elements 72, 73, 74 that are easily identifiable on the geometrical shapes of various objects. Conceivable examples are skylines or profiles of a village/city, a bridge, a building, a machine, a bottle etc., that are visually recognisable as such. The skyline of a city consists for example of a sky 72 and characteristic profiles 73, 76 of chosen buildings. The sky 72, with or without building profiles, will make it easy to determine the orientation of the symbol 7, i.e. what is up and what is down. This will reduce the extent of the image analysis.

Individual parts of the symbol will furthermore be able to contain bar-codes 30 and/or matrix codes 31. Different buildings can e.g. be represented by use of one or more bar¬ codes and/or matrix codes. When for example using contours 73 and/or other types of particular features of known buildings (churches, bridges, houses, sculptures, mountain formations etc.), analysis of a digital image can be simplified, as contours and/or other features act as known support lines or dots.

Another advantage of using an associative image is that the symbol 7 as such can make a human react (e.g. associating the symbol with the possibility to get an added value by taking a photograph/scanning the symbol) to possibly create a desired association (e.g. a specific association that an advertiser wants the human observer to create) whereas a scanner that "reads" the same information area may read something totally different, inherent in the digital code 3(e.g. the matrix code). The invention is also based on use of existing symbols 7 such as a logotype, in which elements of bar-codes or matrix codes 31 are used to create new logotypes that in their selves contain digital information 3. Fig. 3 shows an example of a matrix code 31 incorporated in an existing symbol or image. The use of McDonald's logotype is merely intended to exemplify one possible way of use.

Fig. 4 is an example of a symbol 7 along the principles described in connection with Fig. 2, with a matrix code 31 hidden in a symbol/image that is informative and associative tα,a human. Here the symbol 7 is positioned e.g. to inform the buyer that he might win a prize if sending a digital picture to a certain phone number, which might be an efficient way for the producer to achieve direct contact with consumers and at the same time receive information concerning consumption of their goods.

There is a big potential economical advantage for producers that can be achieved by means of the invention, i.e. by eliminating a large amount of expensive commercials/advertising. This may be achieved since it is believed that the visual appearance of the invention will make consumers curious (which is the main purpose of advertising/commercials) once they learn that there may be some kind of "gift/bonus" in connection with a visual symbol according to the invention. Hence the invention in a very cost effective way may provide producers to get the desired information to their costumers, without the need of using expensive intermediary channels, e.g. TV. In this context the invention may show to be of surprising efficiency if the visual symbol (as in a preferred embodiment) is created in a manner as to also signalise a specific Trade Mark, since in a such situation the consumer on top of being informed of the possibility of "gift/bonus" also instantaneously receives information that may assist in deciding whether it is within his/her special sphere of interest.

The object can be of various geometrical shapes, such as a bottle, a ball, a letter, a placard etc. Sheets of paper, books, periodicals/magazines, CD:s etc., are all planar as compared to other objects such as cans of soft drinks that are of tubular shape, bags of crisps that are oval in shape with a somewhat irregular surface etc.

Fig. 5 shows an example of adapting the symbol 7 to a 3-dimensional object. The code 31 is concentrated towards the centre 75 of the symbol 7. This can be a golf ball, a fruit etc. As mentioned, different objects are of different geometrical shapes. When a 3- dimensional, tangible object is to be depicted, i.e. photographed, in two dimensions, there will always be a physical change of the depicted object. The distance to the optical lens, the design and quality of the optical lens and the optical resolution, i.e. the number of pixels, ability to intensify light, i.e. the twilight factor etc., will all affect the result. When using for example integral support dots and lines 73 as a part of the visual expression of a building, a city, a bridge etc., adaptation can be made for a simplified normalisation and linearization of bent or uneven details in a digital image. Furthermore, a possibility exists for the orientation and putting together of a symbol such that the digital image forms basis for the most easy image recognition, linearization and transforming into digital values. It is already well known how use of support dots and lines can simplify both identification of e.g. the orientation of the matrix code, as well as adapt for transforming of pixels into data values.

Based on this, the invention encompasses development of symbols and/or adaptation for placing of such to optimise scanning of objects having a symbol. By developing symbols to avoid optical distortion, adaptation can be made to simplify the process of identifying and transforming images into pixels and thereafter into data. Furthermore, the invention encompasses how to group data in the symbol at a location in which the distortion will be minimal, such as in the middle of a symbol 7 placed on a round or tubular object. The extent of the data content in the symbol should primarily be centred in the middle 75 of a circular object, such as a soccer ball, or along the extension of a tubular object such as a can of soft drink.

The invention also encompasses localisation of a single recognisable symbol 74 (see Fig. 8), in relation to an existing logotype. It is to be understood that the symbol 2,7 shown in Fig. 1 might well be used as such a single recognisable symbol 74, e.g. informing a user 8 by its usual "message" that something can be gained if a picture is taken and transmitted. The relative placing of a recognisable symbol in relation to a logotype, can give information to be used by an application on a hand-hold terminal 4 and/or a server 5.

As depicted in Fig. 6 the invention also comprises a method in which data is collected from one or more different readable symbols Q, W, R, bar-codes R, matrix codes, electronic tags or characteristic and optically readable profiles or symbols of objects, in a given order, in which each reading represents a part of information that either gives complete basis data for further execution, or that the different data elements Q, W, E, R, T are put together in an integrated solution that is thereafter executed on the terminal and/or on a server. We call this Symbol stacking.

Fig. 6 shows an example of process flow from information to symbols, logotypes, bar- codes, and scanning, transforming etc., to having a game on the cellular phone. A game is transformed into various symbols Q, W, R and optionally other characteristics such as a bar-code R, logical values T etc. The symbols etc. can be printed on the objects 1, e.g. a can for soft drink. These symbols are scanned by the user over a period of time, and stacked on the terminal 4 until the game is completed, whereby an executable version of the game is stored in the cellular phone 4.

The invention also encompasses how to convert optically readable or identifiable details of an object, into logical information. For example, a receipt from a shop can contain a bar-code that identifies various conditions in connection with the purchasing, and which thereafter can be scanned and converted into a set of data that makes an inquiry about one of the purchased products, such as if a can of soft drink has been opened. By scanning the bar-code and the top of the can of soft drink, the product is identified and it is determined whether the can of soft drink is opened or closed, i.e. not used, at the time of scanning. This will give logical information about the consumer, the phase of the life cycle of the can, market related information etc.

The invention also encompasses use of electronic tags instead of optically encoded information in an image. By using a particular visual symbol 7 or image (e.g. the symbol 2, 7 shown in Fig. 1 or the one 74 shown in Fig. 8), the user will understand that he or she can scan information by his/her radio receiver/RFID reader (that may be integral with the cellular phone). Such information can be encoded by various types of RFID techniques or Bluetooth.

The designing of the visual symbol 2, 7 is based on there being different part areas/data elements within the well defined image/symbol. These different part areas/data elements that can be based on bar-codes and/or matrix codes or other easily identifiable shapes will together form the data set. Hence, the various part areas of the symbol 7 will form a defined data structure.

The image analysis of the visual symbol 7 takes place in a predefined structured manner, i.e. according to a protocol, preferably sequentially whereby each part area is decoded separately. The different part areas contain e.g. the following (see Fig. 7). A. GUID (Global Unique Identifier) or optionally a reference number such as a bar-code for a product.

B. A code for an image analysis algorithm, i.e. a code to be used to analyse the scanned image and/or to specify any points of identification in the image.

C. A code for the data content, i.e. in which format the data exists.

D. Data content.

E. Specifying of supplementary logical connections, i.e. what else should be scanned to give logical values and deliver a total solution.

The object of the protocol is also to be able to structure a content that is spread over a plurality of symbols, such as based on the Briscan symbols. Furthermore, the protocol enables systematic structuring of information, consisting of supplementary bar-codes, logotype brands, logotype brands together with an identifiable symbol such as the Briscan symbol or other symbols, such as a star etc. It is also possible to include features of objects, such as a profile, e.g. the profile of a can of soft drink, an opened can of soft drink, i.e. where the opening represents a black hole in relation to surrounding top of the can.

Fig. 8 shows the principal structure of a symbol 7 in which A, i.e. GUID, is a unique identifier 74 that unambiguously identifies the symbol 7 and possibly also the product/object 1, and specifies an optional range of serial numbers for supplementary symbols, e.g. a logo 10. B specifies, as a matter of security by means of a matrix code 31, which image analysis algorithm to be used, if this has not been determined in the superior analysis. B can also concretely specify any points of identification, e.g. the tower 73, inside the symbol 7 or outside it, which can aid in simplification of the image analysis and the further communication between the terminal 4 and the end user 8. C specifies by means of a further matrix code 3 IB the type of data to be expected in the symbol, such as a link to a website, text, image, MP3 etc. D consists of concrete data, in the form of procedure call, link to website, programme sequence etc. E specifies the instructions to be undertaken, such as transmission of a packed signal to a given server, for each scanning, establishing of a structure, in which the user of the terminal is instructed to scan other contexts of the concrete object or associated contexts, or to collect various symbols over time. Also any other symbol 7 with data 3 may be segmented according to the above, e.g. the one shown in Fig. 3, wherein e.g. the M- frame may form the GUID, i.e. step A and different parts of the "legs" in the M form B- D. The image analysis system installed on the terminal 4 is designed such that it can interpret the optically readable values and convert these into data and information that is executed in the various areas of the protocol. Fig. 8 illustrates an example of a preferred symbol of the invention, namely a visual and recognisable expression, e.g. a typical profile (skyline) of a city, consisting of elements of bar-codes 30 and matrix codes 31.

The invention consists of stepwise identification and analysis that is enabled by aid of the above described symbols structure. The symbols are designed in the invention such that it is easy to identify the used symbol. Thereby it is given how to conduct further analysis. Fig. 8 shows that a first analysis searches for an easily recognisable symbol 74 from which information is received if there are additional data elements/codes in the image 7. Given the information from the first symbol analysis, a matrix code 31 can be analysed. Additional codes 3 IB, 30 can then be found by aid of previously decoded information.

The invention consists of the use of active interaction with a user 8, in which on basis of a data stacking sequence in a structure one may ask the user of the terminal 4 for supplementary actions in which the status of an object can be determined, such as contours, liquid level, whether a can is opened or still closed etc. Logical information can be retrieved from image analysis or e.g. RFDD reading combined with the point of time of scanning, such as to determine if the user is outdoors or indoors etc.

The invention encompasses use of a system that can be installed on a terminal 4 such as a cellular phone, having the ability to recognise given profiles, symbols, logotypes and/or electronic tags. This system will be able to administer a structure called "stacking", i.e. the storing of information retrieved from one or more Briscan symbols 7, one or more logotypes 10, one or more codes 30, 31, one or more electronic tags, one or more logical contexts and different combinations, in this way to accumulate logical contexts, to accumulate data that can be put together by the system to form a complete programme, solution or other, such as a game, a lottery, a bonus in the form of a reward, telephoning time allotted to the subscription of the telephone etc. A data element in the symbol or the electronic tag (e.g. the data element E from the Briscan protocol above) will secure an accurate positioning in the stacking in the cellular phone. The stacking can either be local on the terminal 4, or central on a server 5. The Briscan symbol enables loyalty programmes for which you have to read symbols etc. from corresponding products from the same supplier, i.e. the same brand 10, such as other Cola bottles or complementary products such as Fanta, or from other complementary products such as milk and diapers. The Briscan system also enables implementation of a bonus coupon system, in which a bonus coupon is read on a tangible product, with or without a bar-code from the receipt after purchasing, resulting in an added value for the user.

The invention also includes how to use other image analysis systems on the same optically read image, and thereby to realise other values or data. In other words, Briscan has two means of creating a link between objects and a hand-hold terminal: 1. data that is dedicated to existing symbols by aid of the Briscan method and/or

2. dedicated to one or more Briscan symbols that are unique, and combining this with reading systems in which qualifications of the earlier generated symbols are changed, in order thereby to create optional new time accurate results.

This results in a high degree of flexibility, such as in connection with market communication, technical status etc.

As is clear from Figs. 9 and 10, the invention also encompasses how to, by vector based object encoding, provide an existing symbol 7 (such as a logotype, a visual symbol, an optically readable symbol, a bar-code etc.) with an additional value, by placing one or more recognisable symbols 7', 7", 7'" in different relative positions in relation to each other. Different values/data can be encoded in dependence of the different relative conditions. The positions of the different symbols in relation to a point of reference (maybe any symbol), i.e. [R_n5O_n] defines the amount of data. Either, a single symbol is used in relation to another one, or any number [n] of symbols are used, whereby all relative conditions define the amount of data. See Figs. 9 and 2, that show recognisable symbols placed in relation to other recognisable symbols or codes.

Fig. 10 shows that an invisible "frame" 71, that borders a logo 10, defines the positioning of the identifiable symbol 7. It has a given origin from which distance and angle to another identifiable symbol can be measured. The angle and radius defines the accessible amount of data. The "Audi" symbol may just as well be an existing standard code such as EAN, UPC or some other matrix code.

The concept is developed for arranging large amounts of real data to be transferred from an object to a terminal, such as part functions for a computer game, or smaller amounts of data such as a certificate, a key for a programme, a bonus coupon, procedure calls, links to one or more different websites, part of an executable code etc. There is no restriction to the amount of data that can be given to a tangible object. Practical and user associated conditions will decide.

A common standard for image recognition ought to be established for the implementation of the various fields of use described herein. For this reason, the Briscan symbol has been developed (according to the above), which is characterised by the use of clear physical frames and use of elements such as a city profile (skyline) against a horizon, which is easy to identify, and use of optional support lines or dots.

The algorithm will also be able to use image recognition for a simple graphical data element such as a logotype, a given type of letter etc. Here, rules are used that give likely connections between positioning in relation to other graphical objects etc.

The graphical Briscan symbol can also be combined with an electronic tag of the type RFID tag or Bluetooth chip, hi that case, the data that was encoded in the Briscan logotype can instead be encoded in the electronic tag. The Briscan symbol is e.g. used to inform the user that he or she should scan information. For the rest, the different applications are similar when using optically encoded symbols as when using electronic tags.

It is evident that a broad interpretation of many of the definitions are intended in the widest sense of the invention, e.g. the term "tangible object" may in its widest sense also include e.g. a computer or TV screen as the tangible object. Moreover, it is evident that contrary to the first embodiment described in relation to Fig. 1 the mobile terminal 4 may be prepared to execute all desired actions on the terminal 4, without any communication with server 5.

Claims

1. A communication and data processing system, for transmittal and use of digital information arranged in connection with a tangible object (1), comprising an information carrier (2) with digital information (3) arranged in connection with said object (1), a mobile terminal (4), a subsystem (5) for data processing, and a communication system (6) for transmittal of information between said terminal (4) and said subsystem (5), ch ar ac t eri s ed i n that said object (1) also exhibits visual information in the form of a symbol (7) arranged to indicate the possibility of interaction between said terminal (4) and said object (1), to achieve transmittal of said digital information (3) to said terminal (4) to initiate some kind of activity by means of said terminal (4).

2. A system according to claim 1, ch aract eri s e d in that said subsystem (5) is prepared to retransmit an information package (11) to said terminal (4) as a result of decoding of said digital information (3) upon receipt thereof from said terminal (4).

3. A system according to claim I or 2, ch arac t eri s e d in that a software application is provided for installation on said terminal (4) to enable local data processing of said digital information (3).

4. A system according to any above claim, characteri s ed i n that said terminal (4) is equipped with a digital camera.

5. A system according to any of the above claims, c h ar ac t eri s e d in that said subsystem (5) and/or a local application on said terminal (4) is arranged with digital image processing capability.

6. A system according to claim 5, char ac t eris e d in that the symbol (7) and/or information carrier (2) include recognisable features (71, 73, 74) that simplifies the process of image analysis.

7. A method for communication and data processing, for transmittal and use of digital information arranged in connection with a tangible object, comprising the steps of: providing an information carrier (2) with digital information in connection with said object (1), providing a subsystem (5) for data processing, using a mobile terminal (4) and a communication system (6) for transmittal of information between said terminal (4) and said subsystem (5), characteri s ed in that said obj ect ( 1 ) also is provided with visual information in the form of a symbol (7) arranged to indicate the possibility of interaction between said terminal (4) and said object (1), to achieve transmittal of said digital information (3) to said terminal (4) to initiate some kind of activity by means of said terminal (4).

8. A method according to claim 7, charact eri s e d in that said activity resides in transmitting said digital information to said subsystem (5) by means of said communication system (6).

9. A method according to claim 7, characteri s ed in that said activity resides in the start of a process locally on said terminal (4).

10. A method according to any of claims 7-9, characteri s ed in that said activity leads to the establishment of a direct communication link between a user (8) of the terminal (4) and the producer of said tangible object (1).

11. A tangible object with digital information, comprising an information carrier (2) with digital information (3) arranged in connection with said tangible object (1), characteri s ed in that said object (1) also exhibits a combined visual information in the form of a symbol (7) arranged to create an association by an observer (8).

12. A tangible obj ect according to claim 11, characteri s ed in that said symbol (7) is arranged to indicate a specific interaction to be performed by a user having a mobile terminal (4), having capability to communicate with said information carrier (2).

13. An object according to claim 11 or 12, characteris ed in that said information carrier (2) and said symbol (7) are linked to each other in a predefined manner.

14. An object according to claim 13, characterised in that said predefined manner is arranged to create a visual appearance that is associative to a human.

15. An object accordingto any of claims 11 - 14, characterised in thatsaid visual appearance creates association to a trade mark, preferably a well known trade mark.

16. An object according to any of claims 11 - 15, characterised in thatsaid information carrier (2) including digital information (3) is embedded into said symbol (7).

17. An object accordingto any of claims 11-16, characterised in thatsaid symbol (7) forms a part of or is integrated into a logotype (10) of a trademark.

18. An object accordingto any of claims 11-17, characterised inthatthe information carrier (2) and/or the symbol (7) includes recognisable elements (71, 72, 73, 76) which assist in defining a position of the symbol (7) and/or information carrier (2).

19. An object accordingto any of claims 11-18, characterised in thatthe object (1) also carries an identifier (74) including digital information arranged to assist in analysing further digital information (3).