US7956276B2 - Method of distributing mashup data, mashup method, server apparatus for mashup data, and mashup apparatus - Google Patents

Method of distributing mashup data, mashup method, server apparatus for mashup data, and mashup apparatus Download PDF

Info

Publication number
US7956276B2
US7956276B2 US11/978,866 US97886607A US7956276B2 US 7956276 B2 US7956276 B2 US 7956276B2 US 97886607 A US97886607 A US 97886607A US 7956276 B2 US7956276 B2 US 7956276B2
Authority
US
United States
Prior art keywords
music
mashup
music content
data
recipe
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Expired - Fee Related
Application number
US11/978,866
Other versions
US20080127812A1 (en
Inventor
Yoichiro Sako
Yasushi Miyajima
Mitsuru Takehara
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Sony Corp
Original Assignee
Sony Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Sony Corp filed Critical Sony Corp
Publication of US20080127812A1 publication Critical patent/US20080127812A1/en
Assigned to SONY CORPORATION reassignment SONY CORPORATION ASSIGNMENT OF ASSIGNORS INTEREST (SEE DOCUMENT FOR DETAILS). Assignors: MIYAJIMA, YASUSHI, TAKEHARA, MITSURU, SAKO, YOICHIRO
Application granted granted Critical
Publication of US7956276B2 publication Critical patent/US7956276B2/en
Expired - Fee Related legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • GPHYSICS
    • G11INFORMATION STORAGE
    • G11BINFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER
    • G11B27/00Editing; Indexing; Addressing; Timing or synchronising; Monitoring; Measuring tape travel
    • G11B27/02Editing, e.g. varying the order of information signals recorded on, or reproduced from, record carriers
    • G11B27/031Electronic editing of digitised analogue information signals, e.g. audio or video signals
    • G11B27/034Electronic editing of digitised analogue information signals, e.g. audio or video signals on discs
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F15/00Digital computers in general; Data processing equipment in general
    • G06F15/16Combinations of two or more digital computers each having at least an arithmetic unit, a program unit and a register, e.g. for a simultaneous processing of several programs
    • GPHYSICS
    • G11INFORMATION STORAGE
    • G11BINFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER
    • G11B27/00Editing; Indexing; Addressing; Timing or synchronising; Monitoring; Measuring tape travel
    • G11B27/02Editing, e.g. varying the order of information signals recorded on, or reproduced from, record carriers
    • G11B27/031Electronic editing of digitised analogue information signals, e.g. audio or video signals
    • G11B27/036Insert-editing
    • GPHYSICS
    • G11INFORMATION STORAGE
    • G11BINFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER
    • G11B27/00Editing; Indexing; Addressing; Timing or synchronising; Monitoring; Measuring tape travel
    • G11B27/10Indexing; Addressing; Timing or synchronising; Measuring tape travel
    • G11B27/34Indicating arrangements 
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/45Management operations performed by the client for facilitating the reception of or the interaction with the content or administrating data related to the end-user or to the client device itself, e.g. learning user preferences for recommending movies, resolving scheduling conflicts
    • H04N21/458Scheduling content for creating a personalised stream, e.g. by combining a locally stored advertisement with an incoming stream; Updating operations, e.g. for OS modules ; time-related management operations
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/60Network structure or processes for video distribution between server and client or between remote clients; Control signalling between clients, server and network components; Transmission of management data between server and client, e.g. sending from server to client commands for recording incoming content stream; Communication details between server and client 
    • H04N21/65Transmission of management data between client and server
    • H04N21/654Transmission by server directed to the client
    • H04N21/6547Transmission by server directed to the client comprising parameters, e.g. for client setup
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/80Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
    • H04N21/81Monomedia components thereof
    • H04N21/8106Monomedia components thereof involving special audio data, e.g. different tracks for different languages
    • H04N21/8113Monomedia components thereof involving special audio data, e.g. different tracks for different languages comprising music, e.g. song in MP3 format

Definitions

  • This invention relates to a method of distributing mashup data, a mashup method, a server apparatus for mashup data, and a mashup apparatus.
  • a remix Processing which puts a part of or all of plural pieces of music together is called a remix.
  • a remix there is a “mashup”, which performs more advanced processing.
  • a piece of music A and a piece of music B are remixed, a new piece of music is created by matching the tempo (performance speed of music) of both music, the number of beats (for example, the number of quarter notes), a key (a pitch of a fundamental note, such as C major, D minor, etc.), a chord progression (changing state of a chord), etc., and cutting and pasting only a seemly suitable section.
  • the mashup has been widely recognized, and pieces of music created by mashups are also used actively for broadcasting, etc.
  • the present invention addresses the above-identified and other problems.
  • a method of distributing mashup data for mashing up at least a first content and a second content including the step of distributing to a user, through a network, a data file having first data for dividing the first content and the second content into a plurality of blocks in accordance with individual contents, respectively, and second data indicating a disposition sequence for disposing the plurality of blocks in a predetermined sequence to create a new content.
  • the original music (the music to be used for a mashup) is provided by the user who are going to listen to the mashup-result music. Also, the original music is only played back in accordance with the data for a mashup, and thus there is little possibility that the copyright is infringed. It would rather contribute to the sales of the original music.
  • FIG. 1 is a form of a display screen according to an embodiment of the present invention.
  • FIG. 2 is a form of a display screen according to an embodiment of the present invention.
  • FIG. 3 is a form of a display screen according to an embodiment of the present invention.
  • FIG. 4 is an enlarged diagram illustrating an example of a display content
  • FIG. 5 is a diagram illustrating an example of a concept of data
  • FIG. 6 is a diagram illustrating an example of a data table and a content thereof
  • FIG. 7 is a diagram illustrating an example to which this invention is applied.
  • FIG. 8 is a flowchart illustrating an example of a data distribution method
  • FIG. 9 is a diagram illustrating another example to which this invention is applied.
  • FIG. 10 is a flowchart illustrating another example of a data distribution method
  • FIG. 11 is a diagram illustrating an example of a personal computer that can be used for this invention.
  • FIG. 12 is a diagram illustrating an example of data provided in a storage
  • FIG. 13 is a schematic diagram illustrating an example of a pre-processing method.
  • FIG. 14 is a waveform chart illustrating an example of a pre-processing method.
  • FIGS. 1 to 3 shows a display example of display screens in the case of performing a mashup.
  • a new piece of music is mashed up from a plurality of pieces of music, for example two pieces of music A and B using a personal computer.
  • a piece of music (to be a material) to be used for a mashup is called an “original music”, and the result music made by the mashup is called a “mashup music”.
  • a section which can be separated from the music such as an intro of the music, an A-melody, a B-melody, a chorus, an interlude, and an outro, etc., is called a “block”.
  • reference numeral 10 denotes a display screen at the time of a mashup.
  • FIG. 1 is a screen at the start time of the mashup
  • FIG. 2 is a screen in the process of the mashup
  • FIG. 3 is a screen at the end time of the mashup.
  • the display screen 10 is divided into two parts, an upper edit area 11 and a lower material area 12 .
  • an upper edit area 11 information on a piece of mashup music (a piece of the mashup-result music) is displayed.
  • the lower material area 12 information on original pieces of music (pieces of music to be used for a mashup) A and B are displayed.
  • the edit area 11 is provided with a belt-shaped area 11 A to which the original music A is copied and a belt-shaped area 11 B to which the original music B is copied.
  • These areas 11 A and 11 B are provided in the area 11 so as to be parallel with each other and to have their horizontal directions equal to a time axial direction.
  • the areas 11 A and 11 B are called tracks 11 A and 11 B, respectively by being likened to a magnetic tape.
  • a performance-time scale 11 S is displayed under the track 11 B, and a pointer 11 p indicating a time position at performance time is displayed at the start point of the performance-time scale 11 S.
  • FIG. 1 is an initial screen
  • FIG. 1 shows a state in which the tracks 12 A and 12 B are provided with the information on the original pieces of music A and B, respectively (when the information is not provided, they are empty in the same manner as the tracks 11 A and 11 B).
  • the track 12 A is divided into two tracks, namely an upper track 12 AM called a “melody track” and a lower track 12 AC called a “code track”.
  • the melody track 12 AM is separated into blocks, namely, an intro of the original music, an A-melody, a B-melody, a chorus, an interlude, and an outro, etc., and each block is provided with the corresponding melody data.
  • the code track 12 AC is separated into blocks in accordance with the code progression of the original music, and each block is provided with the corresponding code data.
  • the track 12 B has the same structure as that of the track 12 A.
  • the melody track 12 BM is separated into the blocks of the original music, and is provided with the corresponding melody data.
  • the code track 12 BC is separated into the blocks of the original codes, and is provided with the corresponding code data.
  • the artist names, the music names, the tempos, and the numbers of bars on the original pieces of music A and B are displayed at the upper part of the tracks 12 A and 12 B, respectively. Furthermore, in the case where there are three original pieces of music or more, the material area 12 is scrolled in the vertical direction by operating a scroll button 14 S or a scroll bar 14 V, displayed on the right side of the material area 12 , and thus all the original music tracks 12 A, 12 B, can be used.
  • the tracks 12 AM and 12 AC and the tracks 12 BM and 12 BC have different lengths in time, they are displayed to have the same length by being standardized, and each block is displayed by being separated by color depending on the contents.
  • the digital audio data of the original pieces of music A and B, and information displayed in the tracks 12 A and 12 B are provided in the personal computer in advance by obtaining, for example through a download site, the Internet, or the like.
  • a playback button 15 P for test listening music during a mashup and the mashup result a stop button 15 S for stopping the playback, an input field for specifying a playback tempo, and a save button 17 for saving the information of the mashup result.
  • FIG. 1 shows a display state as shown in FIG. 1 , for example when as shown by an arrow A 1 in FIG. 2 , “A-melody”, of the melody track 12 AM of the original music A is dragged and dropped, or copied and pasted to the beginning of the track 11 A, the “A-melody” of the original music A is copied to the beginning of the track 11 A.
  • FIG. 2 shows the case where the same “A-melody” is repeatedly copied to the track 11 A as shown by an arrow A 2 .
  • any block of the tracks 12 AM to 12 BC is copied to the track 11 A or 11 B.
  • the tracks 11 A and 11 B can have the contents as shown in FIG. 3 , for example.
  • the playback button 15 P when the user clicks the playback button 15 P, the music of the content created on the track 11 A and the music of the content created on the track 11 B are played back in a mixed state. Accordingly, the user can test listen to the mashup music.
  • this mashup-result music is not produced by playing back the digital audio data of the mashup music itself.
  • the music is reproduced by the blocks of the original music A and B being selectively taken out or processed in accordance with the data displayed on the tracks 11 A and 11 B.
  • the user should delete, copy, or move the unfavorite block of the tracks 11 A and 11 B using a mouse.
  • the user can copy a new block from the tracks 12 AM to 12 BC. That is to say, the user can edit all the blocks of the tracks 11 A and 11 B.
  • the user copies blocks from the tracks 12 AM to 12 BC, edits the tracks 11 A and 11 B, and test listens to the result.
  • the user it is possible for the user to obtain the desired mashup music.
  • the information (the data displayed on the tracks 11 A and 11 B) necessary for playing back the mashup music is stored, for example in a hard disk device as one file. That is to say, the information indicating the original pieces of music A and B, the blocks to be used out of the music A and B, the position in time and the sequence when the blocks are used, and the information on tempo, etc., are stored in the hard disk device as a file.
  • the mata data includes various data for creating a recipe, for example a temperature, a key, a beat, a chord, etc., in addition to general data (the data for identifying a piece of music, a music name, the name of an artist, etc.) of the corresponding music.
  • the data for identifying a piece of music in the case where the user has obtained the music from a CD, such data as the CD number of that CD, a label company (seller), an album name, the music name of the corresponding track, an ISRC, etc., can be used.
  • the user prepares the digital audio data of the original pieces of music A and B, which are targeted, and the recipe thereof in a personal computer. Then, when the user executes the recipe program, the original pieces of music A and B are automatically processed in real time in accordance with the recipe, that is to say, for example in accordance with the tracks 11 A and 11 B as shown in FIG. 1 , and the mashup music is output as sound.
  • FIG. 5 is a diagram illustrating the concept of the tracks 11 A and 11 B.
  • the track 11 A includes a plurality of blocks BLK_A 1 , BLK_A 2 , BLK_A 3 , . . .
  • the track 11 B includes a plurality of blocks BLK_B 1 , BLK_B 2 , BLK_B 3 , . . . .
  • the length (the length in time) of each block varies corresponding to the mashup.
  • the reference numerals of the blocks are sequential, but this does not necessarily mean that the blocks are sequential in the original music.
  • each block in the tracks 11 A and 11 B is defined, for example by the recipe shown in FIG. 6 . That is to say, as shown in FIG. 6A , a track table TRKTBL is provided, and the table TRKTBL has a data area #NUM indicating the number of tracks 11 A, 11 B, . . . , in the edit area 11 of the display screen 10 , and data areas #A, #B, . . . , indicating information on the blocks in the tracks 11 A, 11 B, . . . .
  • the track table TRKTBL has the data area #A of the first track 11 A and the data area #B of the second track 11 B.
  • the tracks are provided with the similar data area for individual tracks, and the data fields individually store relevant data.
  • the data fields #Ai and #Bj of the data areas #A and #B store the data shown in FIG. 6B , for example. That is to say, in the data shown in FIG. 6B , the data of the first row to the ninth row is the information for the original music to be used for the mashup, and the data of the tenth row and after is the information on the music of the mashup result.
  • the “music ID” of the first row is an identification code for identifying an original piece of music (in this case, the original pieces of music A and B). Also, in general, the tempo of music is sometimes different for each block, and thus the “block original tempo” indicates the tempo in the block of the original music.
  • the “block beat” indicates the beat of the block, such as one-two time, three-four time, etc.
  • block key and scale of the fourth row is the information for modulation. It sometimes happens that original music is used for a mashup from the middle of a bar, or used until the middle of a bar, and thus “sample start point/end point in block original music” of the fifth row indicates the position of the start point or the end point, which is counted by sample unit in the original music. Also, “start-point beat count” of the fifth row and “end-point beat count” of the seventh row indicate the start and end of a bar and beat (for example, the third beat of the tenth bar) of the block, respectively, in the original music.
  • sample position indicating the beginning of bar immediate before start point indicates the position of the beginning of the bar immediate before the start point to be used for a mashup, which is counted by sample unit in the original music.
  • sample position indicating the beginning of bar immediate before end point indicates the position of the beginning of the bar immediate before the end point to be used for a mashup, which is counted by sample unit in the original music.
  • start sample position on mashup” of the tenth row and “end sample position on mashup” of the eleventh row indicate a boundary point between a certain block and the next block in a mashup music (for example, FIG. 5 ), that is to say, the start point and the end point of a certain block, which is counted by sample unit, respectively.
  • start bar number on mashup” of the twelfth row and “end bar number on mashup” of the thirteenth row indicate the start and the end bar numbers of the mashup-result music, respectively.
  • the track table TRKTBL shown in FIG. 6 it is possible to take out necessary blocks of the original music for a mashup for each sample unit, and to produce a new mashup music by assembling the blocks. That is to say, the track table TRKTBL becomes a recipe at the time of a mashup.
  • FIG. 7 illustrates an example of the recipe distribution method.
  • Mashup players 1 to n are connected to a server 130 through a network 120 .
  • each of the players 1 to n can be constituted by a personal computer.
  • the network 120 may be a dedicated line directly connected to the server 130 , or the Internet may be interposed between the players and the server.
  • the server 130 stores identification data for identifying the music to be used for the original music, the meta data for using the music as the original music, and the recipes.
  • routine 200 When the routine 200 is executed in the player i, the routine 200 is started from step 201 , and then in step 202 , the original music to be used for a mashup is transmitted to the server 130 to be presented.
  • the above-described identification data can be used for this presentation.
  • step 212 if inputted that another recipe is unnecessary, the processing proceeds from step 213 to step 214 , and the routine 200 terminates.
  • routines 200 and 300 it is possible for the server 130 to distribute the recipe requested by the user (player i) to that user.
  • FIG. 10 illustrates still another example of the recipe distribution method.
  • the server 130 distributes a recipe with a charge.
  • routine 400 When the routine 400 is executed in the player i, the routine 400 is started from step 401 , and then in step 402 , the transmission of a list of mashups is requested to the server 130 .
  • step 502 When the list is requested by step 402 , this is received by step 502 .
  • the processing of the server 130 proceeds to step 503 , and a list of the mashup music is transmitted to the player i.
  • step 404 a desired mashup music can be selected from the received list.
  • the specification is transmitted in step 405 , and is received in step 505 .
  • step 511 for example the beginning 30-second part of the mashup music specified by steps 404 and 405 is transmitted to the player i in a stream format, and this is received by step 411 .
  • the player i plays back, in the streaming format, the beginning 30-second part of the mashup music specified by steps 404 and 405 , that is to say, it becomes possible to test listen to the mashup music.
  • step 412 the player i goes into an input state of whether the mashup music is purchased, and if purchased, whether the original music of the mashup music is also purchased. If this is input, in step 413 , the input result of step 412 is transmitted to the server 130 .
  • step 414 executes step 414 subsequently to step 413 , and a determination is made on whether the input result of step 412 is a purchase of the mashup music. If it is a purchase, the processing proceeds from step 414 to step 415 .
  • steps 515 and 415 the sales and the purchase processing of the mashup music selected in steps 404 and 405 is performed, that is to say, when the transmission and the reception of the recipe necessary for the mashup and the original music are sold and purchased, the digital-audio data file is transmitted and received, and the processing, such as the payment of the charge, etc., is performed.
  • routines 400 and 500 if the mashup music is purchased, that mashup music can be test listened. By referring to the test listening result, it is possible for the user to determine whether to purchase the mashup music.
  • FIG. 11 illustrates an example of the case where the above-described player i is constituted by a personal computer 100 to achieve a mashup. That is to say, the personal computer 100 is constituted in the same manner as a general personal computer, and has a CPU 101 , a ROM 102 , a nonvolatile memory 103 , and a RAM 104 .
  • the CPU 101 executes various programs, and a BIOS executed by the CPU 101 and basic data are written in the ROM 102 and the memory 103 .
  • the RAM 104 serves as a work area when the CPU 101 executes programs. These memories 102 to 104 are connected to the CPU 101 through a system bus 109 .
  • a hard disk 105 is connected to the system bus 109 as a large capacity storage.
  • the hard disk 105 stores an OS for functioning this personal computer 100 , a communication routine 200 or 400 for communicating with a server 130 in order to obtain necessary data for a mashup, a playback routine of mashup music, digital audio data of the original music to be mashed up, the meta data of the original music, and a recipe.
  • a keyboard 106 and a mouse 107 are connected to the system bus 109 as a user interface, particularly for a character-input device and a pointing device, respectively.
  • a CD drive unit 108 is connected to the system bus 109 as an external input means for the digital audio data.
  • a communication interface circuit 111 is connected to the system bus 109 , and the personal computer 100 is connected to an external network, for example the Internet 120 through the communication interface circuit 111 .
  • a server 130 is connected to the network 120 , and the server 130 stores the digital audio data of the original music described in FIG. 7 or FIG. 9 , the identification data thereof, the meta data, the recipe, etc.
  • the digital audio data of the original music, the meta data thereof, and the recipe, which are stored in the server 130 , are downloaded through the Internet 120 , and further through the communication interface circuit 111 , and then are stored in the hard disk 105 as shown in FIG. 12 , for example.
  • the personal computer 100 is provided with an audio playback circuit 112 and a display control circuit 114 , and these circuits are also connected to the system bus 109 .
  • the audio playback circuit 112 performs decode processing, such as MP3 as necessary when digital audio data is supplied thereto, performs D/A conversion on the digital audio data into an analog audio signal, and supplies the analog audio signal to a speaker 113 .
  • the display control circuit 114 has a video RAM, which is not shown in the figure. Display data is supplied to the video RAM, and at the same time, the video data is repeatedly read at a predetermined cycle to be converted into a video signal. The video signal is supplied to the display 115 , and images are displayed as shown in FIGS. 1 to 3 , etc.
  • the hardware of the server 130 may basically have the same configuration as that of the personal computer 100 .
  • the tempo and the key of the original music is changed, and this change can be executed by the player i.
  • the tempo should be adjusted such that the beat start position (that is to say, the start position of a bar) of one piece of the original music or a desired piece of mashup-result music and the beat start position of the other piece of the original music are performed with the same timing, and further key-matching (modulation) processing should be performed.
  • the beat start position that is to say, the start position of a bar
  • the read digital audio data DCHG comes to have a frequency two times the frequency of the original music. That is to say, the data becomes one octave higher.
  • the original pieces of music A and B are provided by the user who is going to listen to mashup music, and the original pieces of music A and B are only played back in accordance with a recipe.
  • the copy right is infringed.
  • the music of the past which is less contributing to sales at present, may attract attention again by this mashup system, and may contribute to sales.
  • this invention can be applied to the case where a plurality of contents are mashed up.
  • the invention can be applied to the case where a plurality of moving images are mashed up, the case where music, sound, sound effect, and the like are added to a moving image, and the case where a plurality of sentences are mashed up, etc.
  • processing such as reverberation, echo, and equalizer, etc.

Abstract

A method of distributing mashup data for mashing up at least a first content and a second content. The method includes the step of distributing to a user, through a network, a data file having first data for dividing the first content and the second content into a plurality of blocks in accordance with individual contents, respectively, and second data indicating a disposition sequence for disposing the plurality of blocks in a predetermined sequence to create a new content.

Description

CROSS-REFERENCE TO RELATED APPLICATIONS
The present application claims priority from Japanese Patent Application No. JP 2006-326437, filed in the Japanese Patent Office on Dec. 4, 2006, the entire content of which is incorporated herein by reference.
BACKGROUND OF THE INVENTION
1. Field of the Invention
This invention relates to a method of distributing mashup data, a mashup method, a server apparatus for mashup data, and a mashup apparatus.
2. Description of the Related Art
Processing which puts a part of or all of plural pieces of music together is called a remix. As one type of a remix, there is a “mashup”, which performs more advanced processing. In the mashup, when a piece of music A and a piece of music B are remixed, a new piece of music is created by matching the tempo (performance speed of music) of both music, the number of beats (for example, the number of quarter notes), a key (a pitch of a fundamental note, such as C major, D minor, etc.), a chord progression (changing state of a chord), etc., and cutting and pasting only a seemly suitable section.
The mashup has been widely recognized, and pieces of music created by mashups are also used actively for broadcasting, etc.
Related art documents include, for example Japanese Unexamined Patent Application Publication No. 2006-107693.
SUMMARY OF THE INVENTION
However, in order to carry out a mashup, it is necessary for the user to have rich knowledge of music. Thus, there are many listeners (users) who desire to get mashup-result music. Also, when a new piece of music is created by mashing up a piece of music, the copyright of the original music might be infringed.
The present invention addresses the above-identified and other problems.
According to an embodiment of the present invention, there is provided a method of distributing mashup data for mashing up at least a first content and a second content, the method including the step of distributing to a user, through a network, a data file having first data for dividing the first content and the second content into a plurality of blocks in accordance with individual contents, respectively, and second data indicating a disposition sequence for disposing the plurality of blocks in a predetermined sequence to create a new content.
By this invention, it is possible to carry out a mashup without having special knowledge for a mashup. Also, it is possible to distribute data for obtaining the mashup result through a network free of charge or with a charge. In that case, the original music (the music to be used for a mashup) is provided by the user who are going to listen to the mashup-result music. Also, the original music is only played back in accordance with the data for a mashup, and thus there is little possibility that the copyright is infringed. It would rather contribute to the sales of the original music.
BRIEF DESCRIPTION OF THE DRAWINGS
FIG. 1 is a form of a display screen according to an embodiment of the present invention;
FIG. 2 is a form of a display screen according to an embodiment of the present invention;
FIG. 3 is a form of a display screen according to an embodiment of the present invention;
FIG. 4 is an enlarged diagram illustrating an example of a display content;
FIG. 5 is a diagram illustrating an example of a concept of data;
FIG. 6 is a diagram illustrating an example of a data table and a content thereof;
FIG. 7 is a diagram illustrating an example to which this invention is applied;
FIG. 8 is a flowchart illustrating an example of a data distribution method;
FIG. 9 is a diagram illustrating another example to which this invention is applied;
FIG. 10 is a flowchart illustrating another example of a data distribution method;
FIG. 11 is a diagram illustrating an example of a personal computer that can be used for this invention;
FIG. 12 is a diagram illustrating an example of data provided in a storage;
FIG. 13 is a schematic diagram illustrating an example of a pre-processing method; and
FIG. 14 is a waveform chart illustrating an example of a pre-processing method.
DESCRIPTION OF THE PREFERRED EMBODIMENTS 1. Display Example at Mash-Up Time
FIGS. 1 to 3 shows a display example of display screens in the case of performing a mashup. In this example, a new piece of music is mashed up from a plurality of pieces of music, for example two pieces of music A and B using a personal computer. In this regard, in the following, a piece of music (to be a material) to be used for a mashup is called an “original music”, and the result music made by the mashup is called a “mashup music”. Also, a section which can be separated from the music, such as an intro of the music, an A-melody, a B-melody, a chorus, an interlude, and an outro, etc., is called a “block”.
In FIGS. 1 to 3, reference numeral 10 denotes a display screen at the time of a mashup. FIG. 1 is a screen at the start time of the mashup, FIG. 2 is a screen in the process of the mashup, and FIG. 3 is a screen at the end time of the mashup.
The display screen 10 is divided into two parts, an upper edit area 11 and a lower material area 12. In the upper edit area 11, information on a piece of mashup music (a piece of the mashup-result music) is displayed. In the lower material area 12, information on original pieces of music (pieces of music to be used for a mashup) A and B are displayed.
Thus, the edit area 11 is provided with a belt-shaped area 11A to which the original music A is copied and a belt-shaped area 11B to which the original music B is copied. These areas 11A and 11B are provided in the area 11 so as to be parallel with each other and to have their horizontal directions equal to a time axial direction. In this regard, in the following, the areas 11A and 11B are called tracks 11A and 11B, respectively by being likened to a magnetic tape.
Also, a performance-time scale 11S is displayed under the track 11B, and a pointer 11 p indicating a time position at performance time is displayed at the start point of the performance-time scale 11S.
Further, a belt-shaped track 12A indicating the information on the original music A and a belt-shaped track 12B indicating the information on the original music B are formed in the material area 12 so as to be parallel with each other and to have their horizontal directions equal to a time axial direction. Although FIG. 1 is an initial screen, FIG. 1 shows a state in which the tracks 12A and 12B are provided with the information on the original pieces of music A and B, respectively (when the information is not provided, they are empty in the same manner as the tracks 11A and 11B).
In this case, the track 12A is divided into two tracks, namely an upper track 12AM called a “melody track” and a lower track 12AC called a “code track”. The melody track 12AM is separated into blocks, namely, an intro of the original music, an A-melody, a B-melody, a chorus, an interlude, and an outro, etc., and each block is provided with the corresponding melody data. Also, as shown in FIG. 4 by the time axis (in horizontal direction) being enlarged, the code track 12AC is separated into blocks in accordance with the code progression of the original music, and each block is provided with the corresponding code data.
Furthermore, the track 12B has the same structure as that of the track 12A. The melody track 12BM is separated into the blocks of the original music, and is provided with the corresponding melody data. The code track 12BC is separated into the blocks of the original codes, and is provided with the corresponding code data.
Also, as shown by reference numerals 13A and 13B, the artist names, the music names, the tempos, and the numbers of bars on the original pieces of music A and B are displayed at the upper part of the tracks 12A and 12B, respectively. Furthermore, in the case where there are three original pieces of music or more, the material area 12 is scrolled in the vertical direction by operating a scroll button 14S or a scroll bar 14V, displayed on the right side of the material area 12, and thus all the original music tracks 12A, 12B, can be used.
In this regard, in reality, in the case where the tracks 12AM and 12AC and the tracks 12BM and 12BC have different lengths in time, they are displayed to have the same length by being standardized, and each block is displayed by being separated by color depending on the contents. Also, the digital audio data of the original pieces of music A and B, and information displayed in the tracks 12A and 12B are provided in the personal computer in advance by obtaining, for example through a download site, the Internet, or the like.
Also, in the upper part of the display screen 10, a playback button 15P for test listening music during a mashup and the mashup result, a stop button 15S for stopping the playback, an input field for specifying a playback tempo, and a save button 17 for saving the information of the mashup result.
2. Mashup Method
In a display state as shown in FIG. 1, for example when as shown by an arrow A1 in FIG. 2, “A-melody”, of the melody track 12AM of the original music A is dragged and dropped, or copied and pasted to the beginning of the track 11A, the “A-melody” of the original music A is copied to the beginning of the track 11A. FIG. 2 shows the case where the same “A-melody” is repeatedly copied to the track 11A as shown by an arrow A2.
Also, in FIG. 2, when as shown by an arrow B1, “A-melody” of the melody track 12BM of the original music B is dragged and dropped, or copied and pasted to the beginning of the track 11B, the “A-melody” of the original music B is copied to the beginning of the track 11B.
After this, by performing the similar operation, any block of the tracks 12AM to 12BC is copied to the track 11A or 11B. As a result, the tracks 11A and 11B can have the contents as shown in FIG. 3, for example.
Thus, when the user clicks the playback button 15P, the music of the content created on the track 11A and the music of the content created on the track 11B are played back in a mixed state. Accordingly, the user can test listen to the mashup music.
Note that the playback of this mashup-result music is not produced by playing back the digital audio data of the mashup music itself. The music is reproduced by the blocks of the original music A and B being selectively taken out or processed in accordance with the data displayed on the tracks 11A and 11B.
If the user is not satisfied with the mashup music, the user should delete, copy, or move the unfavorite block of the tracks 11A and 11B using a mouse. Alternatively, the user can copy a new block from the tracks 12AM to 12BC. That is to say, the user can edit all the blocks of the tracks 11A and 11B.
In this manner, the user copies blocks from the tracks 12AM to 12BC, edits the tracks 11A and 11B, and test listens to the result. Thus, it is possible for the user to obtain the desired mashup music.
When a new piece of music is completed by the mashup, the user clicks the save button 17. Then, not the digital audio data of the mashup music itself, but the information (the data displayed on the tracks 11A and 11B) necessary for playing back the mashup music is stored, for example in a hard disk device as one file. That is to say, the information indicating the original pieces of music A and B, the blocks to be used out of the music A and B, the position in time and the sequence when the blocks are used, and the information on tempo, etc., are stored in the hard disk device as a file.
In this regard, when someone cooks, he or she prepares food materials in accordance with a recipe, and cooks the food materials by the procedure and the method indicated by a recipe. The above-described method of mashing up is similar to cooking. Thus, in the following, the information (in the above-described case, the information stored in the hard disk device when the save button 17 is clicked) necessary for a mashup is called a “recipe”.
That is to say, if the digital audio data and the meta data of music is prepared in accordance with a recipe and the data is edited in accordance with the recipe, a piece of mashup music is created. In this regard, the mata data includes various data for creating a recipe, for example a temperature, a key, a beat, a chord, etc., in addition to general data (the data for identifying a piece of music, a music name, the name of an artist, etc.) of the corresponding music. Also, for the data for identifying a piece of music, in the case where the user has obtained the music from a CD, such data as the CD number of that CD, a label company (seller), an album name, the music name of the corresponding track, an ISRC, etc., can be used.
3. Playback of Mashup Music
In this case, the user prepares the digital audio data of the original pieces of music A and B, which are targeted, and the recipe thereof in a personal computer. Then, when the user executes the recipe program, the original pieces of music A and B are automatically processed in real time in accordance with the recipe, that is to say, for example in accordance with the tracks 11A and 11B as shown in FIG. 1, and the mashup music is output as sound.
4. Example of Data Structure in Recipe
FIG. 5 is a diagram illustrating the concept of the tracks 11A and 11B. As a result of the mashup, the track 11A includes a plurality of blocks BLK_A1, BLK_A2, BLK_A3, . . . , and the track 11B includes a plurality of blocks BLK_B1, BLK_B2, BLK_B3, . . . . As shown in FIG. 5, the length (the length in time) of each block varies corresponding to the mashup. Also, the reference numerals of the blocks are sequential, but this does not necessarily mean that the blocks are sequential in the original music.
At this time, each block in the tracks 11A and 11B is defined, for example by the recipe shown in FIG. 6. That is to say, as shown in FIG. 6A, a track table TRKTBL is provided, and the table TRKTBL has a data area #NUM indicating the number of tracks 11A, 11B, . . . , in the edit area 11 of the display screen 10, and data areas #A, #B, . . . , indicating information on the blocks in the tracks 11A, 11B, . . . .
In the case of FIGS. 1 to 5, the number of tracks indicated by the data area #NUM is 2. Thus, the track table TRKTBL has the data area #A of the first track 11A and the data area #B of the second track 11B.
The data area #A of the first track 11A has a data field #A0 indicating the number of blocks of the first track 11A, and a data field #Ai indicating the information on each block BLK_Ai (i=1, 2, . . . ). These data fields #A0 and #Ai individually store relevant data.
Also, in the same manner, the data area #B of the second track 11B has a data field #B0 indicating the number of blocks of the second track 11B, and a data field #Bj indicating the information on each block BLK_Bj (j=1, 2, . . . ). After this, if there are a third track and more, the tracks are provided with the similar data area for individual tracks, and the data fields individually store relevant data.
At this time, the data fields #Ai and #Bj of the data areas #A and #B store the data shown in FIG. 6B, for example. That is to say, in the data shown in FIG. 6B, the data of the first row to the ninth row is the information for the original music to be used for the mashup, and the data of the tenth row and after is the information on the music of the mashup result.
The “music ID” of the first row is an identification code for identifying an original piece of music (in this case, the original pieces of music A and B). Also, in general, the tempo of music is sometimes different for each block, and thus the “block original tempo” indicates the tempo in the block of the original music. The “block beat” indicates the beat of the block, such as one-two time, three-four time, etc.
Further, “block key and scale” of the fourth row is the information for modulation. It sometimes happens that original music is used for a mashup from the middle of a bar, or used until the middle of a bar, and thus “sample start point/end point in block original music” of the fifth row indicates the position of the start point or the end point, which is counted by sample unit in the original music. Also, “start-point beat count” of the fifth row and “end-point beat count” of the seventh row indicate the start and end of a bar and beat (for example, the third beat of the tenth bar) of the block, respectively, in the original music.
“Sample position indicating the beginning of bar immediate before start point” of the eighth row indicates the position of the beginning of the bar immediate before the start point to be used for a mashup, which is counted by sample unit in the original music. In the same manner, “sample position indicating the beginning of bar immediate before end point” of the ninth row indicates the position of the beginning of the bar immediate before the end point to be used for a mashup, which is counted by sample unit in the original music.
Accordingly, it is possible to know the parts (blocks) of the original music necessary for a mashup by the information of the first to the ninth rows.
Further, in FIG. 6B, “start sample position on mashup” of the tenth row and “end sample position on mashup” of the eleventh row indicate a boundary point between a certain block and the next block in a mashup music (for example, FIG. 5), that is to say, the start point and the end point of a certain block, which is counted by sample unit, respectively. Also, “start bar number on mashup” of the twelfth row and “end bar number on mashup” of the thirteenth row indicate the start and the end bar numbers of the mashup-result music, respectively.
Accordingly, it is possible to know the formation of a mashup by the blocks obtained from the original music by the information of the tenth to the thirteenth rows.
In this manner, by the track table TRKTBL shown in FIG. 6, it is possible to take out necessary blocks of the original music for a mashup for each sample unit, and to produce a new mashup music by assembling the blocks. That is to say, the track table TRKTBL becomes a recipe at the time of a mashup.
5. Recipe Distribution Method
5-1 Example of Recipe Distribution Method (No. 1)
FIG. 7 illustrates an example of the recipe distribution method. Mashup players 1 to n are connected to a server 130 through a network 120. In this case, as described below, each of the players 1 to n can be constituted by a personal computer.
Also, the network 120 may be a dedicated line directly connected to the server 130, or the Internet may be interposed between the players and the server. Further, in this example, the server 130 stores identification data for identifying the music to be used for the original music, the meta data for using the music as the original music, and the recipes.
When the player i (i=1 to n) receives the distribution of a recipe from the server 130, for example a routine 200 as shown in FIG. 8 is executed by the player i, and a routine 300 is executed by the server 130. That is to say, in the server 130, the routine 300 is started from step 301, and then the processing waits for receiving an access from the players 1 to n in step 302.
When the routine 200 is executed in the player i, the routine 200 is started from step 201, and then in step 202, the original music to be used for a mashup is transmitted to the server 130 to be presented. The above-described identification data can be used for this presentation.
When the original music is presented by step 202, this is received by step 302. The processing of the server 130 proceeds to step 303, and a list of the recipe corresponding to the presented original music is transmitted to the player i.
Then, the list of the recipe is received by the player i to be displayed in step 203. In step 204, a selection of a desired recipe from the received list of recipes is waited. When a desired recipe is selected, in step 205, the request for the selected recipe is transmitted. This request is received in step 304, and in step 305, the server 130 transmits the recipe requested by step 205.
In step 206, the transmitted recipe is received and stored by the player i. In step 211, a mashup is executed in accordance with the recipe received and stored by step 206, and the music of the mashup result is played back.
When the playback is completed, in step 212, input of whether another recipe is necessary is waited. When inputted, in step 213, the input result of step 212 is determined. If inputted that another recipe is necessary, the processing returns from step 213 to step 202, and the above-described processing is repeated after that. In this regard, in the routine 300, the processing returns to step 302 subsequently to step 305 to be in a state of responding to a request from a player (including players other than the player i).
Also, in step 212, if inputted that another recipe is unnecessary, the processing proceeds from step 213 to step 214, and the routine 200 terminates.
In this manner, by the routines 200 and 300, it is possible for the server 130 to distribute the recipe requested by the user (player i) to that user.
5-2 Example of Recipe Distribution Method (No. 2)
FIG. 9 illustrates another example of the recipe distribution method. In this example, a recipe can be received from the server 130, and at the same time, a recipe can be distributed among a plurality of players (users) 1 to n by P2P (Peer to Peer) communication.
5-3 Example of Recipe Distribution Method (No. 3)
FIG. 10 illustrates still another example of the recipe distribution method. In this example, the server 130 distributes a recipe with a charge.
However, in 5-1 and the system in FIG. 7, the server 130 stores identification data for identifying the music to be used for the original music, the meta data for using the music as the original music, and the recipes. In this example, the server 130 further stores the digital audio data of the original music.
When the player i receives the distribution of a piece of mashup music from the server 130, for example a routine 400 as shown in FIG. 10 is executed by the player i, and a routine 500 is executed by the server 130. That is to say, in the server 130, the routine 500 is started from step 501, and then the processing waits for receiving an access from the players 1 to n in step 502.
When the routine 400 is executed in the player i, the routine 400 is started from step 401, and then in step 402, the transmission of a list of mashups is requested to the server 130.
When the list is requested by step 402, this is received by step 502. The processing of the server 130 proceeds to step 503, and a list of the mashup music is transmitted to the player i.
Then, the list is received by the player i, and is displayed in step 403. In step 404, a desired mashup music can be selected from the received list. When a desired mashup music is specified, the specification is transmitted in step 405, and is received in step 505.
Next, in step 511, for example the beginning 30-second part of the mashup music specified by steps 404 and 405 is transmitted to the player i in a stream format, and this is received by step 411. As a result, the player i plays back, in the streaming format, the beginning 30-second part of the mashup music specified by steps 404 and 405, that is to say, it becomes possible to test listen to the mashup music.
When the playback is completed, in step 412, the player i goes into an input state of whether the mashup music is purchased, and if purchased, whether the original music of the mashup music is also purchased. If this is input, in step 413, the input result of step 412 is transmitted to the server 130.
Then, in step 513, the server 130 receives the transmission from step 413, and in step 514, a determination is made on whether the mashup music is purchased, and if purchased, whether the original music of the mashup music is also purchased. If the mashup music is purchased, the processing proceeds from step 514 to step 515.
Also, the player i executes step 414 subsequently to step 413, and a determination is made on whether the input result of step 412 is a purchase of the mashup music. If it is a purchase, the processing proceeds from step 414 to step 415.
When in steps 515 and 415, the sales and the purchase processing of the mashup music selected in steps 404 and 405 is performed, that is to say, when the transmission and the reception of the recipe necessary for the mashup and the original music are sold and purchased, the digital-audio data file is transmitted and received, and the processing, such as the payment of the charge, etc., is performed.
In the routine 500, the processing returns to step 502 after that, and the routine 400 terminates in step 416.
Also, if the input result of step 412 is not a purchase, the processing proceeds from step 414 to step 416, and the routine 400 terminates. Further, in the routine 500, in step 514, if a determination is made that the mashup music is not purchased, the processing returns to step 502 from step 514.
In this manner, by the routines 400 and 500, if the mashup music is purchased, that mashup music can be test listened. By referring to the test listening result, it is possible for the user to determine whether to purchase the mashup music.
6. Hardware Example
FIG. 11 illustrates an example of the case where the above-described player i is constituted by a personal computer 100 to achieve a mashup. That is to say, the personal computer 100 is constituted in the same manner as a general personal computer, and has a CPU 101, a ROM 102, a nonvolatile memory 103, and a RAM 104.
In this case, the CPU 101 executes various programs, and a BIOS executed by the CPU 101 and basic data are written in the ROM 102 and the memory 103. Also, the RAM 104 serves as a work area when the CPU 101 executes programs. These memories 102 to 104 are connected to the CPU 101 through a system bus 109.
Furthermore, a hard disk 105 is connected to the system bus 109 as a large capacity storage. In this case, for example as shown in FIG. 12, the hard disk 105 stores an OS for functioning this personal computer 100, a communication routine 200 or 400 for communicating with a server 130 in order to obtain necessary data for a mashup, a playback routine of mashup music, digital audio data of the original music to be mashed up, the meta data of the original music, and a recipe.
Also, a keyboard 106 and a mouse 107 are connected to the system bus 109 as a user interface, particularly for a character-input device and a pointing device, respectively. At the same time, a CD drive unit 108 is connected to the system bus 109 as an external input means for the digital audio data.
Furthermore, a communication interface circuit 111 is connected to the system bus 109, and the personal computer 100 is connected to an external network, for example the Internet 120 through the communication interface circuit 111. Moreover, a server 130 is connected to the network 120, and the server 130 stores the digital audio data of the original music described in FIG. 7 or FIG. 9, the identification data thereof, the meta data, the recipe, etc.
The digital audio data of the original music, the meta data thereof, and the recipe, which are stored in the server 130, are downloaded through the Internet 120, and further through the communication interface circuit 111, and then are stored in the hard disk 105 as shown in FIG. 12, for example.
Also, the personal computer 100 is provided with an audio playback circuit 112 and a display control circuit 114, and these circuits are also connected to the system bus 109. The audio playback circuit 112 performs decode processing, such as MP3 as necessary when digital audio data is supplied thereto, performs D/A conversion on the digital audio data into an analog audio signal, and supplies the analog audio signal to a speaker 113.
Furthermore, the display control circuit 114 has a video RAM, which is not shown in the figure. Display data is supplied to the video RAM, and at the same time, the video data is repeatedly read at a predetermined cycle to be converted into a video signal. The video signal is supplied to the display 115, and images are displayed as shown in FIGS. 1 to 3, etc.
Accordingly, if a distributed recipe is received by the method as described in 5, it is possible to playback the mashup music in accordance with the recipe as described in 3. Also, it is possible for the user to execute an additional mashup by himself/herself.
In this regard, the hardware of the server 130 may basically have the same configuration as that of the personal computer 100.
7. Pre-Processing
In order to achieve the above-described mashup, in general, it is necessary that original music A and original music B have the same tempo, key, and beat position. However, any of the original music A and original music B often do not have the same tempo, key, and beat position. Also, it is sometimes more effective to change the tempo and the key of the mashup-result music.
Accordingly, the tempo and the key of the original music is changed, and this change can be executed by the player i. For example, as disclosed in Japanese Patent Application No. 2004-269085, etc., it is possible to detect the tempo and the beat of the original music from the level and a peak of the sound volume of the original music. That is to say, it is possible to detect the tempo and the beat of the original music from the level and a peak of the sound volume of the original music. Then, the tempo should be adjusted such that the beat start position (that is to say, the start position of a bar) of one piece of the original music or a desired piece of mashup-result music and the beat start position of the other piece of the original music are performed with the same timing, and further key-matching (modulation) processing should be performed.
Also, for example as shown in FIG. 13 and FIG. 14A, if digital audio data DORG of the original music is written into the memory MM in sequence for each sample, and as shown in FIG. 14B, the written data DORG is thinned, for example by a ratio of one sample out of two samples, and the sample is repeatedly read twice for each predetermined period, the read digital audio data DCHG comes to have a frequency two times the frequency of the original music. That is to say, the data becomes one octave higher.
Accordingly, it is possible to change the tempo and the key to target values by setting the ratio of thinning when the digital audio data DCHG is read from the memory MM, or by setting the number of repetitions.
8. Summary
By the above-described system, it is possible to carry out a mashup without having special knowledge for a mashup. Alternatively, it is possible to further expand a mashup music by reprocessing the recipe and the mashup music. Also, it is possible to distribute the mashup music through a network free of charge or with a charge.
In that case, the original pieces of music A and B are provided by the user who is going to listen to mashup music, and the original pieces of music A and B are only played back in accordance with a recipe. Thus, there is little possibility that the copy right is infringed. It would be rather possible to contribute to the sales of the original music, because it is meaningless to obtain only a recipe. For example, it is possible to mash up music of the past with a recent hit music in order to enjoy a brand new piece of music. Thus, the music of the past, which is less contributing to sales at present, may attract attention again by this mashup system, and may contribute to sales.
9. Others
In the above description, when the music A is, for example a solo, if the music B is a combination scales performed by various instruments and chords, it is possible to add an accompaniment to the music A. Alternatively, one of the pieces of music A and B may be a various sound effect. Also, it is possible to assume that B=A where A and B are pieces of music, that is to say, it is possible to carry out a mashup using only the blocks of the music A.
Furthermore, in the above, descriptions has been given of the cases where a plurality of pieces of music A and B are mashed up. However, this invention can be applied to the case where a plurality of contents are mashed up. For example, the invention can be applied to the case where a plurality of moving images are mashed up, the case where music, sound, sound effect, and the like are added to a moving image, and the case where a plurality of sentences are mashed up, etc. Also, it is possible to simultaneously perform processing, such as reverberation, echo, and equalizer, etc.
It should be understood by those skilled in the art that various modifications, combinations, sub-combinations and alterations may occur depending on design requirements and other factors insofar as they are within the scope of the appended claims or the equivalents thereof.

Claims (2)

1. A method of distributing mashup data, the method comprising:
distributing to a user a part of mashup music to allow a trial playback thereof, in which the mashup music is formed by mashing up at least a first music content and a second music content;
determining whether the user purchased a recipe corresponding to the mashup music after the trial playback, in which the recipe does not include actual music of the first music content and the second music content; and
when the user purchases the recipe, enabling the user to purchase at least one of the first music content and the second music content,
in which a tempo of at least one of the first music content and the second music content is adjusted so that beat start positions of the first and second music contents are performed with the same timing, and
in which the recipe includes original music information to be used for mashup which is (i) indicative of original tempo, beat, and modulation of the first music content and the second music content in their original forms, (ii) indicative of a start point or end point of a respective bar or bars of a respective block or blocks of the first music content and the second music content in their original forms, and (iii) indicative of a position of a beginning of a bar immediate before the start point and a position of a beginning of a bar immediate before the end point of a respective block or blocks of the first music content and the second music content in their original forms, and in which the recipe further includes information on a mashup music result.
2. A system of distributing mashup data, the system comprising:
means for distributing to a user a part of mashup music to allow a trial playback thereof, in which the mashup music is formed by mashing up at least a first music content and a second music content;
means for determining whether the user purchased a recipe corresponding to the mashup music after the trial playback, in which the recipe does not include actual music of the first music content and the second music content; and
means, when the user purchases the recipe, for enabling the user to purchase at least one of the first music content and the second music content,
in which a tempo of at least one of the first music content and the second music content is adjusted so that beat start positions of the first and second music contents are performed with the same timing, and
in which the recipe includes original music information to be used for mashup which is (i) indicative of original tempo, beat, and modulation of the first music content and the second music content in their original forms, (ii) indicative of a start point or end point of a respective bar or bars of a respective block or blocks of the first music content and the second music content in their original forms, and (iii) indicative of a position of a beginning of a bar immediate before the start point and a position of a beginning of a bar immediate before the end point of a respective block or blocks of the first music content and the second music content in their original forms, and in which the recipe further includes information on a mashup music result.
US11/978,866 2006-12-04 2007-10-30 Method of distributing mashup data, mashup method, server apparatus for mashup data, and mashup apparatus Expired - Fee Related US7956276B2 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
JPP2006-326437 2006-12-04
JP2006326437 2006-12-04

Publications (2)

Publication Number Publication Date
US20080127812A1 US20080127812A1 (en) 2008-06-05
US7956276B2 true US7956276B2 (en) 2011-06-07

Family

ID=39208653

Family Applications (1)

Application Number Title Priority Date Filing Date
US11/978,866 Expired - Fee Related US7956276B2 (en) 2006-12-04 2007-10-30 Method of distributing mashup data, mashup method, server apparatus for mashup data, and mashup apparatus

Country Status (6)

Country Link
US (1) US7956276B2 (en)
EP (1) EP1930901A3 (en)
JP (1) JP5259083B2 (en)
KR (1) KR20080051054A (en)
CN (1) CN101197171B (en)
CA (1) CA2612934C (en)

Cited By (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20100186579A1 (en) * 2008-10-24 2010-07-29 Myles Schnitman Media system with playing component
US20140076124A1 (en) * 2012-09-19 2014-03-20 Ujam Inc. Song length adjustment
US20150120701A1 (en) * 2013-10-29 2015-04-30 Olaf Schmidt Providing cloud-based, generic odata mashup services using an on-demand service
US9111519B1 (en) * 2011-10-26 2015-08-18 Mixwolf LLC System and method for generating cuepoints for mixing song data
US20190236209A1 (en) * 2018-01-29 2019-08-01 Gary Bencar Artificial intelligence methodology to automatically generate interactive play along songs

Families Citing this family (17)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP5259075B2 (en) * 2006-11-28 2013-08-07 ソニー株式会社 Mashup device and content creation method
JP4933932B2 (en) 2007-03-23 2012-05-16 ソニー株式会社 Information processing system, information processing apparatus, information processing method, and program
JP4367662B2 (en) 2007-03-23 2009-11-18 ソニー株式会社 Information processing system, terminal device, information processing method, program
JP4404130B2 (en) 2007-10-22 2010-01-27 ソニー株式会社 Information processing terminal device, information processing device, information processing method, and program
US8173883B2 (en) * 2007-10-24 2012-05-08 Funk Machine Inc. Personalized music remixing
JP4424410B2 (en) 2007-11-07 2010-03-03 ソニー株式会社 Information processing system and information processing method
US9055103B2 (en) * 2008-01-30 2015-06-09 Samsung Electronics Co., Ltd. Method of creating mashup application
US20100107060A1 (en) * 2008-10-27 2010-04-29 Ricoh Company, Ltd. System, apparatus and method for generating schedule document
US9774948B2 (en) * 2010-02-18 2017-09-26 The Trustees Of Dartmouth College System and method for automatically remixing digital music
US8458221B2 (en) 2010-10-13 2013-06-04 Sony Corporation Method and system and file format of generating content by reference
US20140229393A1 (en) * 2013-02-11 2014-08-14 James E. Malackowski Ip content discovery platform
US10275476B2 (en) * 2014-12-22 2019-04-30 Verizon Patent And Licensing Inc. Machine to machine data aggregator
CN105005518B (en) * 2015-08-24 2018-12-04 上海天旦网络科技发展有限公司 The system and its processor and method of auto-polymerization redundant system transaction data
GB2557970B (en) * 2016-12-20 2020-12-09 Mashtraxx Ltd Content tracking system and method
US11024276B1 (en) * 2017-09-27 2021-06-01 Diana Dabby Method of creating musical compositions and other symbolic sequences by artificial intelligence
US11500923B2 (en) * 2019-07-29 2022-11-15 Meta Platforms, Inc. Systems and methods for generating interactive music charts
JP7333758B2 (en) 2020-01-23 2023-08-25 東京エレクトロン株式会社 Film forming method and film forming apparatus

Citations (30)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20010029832A1 (en) * 2000-02-15 2001-10-18 Takeshi Kanda Information processing device, information processing method, and recording medium
US20020010740A1 (en) * 2000-06-16 2002-01-24 Takeshi Kikuchi Content distribution system; Content distribution method; distribution server, client terminal, and portable terminal used in the system; and computer readable recording medium on which is recorded a program for operating a computer used in the system
US20020166440A1 (en) * 2001-03-16 2002-11-14 Magix Ag Method of remixing digital information
US20040007120A1 (en) * 1999-07-28 2004-01-15 Yamaha Corporation Portable telephony apparatus with music tone generator
US20040159221A1 (en) * 2003-02-19 2004-08-19 Noam Camiel System and method for structuring and mixing audio tracks
US20040254660A1 (en) * 2003-05-28 2004-12-16 Alan Seefeldt Method and device to process digital media streams
US6835884B2 (en) * 2000-09-20 2004-12-28 Yamaha Corporation System, method, and storage media storing a computer program for assisting in composing music with musical template data
EP1503381A2 (en) 2003-07-28 2005-02-02 Sony Corporation Editing system and control method thereof
EP1524667A1 (en) 2003-10-16 2005-04-20 Magix Ag System and method for improved video editing
JP2006107693A (en) 2004-09-10 2006-04-20 Sony Corp Recording medium, recording device, recording method, data output device, data output method, and data distribution/circulation system
US20060107822A1 (en) * 2004-11-24 2006-05-25 Apple Computer, Inc. Music synchronization arrangement
US20060265657A1 (en) * 2005-05-23 2006-11-23 Gilley Thomas S Distributed scalable media environment
US20070012163A1 (en) * 2005-06-29 2007-01-18 Sony Corporation Content acquisition apparatus, content acquisition method and content acquisition program
US20070074617A1 (en) * 2005-10-04 2007-04-05 Linda Vergo System and method for tailoring music to an activity
US20070094139A1 (en) * 2005-10-10 2007-04-26 Yahoo! Inc. Media item payment system and associated method of use
US20070119292A1 (en) * 2005-09-26 2007-05-31 Yamaha Corporation Apparatus for automatically starting add-on progression to run with inputted music, and computer program therefor
US20070137466A1 (en) * 2005-12-16 2007-06-21 Eric Lindemann Sound synthesis by combining a slowly varying underlying spectrum, pitch and loudness with quicker varying spectral, pitch and loudness fluctuations
US20070209498A1 (en) * 2003-12-18 2007-09-13 Ulf Lindgren Midi Encoding and Decoding
US20070261537A1 (en) * 2006-05-12 2007-11-15 Nokia Corporation Creating and sharing variations of a music file
US20070285815A1 (en) * 2004-09-27 2007-12-13 Juergen Herre Apparatus and method for synchronizing additional data and base data
US20080072261A1 (en) * 2006-06-16 2008-03-20 Ralston John D System, method and apparatus of video processing and applications
US20080071929A1 (en) * 2006-09-18 2008-03-20 Yann Emmanuel Motte Methods and apparatus for selection of information and web page generation
US7351904B2 (en) * 2004-08-31 2008-04-01 Sony Corporation Information processing apparatus and method, program and recording medium
US20080086689A1 (en) * 2006-10-09 2008-04-10 Qmind, Inc. Multimedia content production, publication, and player apparatus, system and method
WO2008065808A1 (en) 2006-11-28 2008-06-05 Sony Corporation Mashing-up data file, mashing-up device and contents making-out method
US20080184288A1 (en) * 2006-11-06 2008-07-31 Ken Lipscomb System and method for creating a customized video advertisement
US20090019995A1 (en) * 2006-12-28 2009-01-22 Yasushi Miyajima Music Editing Apparatus and Method and Program
US20090044689A1 (en) * 2005-12-09 2009-02-19 Sony Corporation Music edit device, music edit information creating method, and recording medium where music edit information is recorded
US20090133568A1 (en) * 2005-12-09 2009-05-28 Sony Corporation Music edit device and music edit method
US7596234B2 (en) * 2003-06-26 2009-09-29 Microsoft Corporation Method and apparatus for playback of audio files

Family Cites Families (13)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP3402490B2 (en) * 1993-06-17 2003-05-06 パイオニア株式会社 Information playback device
CN1293538C (en) * 1997-11-21 2007-01-03 日本胜利株式会社 Record carrier
JP2001257967A (en) * 2000-03-09 2001-09-21 Sharp Corp Information editing service system
JP2003018524A (en) * 2001-07-03 2003-01-17 Fuji Color Service Co Ltd Image processing equipment and program thereof
JP4646099B2 (en) * 2001-09-28 2011-03-09 パイオニア株式会社 Audio information reproducing apparatus and audio information reproducing system
JP4381005B2 (en) 2003-03-05 2009-12-09 四国化工機株式会社 Container transfer conveyor device
JP2005020202A (en) * 2003-06-24 2005-01-20 Canon Inc Reproduction apparatus, reproduction method, and recording medium and program for them
JP2006030538A (en) * 2004-07-15 2006-02-02 Yamaha Corp Musical piece data editing/reproducing device and mobile information terminal using same
JP4539219B2 (en) * 2004-08-04 2010-09-08 株式会社デンソー List exchange system for music, video content, electronic book, and WEB content, and server and terminal device used therefor
JP4412128B2 (en) * 2004-09-16 2010-02-10 ソニー株式会社 Playback apparatus and playback method
JP4626376B2 (en) * 2005-04-25 2011-02-09 ソニー株式会社 Music content playback apparatus and music content playback method
JP4364838B2 (en) * 2005-06-06 2009-11-18 Kddi株式会社 Music reproducing apparatus capable of remixing music, and method and program for remixing music
EP1779911A1 (en) * 2005-10-28 2007-05-02 M-I Epcon As A separator tank

Patent Citations (32)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20040007120A1 (en) * 1999-07-28 2004-01-15 Yamaha Corporation Portable telephony apparatus with music tone generator
US20010029832A1 (en) * 2000-02-15 2001-10-18 Takeshi Kanda Information processing device, information processing method, and recording medium
US20020010740A1 (en) * 2000-06-16 2002-01-24 Takeshi Kikuchi Content distribution system; Content distribution method; distribution server, client terminal, and portable terminal used in the system; and computer readable recording medium on which is recorded a program for operating a computer used in the system
US6835884B2 (en) * 2000-09-20 2004-12-28 Yamaha Corporation System, method, and storage media storing a computer program for assisting in composing music with musical template data
US20020166440A1 (en) * 2001-03-16 2002-11-14 Magix Ag Method of remixing digital information
US20040159221A1 (en) * 2003-02-19 2004-08-19 Noam Camiel System and method for structuring and mixing audio tracks
US20040254660A1 (en) * 2003-05-28 2004-12-16 Alan Seefeldt Method and device to process digital media streams
US7596234B2 (en) * 2003-06-26 2009-09-29 Microsoft Corporation Method and apparatus for playback of audio files
EP1503381A2 (en) 2003-07-28 2005-02-02 Sony Corporation Editing system and control method thereof
EP1524667A1 (en) 2003-10-16 2005-04-20 Magix Ag System and method for improved video editing
US20070209498A1 (en) * 2003-12-18 2007-09-13 Ulf Lindgren Midi Encoding and Decoding
US7351904B2 (en) * 2004-08-31 2008-04-01 Sony Corporation Information processing apparatus and method, program and recording medium
JP2006107693A (en) 2004-09-10 2006-04-20 Sony Corp Recording medium, recording device, recording method, data output device, data output method, and data distribution/circulation system
US20070285815A1 (en) * 2004-09-27 2007-12-13 Juergen Herre Apparatus and method for synchronizing additional data and base data
US20060107822A1 (en) * 2004-11-24 2006-05-25 Apple Computer, Inc. Music synchronization arrangement
US20060265657A1 (en) * 2005-05-23 2006-11-23 Gilley Thomas S Distributed scalable media environment
WO2006127951A2 (en) 2005-05-23 2006-11-30 Gilley Thomas S Distributed scalable media environment
US20070012163A1 (en) * 2005-06-29 2007-01-18 Sony Corporation Content acquisition apparatus, content acquisition method and content acquisition program
US20070119292A1 (en) * 2005-09-26 2007-05-31 Yamaha Corporation Apparatus for automatically starting add-on progression to run with inputted music, and computer program therefor
US20070074617A1 (en) * 2005-10-04 2007-04-05 Linda Vergo System and method for tailoring music to an activity
US20070094139A1 (en) * 2005-10-10 2007-04-26 Yahoo! Inc. Media item payment system and associated method of use
US20090044689A1 (en) * 2005-12-09 2009-02-19 Sony Corporation Music edit device, music edit information creating method, and recording medium where music edit information is recorded
US20090133568A1 (en) * 2005-12-09 2009-05-28 Sony Corporation Music edit device and music edit method
US20070137466A1 (en) * 2005-12-16 2007-06-21 Eric Lindemann Sound synthesis by combining a slowly varying underlying spectrum, pitch and loudness with quicker varying spectral, pitch and loudness fluctuations
US20070261537A1 (en) * 2006-05-12 2007-11-15 Nokia Corporation Creating and sharing variations of a music file
US20080072261A1 (en) * 2006-06-16 2008-03-20 Ralston John D System, method and apparatus of video processing and applications
US20080071929A1 (en) * 2006-09-18 2008-03-20 Yann Emmanuel Motte Methods and apparatus for selection of information and web page generation
US20080086689A1 (en) * 2006-10-09 2008-04-10 Qmind, Inc. Multimedia content production, publication, and player apparatus, system and method
US20080184288A1 (en) * 2006-11-06 2008-07-31 Ken Lipscomb System and method for creating a customized video advertisement
WO2008065808A1 (en) 2006-11-28 2008-06-05 Sony Corporation Mashing-up data file, mashing-up device and contents making-out method
US20090019995A1 (en) * 2006-12-28 2009-01-22 Yasushi Miyajima Music Editing Apparatus and Method and Program
US7626112B2 (en) * 2006-12-28 2009-12-01 Sony Corporation Music editing apparatus and method and program

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
European Search Report, EP 07 12 1978.

Cited By (12)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20100186579A1 (en) * 2008-10-24 2010-07-29 Myles Schnitman Media system with playing component
US8841536B2 (en) * 2008-10-24 2014-09-23 Magnaforte, Llc Media system with playing component
US9111519B1 (en) * 2011-10-26 2015-08-18 Mixwolf LLC System and method for generating cuepoints for mixing song data
US20140076124A1 (en) * 2012-09-19 2014-03-20 Ujam Inc. Song length adjustment
US20140076125A1 (en) * 2012-09-19 2014-03-20 Ujam Inc. Adjustment of song length
US9070351B2 (en) * 2012-09-19 2015-06-30 Ujam Inc. Adjustment of song length
US9230528B2 (en) * 2012-09-19 2016-01-05 Ujam Inc. Song length adjustment
US20150120701A1 (en) * 2013-10-29 2015-04-30 Olaf Schmidt Providing cloud-based, generic odata mashup services using an on-demand service
US9418168B2 (en) * 2013-10-29 2016-08-16 Sap Se Providing cloud-based, generic OData mashup services using an on-demand service
US20190236209A1 (en) * 2018-01-29 2019-08-01 Gary Bencar Artificial intelligence methodology to automatically generate interactive play along songs
US10534811B2 (en) * 2018-01-29 2020-01-14 Beamz Ip, Llc Artificial intelligence methodology to automatically generate interactive play along songs
US20200142926A1 (en) * 2018-01-29 2020-05-07 Beamz Ip, Llc Artificial intelligence methodology to automatically generate interactive play along songs

Also Published As

Publication number Publication date
EP1930901A2 (en) 2008-06-11
CA2612934C (en) 2013-01-22
JP5259083B2 (en) 2013-08-07
CA2612934A1 (en) 2008-06-04
EP1930901A3 (en) 2009-02-18
CN101197171B (en) 2012-10-10
JP2008165837A (en) 2008-07-17
US20080127812A1 (en) 2008-06-05
CN101197171A (en) 2008-06-11
KR20080051054A (en) 2008-06-10

Similar Documents

Publication Publication Date Title
US7956276B2 (en) Method of distributing mashup data, mashup method, server apparatus for mashup data, and mashup apparatus
US8115090B2 (en) Mashup data file, mashup apparatus, and content creation method
RU2662125C2 (en) System and method of generating audio file
US9355627B2 (en) System and method for combining a song and non-song musical content
US8173883B2 (en) Personalized music remixing
US20120014673A1 (en) Video and audio content system
US10062367B1 (en) Vocal effects control system
US7394011B2 (en) Machine and process for generating music from user-specified criteria
US9459828B2 (en) Musically contextual audio advertisements
US20100132536A1 (en) File creation process, file format and file playback apparatus enabling advanced audio interaction and collaboration capabilities
US20090157203A1 (en) Client-side audio signal mixing on low computational power player using beat metadata
US20070044643A1 (en) Method and Apparatus for Automating the Mixing of Multi-Track Digital Audio
CN103718243A (en) Enhanced media recordings and playback
US20120072841A1 (en) Browser-Based Song Creation
Jackson Digital audio editing fundamentals
US9014831B2 (en) Server side audio file beat mixing
WO2013114421A1 (en) Display system, display control system, audio equipment, display method, and program
KR102534870B1 (en) Method and apparatus for providing an audio mixing interface using a plurality of audio stems
Nahmani Logic Pro-Apple Pro Training Series: Professional Music Production
Mason et al. Research White Paper

Legal Events

Date Code Title Description
AS Assignment

Owner name: SONY CORPORATION, JAPAN

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:SAKO, YOICHIRO;MIYAJIMA, YASUSHI;TAKEHARA, MITSURU;REEL/FRAME:021492/0658;SIGNING DATES FROM 20071001 TO 20071008

Owner name: SONY CORPORATION, JAPAN

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:SAKO, YOICHIRO;MIYAJIMA, YASUSHI;TAKEHARA, MITSURU;SIGNING DATES FROM 20071001 TO 20071008;REEL/FRAME:021492/0658

FEPP Fee payment procedure

Free format text: PAYOR NUMBER ASSIGNED (ORIGINAL EVENT CODE: ASPN); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY

Free format text: PAYER NUMBER DE-ASSIGNED (ORIGINAL EVENT CODE: RMPN); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY

STCF Information on status: patent grant

Free format text: PATENTED CASE

FPAY Fee payment

Year of fee payment: 4

MAFP Maintenance fee payment

Free format text: PAYMENT OF MAINTENANCE FEE, 8TH YEAR, LARGE ENTITY (ORIGINAL EVENT CODE: M1552); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY

Year of fee payment: 8

FEPP Fee payment procedure

Free format text: MAINTENANCE FEE REMINDER MAILED (ORIGINAL EVENT CODE: REM.); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY

LAPS Lapse for failure to pay maintenance fees

Free format text: PATENT EXPIRED FOR FAILURE TO PAY MAINTENANCE FEES (ORIGINAL EVENT CODE: EXP.); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY

STCH Information on status: patent discontinuation

Free format text: PATENT EXPIRED DUE TO NONPAYMENT OF MAINTENANCE FEES UNDER 37 CFR 1.362

FP Lapsed due to failure to pay maintenance fee

Effective date: 20230607