WO2006127859A3 - Distributed and interactive database architecture for parallel and asynchronous data processing of complex data and for real-time query processing - Google Patents

Distributed and interactive database architecture for parallel and asynchronous data processing of complex data and for real-time query processing Download PDF

Info

Publication number
WO2006127859A3
WO2006127859A3 PCT/US2006/020165 US2006020165W WO2006127859A3 WO 2006127859 A3 WO2006127859 A3 WO 2006127859A3 US 2006020165 W US2006020165 W US 2006020165W WO 2006127859 A3 WO2006127859 A3 WO 2006127859A3
Authority
WO
WIPO (PCT)
Prior art keywords
data
metadata
item
processing
store
Prior art date
Application number
PCT/US2006/020165
Other languages
French (fr)
Other versions
WO2006127859A2 (en
Inventor
Nevzat Hurkan Balkir
Marc Louis Gutchell
Peter J Lindgren
Eric Michael Tagliere
Original Assignee
Experian Marketing Solutions I
Nevzat Hurkan Balkir
Marc Louis Gutchell
Peter J Lindgren
Eric Michael Tagliere
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Priority claimed from US11/137,618 external-priority patent/US8510329B2/en
Application filed by Experian Marketing Solutions I, Nevzat Hurkan Balkir, Marc Louis Gutchell, Peter J Lindgren, Eric Michael Tagliere filed Critical Experian Marketing Solutions I
Publication of WO2006127859A2 publication Critical patent/WO2006127859A2/en
Publication of WO2006127859A3 publication Critical patent/WO2006127859A3/en

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/24—Querying
    • G06F16/245—Query processing
    • G06F16/2455—Query execution
    • G06F16/24568—Data stream processing; Continuous queries
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q30/00—Commerce
    • G06Q30/02—Marketing; Price estimation or determination; Fundraising
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/23—Updating
    • G06F16/2358—Change logging, detection, and notification
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/25—Integrating or interfacing systems involving database management systems
    • G06F16/258—Data format conversion from or to a database
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/28—Databases characterised by their database models, e.g. relational or object models
    • G06F16/283—Multi-dimensional databases or data warehouses, e.g. MOLAP or ROLAP
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/90—Details of database functions independent of the retrieved data types
    • G06F16/901—Indexing; Data structures therefor; Storage structures
    • G06F16/9024—Graphs; Linked lists
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/90—Details of database functions independent of the retrieved data types
    • G06F16/95—Retrieval from the web
    • G06F16/953—Querying, e.g. by the use of web search engines
    • G06F16/9535—Search customisation based on user profiles and personalisation
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q30/00—Commerce
    • G06Q30/02—Marketing; Price estimation or determination; Fundraising
    • G06Q30/0241—Advertisements
    • Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
    • Y10—TECHNICAL SUBJECTS COVERED BY FORMER USPC
    • Y10S—TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
    • Y10S707/00—Data processing: database and file management or data structures
    • Y10S707/99941—Database schema or data structure
    • Y10S707/99948—Application of database or data structure, e.g. distributed, multimedia, or image

Abstract

The various embodiments of the invention provide a data processing system and method, for applications such as marketing campaign management, speech recognition and signal processing An exemplary system embodiment includes a first data repository (fig 4, item 320) adapted to store a plurality of entity and attribute data, a second data repository adapted to store a plurality of entity linkage data (fig 4, item 310), a metadata data repository adapted to store a plurality of metadata modules (fig 4, item 330), with a first metadata module having a plurality of selectable parameters, received through a control interface (fig 4, item 135), and having a plurality of metadata linkages to a first subset of metadata modules, and a multidimensional data structure The control interface may modify the plurality of selectable parameters in response to received control information A plurality of processing nodes (fig 4, items 335 and 355) are adapted to use the plurality of selectable parameters to assemble a first plurality of data from the first and second data repositories and from input data, to reduce the first plurality of data to form a second plurality of data, and to aggregate and dimension the second plurality of data for storage in the multidimensional data structure.
PCT/US2006/020165 2005-05-25 2006-05-23 Distributed and interactive database architecture for parallel and asynchronous data processing of complex data and for real-time query processing WO2006127859A2 (en)

Applications Claiming Priority (4)

Application Number Priority Date Filing Date Title
US11/137,618 US8510329B2 (en) 2005-05-25 2005-05-25 Distributed and interactive database architecture for parallel and asynchronous data processing of complex data and for real-time query processing
US11/137,618 2005-05-25
US11/151,137 2005-06-13
US11/151,137 US7707163B2 (en) 2005-05-25 2005-06-13 Software and metadata structures for distributed and interactive database architecture for parallel and asynchronous data processing of complex data and for real-time query processing

Publications (2)

Publication Number Publication Date
WO2006127859A2 WO2006127859A2 (en) 2006-11-30
WO2006127859A3 true WO2006127859A3 (en) 2008-10-23

Family

ID=37452817

Family Applications (2)

Application Number Title Priority Date Filing Date
PCT/US2006/020165 WO2006127859A2 (en) 2005-05-25 2006-05-23 Distributed and interactive database architecture for parallel and asynchronous data processing of complex data and for real-time query processing
PCT/US2006/020168 WO2006127862A2 (en) 2005-05-25 2006-05-24 System, software and metadata structures for distributed and interactive database architecture for parallel and asynchronous data processing of complex data and for real-time query processing

Family Applications After (1)

Application Number Title Priority Date Filing Date
PCT/US2006/020168 WO2006127862A2 (en) 2005-05-25 2006-05-24 System, software and metadata structures for distributed and interactive database architecture for parallel and asynchronous data processing of complex data and for real-time query processing

Country Status (2)

Country Link
US (5) US7707163B2 (en)
WO (2) WO2006127859A2 (en)

Families Citing this family (75)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20030208460A1 (en) * 2002-05-06 2003-11-06 Ncr Corporation Methods, systems and data structures to generate and link reports
WO2007055734A2 (en) * 2005-05-20 2007-05-18 West Virginia University Research Corp. A multi-source data retrieval system
US8180789B1 (en) * 2005-12-05 2012-05-15 Teradata Us, Inc. Techniques for query generation, population, and management
US8510109B2 (en) 2007-08-22 2013-08-13 Canyon Ip Holdings Llc Continuous speech transcription performance indication
US20080103798A1 (en) * 2006-10-25 2008-05-01 Domenikos Steven D Identity Protection
US8359278B2 (en) 2006-10-25 2013-01-22 IndentityTruth, Inc. Identity protection
US9973450B2 (en) 2007-09-17 2018-05-15 Amazon Technologies, Inc. Methods and systems for dynamically updating web service profile information by parsing transcribed message strings
US8117137B2 (en) 2007-04-19 2012-02-14 Microsoft Corporation Field-programmable gate array based accelerator system
US20080310707A1 (en) * 2007-06-15 2008-12-18 Microsoft Corporation Virtual reality enhancement using real world data
US8027962B2 (en) * 2007-09-14 2011-09-27 Teradata Us, Inc. Techniques for asynchronous command interface for scalable and active data warehousing
US8264505B2 (en) * 2007-12-28 2012-09-11 Microsoft Corporation Augmented reality and filtering
US8051091B2 (en) * 2008-02-19 2011-11-01 Sap Ag Parallelizing data manipulation by data set abstraction
US8676577B2 (en) * 2008-03-31 2014-03-18 Canyon IP Holdings, LLC Use of metadata to post process speech recognition output
US8606803B2 (en) * 2008-04-01 2013-12-10 Microsoft Corporation Translating a relational query to a multidimensional query
US8301638B2 (en) 2008-09-25 2012-10-30 Microsoft Corporation Automated feature selection based on rankboost for ranking
US8131659B2 (en) 2008-09-25 2012-03-06 Microsoft Corporation Field-programmable gate array based accelerator system
US20100153351A1 (en) * 2008-12-16 2010-06-17 Yung Alex P Techniques for real-time database processing
GB0906004D0 (en) * 2009-04-07 2009-05-20 Omnifone Ltd MusicStation desktop
US20100293090A1 (en) * 2009-05-14 2010-11-18 Domenikos Steven D Systems, methods, and apparatus for determining fraud probability scores and identity health scores
US8909683B1 (en) 2009-07-17 2014-12-09 Open Invention Network, Llc Method and system for communicating with internet resources to identify and supply content for webpage construction
US9652802B1 (en) 2010-03-24 2017-05-16 Consumerinfo.Com, Inc. Indirect monitoring and reporting of a user's credit data
US9645996B1 (en) 2010-03-25 2017-05-09 Open Invention Network Llc Method and device for automatically generating a tag from a conversation in a social networking website
US10437437B1 (en) * 2010-03-25 2019-10-08 Open Invention Network Llc Method and device for appending information in a conversation in a voice based networking website
US9565298B1 (en) * 2010-03-25 2017-02-07 Open Invention Network Llc Method and device for appending information in a conversation in a voice based networking website
WO2011133507A2 (en) * 2010-04-20 2011-10-27 Webamg Sarl Method and apparatus for creative optimization
WO2011133519A2 (en) * 2010-04-20 2011-10-27 Webamg Sarl Method and apparatus for campaign and inventory optimization
WO2011133550A2 (en) * 2010-04-20 2011-10-27 Webamg Sarl Method and apparatus for landing page optimization
US20120102453A1 (en) * 2010-10-21 2012-04-26 Microsoft Corporation Multi-dimensional objects
WO2012112781A1 (en) 2011-02-18 2012-08-23 Csidentity Corporation System and methods for identifying compromised personally identifiable information on the internet
US20140280075A1 (en) * 2011-08-26 2014-09-18 Hewlett-Packard Development Company, L.P. Multidimension clusters for data partitioning
US8819793B2 (en) 2011-09-20 2014-08-26 Csidentity Corporation Systems and methods for secure and efficient enrollment into a federation which utilizes a biometric repository
US11030562B1 (en) 2011-10-31 2021-06-08 Consumerinfo.Com, Inc. Pre-data breach monitoring
US9087052B2 (en) * 2011-11-02 2015-07-21 Hewlett-Packard Development Company, L.P. Batch DBMS statement processing such that intermediate feedback is provided prior to completion of processing
US9679044B2 (en) * 2011-11-15 2017-06-13 Facebook, Inc. Assigning social networking system users to households
GB201120877D0 (en) * 2011-12-05 2012-01-18 Maxwell Daniel J A method and system for managing data
US9069373B2 (en) * 2011-12-23 2015-06-30 Sap Se Generating a runtime framework
US8938416B1 (en) 2012-01-13 2015-01-20 Amazon Technologies, Inc. Distributed storage of aggregated data
US10169446B1 (en) * 2012-09-10 2019-01-01 Amazon Technologies, Inc. Relational modeler and renderer for non-relational data
US9684877B2 (en) 2012-09-18 2017-06-20 Sap Se System and method for improved consumption models for analytics
US9135314B2 (en) 2012-09-20 2015-09-15 Sap Se System and method for improved consumption models for summary analytics
US8621244B1 (en) 2012-10-04 2013-12-31 Datalogix Inc. Method and apparatus for matching consumers
US8983993B2 (en) * 2012-12-18 2015-03-17 Sap Se Data warehouse queries using SPARQL
US20150242930A1 (en) * 2013-01-31 2015-08-27 Alexander Greystoke Purchasing Feedback System
US10373194B2 (en) 2013-02-20 2019-08-06 Datalogix Holdings, Inc. System and method for measuring advertising effectiveness
US8812387B1 (en) 2013-03-14 2014-08-19 Csidentity Corporation System and method for identifying related credit inquiries
US9047325B2 (en) * 2013-04-08 2015-06-02 International Business Machines Corporation Modularizing complex XML data for generation and extraction
US9251218B2 (en) 2013-08-07 2016-02-02 International Business Machines Corporation Tunable hardware sort engine for performing composite sorting algorithms
US9495418B2 (en) 2013-08-07 2016-11-15 International Business Machines Corporation Scalable acceleration of database query operations
US9619499B2 (en) 2013-08-07 2017-04-11 International Business Machines Corporation Hardware implementation of a tournament tree sort algorithm
US9830354B2 (en) 2013-08-07 2017-11-28 International Business Machines Corporation Accelerating multiple query processing operations
US9396448B2 (en) * 2013-09-10 2016-07-19 Nice-Systems Ltd. Distributed and open schema interactions management system and method
US20150286353A1 (en) * 2013-11-27 2015-10-08 Mariano Delle Donne Information collection, management, sharing and distribution system and method
US10002149B2 (en) 2014-02-22 2018-06-19 SourceThought, Inc. Relevance ranking for data and transformations
US9424083B2 (en) 2014-03-14 2016-08-23 Google Inc. Managing metadata for a distributed processing system with manager agents and worker agents
US10019680B2 (en) * 2014-08-15 2018-07-10 Nice Ltd. System and method for distributed rule-based sequencing engine
US10339527B1 (en) 2014-10-31 2019-07-02 Experian Information Solutions, Inc. System and architecture for electronic fraud detection
US10310813B2 (en) 2014-12-29 2019-06-04 International Business Machines Corporation Hardware implementation of a tournament tree sort algorithm using an external memory
US10268745B2 (en) * 2015-05-29 2019-04-23 Oracle International Corporation Inherited dimensions
US11151468B1 (en) 2015-07-02 2021-10-19 Experian Information Solutions, Inc. Behavior analysis using distributed representations of event data
US9747175B2 (en) 2015-09-30 2017-08-29 Bank Of America Corporation System for aggregation and transformation of real-time data
US10755344B2 (en) 2015-09-30 2020-08-25 Bank Of America Corporation System framework processor for channel contacts
US10664457B2 (en) 2015-09-30 2020-05-26 Bank Of America Corporation System for real-time data structuring and storage
US10069891B2 (en) 2015-09-30 2018-09-04 Bank Of America Corporation Channel accessible single function micro service data collection process for light analytics
US10699028B1 (en) 2017-09-28 2020-06-30 Csidentity Corporation Identity security architecture systems and methods
CN107704622A (en) * 2017-10-27 2018-02-16 成都艾薇尼尔信息技术有限公司 A kind of Intelligent Business service system based on big data analysis
US10896472B1 (en) 2017-11-14 2021-01-19 Csidentity Corporation Security and identity verification system and architecture
WO2019118365A1 (en) * 2017-12-11 2019-06-20 Hispanispace, LLC Systems and methods for ingesting and processing data in a data processing environment
US11347667B2 (en) * 2018-01-10 2022-05-31 Qualcomm Incorporated Bus controller and related methods
US11567628B2 (en) * 2018-07-05 2023-01-31 International Business Machines Corporation Cognitive composition of multi-dimensional icons
CN108984770A (en) * 2018-07-23 2018-12-11 北京百度网讯科技有限公司 Method and apparatus for handling data
US20200089795A1 (en) * 2018-09-17 2020-03-19 Hewlett-Packard Development Company, L.P. Dataset orchestration with metadata variance data
US11481379B2 (en) 2018-11-01 2022-10-25 Hewlett-Packard Development Company, L.P. Metadata variance analytics
EP3997586A4 (en) * 2019-07-08 2022-07-06 Telefonaktiebolaget Lm Ericsson (Publ) Methods and systems for multidimensional data sharding in distributed databases
US20230245057A1 (en) * 2020-04-10 2023-08-03 Anders Lillevik Procurement Category Management System and Method
US20230153283A1 (en) * 2021-11-17 2023-05-18 Rakuten Symphony Singapore Pte. Ltd. Data standardization system and methods of operating the same

Citations (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20030217033A1 (en) * 2002-05-17 2003-11-20 Zigmund Sandler Database system and methods

Family Cites Families (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6131098A (en) * 1997-03-04 2000-10-10 Zellweger; Paul Method and apparatus for a database management system content menu
US6775675B1 (en) * 2001-04-04 2004-08-10 Sagemetrics Corporation Methods for abstracting data from various data structures and managing the presentation of the data
US8510329B2 (en) * 2005-05-25 2013-08-13 Experian Marketing Solutions, Inc. Distributed and interactive database architecture for parallel and asynchronous data processing of complex data and for real-time query processing

Patent Citations (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20030217033A1 (en) * 2002-05-17 2003-11-20 Zigmund Sandler Database system and methods

Also Published As

Publication number Publication date
WO2006127859A2 (en) 2006-11-30
US20100325142A1 (en) 2010-12-23
US8135747B2 (en) 2012-03-13
WO2006127862A3 (en) 2007-03-08
US9454578B2 (en) 2016-09-27
US7707163B2 (en) 2010-04-27
US20150081738A1 (en) 2015-03-19
US20060271507A1 (en) 2006-11-30
US20160078093A1 (en) 2016-03-17
US20120259893A1 (en) 2012-10-11
WO2006127862A2 (en) 2006-11-30
US9201981B2 (en) 2015-12-01
US8775473B2 (en) 2014-07-08

Similar Documents

Publication Publication Date Title
WO2006127859A3 (en) Distributed and interactive database architecture for parallel and asynchronous data processing of complex data and for real-time query processing
Che et al. From big data to big data mining: challenges, issues, and opportunities
KR20210038860A (en) Intent recommendation method, apparatus, device and storage medium
Miloslavskaya et al. Application of big data, fast data, and data lake concepts to information security issues
CN105787767A (en) Method and system for obtaining advertisement click-through rate pre-estimation model
CA2477126A1 (en) Support for multiple content-management data models
Cuesta et al. Towards an architecture for managing big semantic data in real-time
Riyaz et al. A scalable product recommendations using collaborative filtering in hadoop for bigdata
CN106651544A (en) Conversational recommendation system for minimum user interaction
Zneika et al. RDF graph summarization based on approximate patterns
CN107563715A (en) Foreign trade set-off marketing system and method
Sangeetha et al. No Science No Humans, No New Technologies No changes" Big Data a Great Revolution
CN112328832B (en) Movie recommendation method integrating labels and knowledge graph
Kim Building a K-Pop knowledge graph using an entertainment ontology
Shah et al. A review: Web content mining techniques
Vishwanath et al. An Association Rule Mining for Materialized View Selection and View Maintanance
Prakashbhai et al. Inference patterns from Big Data using aggregation, filtering and tagging-A survey
Naeem et al. An ontology based digital preservation system for enterprise collaboration
Chen et al. A semantic query approach to personalized e-Catalogs service system
Mohanty et al. Extracting value from big data: in-memory solutions, real time analytics, and recommendation systems
Sharma et al. A hand to hand taxonomical survey on web mining
Rallabandi et al. Image retrieval system using R-tree self-organizing map
Vo et al. Towards scalable recommendation framework with heterogeneous data sources: preliminary results
Walha et al. ETL4Social-Data: Modeling Approach for Topic Hierarchy.
Rossetto et al. A knowledge graph-based system for retrieval of lifelog data

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application
DPE2 Request for preliminary examination filed before expiration of 19th month from priority date (pct application filed from 20040101)
NENP Non-entry into the national phase

Ref country code: DE

NENP Non-entry into the national phase

Ref country code: RU

122 Ep: pct application non-entry in european phase

Ref document number: 06760356

Country of ref document: EP

Kind code of ref document: A2

DPE2 Request for preliminary examination filed before expiration of 19th month from priority date (pct application filed from 20040101)