CA2617954A1 - Method and system for extracting web data - Google Patents

Method and system for extracting web data Download PDF

Info

Publication number
CA2617954A1
CA2617954A1 CA002617954A CA2617954A CA2617954A1 CA 2617954 A1 CA2617954 A1 CA 2617954A1 CA 002617954 A CA002617954 A CA 002617954A CA 2617954 A CA2617954 A CA 2617954A CA 2617954 A1 CA2617954 A1 CA 2617954A1
Authority
CA
Canada
Prior art keywords
attitude
data
collecting
concept
attitudes
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CA002617954A
Other languages
French (fr)
Other versions
CA2617954C (en
Inventor
Ori Levy
Jonathan Schler
David Tenne
Akiva Navot
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Buzzmetrics Ltd
Original Assignee
Buzzmetrics Ltd.
Ori Levy
Jonathan Schler
David Tenne
Akiva Navot
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Buzzmetrics Ltd., Ori Levy, Jonathan Schler, David Tenne, Akiva Navot filed Critical Buzzmetrics Ltd.
Publication of CA2617954A1 publication Critical patent/CA2617954A1/en
Application granted granted Critical
Publication of CA2617954C publication Critical patent/CA2617954C/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q90/00—Systems or methods specially adapted for administrative, commercial, financial, managerial or supervisory purposes, not involving significant data processing
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q99/00—Subject matter not provided for in other groups of this subclass
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/30—Information retrieval; Database structures therefor; File system structures therefor of unstructured textual data
    • G06F16/38—Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/30—Information retrieval; Database structures therefor; File system structures therefor of unstructured textual data
    • G06F16/38—Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually
    • G06F16/383—Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually using metadata automatically derived from the content
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/90—Details of database functions independent of the retrieved data types
    • G06F16/95—Retrieval from the web
    • G06F16/951—Indexing; Web crawling techniques
    • Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
    • Y10—TECHNICAL SUBJECTS COVERED BY FORMER USPC
    • Y10S—TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
    • Y10S707/00—Data processing: database and file management or data structures
    • Y10S707/99931—Database or file accessing
    • Y10S707/99933—Query processing, i.e. searching

Abstract

An apparatus for providing an analysis of attitudes expressed in web content, comprising: a collector for collecting attitude-data in relation to a predetermined subject from one or more pre-selected web site, the attitude-data containing attitudes in relation to the predetermined subject; a processor, associated with the collector, for processing the attitude data so as to generate an attitude analysis; and an outputter, associated with the processor, for outputting the attitude analysis, thereby to provide an indication of attitudes being expressed in the web content in relation to the predetermined subject.

Claims (43)

1. Apparatus for providing an analysis of attitudes expressed in web sites, comprising:
a collector for collecting attitude-data in relation to a predetermined subject from at least one pre-selected web site, said attitude-data containing attitudes in relation to said predetermined subject;
a processor, associated with said collector, for processing said attitude data so as to generate an attitude analysis; and an outputter, associated with said processor, for outputting said attitude analysis, thereby to provide an indication of attitudes being expressed in said web content in relation to said predetermined subject.
2. The apparatus of claim 1, wherein said collector further comprises at least one crawler, configured for crawling said at least one respective pre-selected web site for the attitude data in relation to said predetermined subject.
3. The apparatus of claim 2, wherein said crawler is further configured to download relevant pages of the at least one pre-selected web site according to a predetermined schedule.
4. The apparatus of claim 1, wherein said collector is further configured to extract relevant data from said relevant pages of the pre-selected web site.
5. The apparatus of claim 1, wherein said collector is further configured to create a mark-up language format representation of said relevant data.
6. The apparatus of claim 5, wherein said mark-up language is XML.
7. The apparatus of claim 1, wherein said collector further comprises a data integrator, configured for integrating the attitude data into a complete and non-redundant attitude data.
8. The apparatus of claim 1, further comprising a collecting policy definer, associated with the collector, operable for defining specific guidelines for collecting with respect to one of said at least one pre-selected web site.
9. The apparatus of claim 1, wherein said processor is further configured for carrying out an initial preprocessing step for extracting metadata of said attitude-data.
10. The apparatus of claim 1, wherein said processor is further operable for categorizing text of said attitude-data.
11. The apparatus of claim 10, wherein said categorization comprises categorization of said attitude data according to style.
12. The apparatus of claim 10, wherein said categorization comprises categorization of said attitude data according to content
13. The apparatus of claim 1, wherein said processor further comprises a statistics generator, configured for generating statistics based on said processing attitude-data.
14. The apparatus of claim 1, wherein said processor further comprises a concept analyzer, configured for analyzing said attitude-data and for finding in said attitude-data at least one relevance-relationship between a phrase and a respective concept relating to said subject.
15. The apparatus of claim 14, wherein said concept is an attitude.
16. The apparatus of claim 1, wherein said processor further comprises a correlation measurer, configured for measuring in said attitude-data correlations among phrases having a relevance-relationship with a common concept and between at least one of said phrases and said common concept, said concept relating to said subject.
17. The apparatus of claim 16, wherein said concept is an attitude.
18. The apparatus of claim 1, wherein said processor further comprises a quotation extractor, for extracting at least one key quotation from said attitude data, said at least one key quotation being descriptive of a relevance-relationship existing in said attitude data between a concept and respective phrases relating thereto, said concept relating to said subject.
19. The apparatus of claim 1, wherein said processor further comprises a clusterer, configured for clustering concepts relating to said attitude-data.
20. The apparatus of claim 1, wherein said collector is configured for collecting attitude-data from a plurality of web sites.
21. The apparatus of claim 1, wherein said outputter is implemented as a desktop application.
22. Apparatus for crawling web content to provide data for attitude analysis of attitudes expressed in said web content in relation to a predetermined subject, the apparatus comprising a crawler, configured to crawl a plurality of pre-selected web sites, for collecting attitude-data from said web sites, said attitude data comprising attitudes relating to said predetermined subject, said crawler being further configured to provide said attitude data to a predetermined location for said attitude analysis.
23. The apparatus of claim 22, further comprising a policy definer, operable for defining specific guidelines with respect to crawling said pre-selected web sites.
24. The apparatus of claim 22, wherein said crawler is further configured for downloading of relevant pages of the pre-selected web site according to a predetermined schedule.
25. The apparatus of claim 22, wherein said crawler is further configured to use a script in a change query language, for said collecting.
26. The apparatus of claim 1, wherein said outputter is implemented using as web browser based application.
27. Method for analyzing attitudes expressed in web content, said attitudes being in relation to a predetermined subject, comprising:
automatically collecting attitude data from at least one pre-selected web site, the attitude-data expressing a plurality of attitudes in relation to said predetermined subject;
electronically processing the attitude data so as to generate attitude information indicative of said plurality of attitudes; and outputting said attitude-information, thereby to provide an analysis of said attitudes in relation to said predetermined subject.
28. The method of claim 27, wherein said collecting further comprises crawling said pre-selected web site.
29. The method of claim 27, wherein said collecting further comprises extracting relevant data from relevant pages of said pre-selected web site.
30. The method of claim 27, wherein said collecting further comprises creating a mark-up language format representation of said attitude data.
31. The method of claim 27, wherein said collecting further comprises integrating the attitude-data into a complete and non-redundant attitude data.
32. The method of claim 27, wherein said processing further comprises an initial preprocessing, for extracting metadata of said attitude data.
33. The method of claim 27, wherein said processing further comprises categorizing text of said attitude-data.
34. The method of claim 33, wherein said categorizing text of said attitude-data, comprises categorization according to style.
35. The method of claim 33, wherein said categorizing text of said attitude-data, comprises categorization according to content.
36. The method of claim 27, wherein said processing further comprises analyzing said attitude-data for finding in said attitude-data at least one relevance-relationship between a phrase and a respective concept.
37. The method of claim 27, wherein said processing further comprises measuring correlations in said attitude-data among phrases having a relevance-relationship with a common concept and between at least one of the phrases and said common concept.
38. The method of claim 27, wherein said processing further comprises extracting at least one key quotation from said attitude-data, said key quotation being descriptive of a relevance-relationship existing in said attitude-data between a concept and respective phrases relating thereto.
39. The method of claim 27, wherein said processing further comprises clustering concepts relating to said attitude-data.
40. The method of claim 27, wherein said collecting comprises collecting attitude-data from all web sites.
41. The method of claim 39, further comprising displaying said clustered concepts and accessing source content via said clusters.
42. Device for interactive setting of a data collection policy using a web page display, comprising a web page displayer, for displaying a web page to a user, operable for defining a data collection policy in relation to said web page.
43. The device of claim 42, wherein said web page displayer is further operable to define a specific data collection policy in relation to a respective region of said web page.
CA2617954A 2005-08-05 2006-08-03 Method and system for extracting web data Active CA2617954C (en)

Applications Claiming Priority (5)

Application Number Priority Date Filing Date Title
US70544205P 2005-08-05 2005-08-05
US60/705,442 2005-08-05
US11/364,169 US20070100779A1 (en) 2005-08-05 2006-03-01 Method and system for extracting web data
US11/364,169 2006-03-01
PCT/IL2006/000905 WO2007017862A2 (en) 2005-08-05 2006-08-03 Method and system for extracting web data

Publications (2)

Publication Number Publication Date
CA2617954A1 true CA2617954A1 (en) 2007-02-15
CA2617954C CA2617954C (en) 2012-10-16

Family

ID=37718765

Family Applications (1)

Application Number Title Priority Date Filing Date
CA2617954A Active CA2617954C (en) 2005-08-05 2006-08-03 Method and system for extracting web data

Country Status (6)

Country Link
US (3) US20070100779A1 (en)
EP (1) EP1922657A4 (en)
AU (1) AU2006277608B2 (en)
CA (1) CA2617954C (en)
MX (1) MX2008001772A (en)
WO (1) WO2007017862A2 (en)

Families Citing this family (90)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7268700B1 (en) 1998-01-27 2007-09-11 Hoffberg Steven M Mobile communication device
US9818136B1 (en) 2003-02-05 2017-11-14 Steven M. Hoffberg System and method for determining contingent relevance
US7590589B2 (en) 2004-09-10 2009-09-15 Hoffberg Steven M Game theoretic prioritization scheme for mobile ad hoc networks permitting hierarchal deference
US8874477B2 (en) 2005-10-04 2014-10-28 Steven Mark Hoffberg Multifactorial optimization system and method
US7949646B1 (en) * 2005-12-23 2011-05-24 At&T Intellectual Property Ii, L.P. Method and apparatus for building sales tools by mining data from websites
US7599861B2 (en) 2006-03-02 2009-10-06 Convergys Customer Management Group, Inc. System and method for closed loop decisionmaking in an automated care system
US7529795B2 (en) * 2006-03-20 2009-05-05 Stragent, Llc Message board aggregator
US7809663B1 (en) 2006-05-22 2010-10-05 Convergys Cmg Utah, Inc. System and method for supporting the utilization of machine language
US8379830B1 (en) 2006-05-22 2013-02-19 Convergys Customer Management Delaware Llc System and method for automated customer service with contingent live interaction
US8869037B2 (en) * 2006-06-22 2014-10-21 Linkedin Corporation Event visualization
US7831928B1 (en) * 2006-06-22 2010-11-09 Digg, Inc. Content visualization
US8862591B2 (en) * 2006-08-22 2014-10-14 Twitter, Inc. System and method for evaluating sentiment
US7895127B2 (en) * 2006-09-29 2011-02-22 Weiser Anatoly S Rating-based sorting and displaying of reviews
TWI337712B (en) * 2006-10-30 2011-02-21 Inst Information Industry Systems and methods for measuring behavior characteristics, and machine readable medium thereof
US7720807B1 (en) * 2007-01-17 2010-05-18 Square Zero, Inc. Representing finite node-labeled trees using a one bit encoding
US20080215571A1 (en) * 2007-03-01 2008-09-04 Microsoft Corporation Product review search
US20080249764A1 (en) * 2007-03-01 2008-10-09 Microsoft Corporation Smart Sentiment Classifier for Product Reviews
US8051372B1 (en) * 2007-04-12 2011-11-01 The New York Times Company System and method for automatically detecting and extracting semantically significant text from a HTML document associated with a plurality of HTML documents
US7890549B2 (en) * 2007-04-30 2011-02-15 Quantum Leap Research, Inc. Collaboration portal (COPO) a scaleable method, system, and apparatus for providing computer-accessible benefits to communities of users
CN100452054C (en) * 2007-05-09 2009-01-14 崔志明 Integrated data source finding method for deep layer net page data source
US7827128B1 (en) * 2007-05-11 2010-11-02 Aol Advertising Inc. System identification, estimation, and prediction of advertising-related data
JP2009025968A (en) * 2007-07-18 2009-02-05 Fujifilm Corp Related term dictionary preparation device, method, program, and content retrieval device
US20090157668A1 (en) * 2007-12-12 2009-06-18 Christopher Daniel Newton Method and system for measuring an impact of various categories of media owners on a corporate brand
US8065265B2 (en) * 2007-10-29 2011-11-22 Microsoft Corporation Methods and apparatus for web-based research
US8126881B1 (en) 2007-12-12 2012-02-28 Vast.com, Inc. Predictive conversion systems and methods
US8347326B2 (en) 2007-12-18 2013-01-01 The Nielsen Company (US) Identifying key media events and modeling causal relationships between key events and reported feelings
US20090182759A1 (en) * 2008-01-11 2009-07-16 Yahoo! Inc. Extracting entities from a web page
US20090187559A1 (en) * 2008-01-17 2009-07-23 Peter Gloor Method of analyzing unstructured documents to predict asset value performance
CA2650319C (en) 2008-01-24 2016-10-18 Radian6 Technologies Inc. Method and system for targeted advertising based on topical memes
US8219549B2 (en) * 2008-02-06 2012-07-10 Microsoft Corporation Forum mining for suspicious link spam sites detection
US9245252B2 (en) 2008-05-07 2016-01-26 Salesforce.Com, Inc. Method and system for determining on-line influence in social media
US20090319505A1 (en) * 2008-06-19 2009-12-24 Microsoft Corporation Techniques for extracting authorship dates of documents
US8099408B2 (en) * 2008-06-27 2012-01-17 Microsoft Corporation Web forum crawling using skeletal links
US8296278B2 (en) * 2008-09-17 2012-10-23 Microsoft Corporation Identifying product issues using forum data
US8375024B2 (en) * 2008-11-13 2013-02-12 Buzzient, Inc. Modeling social networks using analytic measurements of online social media content
US8244224B2 (en) * 2008-11-20 2012-08-14 Research In Motion Limited Providing customized information to a user based on identifying a trend
CN102282552B (en) * 2008-12-23 2016-08-03 黄家正 Based Intelligent Control based on pattern, monitoring and the system of automatization, method and computer program
US20100169159A1 (en) * 2008-12-30 2010-07-01 Nicholas Rose Media for Service and Marketing
US20100211533A1 (en) * 2009-02-18 2010-08-19 Microsoft Corporation Extracting structured data from web forums
US9672478B2 (en) 2009-02-26 2017-06-06 Oracle International Corporation Techniques for semantic business policy composition
US8972424B2 (en) 2009-05-29 2015-03-03 Peter Snell Subjective linguistic analysis
CN102460374A (en) * 2009-05-29 2012-05-16 彼得·S·斯内尔 System and related method for digital attitude mapping
US8694357B2 (en) * 2009-06-08 2014-04-08 E-Rewards, Inc. Online marketing research utilizing sentiment analysis and tunable demographics analysis
US11620660B2 (en) 2009-08-19 2023-04-04 Oracle International Corporation Systems and methods for creating and inserting application media content into social media system displays
US10339541B2 (en) 2009-08-19 2019-07-02 Oracle International Corporation Systems and methods for creating and inserting application media content into social media system displays
US9633399B2 (en) * 2009-08-19 2017-04-25 Oracle International Corporation Method and system for implementing a cloud-based social media marketing method and system
US20140074551A1 (en) 2012-09-09 2014-03-13 Oracle International Corporation Method and system for implementing a social media marketing and engagement application
US20120011432A1 (en) 2009-08-19 2012-01-12 Vitrue, Inc. Systems and methods for associating social media systems and web pages
WO2011079311A1 (en) * 2009-12-24 2011-06-30 Minh Duong-Van System and method for determining sentiment expressed in documents
US8949236B2 (en) 2010-02-26 2015-02-03 Oracle International Corporation Techniques for analyzing data from multiple sources
US20110231416A1 (en) * 2010-03-22 2011-09-22 Brandon Lee Goodchild Drake Analyzing script for scanning mass internet content
US9183292B2 (en) 2010-03-24 2015-11-10 Taykey Ltd. System and methods thereof for real-time detection of an hidden connection between phrases
US8782046B2 (en) 2010-03-24 2014-07-15 Taykey Ltd. System and methods for predicting future trends of term taxonomies usage
US9946775B2 (en) 2010-03-24 2018-04-17 Taykey Ltd. System and methods thereof for detection of user demographic information
US8965835B2 (en) * 2010-03-24 2015-02-24 Taykey Ltd. Method for analyzing sentiment trends based on term taxonomies of user generated content
US10600073B2 (en) 2010-03-24 2020-03-24 Innovid Inc. System and method for tracking the performance of advertisements and predicting future behavior of the advertisement
US9613139B2 (en) 2010-03-24 2017-04-04 Taykey Ltd. System and methods thereof for real-time monitoring of a sentiment trend with respect of a desired phrase
US8930377B2 (en) * 2010-03-24 2015-01-06 Taykey Ltd. System and methods thereof for mining web based user generated content for creation of term taxonomies
US8230062B2 (en) 2010-06-21 2012-07-24 Salesforce.Com, Inc. Referred internet traffic analysis system and method
US9043232B1 (en) * 2010-08-09 2015-05-26 Amazon Technologies, Inc. Associating item images with item catalog data
US8838709B2 (en) * 2010-12-17 2014-09-16 Silverpop Systems, Inc. Anti-phishing electronic message verification
US8825813B2 (en) 2010-12-28 2014-09-02 Microsoft Corporation Distributed network coordinate system based on network performance
US8782058B2 (en) * 2011-10-12 2014-07-15 Desire2Learn Incorporated Search index dictionary
US9116985B2 (en) * 2011-12-16 2015-08-25 Sas Institute Inc. Computer-implemented systems and methods for taxonomy development
US10366117B2 (en) * 2011-12-16 2019-07-30 Sas Institute Inc. Computer-implemented systems and methods for taxonomy development
US20130173254A1 (en) * 2011-12-31 2013-07-04 Farrokh Alemi Sentiment Analyzer
US9430738B1 (en) 2012-02-08 2016-08-30 Mashwork, Inc. Automated emotional clustering of social media conversations
US20140136185A1 (en) * 2012-11-13 2014-05-15 International Business Machines Corporation Sentiment analysis based on demographic analysis
US9704136B2 (en) * 2013-01-31 2017-07-11 Hewlett Packard Enterprise Development Lp Identifying subsets of signifiers to analyze
US9104718B1 (en) 2013-03-07 2015-08-11 Vast.com, Inc. Systems, methods, and devices for measuring similarity of and generating recommendations for unique items
US10007946B1 (en) 2013-03-07 2018-06-26 Vast.com, Inc. Systems, methods, and devices for measuring similarity of and generating recommendations for unique items
US9465873B1 (en) 2013-03-07 2016-10-11 Vast.com, Inc. Systems, methods, and devices for identifying and presenting identifications of significant attributes of unique items
US9830635B1 (en) 2013-03-13 2017-11-28 Vast.com, Inc. Systems, methods, and devices for determining and displaying market relative position of unique items
US11928606B2 (en) 2013-03-15 2024-03-12 TSG Technologies, LLC Systems and methods for classifying electronic documents
US9298814B2 (en) 2013-03-15 2016-03-29 Maritz Holdings Inc. Systems and methods for classifying electronic documents
US9852400B2 (en) * 2013-05-01 2017-12-26 Palo Alto Research Center Incorporated System and method for detecting quitting intention based on electronic-communication dynamics
US10235459B1 (en) 2013-07-25 2019-03-19 Google Llc Creating entries in at least one of a personal cache and a personal index
US10521807B2 (en) 2013-09-05 2019-12-31 TSG Technologies, LLC Methods and systems for determining a risk of an emotional response of an audience
US9569530B2 (en) 2013-11-12 2017-02-14 International Business Machines Corporation Extracting and mining of quote data across multiple languages
US10127596B1 (en) 2013-12-10 2018-11-13 Vast.com, Inc. Systems, methods, and devices for generating recommendations of unique items
US10922657B2 (en) 2014-08-26 2021-02-16 Oracle International Corporation Using an employee database with social media connections to calculate job candidate reputation scores
US10325000B2 (en) * 2014-09-30 2019-06-18 Isis Innovation Ltd System for automatically generating wrapper for entire websites
US10333696B2 (en) 2015-01-12 2019-06-25 X-Prime, Inc. Systems and methods for implementing an efficient, scalable homomorphic transformation of encrypted data with minimal data expansion and improved processing efficiency
EP3107009A1 (en) * 2015-06-19 2016-12-21 Tata Consultancy Services Limited Self-learning based crawling and rule-based data mining for automatic information extraction
US20160379515A1 (en) * 2015-06-29 2016-12-29 Fujitsu Limited System and method for enhancing logical thinking in curation learning
US11205103B2 (en) 2016-12-09 2021-12-21 The Research Foundation for the State University Semisupervised autoencoder for sentiment analysis
CN107329970A (en) * 2017-05-23 2017-11-07 成都联宇云安科技有限公司 A kind of method analyzed and processed for mobile phone managing and control system public sentiment big data
US10268704B1 (en) 2017-10-12 2019-04-23 Vast.com, Inc. Partitioned distributed database systems, devices, and methods
CN108021704B (en) * 2017-12-27 2021-05-04 广东广业开元科技有限公司 Agent optimal configuration method based on social public opinion data mining technology
US11108795B2 (en) 2018-05-25 2021-08-31 At&T Intellectual Property I, L.P. Intrusion detection using robust singular value decomposition

Family Cites Families (131)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US3950618A (en) * 1971-03-25 1976-04-13 Bloisi Albertoni De Lemos System for public opinion research
US4930077A (en) 1987-04-06 1990-05-29 Fan David P Information processing expert system for text analysis and predicting public opinion based information available to the public
US5124911A (en) 1988-04-15 1992-06-23 Image Engineering, Inc. Method of evaluating consumer choice through concept testing for the marketing and development of consumer products
US5041972A (en) 1988-04-15 1991-08-20 Frost W Alan Method of measuring and evaluating consumer response for the development of consumer products
US5301109A (en) 1990-06-11 1994-04-05 Bell Communications Research, Inc. Computerized cross-language document retrieval using latent semantic indexing
US5077785A (en) 1990-07-13 1991-12-31 Monson Gerald D System for recording comments by patrons of establishments
US5321833A (en) 1990-08-29 1994-06-14 Gte Laboratories Incorporated Adaptive ranking system for information retrieval
US5317507A (en) 1990-11-07 1994-05-31 Gallant Stephen I Method for document retrieval and for word sense disambiguation using neural networks
US5317673A (en) * 1992-06-22 1994-05-31 Sri International Method and apparatus for context-dependent estimation of multiple probability distributions of phonetic classes with multilayer perceptrons in a speech recognition system
JPH0756933A (en) 1993-06-24 1995-03-03 Xerox Corp Method for retrieval of document
US5519608A (en) 1993-06-24 1996-05-21 Xerox Corporation Method for extracting from a text corpus answers to questions stated in natural language by using linguistic analysis and hypothesis generation
EP0736203A1 (en) 1993-12-23 1996-10-09 Diacom Technologies, Inc. Method and apparatus for implementing user feedback
US5671333A (en) 1994-04-07 1997-09-23 Lucent Technologies Inc. Training apparatus and method
US5495412A (en) 1994-07-15 1996-02-27 Ican Systems, Inc. Computer-based method and apparatus for interactive computer-assisted negotiations
US6029195A (en) 1994-11-29 2000-02-22 Herz; Frederick S. M. System for customized electronic identification of desirable objects
US5758257A (en) 1994-11-29 1998-05-26 Herz; Frederick System and method for scheduling broadcast of and access to video programs and other data using customer profiles
US5668953A (en) 1995-02-22 1997-09-16 Sloo; Marshall Allan Method and apparatus for handling a complaint
US5895450A (en) 1995-02-22 1999-04-20 Sloo; Marshall A. Method and apparatus for handling complaints
EP0823090B1 (en) 1995-04-27 2005-01-26 Northrop Grumman Corporation Adaptive filtering neural network classifier
US5659732A (en) 1995-05-17 1997-08-19 Infoseek Corporation Document retrieval over networks wherein ranking and relevance scores are computed at the client for multiple database documents
US5675710A (en) 1995-06-07 1997-10-07 Lucent Technologies, Inc. Method and apparatus for training a text classifier
US6006221A (en) 1995-08-16 1999-12-21 Syracuse University Multilingual document retrieval system and method using semantic vector matching
US6026388A (en) 1995-08-16 2000-02-15 Textwise, Llc User interface and other enhancements for natural language information retrieval system and method
US5659742A (en) 1995-09-15 1997-08-19 Infonautics Corporation Method for storing multi-media information in an information retrieval system
US5819285A (en) 1995-09-20 1998-10-06 Infonautics Corporation Apparatus for capturing, storing and processing co-marketing information associated with a user of an on-line computer service using the world-wide-web.
ES2174050T3 (en) 1996-01-12 2002-11-01 Ibm ANONYMOUS EXCHANGE AND INFORMATION SECURITY IN A NETWORK.
IT1285619B1 (en) 1996-03-15 1998-06-18 Co Me Sca Costruzioni Meccanic BENDING METHOD OF A DIELECTRIC SHEET IN THE SHEET
US5867799A (en) 1996-04-04 1999-02-02 Lang; Andrew K. Information system and method for filtering a massive flow of information entities to meet user information classification needs
US6314420B1 (en) 1996-04-04 2001-11-06 Lycos, Inc. Collaborative/adaptive search engine
US5950172A (en) 1996-06-07 1999-09-07 Klingman; Edwin E. Secured electronic rating system
US5822744A (en) 1996-07-15 1998-10-13 Kesel; Brad Consumer comment reporting apparatus and method
US6026387A (en) 1996-07-15 2000-02-15 Kesel; Brad Consumer comment reporting apparatus and method
US6038610A (en) 1996-07-17 2000-03-14 Microsoft Corporation Storage of sitemaps at server sites for holding information regarding content
US5864863A (en) 1996-08-09 1999-01-26 Digital Equipment Corporation Method for parsing, indexing and searching world-wide-web pages
US5920854A (en) 1996-08-14 1999-07-06 Infoseek Corporation Real-time document collection search engine with phrase indexing
US5857179A (en) 1996-09-09 1999-01-05 Digital Equipment Corporation Computer method and apparatus for clustering documents and automatic generation of cluster keywords
US5911043A (en) 1996-10-01 1999-06-08 Baker & Botts, L.L.P. System and method for computer-based rating of information retrieved from a computer network
US5924094A (en) 1996-11-01 1999-07-13 Current Network Technologies Corporation Independent distributed database system
US5836771A (en) 1996-12-02 1998-11-17 Ho; Chi Fai Learning method and system based on questioning
US5950189A (en) 1997-01-02 1999-09-07 At&T Corp Retrieval system and method
US7437351B2 (en) * 1997-01-10 2008-10-14 Google Inc. Method for searching media
US6138128A (en) 1997-04-02 2000-10-24 Microsoft Corp. Sharing and organizing world wide web references using distinctive characters
US6362837B1 (en) 1997-05-06 2002-03-26 Michael Ginn Method and apparatus for simultaneously indicating rating value for the first document and display of second document in response to the selection
US6098066A (en) 1997-06-13 2000-08-01 Sun Microsystems, Inc. Method and apparatus for searching for documents stored within a document directory hierarchy
US6012053A (en) 1997-06-23 2000-01-04 Lycos, Inc. Computer system with user-controlled relevance ranking of search results
US6233575B1 (en) 1997-06-24 2001-05-15 International Business Machines Corporation Multilevel taxonomy based on features derived from training documents classification using fisher values as discrimination values
US6119933A (en) 1997-07-17 2000-09-19 Wong; Earl Chang Method and apparatus for customer loyalty and marketing analysis
US6278990B1 (en) 1997-07-25 2001-08-21 Claritech Corporation Sort system for text retrieval
US5983216A (en) 1997-09-12 1999-11-09 Infoseek Corporation Performing automated document collection and selection by providing a meta-index with meta-index values indentifying corresponding document collections
US5845278A (en) 1997-09-12 1998-12-01 Inioseek Corporation Method for automatically selecting collections to search in full text searches
US5974412A (en) 1997-09-24 1999-10-26 Sapient Health Network Intelligent query system for automatically indexing information in a database and automatically categorizing users
US6266664B1 (en) 1997-10-01 2001-07-24 Rulespace, Inc. Method for scanning, analyzing and rating digital information content
US6094657A (en) 1997-10-01 2000-07-25 International Business Machines Corporation Apparatus and method for dynamic meta-tagging of compound documents
US5953718A (en) 1997-11-12 1999-09-14 Oracle Corporation Research mode for a knowledge base search and retrieval system
US6236991B1 (en) 1997-11-26 2001-05-22 International Business Machines Corp. Method and system for providing access for categorized information from online internet and intranet sources
US6269362B1 (en) 1997-12-19 2001-07-31 Alta Vista Company System and method for monitoring web pages by comparing generated abstracts
US6081793A (en) 1997-12-30 2000-06-27 International Business Machines Corporation Method and system for secure computer moderated voting
US6289342B1 (en) 1998-01-05 2001-09-11 Nec Research Institute, Inc. Autonomous citation indexing and literature browsing using citation context
JP3692764B2 (en) 1998-02-25 2005-09-07 株式会社日立製作所 Structured document registration method, search method, and portable medium used therefor
US6067539A (en) 1998-03-02 2000-05-23 Vigil, Inc. Intelligent information retrieval system
US6185558B1 (en) 1998-03-03 2001-02-06 Amazon.Com, Inc. Identifying the items most relevant to a current query based on items selected in connection with similar queries
US6421675B1 (en) 1998-03-16 2002-07-16 S. L. I. Systems, Inc. Search engine
US6064980A (en) 1998-03-17 2000-05-16 Amazon.Com, Inc. System and methods for collaborative recommendations
US6236987B1 (en) 1998-04-03 2001-05-22 Damon Horowitz Dynamic content organization in information retrieval systems
US6078892A (en) 1998-04-09 2000-06-20 International Business Machines Corporation Method for customer lead selection and optimization
US6112203A (en) 1998-04-09 2000-08-29 Altavista Company Method for ranking documents in a hyperlinked environment using connectivity and selective content analysis
US6032145A (en) 1998-04-10 2000-02-29 Requisite Technology, Inc. Method and system for database manipulation
GB2336698A (en) 1998-04-24 1999-10-27 Dialog Corp Plc The Automatic content categorisation of text data files using subdivision to reduce false classification
US6006225A (en) 1998-06-15 1999-12-21 Amazon.Com Refining search queries by the suggestion of correlated terms from prior searches
US6192360B1 (en) 1998-06-23 2001-02-20 Microsoft Corporation Methods and apparatus for classifying text and for building a text classifier
US6401118B1 (en) 1998-06-30 2002-06-04 Online Monitoring Services Method and computer program product for an online monitoring search engine
US6202068B1 (en) 1998-07-02 2001-03-13 Thomas A. Kraay Database display and search method
US6035294A (en) 1998-08-03 2000-03-07 Big Fat Fish, Inc. Wide access databases and database systems
AU5465099A (en) 1998-08-04 2000-02-28 Rulespace, Inc. Method and system for deriving computer users' personal interests
JP2001202013A (en) * 2000-01-21 2001-07-27 Nec Corp Anonymous participation authority control system
US6138113A (en) 1998-08-10 2000-10-24 Altavista Company Method for identifying near duplicate pages in a hyperlinked database
US6393460B1 (en) 1998-08-28 2002-05-21 International Business Machines Corporation Method and system for informing users of subjects of discussion in on-line chats
US6334131B2 (en) 1998-08-29 2001-12-25 International Business Machines Corporation Method for cataloging, filtering, and relevance ranking frame-based hierarchical information structures
US6513032B1 (en) 1998-10-29 2003-01-28 Alta Vista Company Search and navigation system and method using category intersection pre-computation
US6360215B1 (en) 1998-11-03 2002-03-19 Inktomi Corporation Method and apparatus for retrieving documents based on information other than document content
US6236977B1 (en) 1999-01-04 2001-05-22 Realty One, Inc. Computer implemented marketing system
US6510513B1 (en) 1999-01-13 2003-01-21 Microsoft Corporation Security services and policy enforcement for electronic data
US20020059258A1 (en) * 1999-01-21 2002-05-16 James F. Kirkpatrick Method and apparatus for retrieving and displaying consumer interest data from the internet
US6385586B1 (en) 1999-01-28 2002-05-07 International Business Machines Corporation Speech recognition text-based language conversion and text-to-speech in a client-server configuration to enable language translation devices
US6418433B1 (en) 1999-01-28 2002-07-09 International Business Machines Corporation System and method for focussed web crawling
US6411936B1 (en) 1999-02-05 2002-06-25 Nval Solutions, Inc. Enterprise value enhancement system and method
US6553358B1 (en) 1999-04-20 2003-04-22 Microsoft Corporation Decision-theoretic approach to harnessing text classification for guiding automated action
US6304864B1 (en) 1999-04-20 2001-10-16 Textwise Llc System for retrieving multimedia information from the internet using multiple evolving intelligent agents
US6493703B1 (en) 1999-05-11 2002-12-10 Prophet Financial Systems System and method for implementing intelligent online community message board
US6571234B1 (en) 1999-05-11 2003-05-27 Prophet Financial Systems, Inc. System and method for managing online message board
US6546390B1 (en) 1999-06-11 2003-04-08 Abuzz Technologies, Inc. Method and apparatus for evaluating relevancy of messages to users
US6571238B1 (en) 1999-06-11 2003-05-27 Abuzz Technologies, Inc. System for regulating flow of information to user by using time dependent function to adjust relevancy threshold
KR20010004404A (en) 1999-06-28 2001-01-15 정선종 Keyfact-based text retrieval system, keyfact-based text index method, and retrieval method using this system
US6507866B1 (en) 1999-07-19 2003-01-14 At&T Wireless Services, Inc. E-mail usage pattern detection
US6341306B1 (en) 1999-08-13 2002-01-22 Atomica Corporation Web-based information retrieval responsive to displayed word identified by a text-grabbing algorithm
WO2001016839A2 (en) * 1999-08-31 2001-03-08 Video Ventures Joint Venture D/B/A Comsort System for influence network marketing
US6260041B1 (en) 1999-09-30 2001-07-10 Netcurrents, Inc. Apparatus and method of implementing fast internet real-time search technology (first)
US6434549B1 (en) 1999-12-13 2002-08-13 Ultris, Inc. Network-based, human-mediated exchange of information
US6324648B1 (en) 1999-12-14 2001-11-27 Gte Service Corporation Secure gateway having user identification and password authentication
US6651086B1 (en) * 2000-02-22 2003-11-18 Yahoo! Inc. Systems and methods for matching participants to a conversation
JP2003527686A (en) * 2000-03-16 2003-09-16 チェン，ユアン，ヤン How to classify things from many classes as members of one or more classes
US6757646B2 (en) * 2000-03-22 2004-06-29 Insightful Corporation Extended functionality for an inverse inference engine based web search
US6983320B1 (en) * 2000-05-23 2006-01-03 Cyveillance, Inc. System, method and computer program product for analyzing e-commerce competition of an entity by utilizing predetermined entity-specific metrics and analyzed statistics from web pages
WO2002005196A2 (en) * 2000-07-06 2002-01-17 Protigen, Inc. System and method for anonymous transaction in a data network and classification of individuals without knowing their real identity
NO313399B1 (en) * 2000-09-14 2002-09-23 Fast Search & Transfer Asa Procedure for searching and analyzing information in computer networks
US20020062368A1 (en) * 2000-10-11 2002-05-23 David Holtzman System and method for establishing and evaluating cross community identities in electronic forums
US7197470B1 (en) * 2000-10-11 2007-03-27 Buzzmetrics, Ltd. System and method for collection analysis of electronic discussion methods
US6560600B1 (en) * 2000-10-25 2003-05-06 Alta Vista Company Method and apparatus for ranking Web page search results
GB2368670A (en) * 2000-11-03 2002-05-08 Envisional Software Solutions Data acquisition system
CA2469146A1 (en) * 2000-11-20 2002-09-12 Amerasia International Technology, Inc. Electronic voting apparatus, system and method
US6526440B1 (en) 2001-01-30 2003-02-25 Google, Inc. Ranking search results by reranking the results based on local inter-connectivity
US6584470B2 (en) 2001-03-01 2003-06-24 Intelliseek, Inc. Multi-layered semiotic mechanism for answering natural language questions using document retrieval combined with information extraction
US20030094489A1 (en) * 2001-04-16 2003-05-22 Stephanie Wald Voting system and method
US20030046144A1 (en) * 2001-08-28 2003-03-06 International Business Machines Corporation System and method for anonymous message forwarding and anonymous voting
US6892944B2 (en) * 2001-10-01 2005-05-17 Amerasia International Technology, Inc. Electronic voting apparatus and method for optically scanned ballot
TW571248B (en) * 2001-10-11 2004-01-11 Exscientia Llc Method and apparatus for learning to classify patterns and assess the value of decisions
US7055273B2 (en) * 2001-10-12 2006-06-06 Attitude Measurement Corporation Removable label and incentive item to facilitate collecting consumer data
WO2003075186A1 (en) * 2002-03-01 2003-09-12 Paul Jeffrey Krupin A method and system for creating improved search queries
US7716161B2 (en) * 2002-09-24 2010-05-11 Google, Inc, Methods and apparatus for serving relevant advertisements
FR2842680A1 (en) * 2002-07-19 2004-01-23 France Telecom LIST SIGNING METHOD AND ELECTRONIC VOTING APPLICATION
US7599911B2 (en) * 2002-08-05 2009-10-06 Yahoo! Inc. Method and apparatus for search ranking using human input and automated ranking
US7130777B2 (en) * 2003-11-26 2006-10-31 International Business Machines Corporation Method to hierarchical pooling of opinions from multiple sources
US7865354B2 (en) * 2003-12-05 2011-01-04 International Business Machines Corporation Extracting and grouping opinions from text documents
JP4597867B2 (en) * 2003-12-08 2010-12-15 石井 美恵子 Privacy protection method, privacy protection identifier transmission device, privacy protection system and program
US7287012B2 (en) * 2004-01-09 2007-10-23 Microsoft Corporation Machine-learned approach to determining document relevance for search over large electronic collections of documents
US20060041605A1 (en) * 2004-04-01 2006-02-23 King Martin T Determining actions involving captured information and electronic content associated with rendered documents
US7596571B2 (en) * 2004-06-30 2009-09-29 Technorati, Inc. Ecosystem method of aggregation and search and related techniques
US7523085B2 (en) * 2004-09-30 2009-04-21 Buzzmetrics, Ltd An Israel Corporation Topical sentiments in electronically stored communications
US7624102B2 (en) * 2005-01-28 2009-11-24 Microsoft Corporation System and method for grouping by attribute
US20070027840A1 (en) * 2005-07-27 2007-02-01 Jobserve Limited Searching method and system
KR100856007B1 (en) * 2006-09-06 2008-09-02 성균관대학교산학협력단 A verification method for operation of encryption apparatus andits application to electronic voting

Also Published As

Publication number Publication date
WO2007017862A2 (en) 2007-02-15
AU2006277608A1 (en) 2007-02-15
US20070033189A1 (en) 2007-02-08
WO2007017862A3 (en) 2007-09-20
US20070033188A1 (en) 2007-02-08
US7596552B2 (en) 2009-09-29
EP1922657A4 (en) 2009-12-09
CA2617954C (en) 2012-10-16
MX2008001772A (en) 2009-01-07
AU2006277608B2 (en) 2011-08-04
EP1922657A2 (en) 2008-05-21
US20070100779A1 (en) 2007-05-03

Similar Documents

Publication Publication Date Title
CA2617954A1 (en) Method and system for extracting web data
Jorgensen Indexing Images: Testing an Image Description Template.
CN101546587A (en) Method and device for automatically displaying visual elements in song-playing process
Hill He's Got Your Number.
Trudgill Solute modelling in catchment systems.
Van House Public Library Effectiveness: Theory, Measures, and Determinants.
Hord Anatomy of Incident and Tactic Interventions: Dimensions, Design.
Gomide Corpus linguistics software: Understanding their usages and delivering two new tools
Odhiambo Influence of use of education management information system (EMIS) on management of secondary schools in nairobi city county, Kenya
Ward The News Library's Contribution to Newsmaking.
Goel et al. Plagiarism and its detection in programming languages
Mansurova et al. Design and development of media-corpus of the Kazakh language
Sun et al. Design of an e-book user interface and visualizations to support reading for comprehension
Belk et al. Supporting adaptive interactive systems with semantic markups and human factors
Kemis et al. The aeIou Approach to Program Evaluation.
Cashin et al. IDEA Technical Report No. 4. Description of IDEA Standard Form Data Base.
Guida Plago: A system for plagiarism detection and intervention in massive courses
Etemadiour et al. Components of ideation in designing process by semiotic approach with factor analysis in R
Jarnkoon et al. The Development of Information Systems for Academic Administration in School Under Roi Et Primary Educational Service Area Office 2
Henrickson Use of National Databases: Case Study on Census Data.
Walters A psychobiographical study of Gavin Maxwell: a Kernberg object relations approach
Ben-Mazwi Matolengwe Investigating talent management strategies influencing the retention of employees with technical expertise at Aspen Pharmacare
Ben-Arieh et al. Time for (More) Time-Use Studies: Studying the Daily Activities of Children. Opinion, Dialogue, Review.
Cline Cognitive Style in System Design.
Kim A Cost-Effectiveness/Benefit Analysis Model for Postsecondary Vocational Programs. Technical Report.

Legal Events

Date Code Title Description
EEER Examination request