WO2006015169A3 - A system and method for report level confidence - Google Patents

A system and method for report level confidence Download PDF

Info

Publication number
WO2006015169A3
WO2006015169A3 PCT/US2005/026888 US2005026888W WO2006015169A3 WO 2006015169 A3 WO2006015169 A3 WO 2006015169A3 US 2005026888 W US2005026888 W US 2005026888W WO 2006015169 A3 WO2006015169 A3 WO 2006015169A3
Authority
WO
WIPO (PCT)
Prior art keywords
asr
rcm
accuracy
document
output
Prior art date
Application number
PCT/US2005/026888
Other languages
French (fr)
Other versions
WO2006015169A2 (en
Inventor
Alwin B Carus
Larissa Lapshina
Elizabeth M Lovance
Original Assignee
Dictaphone Corp
Alwin B Carus
Larissa Lapshina
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Dictaphone Corp, Alwin B Carus, Larissa Lapshina filed Critical Dictaphone Corp
Priority to EP05777492.9A priority Critical patent/EP1787289B1/en
Priority to CA2575373A priority patent/CA2575373C/en
Priority to GB0703020A priority patent/GB2432704B/en
Publication of WO2006015169A2 publication Critical patent/WO2006015169A2/en
Publication of WO2006015169A3 publication Critical patent/WO2006015169A3/en

Links

Classifications

    • GPHYSICS
    • G10MUSICAL INSTRUMENTS; ACOUSTICS
    • G10LSPEECH ANALYSIS OR SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING; SPEECH OR AUDIO CODING OR DECODING
    • G10L15/00Speech recognition
    • G10L15/22Procedures used during a speech recognition process, e.g. man-machine dialogue
    • GPHYSICS
    • G10MUSICAL INSTRUMENTS; ACOUSTICS
    • G10LSPEECH ANALYSIS OR SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING; SPEECH OR AUDIO CODING OR DECODING
    • G10L15/00Speech recognition
    • G10L15/01Assessment or evaluation of speech recognition systems
    • GPHYSICS
    • G10MUSICAL INSTRUMENTS; ACOUSTICS
    • G10LSPEECH ANALYSIS OR SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING; SPEECH OR AUDIO CODING OR DECODING
    • G10L15/00Speech recognition
    • G10L15/26Speech to text systems

Abstract

A system and method is disclosed for Report Confidence Modeling (RCM) including automatic adaptive classification of ASR output documents to determine the most efficient document edit workflow to convert dictation into finished output. The RCM (30) according to the present invention may include a mechanism to predict recognition accuracy (35) of a document generated by an ASR engine (25). Predicted accuracy of the document allows an ASR application to sort recognized documents based on their estimated accuracy or quality and route them appropriately for further processing, editing (60) and/or formatting.
PCT/US2005/026888 2004-07-30 2005-07-28 A system and method for report level confidence WO2006015169A2 (en)

Priority Applications (3)

Application Number Priority Date Filing Date Title
EP05777492.9A EP1787289B1 (en) 2004-07-30 2005-07-28 A system and method for report level confidence
CA2575373A CA2575373C (en) 2004-07-30 2005-07-28 A system and method for report level confidence
GB0703020A GB2432704B (en) 2004-07-30 2005-07-28 A system and method for report level confidence

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US59212304P 2004-07-30 2004-07-30
US60/592,123 2004-07-30

Publications (2)

Publication Number Publication Date
WO2006015169A2 WO2006015169A2 (en) 2006-02-09
WO2006015169A3 true WO2006015169A3 (en) 2006-10-05

Family

ID=35787841

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/US2005/026888 WO2006015169A2 (en) 2004-07-30 2005-07-28 A system and method for report level confidence

Country Status (5)

Country Link
US (1) US7818175B2 (en)
EP (1) EP1787289B1 (en)
CA (1) CA2575373C (en)
GB (1) GB2432704B (en)
WO (1) WO2006015169A2 (en)

Families Citing this family (37)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
GB2420946B (en) 2003-04-22 2006-09-27 Spinvox Ltd A method of providing voicemails to a mobile telephone
US8221126B2 (en) * 2004-11-22 2012-07-17 Bravobrava L.L.C. System and method for performing programmatic language learning tests and evaluations
US8033831B2 (en) * 2004-11-22 2011-10-11 Bravobrava L.L.C. System and method for programmatically evaluating and aiding a person learning a new language
US8272874B2 (en) * 2004-11-22 2012-09-25 Bravobrava L.L.C. System and method for assisting language learning
US8032372B1 (en) * 2005-09-13 2011-10-04 Escription, Inc. Dictation selection
US20070078806A1 (en) * 2005-10-05 2007-04-05 Hinickle Judith A Method and apparatus for evaluating the accuracy of transcribed documents and other documents
US20070094034A1 (en) * 2005-10-21 2007-04-26 Berlin Bradley M Incident report transcription system and methodologies
US8976944B2 (en) * 2006-02-10 2015-03-10 Nuance Communications, Inc. Mass-scale, user-independent, device-independent voice messaging system
EP2523443B1 (en) * 2006-02-10 2014-01-29 Nuance Communications, Inc. A mass-scale, user-independent, device-independent, voice message to text conversion system
JP4957075B2 (en) * 2006-05-15 2012-06-20 富士通株式会社 Reliability evaluation program and reliability evaluation apparatus
US7831423B2 (en) * 2006-05-25 2010-11-09 Multimodal Technologies, Inc. Replacing text representing a concept with an alternate written form of the concept
US8560314B2 (en) * 2006-06-22 2013-10-15 Multimodal Technologies, Llc Applying service levels to transcripts
US8521510B2 (en) 2006-08-31 2013-08-27 At&T Intellectual Property Ii, L.P. Method and system for providing an automated web transcription service
EP2119209A2 (en) 2007-01-09 2009-11-18 Spinvox Limited A mobile telephone programmed to allow a user to speak a message which is then remotely automatically converted to text
US20080177623A1 (en) * 2007-01-24 2008-07-24 Juergen Fritsch Monitoring User Interactions With A Document Editing System
US20090132254A1 (en) * 2007-11-20 2009-05-21 General Electric Company Diagnostic report based on quality of user's report dictation
US8639512B2 (en) * 2008-04-23 2014-01-28 Nvoq Incorporated Method and systems for measuring user performance with speech-to-text conversion for dictation systems
US20100125450A1 (en) * 2008-10-27 2010-05-20 Spheris Inc. Synchronized transcription rules handling
US9070360B2 (en) * 2009-12-10 2015-06-30 Microsoft Technology Licensing, Llc Confidence calibration in automatic speech recognition systems
JP5587493B2 (en) * 2010-04-14 2014-09-10 ザ ダン アンド ブラッドストリート コーポレーション Method and system for assigning actionable attributes to data representing personal identification
US9002700B2 (en) 2010-05-13 2015-04-07 Grammarly, Inc. Systems and methods for advanced grammar checking
US20110313762A1 (en) * 2010-06-20 2011-12-22 International Business Machines Corporation Speech output with confidence indication
US9774747B2 (en) * 2011-04-29 2017-09-26 Nexidia Inc. Transcription system
US9037962B1 (en) * 2012-04-30 2015-05-19 Intuit Inc. Method and system for tracking and reporting data importation accuracy
US8612261B1 (en) 2012-05-21 2013-12-17 Health Management Associates, Inc. Automated learning for medical data processing system
US9020803B2 (en) 2012-09-20 2015-04-28 International Business Machines Corporation Confidence-rated transcription and translation
JP2014202848A (en) * 2013-04-03 2014-10-27 株式会社東芝 Text generation device, method and program
US9633650B2 (en) * 2013-08-28 2017-04-25 Verint Systems Ltd. System and method of automated model adaptation
US9508346B2 (en) * 2013-08-28 2016-11-29 Verint Systems Ltd. System and method of automated language model adaptation
US20150120379A1 (en) * 2013-10-30 2015-04-30 Educational Testing Service Systems and Methods for Passage Selection for Language Proficiency Testing Using Automated Authentic Listening
US9613619B2 (en) * 2013-10-30 2017-04-04 Genesys Telecommunications Laboratories, Inc. Predicting recognition quality of a phrase in automatic speech recognition systems
US20180034961A1 (en) 2014-02-28 2018-02-01 Ultratec, Inc. Semiautomated Relay Method and Apparatus
US20180270350A1 (en) 2014-02-28 2018-09-20 Ultratec, Inc. Semiautomated relay method and apparatus
US10389876B2 (en) 2014-02-28 2019-08-20 Ultratec, Inc. Semiautomated relay method and apparatus
US10275576B2 (en) * 2014-06-27 2019-04-30 Passport Health Communications, Inc Automatic medical coding system and method
US10210384B2 (en) * 2016-07-25 2019-02-19 Intuit Inc. Optical character recognition (OCR) accuracy by combining results across video frames
US11158322B2 (en) 2019-09-06 2021-10-26 Verbit Software Ltd. Human resolution of repeated phrases in a hybrid transcription system

Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6006183A (en) * 1997-12-16 1999-12-21 International Business Machines Corp. Speech recognition confidence level display
US6122614A (en) * 1998-11-20 2000-09-19 Custom Speech Usa, Inc. System and method for automating transcription services
US6366882B1 (en) * 1997-03-27 2002-04-02 Speech Machines, Plc Apparatus for converting speech to text
US6799162B1 (en) * 1998-12-17 2004-09-28 Sony Corporation Semi-supervised speaker adaptation
US6879956B1 (en) * 1999-09-30 2005-04-12 Sony Corporation Speech recognition with feedback from natural language processing for adaptation of acoustic models
US7016844B2 (en) * 2002-09-26 2006-03-21 Core Mobility, Inc. System and method for online transcription services
US7031918B2 (en) * 2002-03-20 2006-04-18 Microsoft Corporation Generating a task-adapted acoustic model from one or more supervised and/or unsupervised corpora

Family Cites Families (44)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5033088A (en) * 1988-06-06 1991-07-16 Voice Processing Corp. Method and apparatus for effectively receiving voice input to a voice recognition system
US5146439A (en) * 1989-01-04 1992-09-08 Pitney Bowes Inc. Records management system having dictation/transcription capability
US5268990A (en) * 1991-01-31 1993-12-07 Sri International Method for recognizing speech using linguistically-motivated hidden Markov models
US5519808A (en) * 1993-03-10 1996-05-21 Lanier Worldwide, Inc. Transcription interface for a word processing station
US5602982A (en) * 1994-09-23 1997-02-11 Kelly Properties, Inc. Universal automated training and testing software system
US5812882A (en) * 1994-10-18 1998-09-22 Lanier Worldwide, Inc. Digital dictation system having a central station that includes component cards for interfacing to dictation stations and transcription stations and for processing and storing digitized dictation segments
US5883986A (en) * 1995-06-02 1999-03-16 Xerox Corporation Method and system for automatic transcription correction
US5857212A (en) * 1995-07-06 1999-01-05 Sun Microsystems, Inc. System and method for horizontal alignment of tokens in a structural representation program editor
US5799276A (en) * 1995-11-07 1998-08-25 Accent Incorporated Knowledge-based speech recognition system and methods having frame length computed based upon estimated pitch period of vocalic intervals
US5898830A (en) * 1996-10-17 1999-04-27 Network Engineering Software Firewall providing enhanced network security and user transparency
US5748888A (en) * 1996-05-29 1998-05-05 Compaq Computer Corporation Method and apparatus for providing secure and private keyboard communications in computer systems
US5875448A (en) * 1996-10-08 1999-02-23 Boys; Donald R. Data stream editing system including a hand-held voice-editing apparatus having a position-finding enunciator
US5974413A (en) * 1997-07-03 1999-10-26 Activeword Systems, Inc. Semantic user interface
US6374225B1 (en) * 1998-10-09 2002-04-16 Enounce, Incorporated Method and apparatus to prepare listener-interest-filtered works
US6415256B1 (en) * 1998-12-21 2002-07-02 Richard Joseph Ditzik Integrated handwriting and speed recognition systems
US6961699B1 (en) * 1999-02-19 2005-11-01 Custom Speech Usa, Inc. Automated transcription system and method using two speech converting instances and computer-assisted correction
US6266882B1 (en) * 1999-05-20 2001-07-31 Carrier Corporation Fin collar and method of manufacturing
JP2001043062A (en) * 1999-07-27 2001-02-16 Nec Corp Personal computer, volume control method thereof, and recording medium
US6865258B1 (en) * 1999-08-13 2005-03-08 Intervoice Limited Partnership Method and system for enhanced transcription
US6584205B1 (en) * 1999-08-26 2003-06-24 American Technology Corporation Modulator processing for a parametric speaker system
US6535849B1 (en) * 2000-01-18 2003-03-18 Scansoft, Inc. Method and system for generating semi-literal transcripts for speech recognition systems
US7082615B1 (en) * 2000-03-31 2006-07-25 Intel Corporation Protecting software environment in isolated execution
WO2001084535A2 (en) * 2000-05-02 2001-11-08 Dragon Systems, Inc. Error correction in speech recognition
US6950994B2 (en) * 2000-08-31 2005-09-27 Yahoo! Inc. Data list transmutation and input mapping
US7236932B1 (en) * 2000-09-12 2007-06-26 Avaya Technology Corp. Method of and apparatus for improving productivity of human reviewers of automatically transcribed documents generated by media conversion systems
EP1374226B1 (en) 2001-03-16 2005-07-20 Koninklijke Philips Electronics N.V. Transcription service stopping automatic transcription
US20020188452A1 (en) * 2001-06-11 2002-12-12 Howes Simon L. Automatic normal report system
US7529685B2 (en) * 2001-08-28 2009-05-05 Md Datacor, Inc. System, method, and apparatus for storing, retrieving, and integrating clinical, diagnostic, genomic, and therapeutic data
WO2003027921A2 (en) * 2001-09-26 2003-04-03 Koninklijke Philips Electronics N.V. Method for the computer-controlled implementation of a work process, and device for implementing a work process
US7152213B2 (en) * 2001-10-04 2006-12-19 Infogation Corporation System and method for dynamic key assignment in enhanced user interface
US20030154085A1 (en) * 2002-02-08 2003-08-14 Onevoice Medical Corporation Interactive knowledge base system
US7292975B2 (en) * 2002-05-01 2007-11-06 Nuance Communications, Inc. Systems and methods for evaluating speaker suitability for automatic speech recognition aided transcription
US20030221990A1 (en) * 2002-06-04 2003-12-04 Yoon H. Alex Multi-stage hydrocracker with kerosene recycle
US20050096910A1 (en) * 2002-12-06 2005-05-05 Watson Kirk L. Formed document templates and related methods and systems for automated sequential insertion of speech recognition results
WO2004088635A1 (en) * 2003-03-31 2004-10-14 Koninklijke Philips Electronics N.V. System for correction of speech recognition results with confidence level indication
US20050102140A1 (en) * 2003-11-12 2005-05-12 Joel Davne Method and system for real-time transcription and correction using an electronic communication environment
KR20060130717A (en) * 2004-03-05 2006-12-19 시큐어 시스템즈 리미티드 Partition access control system and method for controlling partition access
US7584103B2 (en) * 2004-08-20 2009-09-01 Multimodal Technologies, Inc. Automated extraction of semantic content and generation of a structured document from speech
KR100713128B1 (en) 2004-11-08 2007-05-02 주식회사 비젯 Device and System for preventing virus
WO2006105095A2 (en) * 2005-03-29 2006-10-05 Glowpoint, Inc. Video communication call authorization
FI20050561A0 (en) * 2005-05-26 2005-05-26 Nokia Corp Processing of packet data in a communication system
US20070143857A1 (en) * 2005-12-19 2007-06-21 Hazim Ansari Method and System for Enabling Computer Systems to Be Responsive to Environmental Changes
US9904809B2 (en) * 2006-02-27 2018-02-27 Avago Technologies General Ip (Singapore) Pte. Ltd. Method and system for multi-level security initialization and configuration
US7831423B2 (en) * 2006-05-25 2010-11-09 Multimodal Technologies, Inc. Replacing text representing a concept with an alternate written form of the concept

Patent Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6366882B1 (en) * 1997-03-27 2002-04-02 Speech Machines, Plc Apparatus for converting speech to text
US6006183A (en) * 1997-12-16 1999-12-21 International Business Machines Corp. Speech recognition confidence level display
US6122614A (en) * 1998-11-20 2000-09-19 Custom Speech Usa, Inc. System and method for automating transcription services
US6799162B1 (en) * 1998-12-17 2004-09-28 Sony Corporation Semi-supervised speaker adaptation
US6879956B1 (en) * 1999-09-30 2005-04-12 Sony Corporation Speech recognition with feedback from natural language processing for adaptation of acoustic models
US7031918B2 (en) * 2002-03-20 2006-04-18 Microsoft Corporation Generating a task-adapted acoustic model from one or more supervised and/or unsupervised corpora
US7016844B2 (en) * 2002-09-26 2006-03-21 Core Mobility, Inc. System and method for online transcription services

Also Published As

Publication number Publication date
CA2575373C (en) 2015-09-08
EP1787289B1 (en) 2018-01-10
US7818175B2 (en) 2010-10-19
EP1787289A2 (en) 2007-05-23
CA2575373A1 (en) 2006-02-09
US20060026003A1 (en) 2006-02-02
EP1787289A4 (en) 2008-05-14
GB2432704A (en) 2007-05-30
WO2006015169A2 (en) 2006-02-09
GB0703020D0 (en) 2007-03-28
GB2432704B (en) 2009-12-09

Similar Documents

Publication Publication Date Title
WO2006015169A3 (en) A system and method for report level confidence
EP0977174A3 (en) Search optimization system and method for continuous speech recognition
WO2001097213A8 (en) Speech recognition using utterance-level confidence estimates
EP0865032A3 (en) Speech recognizing performing noise adaptation
CN1920948A (en) Voice recognition system and voice processing system
WO2003058388A3 (en) Process for determining a confidence factor for insurance underwriting suitable for use by an automated system
EP1349145A3 (en) System and method for providing information using spoken dialogue interface
ATE509332T1 (en) AUTOMATIC DETECTION OF VEHICLE OPERATING NOISE SIGNALS
WO2005055197A3 (en) Noise suppressor for speech coding and speech recognition
WO2004075027A3 (en) A method for form completion using speech recognition and text comparison
WO2004003688A8 (en) A method for comparing a transcribed text file with a previously created file
EP1750251A3 (en) Method and apparatus for extracting voiced/unvoiced classification information using harmonic component of voice signal
HK1082315A1 (en) Method and device for gain quantization in variable bit rate wideband speech coding
EP0977175A3 (en) Method and apparatus for recognizing speech using a knowledge base
CN1293428A (en) Information check method based on speed recognition
CA2439427A1 (en) Method for determining an acoustic environment situation, application of the method and hearing aid
CN106847259A (en) A kind of screening of audio keyword template and optimization method
EP1022723A3 (en) Unsupervised adaptation of a speech recognizer using reliable information among N-best strings
DE60133757D1 (en) METHOD AND DEVICE FOR CODING VOTING LANGUAGE
ATE407411T1 (en) METHOD FOR PROVIDING ACCOUNT INFORMATION AND SYSTEM FOR WRITING DICTATE TEXT
EP0750292A3 (en) Speech recognition method and speech recognition system with reduced recognition time in consideration of environmental variation
CN1308911C (en) Method and system for identifying status of speaker
CN1046366C (en) Discriminating between stationary and non-stationary signals
EP1207517A1 (en) Method for recognizing speech
CN1499484A (en) Recognition system of Chinese continuous speech

Legal Events

Date Code Title Description
AK Designated states

Kind code of ref document: A2

Designated state(s): AE AG AL AM AT AU AZ BA BB BG BR BW BY BZ CA CH CN CO CR CU CZ DE DK DM DZ EC EE EG ES FI GB GD GE GH GM HR HU ID IL IN IS JP KE KG KM KP KR KZ LC LK LR LS LT LU LV MA MD MG MK MN MW MX MZ NA NG NI NO NZ OM PG PH PL PT RO RU SC SD SE SG SK SL SM SY TJ TM TN TR TT TZ UA UG US UZ VC VN YU ZA ZM ZW

AL Designated countries for regional patents

Kind code of ref document: A2

Designated state(s): BW GH GM KE LS MW MZ NA SD SL SZ TZ UG ZM ZW AM AZ BY KG KZ MD RU TJ TM AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HU IE IS IT LT LU LV MC NL PL PT RO SE SI SK TR BF BJ CF CG CI CM GA GN GQ GW ML MR NE SN TD TG

121 Ep: the epo has been informed by wipo that ep was designated in this application
WWE Wipo information: entry into national phase

Ref document number: 2575373

Country of ref document: CA

NENP Non-entry into the national phase

Ref country code: DE

ENP Entry into the national phase

Ref document number: 0703020

Country of ref document: GB

Kind code of ref document: A

Free format text: PCT FILING DATE = 20050728

WWE Wipo information: entry into national phase

Ref document number: 0703020.8

Country of ref document: GB

WWE Wipo information: entry into national phase

Ref document number: 2005777492

Country of ref document: EP

WWP Wipo information: published in national office

Ref document number: 2005777492

Country of ref document: EP