WO1996017465A1 - Dynamic selection of voice compression rate in a voice data modem - Google Patents

Dynamic selection of voice compression rate in a voice data modem Download PDF

Info

Publication number
WO1996017465A1
WO1996017465A1 PCT/US1995/014826 US9514826W WO9617465A1 WO 1996017465 A1 WO1996017465 A1 WO 1996017465A1 US 9514826 W US9514826 W US 9514826W WO 9617465 A1 WO9617465 A1 WO 9617465A1
Authority
WO
WIPO (PCT)
Prior art keywords
data
voice
speech
segment
digital
Prior art date
Application number
PCT/US1995/014826
Other languages
French (fr)
Inventor
Raghu N. Sharma
Jeffrey P. Davis
Timothy D. Gunn
Ping Li
Sidhartha Maitra
Ashish A. Thanawala
Original Assignee
Multi-Tech Systems, Inc.
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Multi-Tech Systems, Inc. filed Critical Multi-Tech Systems, Inc.
Publication of WO1996017465A1 publication Critical patent/WO1996017465A1/en

Links

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L12/00Data switching networks
    • H04L12/64Hybrid switching systems
    • H04L12/6418Hybrid transport
    • GPHYSICS
    • G10MUSICAL INSTRUMENTS; ACOUSTICS
    • G10LSPEECH ANALYSIS OR SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING; SPEECH OR AUDIO CODING OR DECODING
    • G10L19/00Speech or audio signals analysis-synthesis techniques for redundancy reduction, e.g. in vocoders; Coding or decoding of speech or audio signals, using source filter models or psychoacoustic analysis
    • G10L19/04Speech or audio signals analysis-synthesis techniques for redundancy reduction, e.g. in vocoders; Coding or decoding of speech or audio signals, using source filter models or psychoacoustic analysis using predictive techniques
    • G10L19/06Determination or coding of the spectral characteristics, e.g. of the short-term prediction coefficients
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L27/00Modulated-carrier systems
    • H04L27/32Carrier systems characterised by combinations of two or more of the types covered by groups H04L27/02, H04L27/10, H04L27/18 or H04L27/26
    • H04L27/34Amplitude- and phase-modulated carrier systems, e.g. quadrature-amplitude modulated carrier systems
    • H04L27/3405Modifications of the signal space to increase the efficiency of transmission, e.g. reduction of the bit error rate, bandwidth, or average power
    • H04L27/3416Modifications of the signal space to increase the efficiency of transmission, e.g. reduction of the bit error rate, bandwidth, or average power in which the information is carried by both the individual signal points and the subset to which the individual points belong, e.g. using coset coding, lattice coding, or related schemes
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L65/00Network arrangements, protocols or services for supporting real-time applications in data packet communication
    • H04L65/60Network streaming of media packets
    • H04L65/75Media network packet handling
    • H04L65/762Media network packet handling at the source 
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L65/00Network arrangements, protocols or services for supporting real-time applications in data packet communication
    • H04L65/80Responding to QoS
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L9/00Cryptographic mechanisms or cryptographic arrangements for secret or secure communications; Network security protocols
    • H04L9/40Network security protocols
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04MTELEPHONIC COMMUNICATION
    • H04M1/00Substation equipment, e.g. for use by subscribers
    • H04M1/247Telephone sets including user guidance or feature selection means facilitating their use
    • H04M1/2473Telephone terminals interfacing a personal computer, e.g. using an API (Application Programming Interface)
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04MTELEPHONIC COMMUNICATION
    • H04M1/00Substation equipment, e.g. for use by subscribers
    • H04M1/247Telephone sets including user guidance or feature selection means facilitating their use
    • H04M1/2477Telephone sets including user guidance or feature selection means facilitating their use for selecting a function from a menu display
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04MTELEPHONIC COMMUNICATION
    • H04M1/00Substation equipment, e.g. for use by subscribers
    • H04M1/253Telephone sets using digital voice transmission
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04MTELEPHONIC COMMUNICATION
    • H04M1/00Substation equipment, e.g. for use by subscribers
    • H04M1/60Substation equipment, e.g. for use by subscribers including speech amplifiers
    • H04M1/6033Substation equipment, e.g. for use by subscribers including speech amplifiers for providing handsfree use or a loudspeaker mode in telephone sets
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04MTELEPHONIC COMMUNICATION
    • H04M11/00Telephonic communication systems specially adapted for combination with other electrical systems
    • H04M11/06Simultaneous speech and data transmission, e.g. telegraphic transmission over the same conductors
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04MTELEPHONIC COMMUNICATION
    • H04M11/00Telephonic communication systems specially adapted for combination with other electrical systems
    • H04M11/06Simultaneous speech and data transmission, e.g. telegraphic transmission over the same conductors
    • H04M11/068Simultaneous speech and data transmission, e.g. telegraphic transmission over the same conductors using time division multiplex techniques
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04MTELEPHONIC COMMUNICATION
    • H04M3/00Automatic or semi-automatic exchanges
    • H04M3/42Systems providing special services or facilities to subscribers
    • H04M3/50Centralised arrangements for answering calls; Centralised arrangements for recording messages for absent or busy subscribers ; Centralised arrangements for recording messages
    • H04M3/53Centralised arrangements for recording incoming messages, i.e. mailbox systems
    • H04M3/5307Centralised arrangements for recording incoming messages, i.e. mailbox systems for recording messages comprising any combination of audio and non-audio components
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04MTELEPHONIC COMMUNICATION
    • H04M3/00Automatic or semi-automatic exchanges
    • H04M3/42Systems providing special services or facilities to subscribers
    • H04M3/50Centralised arrangements for answering calls; Centralised arrangements for recording messages for absent or busy subscribers ; Centralised arrangements for recording messages
    • H04M3/53Centralised arrangements for recording incoming messages, i.e. mailbox systems
    • H04M3/533Voice mail systems
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04MTELEPHONIC COMMUNICATION
    • H04M3/00Automatic or semi-automatic exchanges
    • H04M3/42Systems providing special services or facilities to subscribers
    • H04M3/56Arrangements for connecting several subscribers to a common circuit, i.e. affording conference facilities
    • H04M3/567Multimedia conference systems
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04MTELEPHONIC COMMUNICATION
    • H04M7/00Arrangements for interconnection between switching centres
    • H04M7/12Arrangements for interconnection between switching centres for working between exchanges having different types of switching equipment, e.g. power-driven and step by step or decimal and non-decimal
    • H04M7/1205Arrangements for interconnection between switching centres for working between exchanges having different types of switching equipment, e.g. power-driven and step by step or decimal and non-decimal where the types of switching equipement comprises PSTN/ISDN equipment and switching equipment of networks other than PSTN/ISDN, e.g. Internet Protocol networks
    • H04M7/128Details of addressing, directories or routing tables
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04MTELEPHONIC COMMUNICATION
    • H04M7/00Arrangements for interconnection between switching centres
    • H04M7/12Arrangements for interconnection between switching centres for working between exchanges having different types of switching equipment, e.g. power-driven and step by step or decimal and non-decimal
    • H04M7/1205Arrangements for interconnection between switching centres for working between exchanges having different types of switching equipment, e.g. power-driven and step by step or decimal and non-decimal where the types of switching equipement comprises PSTN/ISDN equipment and switching equipment of networks other than PSTN/ISDN, e.g. Internet Protocol networks
    • H04M7/1295Details of dual tone multiple frequency signalling
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N1/00Scanning, transmission or reproduction of documents or the like, e.g. facsimile transmission; Details thereof
    • H04N1/00127Connection or combination of a still picture apparatus with another apparatus, e.g. for storage, processing or transmission of still picture signals or of information associated with a still picture
    • H04N1/00204Connection or combination of a still picture apparatus with another apparatus, e.g. for storage, processing or transmission of still picture signals or of information associated with a still picture with a digital computer or a digital computer system, e.g. an internet server
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N1/00Scanning, transmission or reproduction of documents or the like, e.g. facsimile transmission; Details thereof
    • H04N1/00127Connection or combination of a still picture apparatus with another apparatus, e.g. for storage, processing or transmission of still picture signals or of information associated with a still picture
    • H04N1/00204Connection or combination of a still picture apparatus with another apparatus, e.g. for storage, processing or transmission of still picture signals or of information associated with a still picture with a digital computer or a digital computer system, e.g. an internet server
    • H04N1/00206Transmitting or receiving computer data via an image communication device, e.g. a facsimile transceiver
    • GPHYSICS
    • G10MUSICAL INSTRUMENTS; ACOUSTICS
    • G10LSPEECH ANALYSIS OR SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING; SPEECH OR AUDIO CODING OR DECODING
    • G10L19/00Speech or audio signals analysis-synthesis techniques for redundancy reduction, e.g. in vocoders; Coding or decoding of speech or audio signals, using source filter models or psychoacoustic analysis
    • G10L19/04Speech or audio signals analysis-synthesis techniques for redundancy reduction, e.g. in vocoders; Coding or decoding of speech or audio signals, using source filter models or psychoacoustic analysis using predictive techniques
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L12/00Data switching networks
    • H04L12/64Hybrid switching systems
    • H04L12/6418Hybrid transport
    • H04L2012/6424Access arrangements
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L12/00Data switching networks
    • H04L12/64Hybrid switching systems
    • H04L12/6418Hybrid transport
    • H04L2012/6424Access arrangements
    • H04L2012/6427Subscriber Access Module; Concentrator; Group equipment
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L12/00Data switching networks
    • H04L12/64Hybrid switching systems
    • H04L12/6418Hybrid transport
    • H04L2012/6445Admission control
    • H04L2012/6459Multiplexing, e.g. TDMA, CDMA
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L12/00Data switching networks
    • H04L12/64Hybrid switching systems
    • H04L12/6418Hybrid transport
    • H04L2012/6475N-ISDN, Public Switched Telephone Network [PSTN]
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L12/00Data switching networks
    • H04L12/64Hybrid switching systems
    • H04L12/6418Hybrid transport
    • H04L2012/6481Speech, voice
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L12/00Data switching networks
    • H04L12/64Hybrid switching systems
    • H04L12/6418Hybrid transport
    • H04L2012/6491Echo cancellation
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L12/00Data switching networks
    • H04L12/64Hybrid switching systems
    • H04L12/6418Hybrid transport
    • H04L2012/6494Silence suppression
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L65/00Network arrangements, protocols or services for supporting real-time applications in data packet communication
    • H04L65/1066Session management
    • H04L65/1101Session protocols
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04MTELEPHONIC COMMUNICATION
    • H04M2203/00Aspects of automatic or semi-automatic exchanges
    • H04M2203/45Aspects of automatic or semi-automatic exchanges related to voicemail messaging
    • H04M2203/4509Unified messaging with single point of access to voicemail and other mail or messaging systems
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04MTELEPHONIC COMMUNICATION
    • H04M3/00Automatic or semi-automatic exchanges
    • H04M3/002Applications of echo suppressors or cancellers in telephonic connections
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04MTELEPHONIC COMMUNICATION
    • H04M7/00Arrangements for interconnection between switching centres
    • H04M7/006Networks other than PSTN/ISDN providing telephone service, e.g. Voice over Internet Protocol (VoIP), including next generation networks with a packet-switched transport layer

Definitions

  • the present invention relates to communications systems and in particular to modem communications having simultaneous digitized voice and data capabilities.
  • Simultaneous voice and modem data transmitted over the same communications link between two sites has been accomplished in several ways.
  • the most common communications link used between two sites is the telephone line.
  • the most common data handling equipment to communicate over a communications link is the computer modem which modulates digital data onto a carrier for transmission in the voice band of the telephone line.
  • a wide variety of modulation standards have been promulgated by such international groups as the CCITT for communication in the voice band.
  • the data bandwidth for such modulation standards is typically fixed and the throughput rate of data is also assumed to be fixed.
  • a 9600 baud modulation rate may have such a high bit error rate that the modulation must be changed to a 2400 baud connection. This is done in a handshake communication protocol between the two sites when the communications link simply cannot support the higher rate.
  • the present invention solves the aforementioned problems and shortcoming of the existing art and solves other problems not listed above which will become apparent to those skilled in the art upon reading and understanding the present specification and claims.
  • the present invention describes a voice over data modem which allows the operator to simultaneously transmit voice and data communication to a remote site.
  • This voice over data function dynamically allocates data bandwidth over the telephone line depending on the demands of the voice grade digitized signal and the modulation speed of the communication link between the two sites.
  • the present invention includes software and hardware components to enable digital data communication over standard telephone lines.
  • the present invention converts analog voice signals to digital data, compresses that data and places the compressed speech data into packets for transfer over the telephone lines to a remote site.
  • a voice control digital signal processor operates to use one of a plurality of speech compression algorithms which produce a scaleable amount of compression.
  • the rate of compression is inversely proportional to the qualin of the speech the compression algorithm is able to reproduce. The higher the compression, the lower the reproduction quality.
  • the selection of the rate of compression is dependant on such factors as the speed or data bandwidth on the communications connection between the two sites, the data demand between the sites and amount of silence detected in the speech signal.
  • the voice compression rate is dynamically changed as the aforementioned factors change.
  • a negotiation handshake protocol is described which enables the two sites to negotiate the compression rate based on such factors.
  • Figure 1 shows the telecommunications environment within which the present may operate in several of the possible modes of communication
  • FIG. 2 is a block diagram of the hardware components of the present system
  • FIG. 3 is a detailed function flow diagram of the speech compression algorithm
  • Figure 4 is a detailed function flow diagram of the speech decompression algorithm
  • Figure 5 is a signal flow diagram of the speech compression algorithm
  • Figure 6 is a signal flow diagram of the speech compression algorithm showing details of the code book synthesis.
  • Figure 7 is a detailed function flow diagram of the voice/data multiplexing function.
  • Figure 1 shows a typical arrangement for the use of the present system.
  • Personal computer 10 is running the software components of the present system while the hardware components 20 include the data communication equipment and telephone headset.
  • Hardware components 20 communicate over a standard telephone line 30 to one of a variety of remote sites.
  • One of the remote sites may be equipped with the present system including hardware components 20a and software components running on personal computer 10a.
  • the local hardware components 20 may be communicating over standard telephone line 30 to facsimile machine 60.
  • the present system may be communicating over a standard telephone line 30 to another personal computer 80 through a remote modem 70.
  • the present system may be communicating over a standard telephone line 30 to a standard telephone 90.
  • the present inventions are embodied in a commercial product by the assignee, Multi-Tech Systems, Inc.
  • the software component operating on a personal computer is sold under the commercial trademark of MultiExpressPCSTM personal communications software while the hardware component of the present system is sold under the commercial name of MultiModemPCSTM, Intelligent Personal Communications System Modem.
  • the software component runs under Microsoft* WindowsTM however those skilled in the art will readily recognize that the present system is easily adaptable to run under any single or multi-user, single or multi-window operating system.
  • the present system is a multifunction communication system which includes hardware and software components.
  • the system allows the user to connect to remote locations equipped with a similar system or with modems, facsimile machines or standard telephones over a single analog telephone line.
  • the software component of the present system includes a number of modules which are described in more detail below.
  • the telephone module allows the system to operate as a conventional or sophisticated telephone system.
  • the system converts voice into a digital signal so that it can be transmitted or stored with other digital data, like computer information.
  • the telephone function supports PBX and Centrex features such a call waiting, call forwarding, caller ID and three-way calling.
  • This module also allows the user to mute, hold or record a conversation.
  • the telephone module enables the handset, headset or hands- free speaker telephone operation of the hardware component. It includes on ⁇ screen push button dialing, speed-dial of stored numbers and digital recording of two-way conversations.
  • the voice mail portion of the present system allows this system to operate as a telephone answering machine by storing voice messages as digitized voice files along with a time/date voice stamp.
  • the digitized voice files can be saved and sent to one or more destinations immediately or at a later time using a queue scheduler.
  • the user can also listen to, forward or edit the voice messages which have been received with a powerful digital voice editing component of the present system.
  • This module also creates queues for outgoing messages to be sent at preselected times and allows the users to create outgoing messages with the voice editor.
  • the fax manager portion of the present system is a queue for incoming and outgoing facsimile pages. In the preferred embodiment of the present system, this function is tied into the Windows "print" command once the present system has been installed.
  • This feature allows the user to create faxes from any Windows -based document that uses the "print" command.
  • the fax manager function of the present system allows the user to view queued faxes which are to be sent or which have been received.
  • This module creates queues for outgoing faxes to be sent at preselected times and logs incoming faxes with time/date stamps.
  • the multi-media mail function of the present system is a utility which allows the user to compose documents that include text, graphics and voice messages using the message composer function of the present system, described more fully below.
  • the multi-media mail utility of the present system allows the user to schedule messages for transmittal and queues up the messages that have been received so that can be viewed at a later time.
  • the show and tell function of the present system allows the user to establish a data over voice (DOV) communications session. When the user is transmitting data to a remote location similarly equipped, the user is able to talk to the person over the telephone line while concurrently transferring the data This voice over data function is accomplished in the hardware components of the present system.
  • DOV data over voice
  • the terminal function of the present system allows the user to establish a data communications session with another computer which is equipped with a modem but which is not equipped with the present system.
  • This feature of the present system is a WindowsTM-based data communications program that reduces the need for issuing "AT' commands by providing menu driven and "pop-up" window alternatives.
  • the address book function of the present system is a database that is accessible from all the other functions of the present system. This database is created by the user inputting destination addresses and telephone numbers for data communication, voice mail, facsimile transmission, modem communication and the like.
  • the address book function of the present system may be utilized to broadcast communications to a wide variety of recipients. Multiple linked databases have separate address books for different groups and different destinations may be created by the users.
  • the address book function includes a textual search capability which allows fast and efficient location of specific addresses as described more fully below.
  • FIG. 2 is a block diagram of the hardware components of the present system corresponding to reference number 20 of Figure 1. These components form the link between the user, the personal computer running the software component of the present system and the telephone line interface. As will be more fully described below, the interface to the hardware components of the present system is via a serial communications port connected to the personal computer.
  • the interface protocol is well ordered and defined such that other software systems or programs running on the personal computer may be designed and implemented which would be capable of controlling the hardware components shown in Figure 2 by using the control and communications protocol defined below.
  • three alternate telephone interfaces are available: the telephone handset 301, a telephone headset 302, and a hands-free microphone 303 and speaker 304.
  • the three alternative interfaces connect to the digital telephone coder-decoder (CODEC) circuit 305.
  • the digital telephone CODEC circuit 305 interfaces with the voice control digital signal processor (DSP) circuit 306 which includes a voice control DSP and CODEC.
  • DSP voice control digital signal processor
  • This circuit does digital to analog (D/A) conversion, analog to digital (A/D) conversion, coding/decoding, gain control and is the interface between the voice control DSP circuit 306 and the telephone interface.
  • the CODEC of the voice control circuit 306 transfers digitized voice information in a compressed format to multiplexor circuit 310 to analog telephone line interface 309.
  • the CODEC of the voice control circuit 306 is actually an integral component of a voice control digital signal processor integrated circuit, as described more fiilly below.
  • the voice control DSP of circuit 306 controls the digital telephone CODEC circuit 305, performs voice compression and echo cancellation.
  • MUX Multiplexor
  • the data pump circuit 311 also includes a digital signal processor (DSP) and a CODEC for communicating over the telephone line interface 309 through MUX circuit 310.
  • DSP digital signal processor
  • CODEC CODEC
  • the data pump DSP and CODEC of circuit 311 performs functions such as modulation, demodulation and echo cancellation to communicate over the telephone line interface 309 using a plurality of telecommunications standards including FAX and modem protocols.
  • the main controller circuit 313 controls the DSP data pump circuit 311 and the voice control DSP circuit 306 through serial input/output and clock timer control (SIO/CTC) circuits 312 and dual port RAM circuit 308 respectively.
  • the main controller circuit 313 communicates with the voice control DSP 306 through dual port RAM circuit 308. In this fashion digital voice data can be read and written simultaneously to the memory portions of circuit 308 for high speed communication between the user (through interfaces 301, 302 or 303/304) and the personal computer connected to serial interface circuit 315 and the remote telephone connection connected through the telephone line attached to line interface circuit 309.
  • the main controller circuit 313 includes, in the preferred embodiment, a microprocessor which controls the functions and operation of all of the hardware components shown in Figure 2.
  • the main controller is connected to RAM circuit 316 and an programmable and electrically erasable read only memory (EEPROM) circuit 317.
  • EEPROM programmable and electrically erasable read only memory
  • the EEPROM circuit 317 includes non-volatile memory in which the executable control programs for the voice control DSP circuits 306 and the main controller circuits 313 operate.
  • the RS232 serial interface circuit 315 communicates to the serial port of the personal computer which is running the software components of the present system.
  • the RS232 serial interface circuit 315 is connected to a serial input/output circuit 314 with main controller circuit 313.
  • SIO circuit 314 is in the preferred embodiment, a part of SIO/CTC circuit 312. Functional Operation of the Hardware Components Referring once again to Figure 2, the multiple and selectable functions described in conjunction with Figure 2 are all implemented in the hardware components of Figure 2. Each of these functions will be discussed in turn.
  • the telephone function 115 is implemented by the user either selecting a telephone number to be dialed from the address book 127 or manually selecting the number through the telephone menu on the personal computer.
  • the telephone number to be dialed is downloaded from the personal computer over the serial interface and received by main controller 313.
  • Main controller 313 causes the data pump DSP circuit 311 to seize the telephone line and transmit the DTMF tones to dial a number.
  • DSP 306 receives commands from the personal computer via main controller 313 to configure the digital telephone CODEC circuit 305 to enable either the handset 301 operation, the microphone 303 and speaker 304 operation or the headset 302 operation.
  • a telephone connection is established through the telephone line interface circuit 309 and communication is enabled.
  • the user's analog voice is transmitted in an analog fashion to the digital telephone CODEC 305 where it is digitized.
  • the digitized voice patterns are passed to the voice control circuit 306 where echo cancellation is accomplished, the digital voice signals are reconstructed into analog signals and passed through multiplexor circuit 310 to the telephone line interface circuit 309 for analog transmission over the telephone line.
  • the incoming analog voice from the telephone connection through telephone connection circuit 309 is passed to the integral CODEC of the voice control circuit 306 where it is digitized.
  • the digitized incoming voice is then passed to digital telephone CODEC circuit 305 where it is reconverted to an analog signal for transmission to the selected telephone interface (either the handset 301, the microphone/speaker 303/304 or the headset 302).
  • Voice Control DSP circuit 306 is programmed to perform echo cancellation to avoid feedback and echoes between transmitted and received signals, as is more fiilly described below.
  • voice messages may be stored for later transmission or the present system may operate as an answering machine receiving incoming messages.
  • the telephone interface is used to send the analog speech patterns to the digital telephone CODEC circuit 305.
  • Circuit 305 digitizes the voice patterns and passes them to voice control circuit 306 where the digitized voice patterns are digitally compressed.
  • the digitized and compressed voice patterns are passed through dual port ram circuit 308 to the main controller circuit 313 where they are transferred through the serial interface to the personal computer using a packet protocol defined below.
  • the voice patterns are then stored on the disk of the personal computer for later use in multi ⁇ media mail, for voice mail, as a pre-recorded answering machine message or for later predetermined transmission to other sites.
  • the hardware components of Figure 2 are placed in answer mode.
  • An incoming telephone ring is detected through the telephone line interface circuit 309 and the main controller circuit 313 is alerted which passes the information off to the personal computer through the RS232 serial interface circuit 315.
  • the telephone line interface circuit 309 seizes the telephone line to make the telephone connection.
  • a pre-recorded message may be sent by the personal computer as compressed and digitized speech through the RS232 interface to the main controller circuit 313.
  • the compressed and digitized speech from the personal computer is passed from main controller circuit 313 through dual port ram circuit 308 to the voice control DSP circuit 306 where it is uncompressed and converted to analog voice patterns.
  • These analog voice patterns are passed through multiplexor circuit 310 to the telephone line interface 309 for transmission to the caller. Such a message may invite the caller to leave a voice message at the sound of a tone.
  • the incoming voice messages are received through telephone line interface 309 and passed to voice control circuit 306.
  • the analog voice patterns are digitized by the integral CODEC of voice control circuit 306 and the digitized voice patterns are compressed by the voice control DSP of the voice control circuit 306.
  • the digitized and compressed speech patterns are passed through dual port ram circuit 308 to the main controller circuit 313 where they are transferred using packet protocol described below through the RS232 serial interface 315 to the personal computer for storage and later retrieval.
  • the hardware components of Figure 2 operate as a transmit and receive voice mail system for implementing the voice mail function 117 of the present system.
  • the hardware components of Figure 2 may also operate to facilitate the fax manager function 119 of Figure 2.
  • fax receive mode an incoming telephone call will be detected by a ring detect circuit of the telephone line interface 309 which will alert the main controller circuit 313 to the incoming call.
  • Main controller circuit 313 will cause line interface circuit 309 to seize the telephone line to receive the call.
  • Main controller circuit 313 will also concurrently alert the operating programs on the personal computer through the RS232 interface using the packet protocol described below.
  • a fax carrier tone is transmitted and a return tone and handshake is received from the telephone line and detected by the data pump circuit 311.
  • the reciprocal transmit and receipt of the fax tones indicates the imminent receipt of a facsimile transmission and the main controller circuit 313 configures the hardware components of Figure 2 for the receipt of that information.
  • the necessary handshaking with the remote facsimile machine is accomplished through the data pump 311 under control of the main controller circuit 313.
  • the incoming data packets of digital facsimile data are received over the telephone line interface and passed through data pump circuit 311 to main controller circuit 313 which forwards the information on a packet basis (using the packet protocol described more fully below) through the serial interface circuit 315 to the personal computer for storage on disk.
  • the FAX data could be transferred from the telephone line to the personal computer using the same path as the packet transfer except using the normal AT stream mode.
  • the incoming facsimile is automatically received and stored on the personal computer through the hardware components of Figure 2.
  • a facsimile transmission is also facilitated by the hardware components of Figure 2.
  • the transmission of a facsimile may be immediate or queued for later transmission at a predetermined or preselected time.
  • Control packet information to configure the hardware components to send a facsimile are sent over the RS232 serial interface between the personal computer and the hardware components of Figure 2 and are received by main controller circuit 313.
  • the data pump circuit 311 then dials the recipient's telephone number using DTMF tones or pulse dialing over the telephone line interface circuit 309.
  • a multimedia transmission consists of a combination of picture information, digital data and digitized voice information.
  • the type of multimedia information transferred to a remote site using the hardware components of Figure 2 could be the multimedia format of the Microsoft ® Multimedia Wave ® format with the aid of an Intelligent Serial Interface (ISI) card added to the personal computer.
  • the multimedia may also be the type of multimedia information assembled by the software component of the present system which is described more fully below.
  • the multimedia package of information including text, graphics and voice messages may be transmitted or received through the hardware components shown in Figure 2.
  • the transmission of a multimedia document through the hardware components of Figure 2 is accomplished by transferring the multimedia digital information using the packet protocol described below over the RS232 serial interface between the personal computer and the serial line interface circuit 315.
  • the packets are then transferred through main controller circuit 313 through the data pump circuit 311 on to the telephone line for receipt at a remote site through telephone line interface circuit 309.
  • the multimedia documents received over the telephone line from the remote site are received at the telephone line interface circuit 309, passed through the data pump circuit 311 for receipt and forwarding by the main controller circuit 313 over the serial line interface circuit 315.
  • the show and tell function 123 of the present system allows the user to establish a data over voice communication session. In this mode of operation, full duplex data transmission may be accomplished simultaneously with the voice communication between both sites. This mode of operation assumes a like- configured remote site.
  • the hardware components of the present system also include a means for sending voice/data over cellular links.
  • the protocol used for transmitting multiplexed voice and data include a supervisory packet described more fully below to keep the link established through the cellular link. This supervisory packet is an acknowledgement that the link is still up.
  • the supervisory packet may also contain link information to be used for adjusting various link parameters when needed.
  • This supervisory packet is sent every second when data is not being sent and if the packet is not acknowledged after a specified number of attempts, the protocol would then give an indication that the cellular link is down and then allow the modem to take action.
  • the action could be for example; change speeds, retrain, or hang up.
  • the use of supervisory packets is a novel method of maintaining inherently intermittent cellular links when transmitting multiplexed voice and data.
  • the voice portion of the voice over data transmission of the show and tell function is accomplished by receiving the user's voice through the telephone interface 301, 302 or 303 and the voice information is digitized by the digital telephone circuit 305.
  • the digitized voice information is passed to the voice control circuit 306 where the digitized voice information is compressed using a voice compression algorithm described more fully below.
  • the digitized and compressed voice information is passed through dual port RAM circuit 308 to the main controller circuit 313.
  • a quiet flag is passed from voice control circuit 306 to the main controller 313 through a packet transfer protocol described below by a dual port RAM circuit 308.
  • main controller circuit 313 in the show and tell function of the present system must efficiently and effectively combine the digitized voice information with the digital information for transmission over the telephone line via telephone line interface circuit 309.
  • main controller circuit 313 dynamically changes the amount of voice information and digital information transmitted at any given period of time depending upon the quiet times during the voice transmissions. For example, during a quiet moment where there is no speech information being transmitted, main controller circuit 313 ensures that a higher volume of digital data information be transmitted over the telephone line interface in lieu of digitized voice information.
  • the packets of digital data transmitted over the telephone line interface with the transmission packet protocol described below requires 100 percent accuracy in the transmission of the digital data, but a lesser standard of accuracy for the transmission and receipt of the digitized voice information. Since digital information must be transmitted with 100 percent accuracy, a corrupted packet of digital information received at the remote site must be re-transmitted. A retransmission signal is communicated back to the local site and the packet of digital information which was corrupted during transmission is retransmitted. If the packet transmitted contained voice data, however, the remote site uses the packets whether they were corrupted or not as long as the packet header was intact. If the header is corrupted, the packet is discarded.
  • the voice information may be corrupted without requesting retransmission since it is understood that the voice information must be transmitted on a real time basis and the corruption of any digital information of the voice signal is not critical. In contrast to this the transmission of digital data is critical and retransmission of corrupted data packets is requested by the remote site.
  • the transmission of the digital data follows the CCITT V.42 standard, as is well known in the industry and as described in the CCITT Blue Book, volume VIII entitled Data Communication over the Telephone Network, 1989.
  • the voice data packet information also follows the CCITT V.42 standard, but uses a different header format so the receiving site recognizes the difference between a data packet and a voice packet.
  • the voice packet is distinguished from a data packet by using undefined bits in the header (80 hex) of the V.42 standard.
  • the packet protocol for voice over data transmission during the show and tell function of the present system is described more fully below.
  • incoming data packets and incoming voice packets are received by the hardware components of Figure 2.
  • the incoming data packets and voice packets are received through the telephone line interface circuit 309 and passed to the main controller circuit 313 via data pump DSP circuit 311.
  • the incoming data packets are passed by the main controller circuit 313 to the serial interface circuit 315 to be passed to the personal computer.
  • the incoming voice packets are passed by the main controller circuit 313 to the dual port RAM circuit 308 for receipt by the voice control DSP circuit 306.
  • the voice packets are decoded and the compressed digital information therein is uncompressed by the voice control DSP of circuit 306.
  • the uncompressed digital voice information is passed to digital telephone CODEC circuit 305 where it is reconverted to an analog signal and retransmitted through the telephone line interface circuits. In this fashion full-duplex voice and data transmission and reception is accomplished through the hardware components of Figure 2 during the show and tell functional operation of the present system.
  • Terminal operation 125 of the present system is also supported by the hardware components of Figure 2.
  • Terminal operation means that the local personal computer simply operates as a "dumb" terminal including file transfer capabilities. Thus no local processing takes place other than the handshaking protocol required for the operation of a dumb terminal.
  • the remote site is assumed to be a modem connected to a personal computer but the remote site is not necessarily a site which is configured according to the present system.
  • the command and data information from personal computer is transferred over the RS232 serial interface circuit 315, forwarded by main controller circuit 313 to the data pump circuit 311 where the data is placed on the telephone line via telephone line interface circuit 309.
  • data is received from the telephone line over telephone line interface circuit 309 and simply forwarded by the data pump circuit 311, the main controller circuit 313 over the serial line interface circuit 315 to the personal computer.
  • the address book function of the present system is primarily a support function for providing telephone numbers and addresses for the other various functions of the present system.
  • a special packet protocol is used for communication between the hardware components 20 and the personal computer (PC) 10.
  • the protocol is used for transferring different types of information between the two devices such as the transfer of DATA, VOICE, and QUALIFIED information.
  • the protocol also uses the BREAK as defined in CCITT X28 as a means to maintain protocol synchronization. A description of this BREAK sequence is also described in the Statutory Invention Registration entitled
  • the protocol has two modes of operation. One mode is packet mode and the other is stream mode.
  • the protocol allows mixing of different types of information into the data stream without having to physically switch modes of operation.
  • the hardware component 20 will identify the packet received from the computer 10 and perform the appropriate action according to the specifications of the protocol. If it is a data packet, then the controller 313 of hardware component 20 would send it to the data pump circuit 311. If the packet is a voice packet, then the controller 313 of hardware component 20 would distribute that information to the Voice DSP 306. This packet transfer mechanism also works in the reverse, where the controller 313 of hardware component 20 would give different information to the computer 10 without having to switch into different modes.
  • the packet protocol also allows commands to be sent to either the main controller 313 directly or to the Voice DSP 306 for controlling different options without having to enter a command state.
  • Packet mode is made up of 8 bit asynchronous data and is identified by a beginning synchronization character (01 hex) followed by an ID/LI character and then followed by the information to be sent.
  • ID/LI character codes defined below, those skilled in the art will readily recognize that other ID/LI character codes could be defined to allow for additional types of packets such as video data, or alternate voice compression algorithm packets such as Codebook Excited Linear Predictive Coding (CELP) algorithm, GSM, RPE, VSELP, etc.
  • CELP Codebook Excited Linear Predictive Coding
  • Stream mode is used when large amounts of one type of packet (VOICE, DATA, or QUALIFIED) is being sent.
  • the transmitter tells the receiver to enter stream mode by a unique command. Thereafter, the transmitter tells the receiver to terminate stream mode by using the BREAK command followed by an "AT' type command.
  • the command used to terminate the stream mode can be a command to enter another type of stream mode or it can be a command to enter back into packet mode.
  • a Data Packet is shown in Table 1 and is used for normal data transfer between the controller 313 of hardware component 20 and the computer 10 for such things as text, file transfers, binary data and any other type of information presently being sent through modems. All packet transfers begin with a synch character 01 hex (synchronization byte). The Data Packet begins with an ID byte which specifies the packet type and packet length. Table 3 describes the Data Packet byte structure and Table 4 describes the bit structure of the ID byte of the Data Packet. Table 5 is an example of a Data Packet with a byte length of 6. The value of the LI field is the actual length of the data field to follow, not counting the ID byte. TABLE 3: Data Packet Byte Structure
  • ID Byte of Data Packet Bit 7 identifies the type of packet
  • Bits 6 - 0 contain the LI or length indicator portion of the ID byte
  • the Voice Packet is used to transfer compressed VOICE messages between the controller 313 of hardware component 20 and the computer 10.
  • the Voice Packet is similar to the Data Packet except for its length which is, in the preferred embodiment, currently fixed at 23 bytes of data. Once again, all packets begin with a synchronization character chosen in the preferred embodiment to be 01 hex (01H).
  • the ID byte of the Voice Packet is completely a zero byte: all bits are set to zero.
  • Table 6 shows the ID byte of the Voice Packet and Table 7 shows the Voice Packet byte structure. TABLE 6: ID Byte of Voice Packet
  • LI (length indicator) 0 23 bytes of data (depending upon compression algorithm used)
  • the Qualified Packet is used to transfer commands and other non-data/voice related information between the controller 313 of hardware component 20 and the computer 10.
  • the various species or types of the Qualified Packets are described below and are listed above in Table 2.
  • all packets start with a synchronization character chosen in the preferred embodiment to be 01 hex (01H).
  • a Qualified Packet starts with two bytes where the first byte is the ID byte and the second byte is the QUALIFIER type identifier.
  • Table 8 shows the ID byte for the Qualified Packet
  • Table 9 shows the byte structure of the Qualified Packet
  • Tables 10-12 list the Qualifier Type byte bit maps for the three types of Qualified Packets. TABLE 8 : ID Byte of Qualified Packet
  • the bit maps of the Qualifier Byte (QUAL BYTE) of the Qualified Packet are shown in Tables 10-12.
  • Table 10 describes the Qualifier Byte of Qualified Packet, Group 1 which are immediate commands.
  • Table 11 describes the Qualifier Byte of Qualified Packet, Group 2 which are stream mode commands in that the command is to stay in the designated mode until a BREAK + INIT command string is sent.
  • Table 12 describes the Qualifier Byte of Qualified Packet, Group 3 which are information or status commands.
  • the Qualifier Packet indicating stream mode and BREAK attention is used when a large of amount of information is sent (voice, data%) to allow the highest throughput possible.
  • This command is mainly intended for use in DATA mode but can be used in any one of the possible modes.
  • a break "AT... ⁇ cr>" type command would cause a change in state and set the serial rate from the "AT” command.
  • a supervisory packet shown in Table 13 is used. Both sides of the cellular link will send the cellular supervisory packet every 3 seconds. Upon receiving the cellular supervisory packet, the receiving side will acknowledge it using the ACK field of the cellular supervisory packet. If the sender does not receive an acknowledgement within one second, it will repeat sending the cellular supervisory packet up to 12 times. After 12 attempts of sending the cellular supervisory packet without an acknowledgement, the sender will disconnect the line. Upon receiving an acknowledgement the sender will restart its 3 second timer. Those skilled in the art will readily recognize that the timer values and wait times selected here may be varied without departing from the spirit or scope of the present invention.
  • Speech Compression The Speech Compression algorithm described above for use in transmitting voice over data accomplished via the voice control circuit 306.
  • the user is talking either through the handset, the headset or the microphone speaker telephone interface.
  • the analog voice signals are received and digitized by the telephone CODEC circuit 305.
  • the digitized voice information is passed from the digital 746S PCMJS95/14826
  • the digital signal processor (DSP) of the voice control circuit 306 is programmed to do the voice compression algorithm.
  • the source code programmed into the voice control DSP is in the microfiche appendix of U.S. Patent Application Serial No. 08/002,467, filed January 8, 1993 entitled "COMPUTER-BASED MUL ⁇ FUNC ⁇ ON PERSONAL COMMUNICATIONS SYSTEM'.
  • the DSP of the voice control circuit 306 compresses the speech and places the compressed digital representations of the speech into special packets described more fully below.
  • the compressed voice information is passed to the dual port ram circuit 308 for either forwarding and storage on the disk of the personal computer via the RS232 serial interface or for multiplexing with conventional modem data to be transmitted over the telephone line via the telephone line interface circuit 309 in the voice-over-data mode of operation Show and Tell function 123.
  • the compressed speech bits are multiplexed with data bits using a packet format described below. Three compression rates are described herein which will be called 8Kbit/sec, 9.6Kbit sec and 16Kbit sec.
  • Speech Compression Algorithm To multiplex high-fidelity speech with digital data and transmit both over the telephone line, a high available bandwidth would normally be required.
  • the analog voice information is digitized into 8-bit PCM data at an 8 KHz sampling rate producing a serial bit stream of 64,000 bps serial data rate. This rate cannot be transmitted over the telephone line.
  • the 64 Kbs digital voice data is compressed into a 9500 bps encoding bit stream using a fixed-point (non-floating point) DSP such that the compressed speech can be transmitted over the telephone line multiplexed with asynchronous data This is accomplished in an efficient manner such that enough machine cycles remain during real time speech compression to allow to allow for echo cancellation in the same fixed-point DSP.
  • a silence detection function is used to detect quiet intervals in the speech signal which allows the data processor to substitute asynchronous data in lieu of voice data packets over the telephone line to efficiently time multiplex the voice and asynchronous data transmission.
  • the allocation of time for asynchronous data transmission is constantly changing depending on how much silence is on the voice channel.
  • the voice compression algorithm of the present system relies on a model of human speech which shows that human speech contains redundancy inherent in the voice patterns. Only the incremental innovations (changes) need to be transmitted.
  • the algorithm operates on 128 digitized speech samples (20 milliseconds at 6400 Hz), divides the speech samples into time segments of 32 samples (5 milliseconds) each, and uses predicted coding on each segment.
  • the input to the algorithm could be either PCM data sampled at 6400 Hz or 8000 Hz. If the sampling is at 8000 Hz, or any other selected sampling rate, the input sample data stream must be decimated from 8000 Hz to 6400 Hz before processing the speech data. At the output, the 6400 Hz PCM signal is interpolated back to 8000 Hz and passed to the CODEC.
  • the present system includes a unique Vector Quantization (VQ) speech compression algorithm designed to provide maximum fidelity with minimum compute power and bandwidth.
  • VQ Vector Quantization
  • FIG. 3 is a high level signal flow block diagram of the speech compression algorithm used in the present system to compress the digitized voice for transmission over the telephone line in the voice over data mode of operation or for storage and use on the personal computer.
  • the transmitter and receiver components are implemented using the programniable voice control DSP/CODEC circuit 306 shown in Figure 2.
  • the DC removal stage 1101 receives the digitized speech signal and removes the D.C. bias by calculating the long-term average and subtracting it from each sample. This ensures that the digital samples of the speech are centered about a zero mean value.
  • the pre-emphasis stage 1103 whitens the spectral content of the speech signal by balancing the extra energy in the low band with the reduced energy in the high band.
  • the system finds the innovation in the current speech segment by subtracting 1109 the prediction from reconstructed past samples synthesized from synthesis stage 1107. This process requires the synthesis of the past speech samples locally (analysis by synthesis).
  • the synthesis block 1107 at the transmitter performs the same function as the synthesis block 1113 at the receiver.
  • a difference term is produced in the form of an error signal. This residual error is used to find the best match in the code book 1105.
  • the code book 1105 quantizes the error signal using a code book generated from a representative set of speakers and environments. A minimum mean squared error match is determined in segments.
  • the code book is designed to provide a quantization error with spectral rolloff (higher quantization error for low frequencies and lower quantization error for higher frequencies).
  • the quantization noise spectrum in the reconstructed signal will always tend to be smaller than the underlying speech signal.
  • each frame of 20ms is divided into 4 sub-blocks or segments of 5ms each.
  • Each sub-block of data consists of a plurality of bits for the long term predictor, a plurality of bits for the long term predictor gain, a plurality of bits for the sub-block gain, and a plurality of bits for each code book entry for each 5ms.
  • each 1.25ms of speech is looked up in a 512 word code book for the best match.
  • the table entry is transmitted rather than the actual samples.
  • the code book entries are pre-computed from representative speech segments, as described more fully below.
  • the synthesis block 1113 at the receiver performs the same function as the synthesis block 1107 at the transmitter.
  • the synthesis block 1113 reconstructs the original signal from the voice data packets by using the gain and pitch values and code book address corresponding to the error signal most closely matched in the code book.
  • the code book at the receiver is similar to the code book 1105 in the transmitter.
  • the de-emphasis stage 1115 inverts the pre-emphasis operation by restoring the balance of original speech signal.
  • the complete speech compression algorithm is summarized as follows: a) Digitally sample the voice to produce a PCM sample bit stream sampled at 8,000 samples per second.
  • a minimum mean squared error match is determined in 5ms segments.
  • the code book is designed to provide a quantization error with spectral rolloff (higher quantization error for low frequencies and lower quantization error for higher frequencies).
  • the quantization noise spectrum in the reconstructed signal will always tend to be smaller than the underlying speech signal.
  • the major advantages of this approach over other low-bit-rate algorithms are that there is no need for any complicated calculation of reflection coefficients (no matrix inverse or lattice filter computations). Also, the quantization noise in the output speech is hidden under the speech signal and there are no pitch tracking artifacts: the speech sounds "natural", with only minor increases of background hiss at lower bit-rates.
  • the computational load is reduced significantly compared to a VSELP algorithm and variations of the present algorithm thus provides bit rates of 8, 9.6 and 16 Kbit/sec, and can also provide bit rates of 9.2Kbit/sec, 9.5Kbit/sec and many other rates.
  • the total delay through the analysis section is less than 20 milliseconds in the 9.6Kbit/sec embodiment.
  • the present algorithm is accomplished completely in the waveform domain and there is no spectral information being computed and there is no filter computations needed.
  • the speech compression algorithm is described in greater detail with reference to Figures 4 through 7, and with reference to the block diagram of the hardware components of the present system shown at Figure 2.
  • the voice compression algorithm Operates within the programmed control of the voice control DSP circuit 306.
  • the speech or analog voice signal is received through the telephone interface 301, 302 or 303 and is digitized by the digital telephone CODEC circuit 305.
  • the CODEC for circuit 305 is a companding ⁇ -law CODEC.
  • the analog voice signal from the telephone interface is band-limited to about 3,000 Hz and sampled at a selected sampling rate by digital telephone CODEC 305.
  • the sample rates in the 9.6Kbit/sec embodiment of the present invention are 8Ksample/sec.
  • Each sample is encoded into 8-bit PCM data producing a serial 64kb/s.
  • the digitized samples are passed to the voice control DSP/CODEC of circuit 306.
  • the 8-bit ⁇ -law PCM data is converted to 13-bit linear PCM data.
  • the 13-bit representation is necessary to accurately represent the linear version of the logarithmic 8-bit ⁇ -law PCM data. With linear PCM data, simpler mathematics may be performed on the PCM data.
  • the voice control DSP/CODEC of circuit 306 correspond to the single integrated circuit U8 shown in Figures 9A and 9B as a WE DSP16C Digital Signal Processor/CODEC from AT&T Microelectronics which is a combined digital signal processor and a linear CODEC in a single chip as described above.
  • the digital telephone CODEC of circuit 305 corresponds to integrated circuit U12 shown in Figure 9B as a T7540 companding ⁇ -law CODEC.
  • the sampled and digitized PCM voice signals from the telephone ⁇ -law CODEC 305 shown in Figure 2 are passed to the voice control DSP/CODEC circuit 308 via direct data lines clocked and synchronized to a clocking frequency.
  • the sample rate in CODEC 305 in this embodiment of the present invention is 8Ksample sec.
  • the digital samples are loaded into the voice control DSP/CODEC one at a time through the serial input and stored into an internal queue held in RAM, converted to linear PCM data and decimated to a sample rate of 6.4Ksample/sec. As the samples are loaded into the end of the queue in the RAM of the voice control DSP, the samples at the head of the queue are operated upon by the voice compression algorithm.
  • the voice compression algorithm then produces a greatly compressed representation of the speech signals in a digital packet form.
  • the compressed speech signal packets are then passed to the dual port RAM circuit 308 shown in Figure 2 for use by the main controller circuit 313 for either transferring in the voice-over-data mode of operation or for transfer to the personal computer for storage as compressed voice for functions such as telephone answering machine message data, for use in the multi-media documents and the like.
  • voice control DSP/CODEC circuit 306 of Figure 2 will be receiving digital voice PCM data from the digital telephone CODEC circuit 305, compressing it and transferring it to dual port RAM circuit 308 for multiplexing and transfer over the telephone line.
  • This is the transmit mode of operation of the voice control DSP/CODEC circuit 306 corresponding to transmitter block 1100 of Figure 3 and corresponding to the compression algorithm of Figure 4.
  • the voice control DSP/CODEC circuit 306 is receiving compressed voice data packets from dual port RAM circuit 308, uncompressing the voice data and transferring the uncompressed and reconstructed digital PCM voice data to the digital telephone CODEC 305 for digital to analog conversion and eventual transfer to the user through the telephone interface 301, 302, 304.
  • This is the receive mode of operation of the voice control DSP/CODEC circuit 306 corresponding to receiver block 1200 of Figure 3 and corresponding to the decompression algorithm of Figure 5.
  • the voice-control DSP/CODEC circuit 306 is processing the voice data in both directions in a full-duplex fashion.
  • the voice control DSP/CODEC circuit 306 operates at a clock frequency of approximately 24.576MHz while processing data at sampling rates of approximately 8KHz in both directions.
  • the voice compression decompression algorithms and packetization of the voice data is accomplished in a quick and efficient fashion to ensure that all processing is done in real-time without loss of voice information. This is accomplished in an efficient manner such that enough machine cycles remain in the voice control DSP circuit 306 during real time speech compression to allow real time acoustic and line echo cancellation in the same fixed-point DSP.
  • the availability of an eight-bit sample of PCM voice data from the ⁇ -law digital telephone CODEC circuit 305 causes an interrupt in the voice control DSP/CODEC circuit 306 where the sample is loaded into internal registers for processing. Once loaded into an internal register it is transferred to a RAM address which holds a queue of samples.
  • the queued PCM digital voice samples are converted from 8-bit ⁇ - law data to a 13-bit linear data format using table lookup for the conversion.
  • the digital telephone CODEC circuit 305 could also be a linear CODEC.
  • Sample Rate Decimation The sampled and digitized PCM voice signals from the telephone ⁇ -law CODEC 305 shown in Figure 2 are passed to the voice control DSP/CODEC circuit 308 via direct data lines clocked and synchronized to a clocking frequency.
  • the sample rate in this embodiment of the present invention is 8Ksample sec.
  • the digital samples for the 9.6Kbit sec and 8Kbit/sec algorithms are decimated using a digital decimation process to produce a 6.4Ksample sec and 6Ksample sec rate, respectively. For the 16Kbit/sec algorithm, no decimation is needed.
  • the decimated digital samples are shown as speech entering the transmitter block 1100.
  • the transmitter block is the mode of operation of the voice-control DSP/CODEC circuit 306 operating to receive local digitized voice information, compress it and packetize it for transfer to the main controller circuit 313 for transmission on the telephone line.
  • the telephone line connected to telephone line interface 309 of Figure 2 corresponds to the channel 1111 of Figure 3.
  • a frame rate for the voice compression algorithm is 20 milliseconds of speech for each compression. This correlates to 128 samples to process per frame for the 6.4K decimated sampling rate. When 128 samples are accumulated in the queue of the internal DSP RAM, the compression of that sample frame is begun.
  • the voice-control DSP/CODEC circuit 306 is programmed to first remove the DC component 1101 of the incoming speech.
  • the I removal is an adaptive function to establish a center base line on the voice signal by digitally adjusting the values of the PCM data. This corresponds to the DC removal stage 1203 of the software flow chart of Figure 4.
  • the formula for removal of the DC bias or drift is as follows:
  • n sample number
  • s(n) is the current sample
  • x(n) is die sample with the DC bias removed
  • the removal of the DC is for the 20 millisecond frame of voice which amounts to 128 samples at the 6.4Ksample/sec decimated sampling rate which corresponds to the 9.6Kbit/sec algorithm.
  • the selection of ⁇ is based on empirical observation to provide the best result.
  • FIG. 6 is a simplified data flow description of the flow chart of Figure 4 showing the sample rate decimator 1241 and the sample rate incrementor 1242.
  • Sample rate decimator 1241 produces an output 1251 of 6.4Ksample/sec for an 8Ksample sec input in the 9.6Kbit/sec system.
  • a 6Ksample/sec output 1250 is produced for the 8Kbit/sec algorithm, and no decimation is performed on the 8Ksample/sec voice sample rate 1252 for the 16Kbit/sec algorithm.
  • the analysis and compression begin at block 1201 where the 13-bit linear PCM speech samples are accumulated until 128 samples (for the 6.4Ksample/sec decimated sampling rate) representing 20 milliseconds of voice or one frame of voice is passed to the DC removal portion of code operating within the programmed voice control DSP/CODEC circuit 306.
  • the DC removal portion of the code described above approximates the base line of the frame of voice by using an adaptive DC removal technique.
  • a silence detection algorithm 1205 is also included in the programmed code of the DSP/CODEC 306.
  • the silence detection function is a summation of the square of each sample of the voice signal over the frame. If the power of the voice frame falls below a preselected threshold, this would indicate a silent frame.
  • the detection of a silence frame of speech is important for later multiplexing of the V-data (voice data) and C-data (asynchronous computer data) described below.
  • the main controller circuit 313 will transfer conventional digital data (C-data) over the telephone line in lieu of voice data (V-data).
  • the formula for computing the power is
  • the present voice frame is flagged as containing silence.
  • the 128-sample (Decimated Samples) silent frame is still processed by the voice compression algorithm; however, the silent frame packets are discarded by the main controller circuit 313 so that asynchronous digital data may be transferred in lieu of voice data.
  • the rest of the voice compression is operated upon in segments where there are four segments per frame amounting to 32 samples of data per segment (Sub-Block Size). It is only the DC removal and silence detection which is accomplished over an entire 20 millisecond frame.
  • the pre-emphasis 1207 of the voice compression algorithm shown in Figure 4 is the next step.
  • the sub-blocks are first passed through a pre-emphasis stage which whitens the spectral content of the speech signal by balancing the extra energy in the low band with the reduced energy in the high band.
  • the pre-emphasis essentially flattens the signal by reducing the dynamic range of the signal. By using pre-emphasis to flatten the dynamic range of the signal, less of a signal range is required for compression making the compression algorithm operate more efficiently.
  • Each segment thus amounts to five milliseconds of voice which is equal to 32 samples. Pre-emphasis then is done on each segment. The selection of p is based on empirical observation to provide the best result.
  • the next step is the long-term prediction (LTP).
  • the long-term prediction is a method to detect the innovation in the voice signal. Since the voice signal contains many redundant voice segments, we can detect these redundancies and only send information about the changes in the signal from one segment to the next. This is accomplished by comparing the speech samples of the current segment on a sample by sample basis to the reconstructed speech samples from the previous segments to obtain the innovation information and an indicator of the error in the prediction.
  • the long-term predictor gives the pitch and the LTP-Gain of the sub-block which are encoded in the transmitted bit stream.
  • This value is coded with 6-bits.
  • the pitch for segments 0 and 3 is encoded with 6 bits
  • the pitch for segments 1 and 2 is encoded with 5 bits.
  • the Pitch j is chosen as that which maximizes " ⁇ — . Since ⁇ j is positive, only j with positive S ⁇ 2 is considered.
  • the value of the ⁇ is a normalized quantity between zero and unity for this segment where ⁇ is an indicator of the correlation between the segments. For example, a perfect sine wave would produce a ⁇ which would be close to unity since the correlation between the current segments and the previous reconstructed segments should be almost a perfect match so ⁇ is one.
  • the error signal is normalized with respect to the maximum amplitude in the sub-segment for vector-quantization of the error signal.
  • the maximum amplitude in the segment is obtained as follows:
  • the maximum amplitude (G) is encoded using the Gain Encode Table. This table is characterized in Table 17.
  • the encoded amplitude (gcode) is transmitted to the far end. At the receiver, the maximum amplitude is retrieved from Table 18, as follows:
  • the error signal e(n) is then normalized by e(n)
  • G 16 32 64 128 256 512 1024 2048 4096 8192
  • BGCODE 6 * gcode + bcode.
  • Each segment of 32 samples (Sub-Block Size) is divided into 4 vectors of 8 samples (VSIZE) each.
  • Each vector is compared to the vectors stored in the CodeBook and the Index of the Code Vector that is closest to the signal vector is selected.
  • the CodeBook consists of 512 entries (512 addresses). The index chosen has the least difference according to the following minimization formula:
  • the input speech samples are replaced by the corresponding vectors in the chosen indexes. These values are then multiplied by the G q to denormalize the synthesized error signal, e'(n). This signal is then passed through the Inverse
  • the Inverse Pitch Filter output is used to update the synthesized speech buffer which is used for the analysis of the next sub-segment.
  • the signal is then passed through the deemphasis filter since preemphasis was performed at the beginning of the processing.
  • the output of the deemphasis filter, s' (n) is passed on to the D/A to generate analog speech.
  • the voice is reconstructed at the receiving end of the voice- over data link according to the reverse of the compression algorithm as shown as the decompression algorithm in Figure 5.
  • the decompression algorithm simply discards the received frame and initialize the output with zeros. If a speech frame is received, the pitch, LTP-Gain and GAIN are decoded as explained above. The error signal is reconstructed from the codebook indexes, which is then denormalized with respect to the GAIN value. This signal is then passed through the Inverse filter to generate the reconstructed signal. The Pitch and the LTP-Gain are the decoded values, same as those used in the Analysis. The filtered signal is passed through the Deemphasis filter whose output is passed on to the D/A to put out analog speech. The compressed frame contains 23 8-bit words and one 6-bit word. Thus a total of 24 words. Total number of bits transferred is 190, which corresponds to 9500 bps as shown in Table 19 (for the 9.6Kbit/sec algorithm).
  • Code Book Descriptions Table 20 describes the format of the code book for the 9.6Kbit/sec algorithm.
  • the code book values are stored in a signed floating point format which is converted to a fixed point representation of floating point number when stored in the lookup tables of the present invention.
  • the code book comprises a table of nine columns and 512 rows of floating point data.
  • the first 8 rows correspond to the 8 samples of speech and the ninth entry is the precomputed constant described above as -Vi ⁇ y , 2 .
  • An example of the code book data is shown in Table 21 with the complete code book for the 9.6Kbit/sec algorithm.
  • the code books are stored in PROM memory accessible by the Voice DSP as a lookup table.
  • the table data is loaded into local DSP memory upon the selection of the appropriate algorithm to increase access speed.
  • the code books comprise a table of data in which each entry is a sequential address from 000 to 511.
  • a 9 X 512 code book is used for the 9.6Kbit sec algorithm.
  • a 6 X 256 code book is used for the 16Kbit/sec algorithm
  • a 9 X 512 code book is used.
  • the corresponding code book is used to encode decode the speech samples.
  • the code books are generated statistically by encoding a wide variety of speech patterns.
  • the code books are generated in a learning mode for the above-described algorithm in which each speech segment which the compression algorithm is first exposed to is placed in the code book until 512 entries are recorded. Then the algorithm is continually fed a variety of speech patterns upon which the code book is adjusted. As new speech segments are encountered, the code book is searched to find the best match. If the error between the observed speech segment and the code book values exceed a predetermined threshold, then the closest speech segment in the code book and the new speech segment is averaged and the new average is placed in the code book in place of the closest match. In this learning mode, the code book is continually adjusted to have the lowest difference ratio between observed speech segment values and code book values. The learning mode of operation may take hours or days of exposure to different speech patterns to adjust the code books to the best fit.
  • the code books may be exposed to a single person's speech which will result in a code book being tailored to that particular persons method of speaking.
  • the speech patterns of a wide variety of speakers of both genders are exposed to the code book learning algorithm for the average fit for a given language.
  • V-data digitized voice data
  • C-data C-data
  • the V-data and C-data multiplex transmission is achieved in two modes at two levels: the transmit and receive modes and data service level and multiplex control level. This operation is shown diagrammatically in Figure 7.
  • the main controller circuit 313 of Figure 2 operates in the data service level 1505 to collect and buffer data from both the personal computer 10 (through the RS232 port interface 315) and the voice control DSP 306.
  • multiplex control level 1515 the main controller circuit 313 multiplexes the data and transmits that data out over the phone line 1523.
  • the main controller circuit 313 operates in the multiplex control level 1515 to de-multiplex the V-data packets and the C-data packets and then operates in the data service level 1505 to deliver the appropriate data packets to the correct destination: the personal computer 10 for the C-data packets or the voice control DSP circuit 306 for V-data
  • V-data buffer 1511 there are two data buffers, the V-data buffer 1511 and the C-data buffer 1513, implemented in the main controller RAM 316 and maintained by main controller 313.
  • voice control DSP circuit 306 engages voice operation, it will send a block of V-data every 20 ms to the main controller circuit 313 through dual port RAM circuit 308.
  • Each V-data block has one sign byte as a header and 24 bytes of V-data.
  • the sign byte header of the voice packet is transferred every frame from the voice control DSP to the controller 313.
  • the sign byte header contains the sign byte which identifies the contents of the voice packet.
  • V-data contains speech information
  • the main controller circuit 313 If the main controller 313 is in transmit mode for V-data/C-data multiplexing, the main controller circuit 313 operates at the data service level to perform the following tests.
  • the voice control DSP circuit 306 starts to send the 24-byte V-data packet through the dual port RAM to the main controller circuit 313, the main controller will check the V-data buffer to see if the buffer has room for 24 bytes. If there is sufficient room in the V-data buffer, the main controller will check the sign byte in the header preceding the V-data packet. If the sign byte is equal to one (indicating voice information in the packet), the main controller circuit 313 will put the following 24 bytes of V-data into the V-data buffer and clear the silence counter to zero.
  • the main controller 313 sets a flag to request that the V-data be sent by the main controller at the multiplex control level. If the sign byte is equal to zero (indicating silence in the V- data packet), the main controller circuit 313 will increase the silence counter by 1 and check if the silence counter has reached 5. When the silence counter reaches 5, the main controller circuit 313 will not put the following 24 bytes of V-data into the V-data buffer and will stop increasing the silence counter. By this method, the main controller circuit 313 operating at the service level will only provide non-silence V-data to the multiplex control level, while discarding silence V-data packets and preventing the V-data buffer from being overwritten.
  • the operation of the main controller circuit 313 in the multiplex control level is to multiplex the V-data and C-data packets and transmit them through the same channel.
  • both types of data packets are transmitted by the HDLC protocol in which data is transmitted in synchronous mode and checked by CRC error checking. If a V-data packet is received at the remote end with a bad CRC, it is discarded since 100% accuracy of the voice channel is not ensured. If the V-data packets were re-sent in the event of corruption, the real-time quality of the voice transmission would be lost.
  • the C-data is transmitted following a modem data communication protocol such as CCITT V.42.
  • V-data block which includes a maximum of five V-data packets.
  • the V-data block size and the maximum number of blocks are defined as follows:
  • the V-data block header 80h;
  • the V-data block size 24;
  • the maximum V-data block size 5;
  • the V-data block has higher priority to be transmitted than C- data to ensure the integrity of the real-time voice transmission. Therefore, the main controller circuit 313 will check the V-data buffer first to determine whether it will transmit V-data or C-data blocks. If V-data buffer has V-data of more than 69 bytes, a transmit block counter is set to 5 and the main controller circuit 313 starts to transmit V-data from the V-data buffer through the data pump circuit 311 onto the telephone line. Since the transmit block counter indicates 5 blocks of V-data will be transmitted in a continuous stream, the transmission will stop either at finish the 115 bytes of V-data or if the V-data buffer is empty.
  • V-data buffer has V-data with number more than 24 bytes
  • the transmit block counter is set 1 and starts transmit V-data This means that the main controller circuit will only transmit one block of V- data If the V-data buffer has V-data with less than 24 bytes, the main controller circuit services the transmission of C-data
  • the V-data buffer condition is checked before transmitting the first C-data byte. If the V-data buffer contains more than one V-data packet, the current transmission of the C-data block will be terminated in order to handle the V-data.
  • the main controller circuit 313 operates at the multiplex control level to de-multiplex received data to V-data and C-data.
  • the type of block can be identified by checking the first byte of the incoming data blocks.
  • the main controller circuit 313 will initialize a receive V-data byte counter, a backup pointer and a temporary V-data buffer pointer.
  • the value of the receiver V-data byte counter is 24, the value of the receive block counter is 0 and the backup pointer is set to the same value as the V-data receive buffer pointer. If the received byte is not equal to 80 hex (80h indicating a V-data packet), the receive operation will follow the current modem protocol since the data block must contain C-data. If the received byte is equal to 80h, the main controller circuit 313 operating in receive mode will process the V-data.
  • V-data block received when a byte of V-data is received, the byte of V-data is put into the V-data receive buffer, the temporary buffer pointer is increased by 1 and the receive V-data counter is decreased by 1. If the V-data counter is down to zero, the value of the temporary V-data buffer pointer is copied into the backup pointer buffer. The value of the total V-data counter is added with 24 and the receive V-data counter is reset to 24. The value of the receive block counter is increased by 1. A flag to request service of V-data is then set. If the receive block counter has reached 5, the main controller circuit 313 will not put the incoming V-data into the V-data receive buffer but throw it away. If the total V-data counter has reached its maximum value, the receiver will not put the incoming V-data into the V-data receive buffer but throw it away.
  • the main controller circuit 313 operating in the multiplex control level will not check the result of the CRC but instead will check the value of the receive V-data counter. If the value is zero, the check is finished, otherwise the value of the backup pointer is copied back into the current V-data buffer pointer.
  • the receiver is insured to de- multiplex the V-data from the receiving channel 24 bytes at a time.
  • the main controller circuit 313 operating at the service level in the receive mode will monitor the flag of request service of V-data If the flag is set, the main controller circuit 313 will get the V-data from the V-data buffer and transmit it to the voice control DSP circuit 306 at a rate of 24 bytes at a time. After sending a block of V-data, it decreases 24 from the value in the total V-data counter.
  • the modem hardware component 20 incorporates a modified packet protocol for negotiation of the speech compression rate.
  • a modified supervisory packet is formatted using the same open flag, address, CRC, and closing flag formatting bytes which are found in the CCITT V.42 standard data supervisory packet, as is well known in the industry and as is described in the CCITT Blue Book, volume VIII entitled Data Communication over the Telephone Network. 1989 referenced above.
  • the set of CCITT standard header bytes (control words) has been extended to include nonstandard control words used to signal transmission of a nonstandard communication command.
  • Nonstandard control word does not conflict with other data communication terminals, for example, when communicating with a non-PCS (Personal Communications System) modem system, since the nonstandard packet will be ignored by a non-PCS system.
  • Table 22 offers one embodiment of the present invention showing a modified supervisory packet structure. Table 22 omits the CCITT standard formatting bytes: open flag, address, CRC, and closing flag; however, these bytes are described in the CCITT standard.
  • the modified supervisory packet is distinguished from a V.42 standard packet by using a nonstandard control word, such as 80 hex, as the header. The nonstandard control word does not conflict with V.42 standard communications.
  • the modified supervisory packet is transmitted by the HDLC protocol in which data is transmitted in synchronous mode and checked by CRC error checking.
  • the use of a modified supervisory packet eliminates the need for an escape command sent over the telephone line to interrupt data communications, providing an independent channel for negotiation of the compression rate.
  • the channel may also be used as an alternative means for programming standard communications parameters.
  • the modified supervisory packet is encoded with different function codes to provide an independent communications channel between hardware components. This provides a means for real time negotiation and programming of the voice compression rate during uninterrupted transmission of voice data and conventional data without the need for conventional escape routines.
  • the modified supervisory packet is encoded with a function code using several embodiments. For example, in one embodiment, the function code is embedded in the packet as one of the data words and is located in a predetermined position.
  • the supervisory packet header signals a nonstandard supervisory packet and contains the compression rate to be used between the sites.
  • a different nonreserved header is assigned to each function code.
  • These embodiments are not limiting and other methods known to those skilled in the art may be employed to encode the function code into the modified supervisory packet.
  • a system consisting of PCS modem 20 and data terminal 10 are connected via phone line 30 to a second PCS system comprised of PCS modem 20A and data terminal 10A. Therefore, calling modem 20 initializes communication with receiving modem 20A.
  • a speech compression command is sent via a modified supervisory data packet as the request for speech compression algorithm and ratio negotiation.
  • Encoded in the speech compression command is the particular speech compression algorithm and the speech compression ratio desired by the calling PCM modem 20.
  • the first data byte of the modified supervisory packet could be used to identify the speech compression algorithm using a binary coding scheme (e.g., OOh for Vector Quantization, Olh for CELP+, 02h for VCELP, and 03h for TrueSpeech, etc.).
  • a second data byte could be used to encode the speech compression ratio (e.g., OOh for 9.6Kbit/sec, Olh for 16Kbit/sec, 02h for 8Kbit/sec, etc.).
  • This embodiment of the speech compression command supervisory packet is shown in Table 23.
  • the function code could be stored in a predetermined position of one of the packet data bytes.
  • Other function code encoding embodiments are possible without deviating from the scope and spirit of the present invention and the embodiments offered are not intended to be exclusive or limiting embodiments.
  • the receiving PCS modem 20A will recognize the speech compression command and will respond with an acknowledge packet using, for instance, a header byte such as hex 81.
  • the acknowledge packet will alert the calling modem 20 that the speech compression algorithm and speech compression ratio selected are available by use of the ACK field of the supervisory packet shown in Table 23. Receipt of the acknowledge supervisory packet causes the calling modem 20 to transmit subsequent voice over data information according to the selected speech compression algorithm and compression ratio.
  • the frequency of which the speech compression command supervisory packet is transmitted will vary with the application. For moderate quality voice over data applications, the speech compression algorithm need only be negotiated at the initialization of the phone call. For applications requiring more fidelity, the speech compression command supervisory packet is renegotiated throughout the call to accommodate new parties to the communication which have different speech compression algorithm limitations or to actively tune the speech compression ratio as the quality of the communications link fluctuates.
  • Other embodiments provide a speech compression command supervisory packet encode varying transmission rates of the speech compression command supervisory packet and different methods of speech compression algorithm and compression ratio negotiation. Additionally, other encoding embodiments to encode the supervisory packet speech compression algorithm and the speech compression ratio may be incorporated without deviating from the scope and spirit of the present invention, and the described embodiments are not exclusive or limiting.
  • a new supervisory packet may be allocated for use as a means for negotiating multiplexing scheme for the various types of information sent over the communications link. For example, if voice over data mode is employed, there exist several methods for multiplexing the voice and digital data.
  • the multiplexing scheme may be selected by using a modified supervisory packet, called a multiplex supervisory packet, to negotiate the selection of multiplexing scheme.
  • another supervisory packet could be designated for remote control of another hardware device.
  • a remote control supervisory packet could be encoded with the necessary selection parameters needed to program the remote device.

Abstract

The present invention includes software and hardware components to enable digital data communication over standard telephone lines. The present invention converts analog voice signals to digital data, compresses that data and places the compressed speech data into packets for transfer over the telephone lines to a remote site. A voice control digital signal processor (DSP) operates to use one of a plurality of speech compression algorithms which produce a scaleable amount of compression. The rate of compression is inversely proportional to the quality of the speech the compression algorithm is able to reproduce. The higher the compression, the lower the reproduction quality. The selection of the rate of compression is dependent on such factors as the speed or data bandwidth on the communications connection between the two sites, the data demand between the sites and amount of silence detected in the speech signal. The voice compression rate is dynamically changed as the aforementioned factors change. A negotiation handshake protocol is described which enables the two sites to negotiate the compression rate based on such factors.

Description

pwAMir S i vrπckx nψ VΠΓΓI. mMFR ssTπi
RATE TN A VOICE DATA MODEM
Field of the Invention The present invention relates to communications systems and in particular to modem communications having simultaneous digitized voice and data capabilities. Background of the Invention
Simultaneous voice and modem data transmitted over the same communications link between two sites has been accomplished in several ways. The most common communications link used between two sites is the telephone line. The most common data handling equipment to communicate over a communications link is the computer modem which modulates digital data onto a carrier for transmission in the voice band of the telephone line. A wide variety of modulation standards have been promulgated by such international groups as the CCITT for communication in the voice band. The data bandwidth for such modulation standards is typically fixed and the throughput rate of data is also assumed to be fixed.
In some modulations standards, there are provisions for changing the modulation data rate based on the quality of the communications link. For example, in a noisy telephone line, a 9600 baud modulation rate may have such a high bit error rate that the modulation must be changed to a 2400 baud connection. This is done in a handshake communication protocol between the two sites when the communications link simply cannot support the higher rate.
There is a need in the art, however, for an efficient and cost effective way of maximizing bandwidth over the communications link between two sites to enable the simultaneous transmission of voice and data. There is a need, therefore, to negotiate the data bandwidth between the sites, negotiate the compression rate for the voice compression algorithms used to compress the voice and there is a need to allocate and reallocate the ratio of compress voice to digital data transmitted over the communications link.
Summary of the Invention The present invention solves the aforementioned problems and shortcoming of the existing art and solves other problems not listed above which will become apparent to those skilled in the art upon reading and understanding the present specification and claims. The present invention describes a voice over data modem which allows the operator to simultaneously transmit voice and data communication to a remote site. This voice over data function dynamically allocates data bandwidth over the telephone line depending on the demands of the voice grade digitized signal and the modulation speed of the communication link between the two sites.
The present invention includes software and hardware components to enable digital data communication over standard telephone lines. The present invention converts analog voice signals to digital data, compresses that data and places the compressed speech data into packets for transfer over the telephone lines to a remote site. A voice control digital signal processor (DSP) operates to use one of a plurality of speech compression algorithms which produce a scaleable amount of compression. The rate of compression is inversely proportional to the qualin of the speech the compression algorithm is able to reproduce. The higher the compression, the lower the reproduction quality. The selection of the rate of compression is dependant on such factors as the speed or data bandwidth on the communications connection between the two sites, the data demand between the sites and amount of silence detected in the speech signal. The voice compression rate is dynamically changed as the aforementioned factors change. A negotiation handshake protocol is described which enables the two sites to negotiate the compression rate based on such factors.
Description of the Drawings In the drawings, where like numerals describe like components throughout the several views, Figure 1 shows the telecommunications environment within which the present may operate in several of the possible modes of communication;
Figure 2 is a block diagram of the hardware components of the present system;
Figure 3 is a detailed function flow diagram of the speech compression algorithm;
Figure 4 is a detailed function flow diagram of the speech decompression algorithm; Figure 5 is a signal flow diagram of the speech compression algorithm;
Figure 6 is a signal flow diagram of the speech compression algorithm showing details of the code book synthesis; and
Figure 7 is a detailed function flow diagram of the voice/data multiplexing function.
Detailed Description of the Preferred Embodiments
In the following detailed description of the preferred embodiment, reference is made to the accompanying drawings which form a part hereof, and in which is shown by way of illustration specific embodiments in which the inventions may be practiced. These embodiments are described in sufficient detail to enable those skilled in the art to practice the invention, and it is to be understood that other embodiments may be utilized and that structural changes may be m∑i&e without departing from the spirit and scope of the present inventions. The following detailed description is, therefore, not to be taken in a limiting sense, and the scope of the present inventions is defined by the appended claims.
Figure 1 shows a typical arrangement for the use of the present system. Personal computer 10 is running the software components of the present system while the hardware components 20 include the data communication equipment and telephone headset. Hardware components 20 communicate over a standard telephone line 30 to one of a variety of remote sites. One of the remote sites may be equipped with the present system including hardware components 20a and software components running on personal computer 10a. In one alternative use, the local hardware components 20 may be communicating over standard telephone line 30 to facsimile machine 60. In another alternative use, the present system may be communicating over a standard telephone line 30 to another personal computer 80 through a remote modem 70. In another alternative use, the present system may be communicating over a standard telephone line 30 to a standard telephone 90. Those skilled in the art will readily recognize the wide variety of communication interconnections possible with the present system by reading and understanding the following detailed description.
General Overview The present inventions are embodied in a commercial product by the assignee, Multi-Tech Systems, Inc. The software component operating on a personal computer is sold under the commercial trademark of MultiExpressPCS™ personal communications software while the hardware component of the present system is sold under the commercial name of MultiModemPCS™, Intelligent Personal Communications System Modem. In the preferred embodiment, the software component runs under Microsoft* Windows™ however those skilled in the art will readily recognize that the present system is easily adaptable to run under any single or multi-user, single or multi-window operating system.
The present system is a multifunction communication system which includes hardware and software components. The system allows the user to connect to remote locations equipped with a similar system or with modems, facsimile machines or standard telephones over a single analog telephone line. The software component of the present system includes a number of modules which are described in more detail below.
The telephone module allows the system to operate as a conventional or sophisticated telephone system. The system converts voice into a digital signal so that it can be transmitted or stored with other digital data, like computer information. The telephone function supports PBX and Centrex features such a call waiting, call forwarding, caller ID and three-way calling. This module also allows the user to mute, hold or record a conversation. The telephone module enables the handset, headset or hands- free speaker telephone operation of the hardware component. It includes on¬ screen push button dialing, speed-dial of stored numbers and digital recording of two-way conversations.
The voice mail portion of the present system allows this system to operate as a telephone answering machine by storing voice messages as digitized voice files along with a time/date voice stamp. The digitized voice files can be saved and sent to one or more destinations immediately or at a later time using a queue scheduler. The user can also listen to, forward or edit the voice messages which have been received with a powerful digital voice editing component of the present system. This module also creates queues for outgoing messages to be sent at preselected times and allows the users to create outgoing messages with the voice editor. The fax manager portion of the present system is a queue for incoming and outgoing facsimile pages. In the preferred embodiment of the present system, this function is tied into the Windows "print" command once the present system has been installed. This feature allows the user to create faxes from any Windows -based document that uses the "print" command. The fax manager function of the present system allows the user to view queued faxes which are to be sent or which have been received. This module creates queues for outgoing faxes to be sent at preselected times and logs incoming faxes with time/date stamps.
The multi-media mail function of the present system is a utility which allows the user to compose documents that include text, graphics and voice messages using the message composer function of the present system, described more fully below. The multi-media mail utility of the present system allows the user to schedule messages for transmittal and queues up the messages that have been received so that can be viewed at a later time. The show and tell function of the present system allows the user to establish a data over voice (DOV) communications session. When the user is transmitting data to a remote location similarly equipped, the user is able to talk to the person over the telephone line while concurrently transferring the data This voice over data function is accomplished in the hardware components of the present system. It digitizes the voice and transmits it in a dynamically changing allocation of voice data and digital data multiplexed in the same transmission. The allocation at a given moment is selected depending on the amount of voice digital information required to be transferred. Quiet voice intervals allocate greater space to the digital data transmission.
The terminal function of the present system allows the user to establish a data communications session with another computer which is equipped with a modem but which is not equipped with the present system. This feature of the present system is a Windows™-based data communications program that reduces the need for issuing "AT' commands by providing menu driven and "pop-up" window alternatives. The address book function of the present system is a database that is accessible from all the other functions of the present system. This database is created by the user inputting destination addresses and telephone numbers for data communication, voice mail, facsimile transmission, modem communication and the like. The address book function of the present system may be utilized to broadcast communications to a wide variety of recipients. Multiple linked databases have separate address books for different groups and different destinations may be created by the users. The address book function includes a textual search capability which allows fast and efficient location of specific addresses as described more fully below. Hardware Components
Figure 2 is a block diagram of the hardware components of the present system corresponding to reference number 20 of Figure 1. These components form the link between the user, the personal computer running the software component of the present system and the telephone line interface. As will be more fully described below, the interface to the hardware components of the present system is via a serial communications port connected to the personal computer. The interface protocol is well ordered and defined such that other software systems or programs running on the personal computer may be designed and implemented which would be capable of controlling the hardware components shown in Figure 2 by using the control and communications protocol defined below. In the preferred embodiment of the present system, three alternate telephone interfaces are available: the telephone handset 301, a telephone headset 302, and a hands-free microphone 303 and speaker 304. Regardless of the telephone interface, the three alternative interfaces connect to the digital telephone coder-decoder (CODEC) circuit 305. The digital telephone CODEC circuit 305 interfaces with the voice control digital signal processor (DSP) circuit 306 which includes a voice control DSP and CODEC. This circuit does digital to analog (D/A) conversion, analog to digital (A/D) conversion, coding/decoding, gain control and is the interface between the voice control DSP circuit 306 and the telephone interface. The CODEC of the voice control circuit 306 transfers digitized voice information in a compressed format to multiplexor circuit 310 to analog telephone line interface 309.
The CODEC of the voice control circuit 306 is actually an integral component of a voice control digital signal processor integrated circuit, as described more fiilly below. The voice control DSP of circuit 306 controls the digital telephone CODEC circuit 305, performs voice compression and echo cancellation.
Multiplexor (MUX) circuit 310 selects between the voice control DSP circuit 306 and the data pump DSP circuit 311 for transmission of information on the telephone line through telephone line interface circuit 309.
The data pump circuit 311 also includes a digital signal processor (DSP) and a CODEC for communicating over the telephone line interface 309 through MUX circuit 310. The data pump DSP and CODEC of circuit 311 performs functions such as modulation, demodulation and echo cancellation to communicate over the telephone line interface 309 using a plurality of telecommunications standards including FAX and modem protocols.
The main controller circuit 313 controls the DSP data pump circuit 311 and the voice control DSP circuit 306 through serial input/output and clock timer control (SIO/CTC) circuits 312 and dual port RAM circuit 308 respectively. The main controller circuit 313 communicates with the voice control DSP 306 through dual port RAM circuit 308. In this fashion digital voice data can be read and written simultaneously to the memory portions of circuit 308 for high speed communication between the user (through interfaces 301, 302 or 303/304) and the personal computer connected to serial interface circuit 315 and the remote telephone connection connected through the telephone line attached to line interface circuit 309.
As described more fully below, the main controller circuit 313 includes, in the preferred embodiment, a microprocessor which controls the functions and operation of all of the hardware components shown in Figure 2. The main controller is connected to RAM circuit 316 and an programmable and electrically erasable read only memory (EEPROM) circuit 317. The EEPROM circuit 317 includes non-volatile memory in which the executable control programs for the voice control DSP circuits 306 and the main controller circuits 313 operate.
The RS232 serial interface circuit 315 communicates to the serial port of the personal computer which is running the software components of the present system. The RS232 serial interface circuit 315 is connected to a serial input/output circuit 314 with main controller circuit 313. SIO circuit 314 is in the preferred embodiment, a part of SIO/CTC circuit 312. Functional Operation of the Hardware Components Referring once again to Figure 2, the multiple and selectable functions described in conjunction with Figure 2 are all implemented in the hardware components of Figure 2. Each of these functions will be discussed in turn.
The telephone function 115 is implemented by the user either selecting a telephone number to be dialed from the address book 127 or manually selecting the number through the telephone menu on the personal computer. The telephone number to be dialed is downloaded from the personal computer over the serial interface and received by main controller 313. Main controller 313 causes the data pump DSP circuit 311 to seize the telephone line and transmit the DTMF tones to dial a number. DSP 306 receives commands from the personal computer via main controller 313 to configure the digital telephone CODEC circuit 305 to enable either the handset 301 operation, the microphone 303 and speaker 304 operation or the headset 302 operation. A telephone connection is established through the telephone line interface circuit 309 and communication is enabled. The user's analog voice is transmitted in an analog fashion to the digital telephone CODEC 305 where it is digitized. The digitized voice patterns are passed to the voice control circuit 306 where echo cancellation is accomplished, the digital voice signals are reconstructed into analog signals and passed through multiplexor circuit 310 to the telephone line interface circuit 309 for analog transmission over the telephone line. The incoming analog voice from the telephone connection through telephone connection circuit 309 is passed to the integral CODEC of the voice control circuit 306 where it is digitized. The digitized incoming voice is then passed to digital telephone CODEC circuit 305 where it is reconverted to an analog signal for transmission to the selected telephone interface (either the handset 301, the microphone/speaker 303/304 or the headset 302). Voice Control DSP circuit 306 is programmed to perform echo cancellation to avoid feedback and echoes between transmitted and received signals, as is more fiilly described below. In the voice mail function mode of the present system, voice messages may be stored for later transmission or the present system may operate as an answering machine receiving incoming messages. For storing digitized voice, the telephone interface is used to send the analog speech patterns to the digital telephone CODEC circuit 305. Circuit 305 digitizes the voice patterns and passes them to voice control circuit 306 where the digitized voice patterns are digitally compressed. The digitized and compressed voice patterns are passed through dual port ram circuit 308 to the main controller circuit 313 where they are transferred through the serial interface to the personal computer using a packet protocol defined below. The voice patterns are then stored on the disk of the personal computer for later use in multi¬ media mail, for voice mail, as a pre-recorded answering machine message or for later predetermined transmission to other sites.
For the present system to operate as an answering machine, the hardware components of Figure 2 are placed in answer mode. An incoming telephone ring is detected through the telephone line interface circuit 309 and the main controller circuit 313 is alerted which passes the information off to the personal computer through the RS232 serial interface circuit 315. The telephone line interface circuit 309 seizes the telephone line to make the telephone connection. A pre-recorded message may be sent by the personal computer as compressed and digitized speech through the RS232 interface to the main controller circuit 313. The compressed and digitized speech from the personal computer is passed from main controller circuit 313 through dual port ram circuit 308 to the voice control DSP circuit 306 where it is uncompressed and converted to analog voice patterns. These analog voice patterns are passed through multiplexor circuit 310 to the telephone line interface 309 for transmission to the caller. Such a message may invite the caller to leave a voice message at the sound of a tone. The incoming voice messages are received through telephone line interface 309 and passed to voice control circuit 306. The analog voice patterns are digitized by the integral CODEC of voice control circuit 306 and the digitized voice patterns are compressed by the voice control DSP of the voice control circuit 306. The digitized and compressed speech patterns are passed through dual port ram circuit 308 to the main controller circuit 313 where they are transferred using packet protocol described below through the RS232 serial interface 315 to the personal computer for storage and later retrieval. In this fashion the hardware components of Figure 2 operate as a transmit and receive voice mail system for implementing the voice mail function 117 of the present system. The hardware components of Figure 2 may also operate to facilitate the fax manager function 119 of Figure 2. In fax receive mode, an incoming telephone call will be detected by a ring detect circuit of the telephone line interface 309 which will alert the main controller circuit 313 to the incoming call. Main controller circuit 313 will cause line interface circuit 309 to seize the telephone line to receive the call. Main controller circuit 313 will also concurrently alert the operating programs on the personal computer through the RS232 interface using the packet protocol described below. Once the telephone line interface seizes the telephone line, a fax carrier tone is transmitted and a return tone and handshake is received from the telephone line and detected by the data pump circuit 311. The reciprocal transmit and receipt of the fax tones indicates the imminent receipt of a facsimile transmission and the main controller circuit 313 configures the hardware components of Figure 2 for the receipt of that information. The necessary handshaking with the remote facsimile machine is accomplished through the data pump 311 under control of the main controller circuit 313. The incoming data packets of digital facsimile data are received over the telephone line interface and passed through data pump circuit 311 to main controller circuit 313 which forwards the information on a packet basis (using the packet protocol described more fully below) through the serial interface circuit 315 to the personal computer for storage on disk. Those skilled in the art will readily recognize that the FAX data could be transferred from the telephone line to the personal computer using the same path as the packet transfer except using the normal AT stream mode. Thus the incoming facsimile is automatically received and stored on the personal computer through the hardware components of Figure 2. A facsimile transmission is also facilitated by the hardware components of Figure 2. The transmission of a facsimile may be immediate or queued for later transmission at a predetermined or preselected time. Control packet information to configure the hardware components to send a facsimile are sent over the RS232 serial interface between the personal computer and the hardware components of Figure 2 and are received by main controller circuit 313. The data pump circuit 311 then dials the recipient's telephone number using DTMF tones or pulse dialing over the telephone line interface circuit 309. Once an appropriate connection is established with the remote facsimile machine, standard facsimile handshaking is accomplished by the data pump circuit 311. Once the facsimile connection is established, the digital facsimile picture information is received through the data packet protocol transfer over serial line interface circuit 315, passed through main controller circuit 313 and data pump circuit 311 onto the telephone line through telephone line interface circuit 309 for receipt by the remote facsimile machine.
The operation of the multi-media mail function 121 of Figure 2 is also facilitated by the hardware components of Figure 2. A multimedia transmission consists of a combination of picture information, digital data and digitized voice information. For example, the type of multimedia information transferred to a remote site using the hardware components of Figure 2 could be the multimedia format of the Microsoft® Multimedia Wave® format with the aid of an Intelligent Serial Interface (ISI) card added to the personal computer. The multimedia may also be the type of multimedia information assembled by the software component of the present system which is described more fully below.
The multimedia package of information including text, graphics and voice messages (collectively called the multimedia document) may be transmitted or received through the hardware components shown in Figure 2. For example, the transmission of a multimedia document through the hardware components of Figure 2 is accomplished by transferring the multimedia digital information using the packet protocol described below over the RS232 serial interface between the personal computer and the serial line interface circuit 315. The packets are then transferred through main controller circuit 313 through the data pump circuit 311 on to the telephone line for receipt at a remote site through telephone line interface circuit 309. In a similar fashion, the multimedia documents received over the telephone line from the remote site are received at the telephone line interface circuit 309, passed through the data pump circuit 311 for receipt and forwarding by the main controller circuit 313 over the serial line interface circuit 315. The show and tell function 123 of the present system allows the user to establish a data over voice communication session. In this mode of operation, full duplex data transmission may be accomplished simultaneously with the voice communication between both sites. This mode of operation assumes a like- configured remote site. The hardware components of the present system also include a means for sending voice/data over cellular links. The protocol used for transmitting multiplexed voice and data include a supervisory packet described more fully below to keep the link established through the cellular link. This supervisory packet is an acknowledgement that the link is still up. The supervisory packet may also contain link information to be used for adjusting various link parameters when needed. This supervisory packet is sent every second when data is not being sent and if the packet is not acknowledged after a specified number of attempts, the protocol would then give an indication that the cellular link is down and then allow the modem to take action. The action could be for example; change speeds, retrain, or hang up. The use of supervisory packets is a novel method of maintaining inherently intermittent cellular links when transmitting multiplexed voice and data.
The voice portion of the voice over data transmission of the show and tell function is accomplished by receiving the user's voice through the telephone interface 301, 302 or 303 and the voice information is digitized by the digital telephone circuit 305. The digitized voice information is passed to the voice control circuit 306 where the digitized voice information is compressed using a voice compression algorithm described more fully below. The digitized and compressed voice information is passed through dual port RAM circuit 308 to the main controller circuit 313. During quiet periods of the speech, a quiet flag is passed from voice control circuit 306 to the main controller 313 through a packet transfer protocol described below by a dual port RAM circuit 308. Simultaneous with the digitizing compression and packetizing of the voice information is the receipt of the packetized digital information from the personal computer over interface line circuit 315 by main controller circuit 313. Main controller circuit 313 in the show and tell function of the present system must efficiently and effectively combine the digitized voice information with the digital information for transmission over the telephone line via telephone line interface circuit 309. As described above and as described more fiilly below, main controller circuit 313 dynamically changes the amount of voice information and digital information transmitted at any given period of time depending upon the quiet times during the voice transmissions. For example, during a quiet moment where there is no speech information being transmitted, main controller circuit 313 ensures that a higher volume of digital data information be transmitted over the telephone line interface in lieu of digitized voice information.
Also, as described more fully below, the packets of digital data transmitted over the telephone line interface with the transmission packet protocol described below, requires 100 percent accuracy in the transmission of the digital data, but a lesser standard of accuracy for the transmission and receipt of the digitized voice information. Since digital information must be transmitted with 100 percent accuracy, a corrupted packet of digital information received at the remote site must be re-transmitted. A retransmission signal is communicated back to the local site and the packet of digital information which was corrupted during transmission is retransmitted. If the packet transmitted contained voice data, however, the remote site uses the packets whether they were corrupted or not as long as the packet header was intact. If the header is corrupted, the packet is discarded. Thus, the voice information may be corrupted without requesting retransmission since it is understood that the voice information must be transmitted on a real time basis and the corruption of any digital information of the voice signal is not critical. In contrast to this the transmission of digital data is critical and retransmission of corrupted data packets is requested by the remote site.
The transmission of the digital data follows the CCITT V.42 standard, as is well known in the industry and as described in the CCITT Blue Book, volume VIII entitled Data Communication over the Telephone Network, 1989. The voice data packet information also follows the CCITT V.42 standard, but uses a different header format so the receiving site recognizes the difference between a data packet and a voice packet. The voice packet is distinguished from a data packet by using undefined bits in the header (80 hex) of the V.42 standard. The packet protocol for voice over data transmission during the show and tell function of the present system is described more fully below.
Since the voice over data communication with the remote site is full-duplex, incoming data packets and incoming voice packets are received by the hardware components of Figure 2. The incoming data packets and voice packets are received through the telephone line interface circuit 309 and passed to the main controller circuit 313 via data pump DSP circuit 311. The incoming data packets are passed by the main controller circuit 313 to the serial interface circuit 315 to be passed to the personal computer. The incoming voice packets are passed by the main controller circuit 313 to the dual port RAM circuit 308 for receipt by the voice control DSP circuit 306. The voice packets are decoded and the compressed digital information therein is uncompressed by the voice control DSP of circuit 306. The uncompressed digital voice information is passed to digital telephone CODEC circuit 305 where it is reconverted to an analog signal and retransmitted through the telephone line interface circuits. In this fashion full-duplex voice and data transmission and reception is accomplished through the hardware components of Figure 2 during the show and tell functional operation of the present system.
Terminal operation 125 of the present system is also supported by the hardware components of Figure 2. Terminal operation means that the local personal computer simply operates as a "dumb" terminal including file transfer capabilities. Thus no local processing takes place other than the handshaking protocol required for the operation of a dumb terminal. In terminal mode operation, the remote site is assumed to be a modem connected to a personal computer but the remote site is not necessarily a site which is configured according to the present system. In terminal mode of operation, the command and data information from personal computer is transferred over the RS232 serial interface circuit 315, forwarded by main controller circuit 313 to the data pump circuit 311 where the data is placed on the telephone line via telephone line interface circuit 309.
In a reciprocal fashion, data is received from the telephone line over telephone line interface circuit 309 and simply forwarded by the data pump circuit 311, the main controller circuit 313 over the serial line interface circuit 315 to the personal computer.
As described above, and more fiilly below, the address book function of the present system is primarily a support function for providing telephone numbers and addresses for the other various functions of the present system.
Packet Protocol Between the PC and the Hardware Component A special packet protocol is used for communication between the hardware components 20 and the personal computer (PC) 10. The protocol is used for transferring different types of information between the two devices such as the transfer of DATA, VOICE, and QUALIFIED information. The protocol also uses the BREAK as defined in CCITT X28 as a means to maintain protocol synchronization. A description of this BREAK sequence is also described in the Statutory Invention Registration entitled
"ESCAPE METHODS FOR MODEM COMMUNICATIONS", to Timothy D. Gunn filed January 8, 1993.
The protocol has two modes of operation. One mode is packet mode and the other is stream mode. The protocol allows mixing of different types of information into the data stream without having to physically switch modes of operation. The hardware component 20 will identify the packet received from the computer 10 and perform the appropriate action according to the specifications of the protocol. If it is a data packet, then the controller 313 of hardware component 20 would send it to the data pump circuit 311. If the packet is a voice packet, then the controller 313 of hardware component 20 would distribute that information to the Voice DSP 306. This packet transfer mechanism also works in the reverse, where the controller 313 of hardware component 20 would give different information to the computer 10 without having to switch into different modes. The packet protocol also allows commands to be sent to either the main controller 313 directly or to the Voice DSP 306 for controlling different options without having to enter a command state.
Packet mode is made up of 8 bit asynchronous data and is identified by a beginning synchronization character (01 hex) followed by an ID/LI character and then followed by the information to be sent. In addition to the ID/LI character codes defined below, those skilled in the art will readily recognize that other ID/LI character codes could be defined to allow for additional types of packets such as video data, or alternate voice compression algorithm packets such as Codebook Excited Linear Predictive Coding (CELP) algorithm, GSM, RPE, VSELP, etc.
Stream mode is used when large amounts of one type of packet (VOICE, DATA, or QUALIFIED) is being sent. The transmitter tells the receiver to enter stream mode by a unique command. Thereafter, the transmitter tells the receiver to terminate stream mode by using the BREAK command followed by an "AT' type command. The command used to terminate the stream mode can be a command to enter another type of stream mode or it can be a command to enter back into packet mode.
Currently there are 3 types of packets used: DATA, VOICE, and QUALIFIED. Table 1 shows the common packet parameters used for all three packet types. Table 2 shows the three basic types of packets with the sub-types listed. TABLE 1: Packet Parameter*
1. Asynchronous transfer
2. 8 bits, no parity
3. Maximum packet length of 128 bytes
- IDentifier byte = 1 - InFormation = 127 4. SPEED
- variable from 9600 to 57600
- default to 19200
TABLE 2: Packet Types
l. Data
2. Voice
3. Qualified: a. COMMAND b. RESPONSE c. STATUS d. FLOW CONTROL e. BREAK f. ACK g. NAK h. STREAM A Data Packet is shown in Table 1 and is used for normal data transfer between the controller 313 of hardware component 20 and the computer 10 for such things as text, file transfers, binary data and any other type of information presently being sent through modems. All packet transfers begin with a synch character 01 hex (synchronization byte). The Data Packet begins with an ID byte which specifies the packet type and packet length. Table 3 describes the Data Packet byte structure and Table 4 describes the bit structure of the ID byte of the Data Packet. Table 5 is an example of a Data Packet with a byte length of 6. The value of the LI field is the actual length of the data field to follow, not counting the ID byte. TABLE 3: Data Packet Byte Structure
Figure imgf000021_0001
01 ID SYNC LI data data data data data
TABLE 4: ID Byte of Data Packet Bit 7 identifies the type of packet
Bits 6 - 0 contain the LI or length indicator portion of the ID byte
LI (Length Indicator) = 1 to 127
TABLE 5: Data Packet Example
LI (length indicator) = 6
01 06 SYNC ID data data data data data data
The Voice Packet is used to transfer compressed VOICE messages between the controller 313 of hardware component 20 and the computer 10. The Voice Packet is similar to the Data Packet except for its length which is, in the preferred embodiment, currently fixed at 23 bytes of data. Once again, all packets begin with a synchronization character chosen in the preferred embodiment to be 01 hex (01H). The ID byte of the Voice Packet is completely a zero byte: all bits are set to zero. Table 6 shows the ID byte of the Voice Packet and Table 7 shows the Voice Packet byte structure. TABLE 6: ID Byte of Voice Packet
LI (Length Indicator) = 0
TABLE 7: Voice Packet Byte Structure
LI (length indicator) = 0 23 bytes of data (depending upon compression algorithm used)
01 00 SYNC ID data data data data data
The Qualified Packet is used to transfer commands and other non-data/voice related information between the controller 313 of hardware component 20 and the computer 10. The various species or types of the Qualified Packets are described below and are listed above in Table 2. Once again, all packets start with a synchronization character chosen in the preferred embodiment to be 01 hex (01H). A Qualified Packet starts with two bytes where the first byte is the ID byte and the second byte is the QUALIFIER type identifier. Table 8 shows the ID byte for the Qualified Packet, Table 9 shows the byte structure of the Qualified Packet and Tables 10-12 list the Qualifier Type byte bit maps for the three types of Qualified Packets. TABLE 8 : ID Byte of Qualified Packet
7 6 5 4 3 2 1 0
1 LI (Length Indicator) = 1 to 127
The Length Identifier of the ID byte equals the amount of data which follows including the QUALIFIER byte (QUAL byte + DATA). If LI = 1, then the Qualifier Packet contains the Q byte only. TABLE 9: Qualifier Packet Byte Structure
01 85 QUAL ' SYNC ID BYTE data data data '■ data
The bit maps of the Qualifier Byte (QUAL BYTE) of the Qualified Packet are shown in Tables 10-12. The bit map follows the pattern whereby if the QUAL byte = 0, then the command is a break. Also, bit 1 of the QUAL byte designates acknak, bit 2 designates flow control and bit 6 designates stream mode command. Table 10 describes the Qualifier Byte of Qualified Packet, Group 1 which are immediate commands. Table 11 describes the Qualifier Byte of Qualified Packet, Group 2 which are stream mode commands in that the command is to stay in the designated mode until a BREAK + INIT command string is sent. Table 12 describes the Qualifier Byte of Qualified Packet, Group 3 which are information or status commands.
TABLE 10: Qualifier Byte of Qualified Packet: Group 1 7 6 5 4 3 2 1 0 x x x x x x x x
Figure imgf000023_0001
TABLE 11: Qualifier Byte of Qualified Packet: Group 2
7 6 5 4 3 2 1 0 x x x x x x x x
Figure imgf000023_0002
The Qualifier Packet indicating stream mode and BREAK attention is used when a large of amount of information is sent (voice, data...) to allow the highest throughput possible. This command is mainly intended for use in DATA mode but can be used in any one of the possible modes. To change from one mode to another, a break-init sequence would be given. A break "AT...<cr>" type command would cause a change in state and set the serial rate from the "AT" command. TABLE 12 : Qualifier Byte of Qualified Packet: Group 3
Figure imgf000024_0001
In order to determine the status of the cellular link, a supervisory packet shown in Table 13 is used. Both sides of the cellular link will send the cellular supervisory packet every 3 seconds. Upon receiving the cellular supervisory packet, the receiving side will acknowledge it using the ACK field of the cellular supervisory packet. If the sender does not receive an acknowledgement within one second, it will repeat sending the cellular supervisory packet up to 12 times. After 12 attempts of sending the cellular supervisory packet without an acknowledgement, the sender will disconnect the line. Upon receiving an acknowledgement the sender will restart its 3 second timer. Those skilled in the art will readily recognize that the timer values and wait times selected here may be varied without departing from the spirit or scope of the present invention.
TABLE 13: Cellular Supervisory Packet Byte Structure
8F ID LI ACK data data data
Speech Compression The Speech Compression algorithm described above for use in transmitting voice over data accomplished via the voice control circuit 306. Referring once again to Figure 2, the user is talking either through the handset, the headset or the microphone speaker telephone interface. The analog voice signals are received and digitized by the telephone CODEC circuit 305. The digitized voice information is passed from the digital 746S PCMJS95/14826
23 telephone CODEC circuit 305 to the voice control circuits 306. The digital signal processor (DSP) of the voice control circuit 306 is programmed to do the voice compression algorithm. The source code programmed into the voice control DSP is in the microfiche appendix of U.S. Patent Application Serial No. 08/002,467, filed January 8, 1993 entitled "COMPUTER-BASED MULΗFUNCΗON PERSONAL COMMUNICATIONS SYSTEM'. The DSP of the voice control circuit 306 compresses the speech and places the compressed digital representations of the speech into special packets described more fully below. As a result of the voice compression algorithm, the compressed voice information is passed to the dual port ram circuit 308 for either forwarding and storage on the disk of the personal computer via the RS232 serial interface or for multiplexing with conventional modem data to be transmitted over the telephone line via the telephone line interface circuit 309 in the voice-over-data mode of operation Show and Tell function 123. The compressed speech bits are multiplexed with data bits using a packet format described below. Three compression rates are described herein which will be called 8Kbit/sec, 9.6Kbit sec and 16Kbit sec.
Speech Compression Algorithm To multiplex high-fidelity speech with digital data and transmit both over the telephone line, a high available bandwidth would normally be required. In the present invention, the analog voice information is digitized into 8-bit PCM data at an 8 KHz sampling rate producing a serial bit stream of 64,000 bps serial data rate. This rate cannot be transmitted over the telephone line. With the Speech Compression algorithm described below, the 64 Kbs digital voice data is compressed into a 9500 bps encoding bit stream using a fixed-point (non-floating point) DSP such that the compressed speech can be transmitted over the telephone line multiplexed with asynchronous data This is accomplished in an efficient manner such that enough machine cycles remain during real time speech compression to allow to allow for echo cancellation in the same fixed-point DSP.
A silence detection function is used to detect quiet intervals in the speech signal which allows the data processor to substitute asynchronous data in lieu of voice data packets over the telephone line to efficiently time multiplex the voice and asynchronous data transmission. The allocation of time for asynchronous data transmission is constantly changing depending on how much silence is on the voice channel. The voice compression algorithm of the present system relies on a model of human speech which shows that human speech contains redundancy inherent in the voice patterns. Only the incremental innovations (changes) need to be transmitted. The algorithm operates on 128 digitized speech samples (20 milliseconds at 6400 Hz), divides the speech samples into time segments of 32 samples (5 milliseconds) each, and uses predicted coding on each segment. Thus, the input to the algorithm could be either PCM data sampled at 6400 Hz or 8000 Hz. If the sampling is at 8000 Hz, or any other selected sampling rate, the input sample data stream must be decimated from 8000 Hz to 6400 Hz before processing the speech data. At the output, the 6400 Hz PCM signal is interpolated back to 8000 Hz and passed to the CODEC.
With this algorithm, the current segment is predicted as best as possible based on the past recreated segments and a difference signal is determined. The difference values are compared to the stored difference values in a lookup table or code book, and the address of the closest value is sent to the remote site along with the predicted gain and pitch values for each segment. In this fashion the entire 20 milliseconds of speech can be represented by 190 bits, thus achieving an effective data rate of 9500 bps. To produce this compression, the present system includes a unique Vector Quantization (VQ) speech compression algorithm designed to provide maximum fidelity with minimum compute power and bandwidth. The VQ algorithm has two major components. The first section reduces the dynamic range of the input speech signal by removing short term and long term redundancies. This reduction is done in the waveform domain, with the synthesized part used as the reference for deteπnining the incremental "new" content. The second section maps the residual signal into a code book optimized for preserving the general spectral shape of the speech signal. Figure 3 is a high level signal flow block diagram of the speech compression algorithm used in the present system to compress the digitized voice for transmission over the telephone line in the voice over data mode of operation or for storage and use on the personal computer. The transmitter and receiver components are implemented using the programniable voice control DSP/CODEC circuit 306 shown in Figure 2.
The DC removal stage 1101 receives the digitized speech signal and removes the D.C. bias by calculating the long-term average and subtracting it from each sample. This ensures that the digital samples of the speech are centered about a zero mean value. The pre-emphasis stage 1103 whitens the spectral content of the speech signal by balancing the extra energy in the low band with the reduced energy in the high band.
The system finds the innovation in the current speech segment by subtracting 1109 the prediction from reconstructed past samples synthesized from synthesis stage 1107. This process requires the synthesis of the past speech samples locally (analysis by synthesis). The synthesis block 1107 at the transmitter performs the same function as the synthesis block 1113 at the receiver. When the reconstructed previous segment of speech is subtracted from the present segment (before prediction), a difference term is produced in the form of an error signal. This residual error is used to find the best match in the code book 1105. The code book 1105 quantizes the error signal using a code book generated from a representative set of speakers and environments. A minimum mean squared error match is determined in segments. In addition, the code book is designed to provide a quantization error with spectral rolloff (higher quantization error for low frequencies and lower quantization error for higher frequencies). Thus, the quantization noise spectrum in the reconstructed signal will always tend to be smaller than the underlying speech signal.
The following description will specifically explain the algorithm for the 9.6Kbit/sec compression rate, except where specifically stated otherwise. The discussion is applicable to the other compression rates by substituting the parameter values found in Table 14, below, and by following the special instructions for each calculation provided throughout the discussion.
TABLE 14 Speech Compression Algorithm Parameter For Three Voice Compression Rates
Parameter 16Kbit/sec 9.6Kbit/sec 8Kbit/sec
Input Samples (msecs @ 8Ksample/sec) 160 (20msec) 160 (20msec) 192 (24msec)
Decimated Samples (msec) 160 (20msec) 128 (20msec) 144 (24msec)
10 @ rate @ 8Ksample/sec @ 6.4Ksample/sec @ 6Ksample/sec
15 t-
-*_!
20
Figure imgf000029_0001
25
9.6Kbit/sec Compression Rate Algorithm For the 9.6Kbit/sec speech compression rate, each frame of 20ms is divided into 4 sub-blocks or segments of 5ms each. Each sub-block of data consists of a plurality of bits for the long term predictor, a plurality of bits for the long term predictor gain, a plurality of bits for the sub-block gain, and a plurality of bits for each code book entry for each 5ms. In the code book block, each 1.25ms of speech is looked up in a 512 word code book for the best match. The table entry is transmitted rather than the actual samples. The code book entries are pre-computed from representative speech segments, as described more fully below.
On the receiving end 1200, the synthesis block 1113 at the receiver performs the same function as the synthesis block 1107 at the transmitter. The synthesis block 1113 reconstructs the original signal from the voice data packets by using the gain and pitch values and code book address corresponding to the error signal most closely matched in the code book. The code book at the receiver is similar to the code book 1105 in the transmitter. Thus the synthesis block recreates the original pre-emphasized signal. The de-emphasis stage 1115 inverts the pre-emphasis operation by restoring the balance of original speech signal. The complete speech compression algorithm is summarized as follows: a) Digitally sample the voice to produce a PCM sample bit stream sampled at 8,000 samples per second. b) Decimate the 8,000 samples per second sampled data to produce a sampling rate of 6,400 samples per second for the 9.6Kbit/sec compression rate (6,000 samples per second for the 8Kbit/sec algorithm and 8,000 samples per second for the 16Kbit/sec algorithm). c) Remove any D.C. bias in the speech signal. d) Pre-emphasize the signal. e) Find the innovation in the current speech segment by subtracting the prediction from reconstructed past samples. This step requires the synthesis of the past speech samples locally (analysis by synthesis) such that the residual error is fed back into the system. f) Quantize the error signal using a code book generated from a representative set of speakers and environments.
A minimum mean squared error match is determined in 5ms segments. In addition, the code book is designed to provide a quantization error with spectral rolloff (higher quantization error for low frequencies and lower quantization error for higher frequencies). Thus, the quantization noise spectrum in the reconstructed signal will always tend to be smaller than the underlying speech signal. g) At the transmitter and the receiver, reconstruct the speech from the quantized error signal fed into the inverse of the function in step (e) above. Use this signal for analysis by synthesis and for the output to the reconstruction stage below. h) Use a de-emphasis filter to reconstruct the output.
The major advantages of this approach over other low-bit-rate algorithms are that there is no need for any complicated calculation of reflection coefficients (no matrix inverse or lattice filter computations). Also, the quantization noise in the output speech is hidden under the speech signal and there are no pitch tracking artifacts: the speech sounds "natural", with only minor increases of background hiss at lower bit-rates. The computational load is reduced significantly compared to a VSELP algorithm and variations of the present algorithm thus provides bit rates of 8, 9.6 and 16 Kbit/sec, and can also provide bit rates of 9.2Kbit/sec, 9.5Kbit/sec and many other rates. The total delay through the analysis section is less than 20 milliseconds in the 9.6Kbit/sec embodiment. The present algorithm is accomplished completely in the waveform domain and there is no spectral information being computed and there is no filter computations needed.
Detailed Description of the Speech Compression Algorithm
The speech compression algorithm is described in greater detail with reference to Figures 4 through 7, and with reference to the block diagram of the hardware components of the present system shown at Figure 2. The voice compression algorithm Operates within the programmed control of the voice control DSP circuit 306. In operation, the speech or analog voice signal is received through the telephone interface 301, 302 or 303 and is digitized by the digital telephone CODEC circuit 305. The CODEC for circuit 305 is a companding μ-law CODEC. The analog voice signal from the telephone interface is band-limited to about 3,000 Hz and sampled at a selected sampling rate by digital telephone CODEC 305. The sample rates in the 9.6Kbit/sec embodiment of the present invention are 8Ksample/sec. Each sample is encoded into 8-bit PCM data producing a serial 64kb/s. The digitized samples are passed to the voice control DSP/CODEC of circuit 306. There, the 8-bit μ-law PCM data is converted to 13-bit linear PCM data. The 13-bit representation is necessary to accurately represent the linear version of the logarithmic 8-bit μ-law PCM data. With linear PCM data, simpler mathematics may be performed on the PCM data.
The voice control DSP/CODEC of circuit 306 correspond to the single integrated circuit U8 shown in Figures 9A and 9B as a WE DSP16C Digital Signal Processor/CODEC from AT&T Microelectronics which is a combined digital signal processor and a linear CODEC in a single chip as described above. The digital telephone CODEC of circuit 305 corresponds to integrated circuit U12 shown in Figure 9B as a T7540 companding μ-law CODEC.
The sampled and digitized PCM voice signals from the telephone μ-law CODEC 305 shown in Figure 2 are passed to the voice control DSP/CODEC circuit 308 via direct data lines clocked and synchronized to a clocking frequency. The sample rate in CODEC 305 in this embodiment of the present invention is 8Ksample sec. The digital samples are loaded into the voice control DSP/CODEC one at a time through the serial input and stored into an internal queue held in RAM, converted to linear PCM data and decimated to a sample rate of 6.4Ksample/sec. As the samples are loaded into the end of the queue in the RAM of the voice control DSP, the samples at the head of the queue are operated upon by the voice compression algorithm. The voice compression algorithm then produces a greatly compressed representation of the speech signals in a digital packet form. The compressed speech signal packets are then passed to the dual port RAM circuit 308 shown in Figure 2 for use by the main controller circuit 313 for either transferring in the voice-over-data mode of operation or for transfer to the personal computer for storage as compressed voice for functions such as telephone answering machine message data, for use in the multi-media documents and the like.
In the voice-over-data mode of operation, voice control DSP/CODEC circuit 306 of Figure 2 will be receiving digital voice PCM data from the digital telephone CODEC circuit 305, compressing it and transferring it to dual port RAM circuit 308 for multiplexing and transfer over the telephone line. This is the transmit mode of operation of the voice control DSP/CODEC circuit 306 corresponding to transmitter block 1100 of Figure 3 and corresponding to the compression algorithm of Figure 4.
Concurrent with this transmit operation, the voice control DSP/CODEC circuit 306 is receiving compressed voice data packets from dual port RAM circuit 308, uncompressing the voice data and transferring the uncompressed and reconstructed digital PCM voice data to the digital telephone CODEC 305 for digital to analog conversion and eventual transfer to the user through the telephone interface 301, 302, 304. This is the receive mode of operation of the voice control DSP/CODEC circuit 306 corresponding to receiver block 1200 of Figure 3 and corresponding to the decompression algorithm of Figure 5. Thus, the voice-control DSP/CODEC circuit 306 is processing the voice data in both directions in a full-duplex fashion. The voice control DSP/CODEC circuit 306 operates at a clock frequency of approximately 24.576MHz while processing data at sampling rates of approximately 8KHz in both directions. The voice compression decompression algorithms and packetization of the voice data is accomplished in a quick and efficient fashion to ensure that all processing is done in real-time without loss of voice information. This is accomplished in an efficient manner such that enough machine cycles remain in the voice control DSP circuit 306 during real time speech compression to allow real time acoustic and line echo cancellation in the same fixed-point DSP.
In programmed operation, the availability of an eight-bit sample of PCM voice data from the μ-law digital telephone CODEC circuit 305 causes an interrupt in the voice control DSP/CODEC circuit 306 where the sample is loaded into internal registers for processing. Once loaded into an internal register it is transferred to a RAM address which holds a queue of samples. The queued PCM digital voice samples are converted from 8-bit μ- law data to a 13-bit linear data format using table lookup for the conversion. Those skilled in the art will readily recognize that the digital telephone CODEC circuit 305 could also be a linear CODEC.
Sample Rate Decimation The sampled and digitized PCM voice signals from the telephone μ-law CODEC 305 shown in Figure 2 are passed to the voice control DSP/CODEC circuit 308 via direct data lines clocked and synchronized to a clocking frequency. The sample rate in this embodiment of the present invention is 8Ksample sec. The digital samples for the 9.6Kbit sec and 8Kbit/sec algorithms are decimated using a digital decimation process to produce a 6.4Ksample sec and 6Ksample sec rate, respectively. For the 16Kbit/sec algorithm, no decimation is needed.
Referring to Figure 3, the decimated digital samples are shown as speech entering the transmitter block 1100. The transmitter block, of course, is the mode of operation of the voice-control DSP/CODEC circuit 306 operating to receive local digitized voice information, compress it and packetize it for transfer to the main controller circuit 313 for transmission on the telephone line. The telephone line connected to telephone line interface 309 of Figure 2 corresponds to the channel 1111 of Figure 3.
A frame rate for the voice compression algorithm is 20 milliseconds of speech for each compression. This correlates to 128 samples to process per frame for the 6.4K decimated sampling rate. When 128 samples are accumulated in the queue of the internal DSP RAM, the compression of that sample frame is begun. Data Flow Description The voice-control DSP/CODEC circuit 306 is programmed to first remove the DC component 1101 of the incoming speech. The I removal is an adaptive function to establish a center base line on the voice signal by digitally adjusting the values of the PCM data. This corresponds to the DC removal stage 1203 of the software flow chart of Figure 4. The formula for removal of the DC bias or drift is as follows:
32735 x(n) = s(n) - s(n-l) + * x (n-1) where α =
32768 and where n = sample number, s(n) is the current sample, and x(n) is die sample with the DC bias removed
The removal of the DC is for the 20 millisecond frame of voice which amounts to 128 samples at the 6.4Ksample/sec decimated sampling rate which corresponds to the 9.6Kbit/sec algorithm. The selection of α is based on empirical observation to provide the best result.
Referring again to Figure 4, the voice compression algorithm in a control flow diagram is shown which will assist in the understanding of the block diagram of Figure 3. Figure 6 is a simplified data flow description of the flow chart of Figure 4 showing the sample rate decimator 1241 and the sample rate incrementor 1242. Sample rate decimator 1241 produces an output 1251 of 6.4Ksample/sec for an 8Ksample sec input in the 9.6Kbit/sec system. (Similarly, a 6Ksample/sec output 1250 is produced for the 8Kbit/sec algorithm, and no decimation is performed on the 8Ksample/sec voice sample rate 1252 for the 16Kbit/sec algorithm.) The analysis and compression begin at block 1201 where the 13-bit linear PCM speech samples are accumulated until 128 samples (for the 6.4Ksample/sec decimated sampling rate) representing 20 milliseconds of voice or one frame of voice is passed to the DC removal portion of code operating within the programmed voice control DSP/CODEC circuit 306. The DC removal portion of the code described above approximates the base line of the frame of voice by using an adaptive DC removal technique.
A silence detection algorithm 1205 is also included in the programmed code of the DSP/CODEC 306. The silence detection function is a summation of the square of each sample of the voice signal over the frame. If the power of the voice frame falls below a preselected threshold, this would indicate a silent frame. The detection of a silence frame of speech is important for later multiplexing of the V-data (voice data) and C-data (asynchronous computer data) described below. During silent portions of the speech, the main controller circuit 313 will transfer conventional digital data (C-data) over the telephone line in lieu of voice data (V-data). The formula for computing the power is
Sub-Block Size-1 PWR = Σ x (n) * x (n) n = 0 where n is the sample number, and x (n) is the sample value
If the power PWR is lower than a preselected threshold, then the present voice frame is flagged as containing silence. The 128-sample (Decimated Samples) silent frame is still processed by the voice compression algorithm; however, the silent frame packets are discarded by the main controller circuit 313 so that asynchronous digital data may be transferred in lieu of voice data. The rest of the voice compression is operated upon in segments where there are four segments per frame amounting to 32 samples of data per segment (Sub-Block Size). It is only the DC removal and silence detection which is accomplished over an entire 20 millisecond frame.
The pre-emphasis 1207 of the voice compression algorithm shown in Figure 4 is the next step. The sub-blocks are first passed through a pre-emphasis stage which whitens the spectral content of the speech signal by balancing the extra energy in the low band with the reduced energy in the high band. The pre-emphasis essentially flattens the signal by reducing the dynamic range of the signal. By using pre-emphasis to flatten the dynamic range of the signal, less of a signal range is required for compression making the compression algorithm operate more efficiently. The formula for the pre- emphasis is x (n) = x (n) - p * x (n-1) where p = 0.5 for 9.6Kbit/sec and where n is the sample number, x (n) is the sample
Each segment thus amounts to five milliseconds of voice which is equal to 32 samples. Pre-emphasis then is done on each segment. The selection of p is based on empirical observation to provide the best result.
The next step is the long-term prediction (LTP). The long-term prediction is a method to detect the innovation in the voice signal. Since the voice signal contains many redundant voice segments, we can detect these redundancies and only send information about the changes in the signal from one segment to the next. This is accomplished by comparing the speech samples of the current segment on a sample by sample basis to the reconstructed speech samples from the previous segments to obtain the innovation information and an indicator of the error in the prediction.
The long-term predictor gives the pitch and the LTP-Gain of the sub-block which are encoded in the transmitted bit stream. In order to predict the pitch in the current segment, we need at least 3 past sub-blocks of reconstructed speech. This gives a pitch value in the range of MIN PITCH to MAX PITCH (32 and 95, respectively, as given in Table 14). This value is coded with 6-bits. But, in order to accommodate the compressed data rate within a 9600 bps link, the pitch for segments 0 and 3 is encoded with 6 bits, while the pitch for segments 1 and 2 is encoded with 5 bits. When performing the prediction of the Pitch for segments 1 and 2, the correlation lag is adjusted around the predicted pitch value of the previous segment. This gives us a good chance of predicting the correct pitch for the current segment even though the entire range for prediction is not used. The computations for the long-term correlation lag PITCH and associated LTP-gain factor β j (where j = 0, 1, 2, 3 corresponding to each of the four segments of the frame) are done as follows:
For j = min_pitch .... maxjpiteh, first perform the following computations between the current speech samples x(n) and the past reconstructed speech samples xfn)
Sub-Block Size - 1
Sa. 0) = ∑* (i) * x' 0 + MAX_PITCH -j) i=0
* x' (i+MAX_PITCH-j)
Figure imgf000038_0001
S 2 The Pitch j is chosen as that which maximizes "^ — . Since β j is positive, only j with positive S^ 2 is considered.
For the 9.6Kbit sec and 8Kbit/sec embodiments, the Pitch is encoded with different number of bits for each sub-segment, the value of min_pitch and max_pitch (range of the synthesized speech for pitch prediction of the current segment) is computed as follows: if (seg. umber = 0 or 3)
{ min_pitch = MIN PITCH max_pitch = MAX_PITCH
} if (seg number = 1 or 2)
{ min ϊitch = prev_pitch - 15 if (prev pitch < MIN_PITCH + 15) min_pitch = MIN PITCH if (prev_pitch > MAX_PITCH + 15) min_pitch = MAX PITCH - 30 max_pitch = min_pitch + 30 } (This calculation is not necessary for the 16Kbit/sec algorithm.) The prev_piteh parameter in the above equation, is the of the pitch of the previous sub-segment. The pitch j is the encoded in 6 bits or 5 bits as: encoded bits = j - min_pitch The LTP-Gain is given by
Figure imgf000039_0001
The value of the β is a normalized quantity between zero and unity for this segment where β is an indicator of the correlation between the segments. For example, a perfect sine wave would produce a β which would be close to unity since the correlation between the current segments and the previous reconstructed segments should be almost a perfect match so β is one. The LTP gain factor is quantized from a LTP Gain Encode Table. This table is characterized in Table 15. The resulting index (bcode) is transmitted to the far end. At the receiver, the LTP Gain Factor is retrieved from Table 16, as follows: β~ = dlbjab[bcode] TABLE 15: LTP Gain Encode Table
Figure imgf000039_0002
After the Long-Term Prediction, we pass the signal through a pitch filter to whiten the signal so that all the pitch effects are removed. The pitch filter is given by: e(n)=x(n)- q * x' (n-j) where j is the Lag, and β_ is the associated Quantized LTP Gain.
Next, the error signal is normalized with respect to the maximum amplitude in the sub-segment for vector-quantization of the error signal. The maximum amplitude in the segment is obtained as follows:
G = MAX{|ef« |}
The maximum amplitude (G) is encoded using the Gain Encode Table. This table is characterized in Table 17. The encoded amplitude (gcode) is transmitted to the far end. At the receiver, the maximum amplitude is retrieved from Table 18, as follows:
Gq = dlgtabfecode]
The error signal e(n) is then normalized by e(n)
4096 8192
I- I I -> 8 9
Figure imgf000040_0001
TABLE 18: Gain Decode Table
G=16 32 64 128 256 512 1024 2048 4096 8192
I I I - I I- I I - I I -I I - I I I I I I - 1 I I
0 1 2 3 4 5 6 7 8 9 (gcode)
From the Gain and LTP Gain Encode tables, we can see that we would require 4 bits for gcode and 3 bits for bcode. This results in total of 7 bits for both parameters. In order to reduce the bandwidth of the compressed bit stream, the gcode and bcode parameters are encoded together in 6 bits, as follows:
BGCODE = 6 * gcode + bcode. The encoded bits for the G and LTP-Gain (β) at the receiver can be obtained as follows: gcode = BGCODE / 6 bcode = BGCODE - 6 * gcode However, these calculations are needed only for the 8Kbit/sec and 9.6Kbit/sec algorithms.
Each segment of 32 samples (Sub-Block Size) is divided into 4 vectors of 8 samples (VSIZE) each. Each vector is compared to the vectors stored in the CodeBook and the Index of the Code Vector that is closest to the signal vector is selected. The CodeBook consists of 512 entries (512 addresses). The index chosen has the least difference according to the following minimization formula:
VSlZE - l
Figure imgf000041_0001
ι=0 where x, =the input vector of VSIZE samples (8 for the
9.6Kbit sec algorithm), and y, = the code book vector of VSIZE samples (8 for the 9.6Kbit/sec algorithm). The minimization computation, to find the best match between the subsegment and the code book entries is computationally intensive. A brute force comparison may exceed the available machine cycles if real time processing is to be accomplished. Thus, some shorthand processing approaches are taken to reduce the computations required to find the best fit. The above formula can be computed in a shorthand fashion as follows.
By expanding out the above formula, some of the unnecessary terms may be removed and some fixed terms may be pre-computed: (x, - y,)2 = (x, - y,)*(x, - y,)
= (χ>2 - x-y. - χ_ . + y.2) = (x,2 - 2x.y, + y 2) where x 2 is a constant so it may be dropped from the formula, and the value of -Vi 2_y2 may be precomputed and stored as the VSIZE + 1th value (8 + 1 = 9th value for the 9.6 Kbit/sec algorithm) in the code book so that the only real-time computation involved is the following formula:
Figure imgf000042_0001
Thus, for a segment of Sub-Block Size samples (32 for the
9.6Kbit sec algorithm), we will transmit Sub-Block Size/VSIZE CodeBook indices (4 CodeBook Indices, 9 bits each, for the 9.6Kbit/sec algorithm).
Therefore, for the 9.6Kbit/sec algorithm, for each Sub-Block Size segment we will transmit 36 bits representing that segment.
After the appropriate index into the code book is chosen, the input speech samples are replaced by the corresponding vectors in the chosen indexes. These values are then multiplied by the Gq to denormalize the synthesized error signal, e'(n). This signal is then passed through the Inverse
Pitch Filter to reintroduce the Pitch effects that was taken out by the Pitch filter. The Inverse Pitch Filter is performed as follows: y( ) = e'(n) + ^ * x' (n -j) where βq is the Quantized LTP-Gain from Table 16, and j is the Lag.
The Inverse Pitch Filter output is used to update the synthesized speech buffer which is used for the analysis of the next sub-segment. The update of the state buffer is as follows: x' (k) =x' (k + MIN_PITCH) where k = 0, ... , (MAX_PITCH - MIN_PITCH) - 1 χ'(l) =y(n) where / = MAX PITCH - MIN_PITCH, ..., MAX_PITCH - 1 The signal is then passed through the deemphasis filter since preemphasis was performed at the beginning of the processing. In the analysis, only the preemphasis state is updated so that we properly satisfy the Analysis-by-Synthesis method of performing the compression. In the Synthesis, the output of the deemphasis filter, s' (n), is passed on to the D/A to generate analog speech. The deemphasis filter is implemented as follows: s'(n) =y (n) + p * s' (n - 1) where p = 0.5 for the 9.6Kbit/sec algorithm
The voice is reconstructed at the receiving end of the voice- over data link according to the reverse of the compression algorithm as shown as the decompression algorithm in Figure 5.
If a silence frame is received, the decompression algorithm simply discards the received frame and initialize the output with zeros. If a speech frame is received, the pitch, LTP-Gain and GAIN are decoded as explained above. The error signal is reconstructed from the codebook indexes, which is then denormalized with respect to the GAIN value. This signal is then passed through the Inverse filter to generate the reconstructed signal. The Pitch and the LTP-Gain are the decoded values, same as those used in the Analysis. The filtered signal is passed through the Deemphasis filter whose output is passed on to the D/A to put out analog speech. The compressed frame contains 23 8-bit words and one 6-bit word. Thus a total of 24 words. Total number of bits transferred is 190, which corresponds to 9500 bps as shown in Table 19 (for the 9.6Kbit/sec algorithm).
Table 19 Compressed Ftame Packet for 9.6Kbit/sec Algorithm
Figure imgf000044_0001
where BG = Beta/Gain, P = Pitch, VQ = CodeBook Index and S = Spare Bits
Code Book Descriptions Table 20 describes the format of the code book for the 9.6Kbit/sec algorithm. The code book values are stored in a signed floating point format which is converted to a fixed point representation of floating point number when stored in the lookup tables of the present invention. There are 512 entries in each code book corresponding to 512 different speech segments which can be used to encode and reconstruct the speech.
Table 20: Code Book Foimat for the 9.6Kbit/sec Algorithm
Code Book Entries — lΛ Sum2 Constant —
8 entries 1 entry
For the 9.6Kbit/sec algorithm, the code book comprises a table of nine columns and 512 rows of floating point data. The first 8 rows correspond to the 8 samples of speech and the ninth entry is the precomputed constant described above as -Vi Σ y ,2. An example of the code book data is shown in Table 21 with the complete code book for the 9.6Kbit/sec algorithm.
Figure imgf000046_0002
10
»
Figure imgf000046_0001
The code books are stored in PROM memory accessible by the Voice DSP as a lookup table. The table data is loaded into local DSP memory upon the selection of the appropriate algorithm to increase access speed. The code books comprise a table of data in which each entry is a sequential address from 000 to 511. For the 9.6Kbit sec algorithm, a 9 X 512 code book is used. For the 16Kbit/sec algorithm, a 6 X 256 code book is used and for the 8Kbit/sec algorithm, a 9 X 512 code book is used. Depending upon which voice compression quality and compression rate is selected, the corresponding code book is used to encode decode the speech samples.
Generation of the Code Books The code books are generated statistically by encoding a wide variety of speech patterns. The code books are generated in a learning mode for the above-described algorithm in which each speech segment which the compression algorithm is first exposed to is placed in the code book until 512 entries are recorded. Then the algorithm is continually fed a variety of speech patterns upon which the code book is adjusted. As new speech segments are encountered, the code book is searched to find the best match. If the error between the observed speech segment and the code book values exceed a predetermined threshold, then the closest speech segment in the code book and the new speech segment is averaged and the new average is placed in the code book in place of the closest match. In this learning mode, the code book is continually adjusted to have the lowest difference ratio between observed speech segment values and code book values. The learning mode of operation may take hours or days of exposure to different speech patterns to adjust the code books to the best fit.
The code books may be exposed to a single person's speech which will result in a code book being tailored to that particular persons method of speaking. For a mass market sale of this product, the speech patterns of a wide variety of speakers of both genders are exposed to the code book learning algorithm for the average fit for a given language. For other languages, it is best to expose the algorithm to speech patterns of only one language such as English or Japanese.
Voice Over Data Packet Protocol As described above, the present system can transmit voice data and conventional data concurrently by using time multiplex technology. The digitized voice data, called V-data carries the speech information. The conventional data is referred to as C-data. The V-data and C-data multiplex transmission is achieved in two modes at two levels: the transmit and receive modes and data service level and multiplex control level. This operation is shown diagrammatically in Figure 7.
In transmit mode, the main controller circuit 313 of Figure 2 operates in the data service level 1505 to collect and buffer data from both the personal computer 10 (through the RS232 port interface 315) and the voice control DSP 306. In multiplex control level 1515, the main controller circuit 313 multiplexes the data and transmits that data out over the phone line 1523. In the receive mode, the main controller circuit 313 operates in the multiplex control level 1515 to de-multiplex the V-data packets and the C-data packets and then operates in the data service level 1505 to deliver the appropriate data packets to the correct destination: the personal computer 10 for the C-data packets or the voice control DSP circuit 306 for V-data
Transmit Mode In transmit mode, there are two data buffers, the V-data buffer 1511 and the C-data buffer 1513, implemented in the main controller RAM 316 and maintained by main controller 313. When the voice control DSP circuit 306 engages voice operation, it will send a block of V-data every 20 ms to the main controller circuit 313 through dual port RAM circuit 308. Each V-data block has one sign byte as a header and 24 bytes of V-data. The sign byte header of the voice packet is transferred every frame from the voice control DSP to the controller 313. The sign byte header contains the sign byte which identifies the contents of the voice packet. The sign byte is defined as follows: 00 hex = the following V-data contains silent sound
01 hex = the following V-data contains speech information
If the main controller 313 is in transmit mode for V-data/C-data multiplexing, the main controller circuit 313 operates at the data service level to perform the following tests. When the voice control DSP circuit 306 starts to send the 24-byte V-data packet through the dual port RAM to the main controller circuit 313, the main controller will check the V-data buffer to see if the buffer has room for 24 bytes. If there is sufficient room in the V-data buffer, the main controller will check the sign byte in the header preceding the V-data packet. If the sign byte is equal to one (indicating voice information in the packet), the main controller circuit 313 will put the following 24 bytes of V-data into the V-data buffer and clear the silence counter to zero. Then the main controller 313 sets a flag to request that the V-data be sent by the main controller at the multiplex control level. If the sign byte is equal to zero (indicating silence in the V- data packet), the main controller circuit 313 will increase the silence counter by 1 and check if the silence counter has reached 5. When the silence counter reaches 5, the main controller circuit 313 will not put the following 24 bytes of V-data into the V-data buffer and will stop increasing the silence counter. By this method, the main controller circuit 313 operating at the service level will only provide non-silence V-data to the multiplex control level, while discarding silence V-data packets and preventing the V-data buffer from being overwritten.
The operation of the main controller circuit 313 in the multiplex control level is to multiplex the V-data and C-data packets and transmit them through the same channel. At this control level, both types of data packets are transmitted by the HDLC protocol in which data is transmitted in synchronous mode and checked by CRC error checking. If a V-data packet is received at the remote end with a bad CRC, it is discarded since 100% accuracy of the voice channel is not ensured. If the V-data packets were re-sent in the event of corruption, the real-time quality of the voice transmission would be lost. In addition, the C-data is transmitted following a modem data communication protocol such as CCITT V.42.
In order to identify the V-data block to assist the main controller circuit 313 to multiplex the packets for transmission at his level, and to assist the remote site in recognizing and de-multiplexing the data packets, a V-data block is defined which includes a maximum of five V-data packets. The V-data block size and the maximum number of blocks are defined as follows:
The V-data block header = 80h; The V-data block size = 24;
The maximum V-data block size = 5; The V-data block has higher priority to be transmitted than C- data to ensure the integrity of the real-time voice transmission. Therefore, the main controller circuit 313 will check the V-data buffer first to determine whether it will transmit V-data or C-data blocks. If V-data buffer has V-data of more than 69 bytes, a transmit block counter is set to 5 and the main controller circuit 313 starts to transmit V-data from the V-data buffer through the data pump circuit 311 onto the telephone line. Since the transmit block counter indicates 5 blocks of V-data will be transmitted in a continuous stream, the transmission will stop either at finish the 115 bytes of V-data or if the V-data buffer is empty. If V-data buffer has V-data with number more than 24 bytes, the transmit block counter is set 1 and starts transmit V-data This means that the main controller circuit will only transmit one block of V- data If the V-data buffer has V-data with less than 24 bytes, the main controller circuit services the transmission of C-data
During the transmission of a C-data block, the V-data buffer condition is checked before transmitting the first C-data byte. If the V-data buffer contains more than one V-data packet, the current transmission of the C-data block will be terminated in order to handle the V-data. Receive Mode
On the receiving end of the telephone line, the main controller circuit 313 operates at the multiplex control level to de-multiplex received data to V-data and C-data. The type of block can be identified by checking the first byte of the incoming data blocks. Before receiving a block of V- data, the main controller circuit 313 will initialize a receive V-data byte counter, a backup pointer and a temporary V-data buffer pointer. The value of the receiver V-data byte counter is 24, the value of the receive block counter is 0 and the backup pointer is set to the same value as the V-data receive buffer pointer. If the received byte is not equal to 80 hex (80h indicating a V-data packet), the receive operation will follow the current modem protocol since the data block must contain C-data. If the received byte is equal to 80h, the main controller circuit 313 operating in receive mode will process the V-data.
For a V-data block received, when a byte of V-data is received, the byte of V-data is put into the V-data receive buffer, the temporary buffer pointer is increased by 1 and the receive V-data counter is decreased by 1. If the V-data counter is down to zero, the value of the temporary V-data buffer pointer is copied into the backup pointer buffer. The value of the total V-data counter is added with 24 and the receive V-data counter is reset to 24. The value of the receive block counter is increased by 1. A flag to request service of V-data is then set. If the receive block counter has reached 5, the main controller circuit 313 will not put the incoming V-data into the V-data receive buffer but throw it away. If the total V-data counter has reached its maximum value, the receiver will not put the incoming V-data into the V-data receive buffer but throw it away.
At the end of the block which is indicated by receipt of the CRC check bytes, the main controller circuit 313 operating in the multiplex control level will not check the result of the CRC but instead will check the value of the receive V-data counter. If the value is zero, the check is finished, otherwise the value of the backup pointer is copied back into the current V-data buffer pointer. By this method, the receiver is insured to de- multiplex the V-data from the receiving channel 24 bytes at a time. The main controller circuit 313 operating at the service level in the receive mode will monitor the flag of request service of V-data If the flag is set, the main controller circuit 313 will get the V-data from the V-data buffer and transmit it to the voice control DSP circuit 306 at a rate of 24 bytes at a time. After sending a block of V-data, it decreases 24 from the value in the total V-data counter. Negotiation of Voice Compression Rate
The modem hardware component 20 incorporates a modified packet protocol for negotiation of the speech compression rate. A modified supervisory packet is formatted using the same open flag, address, CRC, and closing flag formatting bytes which are found in the CCITT V.42 standard data supervisory packet, as is well known in the industry and as is described in the CCITT Blue Book, volume VIII entitled Data Communication over the Telephone Network. 1989 referenced above. In the modified packet protocol embodiment, the set of CCITT standard header bytes (control words) has been extended to include nonstandard control words used to signal transmission of a nonstandard communication command. The use of a nonstandard control word does not conflict with other data communication terminals, for example, when communicating with a non-PCS (Personal Communications System) modem system, since the nonstandard packet will be ignored by a non-PCS system. Table 22 offers one embodiment of the present invention showing a modified supervisory packet structure. Table 22 omits the CCITT standard formatting bytes: open flag, address, CRC, and closing flag; however, these bytes are described in the CCITT standard. The modified supervisory packet is distinguished from a V.42 standard packet by using a nonstandard control word, such as 80 hex, as the header. The nonstandard control word does not conflict with V.42 standard communications.
TABLE 22: Modified Supervisory Packet Structure
8Oh ID LI ACK data data data
The modified supervisory packet is transmitted by the HDLC protocol in which data is transmitted in synchronous mode and checked by CRC error checking. The use of a modified supervisory packet eliminates the need for an escape command sent over the telephone line to interrupt data communications, providing an independent channel for negotiation of the compression rate. The channel may also be used as an alternative means for programming standard communications parameters. The modified supervisory packet is encoded with different function codes to provide an independent communications channel between hardware components. This provides a means for real time negotiation and programming of the voice compression rate during uninterrupted transmission of voice data and conventional data without the need for conventional escape routines. The modified supervisory packet is encoded with a function code using several embodiments. For example, in one embodiment, the function code is embedded in the packet as one of the data words and is located in a predetermined position. In an alternate embodiment, the supervisory packet header signals a nonstandard supervisory packet and contains the compression rate to be used between the sites. In such an embodiment, for example, a different nonreserved header is assigned to each function code. These embodiments are not limiting and other methods known to those skilled in the art may be employed to encode the function code into the modified supervisory packet. Referring once again to Figure 1, a system consisting of PCS modem 20 and data terminal 10 are connected via phone line 30 to a second PCS system comprised of PCS modem 20A and data terminal 10A. Therefore, calling modem 20 initializes communication with receiving modem 20A. In one embodiment of the present invention, a speech compression command is sent via a modified supervisory data packet as the request for speech compression algorithm and ratio negotiation. Encoded in the speech compression command is the particular speech compression algorithm and the speech compression ratio desired by the calling PCM modem 20. Several methods for encoding the speech compression algorithm and compression ratio exist. For example, in embodiments where the function code is embedded in the header byte, the first data byte of the modified supervisory packet could be used to identify the speech compression algorithm using a binary coding scheme (e.g., OOh for Vector Quantization, Olh for CELP+, 02h for VCELP, and 03h for TrueSpeech, etc.). A second data byte could be used to encode the speech compression ratio (e.g., OOh for 9.6Kbit/sec, Olh for 16Kbit/sec, 02h for 8Kbit/sec, etc.). This embodiment of the speech compression command supervisory packet is shown in Table 23.
TABLE 23: Speech Compression Command Supervisoiy Packet
80h ID LI ACK Algthm CRatio data
Alternatively, as stated above, the function code could be stored in a predetermined position of one of the packet data bytes. Other function code encoding embodiments are possible without deviating from the scope and spirit of the present invention and the embodiments offered are not intended to be exclusive or limiting embodiments.
In either case, the receiving PCS modem 20A will recognize the speech compression command and will respond with an acknowledge packet using, for instance, a header byte such as hex 81. The acknowledge packet will alert the calling modem 20 that the speech compression algorithm and speech compression ratio selected are available by use of the ACK field of the supervisory packet shown in Table 23. Receipt of the acknowledge supervisory packet causes the calling modem 20 to transmit subsequent voice over data information according to the selected speech compression algorithm and compression ratio.
The frequency of which the speech compression command supervisory packet is transmitted will vary with the application. For moderate quality voice over data applications, the speech compression algorithm need only be negotiated at the initialization of the phone call. For applications requiring more fidelity, the speech compression command supervisory packet is renegotiated throughout the call to accommodate new parties to the communication which have different speech compression algorithm limitations or to actively tune the speech compression ratio as the quality of the communications link fluctuates. Other embodiments provide a speech compression command supervisory packet encode varying transmission rates of the speech compression command supervisory packet and different methods of speech compression algorithm and compression ratio negotiation. Additionally, other encoding embodiments to encode the supervisory packet speech compression algorithm and the speech compression ratio may be incorporated without deviating from the scope and spirit of the present invention, and the described embodiments are not exclusive or limiting.
A new supervisory packet may be allocated for use as a means for negotiating multiplexing scheme for the various types of information sent over the communications link. For example, if voice over data mode is employed, there exist several methods for multiplexing the voice and digital data. The multiplexing scheme may be selected by using a modified supervisory packet, called a multiplex supervisory packet, to negotiate the selection of multiplexing scheme.
Similarly, another supervisory packet could be designated for remote control of another hardware device. For example, to control the baud rate or data format of a remote modem, a remote control supervisory packet could be encoded with the necessary selection parameters needed to program the remote device.
Those skilled in the art will readily appreciate that there exist numerous other unidirectional and bidirectional communication and control applications in which the supervisory packet may be used. The examples given are not limiting, but are specific embodiments of the present invention offered for illustrative purposes.
The present inventions are to be limited only in accordance with the scope of the appended claims, since others skilled in the art may devise other embodiments still within the limits of the claims.

Claims

WE CLAIM:
1. A communication module for use with a personal computer, comprising: communications interface means connected for communicating to the personal computer for transferring data between the personal computer and the communications module; telephone line interface means for connection to a telephone line; voice interface means for receiving local voice signals from a local user and for conveying remote voice signals from a remote user to the local user; full-duplex conversion means connected to the voice interface means for converting the local voice signals into outgoing digital voice data and for converting incoming digital voice data into the remote voice signals; digital signal processor means connected to the full-duplex conversion means for compressing the outgoing digital voice data into compressed outgoing digital voice data having one of a plurality of selectable compression rates and for decompressing compressed incoming digital voice data into the incoming digital voice data at one of said plurality of said selectable compression rates; main control means connected for receiving the compressed outgoing digital voice data from the digital signal processor means, connected for receiving outgoing conventional digital data from the personal computer through the communications interface means, and operable for multiplexing the compressed outgoing digital voice data and the conventional digital data to produce multiplexed outgoing data; and the main control means further operable for receiving multiplexed incoming data which contains incoming conventional digital data multiplexed with the compressed incoming digital voice data, for demultiplexing the incoming conventional digital data and the coπφressed incoming digital voice data, and for sending the incoming conventional digital data to the personal computer through the communications interface means and for sending the compressed incoming digital voice data to the digital signal processor means; and the main control means further operable for negotiating the compression rate at various times during the transmission of conventional digital data multiplexed with the compressed digital voice data to change the compression rate.
2. The module according to claim 1 wherein the digital signal processor means is fiarther operable for compressing the outgoing digital voice data into compressed outgoing digital voice data by performing the steps of: a) removing any DC bias in the outgoing digital voice data to produce a normalized outgoing digital voice signal; b) pre-emphasizing the normalized outgoing digital voice signal to produce a pre-emphasized outgoing digital voice signal; c) dividing the pre-emphasized outgoing digital voice signal into segments to produce a current segment and a past segment; d) predicting the pitch of the current speech segment to form a pitch prediction; e) calculating the gain of the pitch of the current speech segment to form a prediction gain; f) reconstructing the past speech segment from a compressed past segment to produce a reconstructed past segment; g) finding the innovation in the current speech segment by comparing the pitch prediction to the reconstructed past segment to produce an error signal; h) determining the maximum amplitude in the current speech segment; i) quantizing the error signal using one of a plurality of code books, each code book corresponding to a different compression rate,the code books being generated from a representative set of speakers and environments to produce a minimum mean squared error matching the form of an index into said one of said plurality of code book; and j) recording the pitch prediction, the prediction gain, the maximum amplitude and the index into the selected code book in a packet as the compressed outgoing digital voice data
3. The module according to claim 1 wherein the digital signal processor means is further operable for detecting silent periods in the outgoing digital voice data and for producing in response thereto a silence flag and wherein the main control means is further operable for transmitting outgoing conventional digital data on the telephone line when the silence flag indicates the absence of voice information and wherein the main control means is further operable for multiplexing and transmitting both the compressed outgoing digital voice data and the outgoing conventional digital data on the telephone line when the silence flag indicates the presence of voice information.
4. A system for performing voice compression, comprising: voice interface means including a voice input device for receiving voice signals from a user; conversion means for converting the voice signals into digital voice data; means for dividing the digital voice signal into segments and for serially producing therefrom a current voice segment and a past voice segment; means for determining the predicted gain of the current voice segment; means for determining the pitch values of the current voice segment; coding means for predictive coding on the current voice segment by predicting the current voice segment as best as possible based on past recreated voice segments and for producing a difference signal value in response thereto; means for selecting a compression rate for the speech compression; means including a plurality of code books stored in a memory for comparing the difference signal value to stored difference values stored one of the plurality od code books stored in the memory and for locating the memory address of the closest match between the difference signal value and the stored difference values; output means for providing a compression packet for each of the segments, the packet including the memory address of the closest match between the difference signal value and the stored difference values, the predicted gain and the pitch values for each voice segment; and output means further for providing a negotiation packet sent to determine the compression rate.
5. A method for compression speech information, comprising the steps of: selecting a compression rate; receiving a speech signal from a person, sampling and digitizing the speech signal and dividing the digitized speech signal into a continuous stream of speech segments having a plurality of digital samples; selecting a current speech segment from the continuous stream of speech segments and reconstructing a past speech segment from a previously compressed past segment to produce a reconstructed past segment; comparing the current segment on a sample by sample basis to the reconstructed past segment to obtain innovation information and an indicator of the error in the comparing; and storing the innovation information and the indicator of the error in the comparing in a data packet as a compressed data packet.
6. The method according to claim 5 wherein the step of comparing includes the following step: determining the predicted gain of the current speech segment; determining the pitch values of the current speech segment; predictive coding the current speech segment by predicting the current speech segment as best as possible based on the recreated past speech segments and for producing a difference signal value in response thereto; and comparing the difference signal value to stored difference values stored in a memory and for locating the memory address of the closest match between the difference signal value and the stored difference values.
PCT/US1995/014826 1994-11-29 1995-11-13 Dynamic selection of voice compression rate in a voice data modem WO1996017465A1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US08/346,421 US5546395A (en) 1993-01-08 1994-11-29 Dynamic selection of compression rate for a voice compression algorithm in a voice over data modem
US08/346,421 1994-11-29

Publications (1)

Publication Number Publication Date
WO1996017465A1 true WO1996017465A1 (en) 1996-06-06

Family

ID=23359306

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/US1995/014826 WO1996017465A1 (en) 1994-11-29 1995-11-13 Dynamic selection of voice compression rate in a voice data modem

Country Status (2)

Country Link
US (1) US5546395A (en)
WO (1) WO1996017465A1 (en)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2000021076A1 (en) * 1998-10-06 2000-04-13 Robert Bosch Gmbh Method for encoding or decoding voice signal scanning values and encoder or decoder
CN101030372B (en) * 2007-02-01 2011-11-30 北京中星微电子有限公司 Speech signal processing system

Families Citing this family (126)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
TW295747B (en) * 1994-06-13 1997-01-11 Sony Co Ltd
US5854898A (en) 1995-02-24 1998-12-29 Apple Computer, Inc. System for automatically adding additional data stream to existing media connection between two end points upon exchange of notifying and confirmation messages therebetween
JPH08279845A (en) * 1995-04-06 1996-10-22 Sony Corp Automatic answering telephone set
JPH09162837A (en) * 1995-11-22 1997-06-20 Internatl Business Mach Corp <Ibm> Method and apparatus for communication that dynamically change compression method
US6084952A (en) * 1996-01-18 2000-07-04 Pocketscience, Inc. System and method for communicating electronic messages over a telephone network using acoustical coupling
US5881104A (en) * 1996-03-25 1999-03-09 Sony Corporation Voice messaging system having user-selectable data compression modes
BR9708166A (en) * 1996-03-27 1999-07-27 Motorola Inc Method and apparatus for providing a multi-part connection for use in a wireless communication system
US5742773A (en) * 1996-04-18 1998-04-21 Microsoft Corporation Method and system for audio compression negotiation for multiple channels
US6028890A (en) * 1996-06-04 2000-02-22 International Business Machines Corporation Baud-rate-independent ASVD transmission built around G.729 speech-coding standard
US6175856B1 (en) * 1996-09-30 2001-01-16 Apple Computer, Inc. Method and apparatus for dynamic selection of compression processing during teleconference call initiation
SE510974C3 (en) * 1996-10-01 1999-08-23 Ericsson Telefon Ab L M Subscriber voxel telecommunication systems and procedures for dynamically allocating voice and data channels
US5825779A (en) * 1996-10-07 1998-10-20 Timeplex, Inc. PBX networking with quality of service control
GB9621243D0 (en) * 1996-10-11 1996-11-27 Nokia Mobile Phones Ltd Dect/gcm interworking
US6202060B1 (en) 1996-10-29 2001-03-13 Bao Q. Tran Data management system
US6904037B2 (en) 1996-11-05 2005-06-07 Cisco Technology, Inc. Asymmetric implementation of DSVD for voice/data internet access
US6037991A (en) * 1996-11-26 2000-03-14 Motorola, Inc. Method and apparatus for communicating video information in a communication system
US5953411A (en) * 1996-12-18 1999-09-14 Intel Corporation Method and apparatus for maintaining audio sample correlation
US6205124B1 (en) 1996-12-31 2001-03-20 Compaq Computer Corporation Multipoint digital simultaneous voice and data system
US6167374A (en) * 1997-02-13 2000-12-26 Siemens Information And Communication Networks, Inc. Signal processing method and system utilizing logical speech boundaries
US6064693A (en) * 1997-02-28 2000-05-16 Data Race, Inc. System and method for handling underrun of compressed speech frames due to unsynchronized receive and transmit clock rates
US5953374A (en) * 1997-03-03 1999-09-14 Pc-Tel, Inc. Bandpass spectral shaping of data signals
US6122271A (en) * 1997-07-07 2000-09-19 Motorola, Inc. Digital communication system with integral messaging and method therefor
US6356545B1 (en) * 1997-08-08 2002-03-12 Clarent Corporation Internet telephone system with dynamically varying codec
US8032808B2 (en) 1997-08-08 2011-10-04 Mike Vargo System architecture for internet telephone
US6138190A (en) * 1997-09-16 2000-10-24 Cirrus Logic, Inc. Analog front end and digital signal processing device and method
US5978757A (en) * 1997-10-02 1999-11-02 Lucent Technologies, Inc. Post storage message compaction
US6201842B1 (en) * 1997-12-29 2001-03-13 Motorola Inc. Device and method for detecting PCM upstream digital impairments in a communication network
US6181752B1 (en) * 1997-12-29 2001-01-30 Motorola Inc. Device and method for detecting PCM upstream digital impairments in a communication network
CN100344137C (en) * 1997-12-29 2007-10-17 摩托罗拉公司 System, device and method for PCM upstream transmission utilizing optimized transmit constellation
US6233319B1 (en) * 1997-12-30 2001-05-15 At&T Corp. Method and system for delivering messages to both live recipients and recording systems
US6052812A (en) * 1998-01-07 2000-04-18 Pocketscience, Inc. Messaging communication protocol
US6556666B1 (en) * 1998-05-05 2003-04-29 Siemens Information & Communication Networks, Inc. Notification system for multimedia messaging systems
US6014432A (en) * 1998-05-19 2000-01-11 Eastman Kodak Company Home health care system
IL127793A0 (en) * 1998-05-28 1999-10-28 Ibm Internet server
US6377573B1 (en) 1998-06-15 2002-04-23 Siemens Information And Communication Networks, Inc. Method and apparatus for providing a minimum acceptable quality of service for a voice conversation over a data network
US6324409B1 (en) 1998-07-17 2001-11-27 Siemens Information And Communication Systems, Inc. System and method for optimizing telecommunication signal quality
US6349286B2 (en) * 1998-09-03 2002-02-19 Siemens Information And Communications Network, Inc. System and method for automatic synchronization for multimedia presentations
US6256606B1 (en) * 1998-11-30 2001-07-03 Conexant Systems, Inc. Silence description coding for multi-rate speech codecs
US6624761B2 (en) 1998-12-11 2003-09-23 Realtime Data, Llc Content independent data compression method and system
GB9828590D0 (en) 1998-12-23 1999-02-17 Northern Telecom Ltd Method and apparatus for managing communications traffic
US6757277B1 (en) 1999-01-26 2004-06-29 Siemens Information And Communication Networks, Inc. System and method for coding algorithm policy adjustment in telephony-over-LAN networks
US7023839B1 (en) * 1999-01-26 2006-04-04 Siemens Communications, Inc. System and method for dynamic codec alteration
US6754265B1 (en) * 1999-02-05 2004-06-22 Honeywell International Inc. VOCODER capable modulator/demodulator
US6389064B1 (en) 1999-03-08 2002-05-14 International Business Machines Corporation Modems, methods, and computer program products for identifying a signaling alphabet in variance with an ideal alphabet due to digital impairments
US6341360B1 (en) 1999-03-08 2002-01-22 International Business Machines Corporation Decision feedback equalizers, methods, and computer program products for detecting severe error events and preserving equalizer filter characteristics in response thereto
US6381267B1 (en) 1999-03-08 2002-04-30 International Business Machines Corporation Modems, methods, and computer program products for falling back to a lower data rate protocol upon detecting abnormal line conditions during startup
US7003030B2 (en) 1999-03-08 2006-02-21 Lenovo (Singapore) Pte. Ltd. Receivers, methods, and computer program products for an analog modem that receives data signals from a digital modem
US6553518B1 (en) 1999-03-08 2003-04-22 International Business Machines Corporation Severe error detectors, methods and computer program products that use constellation specific error event thresholds to detect severe error events during demodulation of a signal comprising symbols from a plurality of symbol constellations
US6661837B1 (en) 1999-03-08 2003-12-09 International Business Machines Corporation Modems, methods, and computer program products for selecting an optimum data rate using error signals representing the difference between the output of an equalizer and the output of a slicer or detector
US6487243B1 (en) 1999-03-08 2002-11-26 International Business Machines Corporation Modems, methods, and computer program products for recovering from errors in a tone reversal sequence between two modems
US7006493B1 (en) 1999-03-09 2006-02-28 Cisco Technology, Inc. Virtual voice port configured to connect a switched voice call to a permanent voice call
US6604158B1 (en) 1999-03-11 2003-08-05 Realtime Data, Llc System and methods for accelerated data storage and retrieval
US6601104B1 (en) 1999-03-11 2003-07-29 Realtime Data Llc System and methods for accelerated data storage and retrieval
EP1177668A2 (en) * 1999-05-10 2002-02-06 Nokia Corporation Header compression
US6661847B1 (en) 1999-05-20 2003-12-09 International Business Machines Corporation Systems methods and computer program products for generating and optimizing signal constellations
EP1059782A3 (en) * 1999-06-10 2004-02-04 Lucent Technologies Inc. Method and apparatus for dynamically allocating bandwidth utilization in a packet telephony network
US6731734B1 (en) 1999-08-19 2004-05-04 Siemens Information & Communication Networks, Inc. Apparatus and method for intelligent conference call codec selection
US6687234B1 (en) 1999-10-05 2004-02-03 Siemens Information & Communication Networks, Inc. Apparatus and method for optimal conference call renegotiation in telephony over LAN systems
US6977898B1 (en) * 1999-10-15 2005-12-20 Cisco Technology, Inc. Method for supporting high priority calls on a congested WAN link
US6816545B1 (en) 1999-10-29 2004-11-09 International Business Machines Corporation Systems, methods and computer program products for identifying digital impairments in modems based on clusters and/or skips in pulse code modulation signal levels
US6765955B1 (en) 1999-10-29 2004-07-20 International Business Machines Corporation Methods, systems and computer program products establishing a communication configuration for a modem connection to compensate for echo noise
US6611563B1 (en) 1999-10-29 2003-08-26 International Business Machines Corporation Systems, methods and computer program products for data mode refinement of modem constellation points
US6662322B1 (en) 1999-10-29 2003-12-09 International Business Machines Corporation Systems, methods, and computer program products for controlling the error rate in a communication device by adjusting the distance between signal constellation points
US6826157B1 (en) 1999-10-29 2004-11-30 International Business Machines Corporation Systems, methods, and computer program products for controlling data rate reductions in a communication device by using a plurality of filters to detect short-term bursts of errors and long-term sustainable errors
US6967995B1 (en) 1999-10-29 2005-11-22 International Business Machines Corporation Methods, systems and computer program products for carrier drop detection using a variable threshold
US6792040B1 (en) 1999-10-29 2004-09-14 International Business Machines Corporation Modems having a dual power mode capability and methods of operating same
US6823017B1 (en) 1999-10-29 2004-11-23 International Business Machines Corporation Systems, methods and computer program products for filtering glitches from measured values in a sequence of code points
US6823004B1 (en) 1999-10-29 2004-11-23 International Business Machines Corporation Methods, systems and computer program products for monitoring performance of a modem during a connection
US6505222B1 (en) 1999-10-29 2003-01-07 International Business Machines Corporation Systems methods and computer program products for controlling undesirable bias in an equalizer
US6792004B1 (en) 1999-10-29 2004-09-14 International Business Machines Corporation Systems, methods and computer program products for averaging learned levels in the presence of robbed-bit signaling based on proximity
US6839382B1 (en) 1999-10-29 2005-01-04 International Business Machines Corporation System, methods and computer program products for identifying digital impairments in modem signals using signature analysis and signal level comparison analysis
US6650657B1 (en) 1999-10-29 2003-11-18 International Business Machines Corporation Systems, methods and computer program products for identifying digital impairments in modem signals
US6754258B1 (en) 1999-10-29 2004-06-22 International Business Machines Corporation Systems, methods and computer program products for averaging learned levels in the presence of digital impairments based on patterns
US6622019B1 (en) * 1999-11-17 2003-09-16 Eci Telecom, Ltd. Increasing channel capacity in fixed cellular networks
US6636530B1 (en) 1999-12-03 2003-10-21 Digital Interactive Streams, Inc. Digital audio telephony over IP network compression
US20010047473A1 (en) 2000-02-03 2001-11-29 Realtime Data, Llc Systems and methods for computer initialization
DE10006245A1 (en) 2000-02-11 2001-08-30 Siemens Ag Method for improving the quality of an audio transmission over a packet-oriented communication network and communication device for implementing the method
US6839413B1 (en) 2000-02-22 2005-01-04 Cisco Technology, Inc. Method and system for data communication
US20020048283A1 (en) 2000-06-29 2002-04-25 Ching-Yi Lin Phone appliance with display screen and methods of using the same
US8692695B2 (en) 2000-10-03 2014-04-08 Realtime Data, Llc Methods for encoding and decoding data
US7417568B2 (en) 2000-10-03 2008-08-26 Realtime Data Llc System and method for data feed acceleration and encryption
US9143546B2 (en) 2000-10-03 2015-09-22 Realtime Data Llc System and method for data feed acceleration and encryption
US7319667B1 (en) * 2000-11-15 2008-01-15 Cisco Technology, Inc. Communication system with priority data compression
US6745012B1 (en) * 2000-11-17 2004-06-01 Telefonaktiebolaget Lm Ericsson (Publ) Adaptive data compression in a wireless telecommunications system
DE10059362A1 (en) * 2000-11-29 2002-06-13 Alcatel Sa Adaptive storage of audio signals
KR100394146B1 (en) * 2000-12-28 2003-08-09 디지털시스 주식회사 The duplex multilevel adaptive compression voice signal transmission method over internet protocol
US7076053B1 (en) * 2001-01-12 2006-07-11 3Com Corporation System for the processing of audio data used for music on hold and paging in a private branch exchange
US7386046B2 (en) 2001-02-13 2008-06-10 Realtime Data Llc Bandwidth sensitive data compression and decompression
EP1241891A1 (en) * 2001-03-13 2002-09-18 eJay AG Apparatus and method for transmitting audio and/or video data
US7047201B2 (en) * 2001-05-04 2006-05-16 Ssi Corporation Real-time control of playback rates in presentations
US7197458B2 (en) * 2001-05-10 2007-03-27 Warner Music Group, Inc. Method and system for verifying derivative digital files automatically
US7023876B2 (en) * 2001-07-09 2006-04-04 Quantum Corporation Point-to-point protocol
KR20030011167A (en) * 2001-07-28 2003-02-07 프롬투정보통신(주) voice compression algorithm changeover system and method using digital signal processor
DE10146551A1 (en) * 2001-09-21 2003-04-24 Siemens Ag Method for data transmission between two data transmission devices
GB2418580B (en) * 2001-10-24 2006-05-24 Accenture Global Services Gmbh Data Processing System And Method
US7177944B1 (en) * 2002-04-13 2007-02-13 Mindspeed Technologies, Inc. Trans-compression selection and configuration in modem over packet networks
TWI250724B (en) * 2002-10-11 2006-03-01 Ericsson Telefon Ab L M Method and communication system for packeting messaging, and header compressor unit
EP1542422B1 (en) * 2002-10-25 2014-10-29 Fujitsu Limited Two-way communication system, communication instrument, and communication control method
US7949016B2 (en) * 2002-10-25 2011-05-24 Fujitsu Limited Interactive communication system, communication equipment and communication control method
US20040249882A1 (en) * 2003-06-04 2004-12-09 Eidson John C. Approximate information preservation using subsets
US9614772B1 (en) 2003-10-20 2017-04-04 F5 Networks, Inc. System and method for directing network traffic in tunneling applications
JP4089596B2 (en) * 2003-11-17 2008-05-28 沖電気工業株式会社 Telephone exchange equipment
US7376567B2 (en) * 2004-02-16 2008-05-20 Celtro Ltd Method and system for efficiently transmitting encoded communication signals
US8327026B1 (en) * 2004-07-01 2012-12-04 Hewlett-Packard Development Company, L.P. Method and system for selecting a data compression technique for data transfer through a data network
GB0416720D0 (en) * 2004-07-27 2004-09-01 British Telecomm Method and system for voice over IP streaming optimisation
US7567897B2 (en) * 2004-08-12 2009-07-28 International Business Machines Corporation Method for dynamic selection of optimized codec for streaming audio content
US8024483B1 (en) 2004-10-01 2011-09-20 F5 Networks, Inc. Selective compression for network connections
US7783781B1 (en) 2005-08-05 2010-08-24 F5 Networks, Inc. Adaptive compression
US8533308B1 (en) 2005-08-12 2013-09-10 F5 Networks, Inc. Network traffic management through protocol-configurable transaction processing
US8275909B1 (en) 2005-12-07 2012-09-25 F5 Networks, Inc. Adaptive compression
US7882084B1 (en) 2005-12-30 2011-02-01 F5 Networks, Inc. Compression of data transmitted over a network
US8565088B1 (en) 2006-02-01 2013-10-22 F5 Networks, Inc. Selectively enabling packet concatenation based on a transaction boundary
US7873065B1 (en) 2006-02-01 2011-01-18 F5 Networks, Inc. Selectively enabling network packet concatenation based on metrics
US9356824B1 (en) 2006-09-29 2016-05-31 F5 Networks, Inc. Transparently cached network resources
US8417833B1 (en) 2006-11-29 2013-04-09 F5 Networks, Inc. Metacodec for optimizing network data compression based on comparison of write and read rates
US9106606B1 (en) 2007-02-05 2015-08-11 F5 Networks, Inc. Method, intermediate device and computer program code for maintaining persistency
US20110033055A1 (en) * 2007-09-05 2011-02-10 Sensear Pty Ltd. Voice Communication Device, Signal Processing Device and Hearing Protection Device Incorporating Same
US7953881B1 (en) * 2008-06-12 2011-05-31 Juniper Networks, Inc. Network characteristic-based compression of network traffic
US9327193B2 (en) 2008-06-27 2016-05-03 Microsoft Technology Licensing, Llc Dynamic selection of voice quality over a wireless system
KR20100006492A (en) * 2008-07-09 2010-01-19 삼성전자주식회사 Method and apparatus for deciding encoding mode
US7930436B1 (en) * 2009-03-09 2011-04-19 Znosko Dmitry Y System and method for dynamically adjusting data compression parameters
US8456532B1 (en) 2011-04-25 2013-06-04 Next Level Security Systems, Inc. Internet protocol camera transcode avoidance
JP6031752B2 (en) * 2011-12-05 2016-11-24 沖電気工業株式会社 Voice communication apparatus and program
JP6695069B2 (en) * 2016-05-31 2020-05-20 パナソニックIpマネジメント株式会社 Telephone device
US10176809B1 (en) * 2016-09-29 2019-01-08 Amazon Technologies, Inc. Customized compression and decompression of audio data
US10754557B2 (en) * 2017-09-26 2020-08-25 Seagate Technology Llc Data storage system with asynchronous data replication

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US4598397A (en) * 1984-02-21 1986-07-01 Cxc Corporation Microtelephone controller
US5121385A (en) * 1988-09-14 1992-06-09 Fujitsu Limited Highly efficient multiplexing system
CA2104701A1 (en) * 1993-01-08 1994-07-09 Raghu Sharma Computer-based multifunction personal communications system
EP0614305A2 (en) * 1993-03-02 1994-09-07 Hitachi, Ltd. Voice/image simultaneous communication apparatus

Family Cites Families (136)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US34034A (en) * 1861-12-24 Improvement in bee-hives
US3304372A (en) * 1963-06-28 1967-02-14 Ibm Voice-data multiplexing system for transmitting data during pauses in the voice signals
US3789165A (en) * 1972-04-24 1974-01-29 Communications Satellite Corp Echo canceller with variable threshold
US3997732A (en) * 1972-07-03 1976-12-14 Mek-Tronix Laboratories Corporation Call tracing and identification system
US3904830A (en) * 1972-07-03 1975-09-09 Mek Tronix Lab Call tracing and identification system
US3973081A (en) * 1975-09-12 1976-08-03 Trw Inc. Feedback residue compression for digital speech systems
US4107471A (en) * 1977-03-22 1978-08-15 International Telephone & Telegraph Corp. Frequency division multiplex communications system
US4100377A (en) * 1977-04-28 1978-07-11 Bell Telephone Laboratories, Incorporated Packet transmission of speech
US4284850A (en) * 1977-12-23 1981-08-18 Storage Technology Corporation Digital memory providing fixed and variable delays in a TASI system
US4205202A (en) * 1978-01-18 1980-05-27 Kahn Leonard R Method and means for improving the spectrum utilization of multichannel telephone systems
US4354273A (en) * 1979-06-12 1982-10-12 Nippon Electric Company, Ltd. ADPCM System for speech or like signals
US4445213A (en) * 1979-07-31 1984-04-24 Bell Telephone Laboratories, Incorporated Communication line interface for controlling data information having differing transmission characteristics
JPS5723356A (en) * 1980-07-02 1982-02-06 Hitachi Ltd Sound signal converter
US4377860A (en) * 1981-01-05 1983-03-22 American Microsystems, Inc. Bandwidth reduction method and structure for combining voice and data in a PCM channel
EP0070949B1 (en) * 1981-07-28 1986-05-07 International Business Machines Corporation Transmission method for voice and digital data and arrangement for carrying out said method
US4425661A (en) * 1981-09-03 1984-01-10 Applied Spectrum Technologies, Inc. Data under voice communications system
US4476559A (en) * 1981-11-09 1984-10-09 At&T Bell Laboratories Simultaneous transmission of voice and data signals over a digital channel
US4500987A (en) * 1981-11-24 1985-02-19 Nippon Electric Co., Ltd. Loop transmission system
US4495620A (en) * 1982-08-05 1985-01-22 At&T Bell Laboratories Transmitting data on the phase of speech
US4479195A (en) * 1982-09-07 1984-10-23 At&T Bell Laboratories Data conference system
US4534024A (en) * 1982-12-02 1985-08-06 At&T Bell Laboratories System and method for controlling a multiple access data communications system including both data packets and voice packets being communicated over a cable television system
US4652703A (en) * 1983-03-01 1987-03-24 Racal Data Communications Inc. Digital voice transmission having improved echo suppression
US4609788A (en) * 1983-03-01 1986-09-02 Racal Data Communications Inc. Digital voice transmission having improved echo suppression
US4587651A (en) * 1983-05-04 1986-05-06 Cxc Corporation Distributed variable bandwidth switch for voice, data, and image communications
US4578537A (en) * 1983-08-05 1986-03-25 International Remote Imaging Systems, Inc. Telecommunication apparatus serving as an interface between a digital computer and an analog communication medium
US4524244A (en) * 1983-08-05 1985-06-18 Cygnet Technologies, Inc. Digital and voice telecommunication apparatus
JPS60130235A (en) * 1983-12-16 1985-07-11 Fujitsu Ltd Data and voice transmitter
US4546212A (en) * 1984-03-08 1985-10-08 Crowder, Inc. Data/voice adapter for telephone network
JPS60203059A (en) * 1984-03-14 1985-10-14 Hashimoto Corp Switching connection device of telephone line
US4593389A (en) * 1984-06-28 1986-06-03 Henry Wurzburg Simultaneous voice and asynchronous data telephone
US4697281A (en) * 1986-03-14 1987-09-29 Spectrum Cellular Communications Corporation, Inc. Cellular telephone data communication system and method
USRE34034E (en) 1985-10-11 1992-08-18 Spectrum Information Technologies, Inc. Cellular telephone data communication system and method
GB8423017D0 (en) * 1984-09-12 1984-10-17 Plessey Co Plc Echo canceller
GB2166320B (en) * 1984-10-25 1988-10-12 Stc Plc Packet switching system
US4629829A (en) * 1984-12-14 1986-12-16 Motorola, Inc. Full duplex speakerphone for radio and landline telephones
US4751736A (en) * 1985-01-31 1988-06-14 Communications Satellite Corporation Variable bit rate speech codec with backward-type prediction and quantization
GB2171576B (en) * 1985-02-04 1989-07-12 Mitel Telecom Ltd Spread spectrum leaky feeder communication system
US4750169A (en) * 1985-03-12 1988-06-07 Pacific Bell Telephone system and method for transmitting digital information
EP0200842B1 (en) * 1985-04-30 1992-10-14 International Business Machines Corporation Modem controlling a modem network
US4718082A (en) * 1985-09-18 1988-01-05 Ark Electronics Modem for effecting full duplex asynchronous/synchronous digital data communications over voice grade telephone link
JPH0752845B2 (en) * 1985-10-04 1995-06-05 日本電気株式会社 Differential encoding circuit
DE3585034D1 (en) * 1985-10-30 1992-02-06 Ibm METHOD FOR DETERMINING A FLAT Echo Path Delay, and Echo Compensator Using This Method.
US4700341A (en) * 1985-10-30 1987-10-13 Racal Data Communications Inc. Stochastic time division multiplexing
NL8600087A (en) * 1986-01-17 1987-08-17 Philips Nv DEVICE FOR FULL-DUPLEX DATA TRANSMISSION ON TWO-WIRE CONNECTIONS.
US4740963A (en) * 1986-01-30 1988-04-26 Lear Siegler, Inc. Voice and data communication system
EP0239293A3 (en) * 1986-03-24 1988-12-14 Gpt Limited Data transmission systems
US4932048A (en) * 1986-04-15 1990-06-05 Canon Kabushiki Kaisha Data communication apparatus with voice communication control
US4926448A (en) * 1986-05-06 1990-05-15 Hayes Microcomputer Products, Inc. Method and apparatus for implementing an escape sequence
US5008926A (en) * 1986-07-17 1991-04-16 Efrat Future Technology Ltd. Message management system
US4813040A (en) * 1986-10-31 1989-03-14 Futato Steven P Method and apparatus for transmitting digital data and real-time digitalized voice information over a communications channel
JPH07118749B2 (en) * 1986-11-14 1995-12-18 株式会社日立製作所 Voice / data transmission equipment
EP0272714B1 (en) * 1986-11-17 1992-06-24 Alcatel N.V. Adjustable echo canceller
US4839802A (en) * 1986-11-19 1989-06-13 Extel Corporation Adaptation of computer to communication operation
ZA883232B (en) 1987-05-06 1989-07-26 Dowd Research Pty Ltd O Packet switches,switching methods,protocols and networks
US4845746A (en) * 1987-06-23 1989-07-04 Rockwell International Corporation Echo canceller with relative feedback control
US4891806A (en) 1987-09-18 1990-01-02 Racal Data Communications Inc. Constellation multiplexed inband secondary channel for voiceband modem
GB2210236B (en) * 1987-09-24 1991-12-18 Newbridge Networks Corp Speech processing system
JP2602847B2 (en) * 1987-09-29 1997-04-23 株式会社日立製作所 Multimedia mail system
US4827085A (en) * 1987-11-19 1989-05-02 Ovonic Imaging Systems, Inc. Voice and image teleconferencing system including paperless facsimile means
US4995059A (en) * 1988-01-14 1991-02-19 Canon Kabushiki Kaisha Predictive coding device
JPH01221042A (en) * 1988-02-29 1989-09-04 Toshiba Corp Congestion control method for packet exchange
CA1314965C (en) * 1988-03-01 1993-03-23 Gerald Molnar Data interface for telephone system
US4890282A (en) * 1988-03-08 1989-12-26 Network Equipment Technologies, Inc. Mixed mode compression for data transmission
EP0331858B1 (en) * 1988-03-08 1993-08-25 International Business Machines Corporation Multi-rate voice encoding method and device
US4887265A (en) * 1988-03-18 1989-12-12 Motorola, Inc. Packet-switched cellular telephone system
US4847900A (en) * 1988-05-02 1989-07-11 Northern Telecom Limited Infrared hookswitch for a telephone
US5177734A (en) * 1988-05-02 1993-01-05 Itt Corporation Multirate wire line modem apparatus
US5195130A (en) 1988-05-05 1993-03-16 Transaction Technology, Inc. Computer and telephone apparatus with user friendly computer interface and enhanced integrity features
SE461308B (en) * 1988-06-03 1990-01-29 Ericsson Telefon Ab L M ADAPTIVE DIGITAL FILTER INCLUDING A NON-RECURSIVE PART AND A RECURSIVE PART
US4991169A (en) * 1988-08-02 1991-02-05 International Business Machines Corporation Real-time digital signal processing relative to multiple digital communication channels
EP0390931B1 (en) * 1988-09-27 1996-03-06 Texas Instruments Japan Ltd. Method of matching operation mode of a modem
US4953210A (en) * 1988-10-19 1990-08-28 Hayes Microcomputer Products, Inc. Feature negotiation protocol for a synchronous modem
US4905282A (en) * 1988-10-19 1990-02-27 Hayes Microcomputer Products, Inc. Feature negotiation protocol and dynamically adjustable retraining sequence for a high speed half duplex modem
US4912758A (en) * 1988-10-26 1990-03-27 International Business Machines Corporation Full-duplex digital speakerphone
US5001745A (en) * 1988-11-03 1991-03-19 Pollock Charles A Method and apparatus for programmed audio annotation
US5107519A (en) * 1988-11-17 1992-04-21 Canon Kabushiki Kaisha Coding device and a decoding device
US5406560A (en) 1988-11-25 1995-04-11 Hitachi, Ltd. Speech packet communication system
DE3840433A1 (en) * 1988-12-01 1990-06-07 Philips Patentverwaltung Echo compensator
US4914650A (en) * 1988-12-06 1990-04-03 American Telephone And Telegraph Company Bandwidth allocation and congestion control scheme for an integrated voice and data network
FR2641093B1 (en) * 1988-12-23 1994-04-29 Alcatel Business Systems
US4935954A (en) * 1988-12-28 1990-06-19 At&T Company Automated message retrieval system
US5081647A (en) * 1989-01-06 1992-01-14 American Telephone & Telegraph Company Communication of a voice signal via continuous quadrature amplitude modulator
US4972457A (en) * 1989-01-19 1990-11-20 Spectrum Information Technologies, Inc. Portable hybrid communication system and methods
US5020058A (en) * 1989-01-23 1991-05-28 Stratacom, Inc. Packet voice/data communication system having protocol independent repetitive packet suppression
NZ232224A (en) 1989-01-27 1993-03-26 British Telecomm Alternate burst communication for cordless phones: bursts contain synchronisation information
US5208850A (en) 1989-02-09 1993-05-04 Fujitsu Limited Multi-media information service center and multi-media communication system
CA2012868C (en) * 1989-03-23 1994-03-22 Shin-Ichiro Hayano Call control with transmission priority in a packet communication network of an atm type
JPH02272500A (en) * 1989-04-13 1990-11-07 Fujitsu Ltd Code driving voice encoding system
US5036513A (en) * 1989-06-21 1991-07-30 Academy Of Applied Science Method of and apparatus for integrated voice (audio) communication simultaneously with "under voice" user-transparent digital data between telephone instruments
US5261027A (en) 1989-06-28 1993-11-09 Fujitsu Limited Code excited linear prediction speech coding system
JPH0332228A (en) * 1989-06-29 1991-02-12 Fujitsu Ltd Gain-shape vector quantization system
US5062133A (en) * 1989-07-07 1991-10-29 Logotronix Incorporated Multi-function telephone call management system
JPH0344218A (en) * 1989-07-12 1991-02-26 Fujitsu Ltd Adaptive echo canceller
FR2651077B1 (en) 1989-08-18 1994-06-10 Letourneur Gregoire DEVICE FOR TREATING ECHO, ESPECIALLY ACOUSTIC, IN A TELEPHONE LINE
EP0420269A3 (en) * 1989-09-28 1992-12-30 Fujitsu Limited Adaptive digital filter including low-pass filter
US5095497A (en) * 1989-10-02 1992-03-10 At & T Bell Laboratories Technique for achieving the full coding gain of encoded digital signals
US5001710A (en) * 1989-10-24 1991-03-19 At&T Bell Laboratories Customer programmable automated integrated voice/data technique for communication systems
CA2001277C (en) * 1989-10-24 1994-07-12 Bruce Leigh Townsend Hands free telecommunications apparatus and method
US5051720A (en) * 1989-11-13 1991-09-24 Secure Telecom, Inc. Remote control system using power line of remote site
US5083310A (en) * 1989-11-14 1992-01-21 Apple Computer, Inc. Compression and expansion technique for digital audio data
US4977591A (en) * 1989-11-17 1990-12-11 Nynex Corporation Dual mode LMS nonlinear data echo canceller
US5136586A (en) * 1989-12-04 1992-08-04 Academy Of Applied Science Method and apparatus for telephone line multiplex channeling of toll-quality voice and digital information
JPH03226051A (en) 1990-01-31 1991-10-07 Fujitsu Ltd Speed notice system for modulator-domodulator
US5044010A (en) * 1990-03-29 1991-08-27 At&T Bell Laboratories Arrangement and method for selecting an available communication channel for a cordless telephone
NL9001016A (en) 1990-04-27 1991-11-18 Philips Nv DIGITAL ECHO COMPENSATOR WITH A DOUBLE-VOICE DETECTOR.
US5127041A (en) * 1990-06-01 1992-06-30 Spectrum Information Technologies, Inc. System and method for interfacing computers to diverse telephone networks
US5127001A (en) * 1990-06-22 1992-06-30 Unisys Corporation Conference call arrangement for distributed network
US5115429A (en) * 1990-08-02 1992-05-19 Codex Corporation Dynamic encoding rate control minimizes traffic congestion in a packet network
JP2503747B2 (en) 1990-09-12 1996-06-05 日本電気株式会社 FIR type eco-canceller
JPH04123621A (en) 1990-09-14 1992-04-23 Nippon Telegr & Teleph Corp <Ntt> Echo eraser
US5193110A (en) 1990-10-09 1993-03-09 Boston Technology, Incorporated Integrated services platform for telephone communication system
GB2251097B (en) 1990-12-08 1995-05-10 Dowty Information Systems An adaptive data compression system
US5214656A (en) 1990-12-13 1993-05-25 At&T Bell Laboratories Multiplexed coded modulation with unequal error protection
FR2670973B1 (en) 1990-12-19 1994-04-15 Ouest Standard Telematique Sa PACKET TRANSMISSION SYSTEM WITH DATA COMPRESSION, METHOD AND EQUIPMENT THEREOF.
US5263019A (en) 1991-01-04 1993-11-16 Picturetel Corporation Method and apparatus for estimating the level of acoustic feedback between a loudspeaker and microphone
US5187591A (en) 1991-01-24 1993-02-16 Micom Communications Corp. System for transmitting and receiving aural information and modulated data
JP2842026B2 (en) 1991-02-20 1998-12-24 日本電気株式会社 Adaptive filter coefficient control method and apparatus
US5341374A (en) 1991-03-01 1994-08-23 Trilan Systems Corporation Communication network integrating voice data and video with distributed call processing
JPH0739968B2 (en) 1991-03-25 1995-05-01 日本電信電話株式会社 Sound transfer characteristics simulation method
US5150410A (en) * 1991-04-11 1992-09-22 Itt Corporation Secure digital conferencing system
US5283638A (en) 1991-04-25 1994-02-01 Compuadd Corporation Multimedia computing and telecommunications workstation
US5283819A (en) 1991-04-25 1994-02-01 Compuadd Corporation Computing and multimedia entertainment system
HU215861B (en) 1991-06-11 1999-03-29 Qualcomm Inc. Methods for performing speech signal compression by variable rate coding and decoding of digitized speech samples and means for impementing these methods
DE69221949T2 (en) 1991-06-13 1998-04-02 Nec Corp Method and device for echo cancellation in a digital telecommunications system
US5307413A (en) 1991-07-19 1994-04-26 Process Software Corporation Method and apparatus for adding data compression and other services in a computer network
US5309562A (en) 1991-08-19 1994-05-03 Multi-Tech Systems, Inc. Method and apparatus for establishing protocol spoofing from a modem
US5233660A (en) 1991-09-10 1993-08-03 At&T Bell Laboratories Method and apparatus for low-delay celp speech coding and decoding
US5371853A (en) 1991-10-28 1994-12-06 University Of Maryland At College Park Method and system for CELP speech coding and codebook for use therewith
US5276703A (en) 1992-01-13 1994-01-04 Windata, Inc. Wireless local area network communications system
US5305312A (en) 1992-02-07 1994-04-19 At&T Bell Laboratories Apparatus for interfacing analog telephones and digital data terminals to an ISDN line
US5249218A (en) 1992-04-06 1993-09-28 Spectrum Information Technologies, Inc. Programmable universal interface system
US5295136A (en) 1992-04-13 1994-03-15 Motorola, Inc. Method of performing convergence in a, least mean square, adaptive filter, echo canceller
US5282197A (en) 1992-05-15 1994-01-25 International Business Machines Low frequency audio sub-channel embedded signalling
US5327520A (en) 1992-06-04 1994-07-05 At&T Bell Laboratories Method of use of voice message coder/decoder
US5343473A (en) 1992-08-07 1994-08-30 International Business Machines Corporation Method of determining whether to use preempt/resume or alternate protocol for data transmission
US5317604A (en) 1992-12-30 1994-05-31 Gte Government Systems Corporation Isochronous interface method

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US4598397A (en) * 1984-02-21 1986-07-01 Cxc Corporation Microtelephone controller
US5121385A (en) * 1988-09-14 1992-06-09 Fujitsu Limited Highly efficient multiplexing system
CA2104701A1 (en) * 1993-01-08 1994-07-09 Raghu Sharma Computer-based multifunction personal communications system
EP0614305A2 (en) * 1993-03-02 1994-09-07 Hitachi, Ltd. Voice/image simultaneous communication apparatus

Non-Patent Citations (2)

* Cited by examiner, † Cited by third party
Title
ANONYMOUS: "Method and Apparatus for the Statistical Multiplexing of Voice, Data, and Image Signals.", IBM TECHNICAL DISCLOSURE BULLETIN, vol. 35, no. 6, November 1992 (1992-11-01), NEW YORK, US, pages 409 - 411, XP002000163 *
ANONYMOUS: "Speech Data Adaptive Multiplexer", IBM TECHNICAL DISCLOSURE BULLETIN, vol. 27, no. 2, July 1984 (1984-07-01), NEW YORK, US, pages 969, XP002000162 *

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2000021076A1 (en) * 1998-10-06 2000-04-13 Robert Bosch Gmbh Method for encoding or decoding voice signal scanning values and encoder or decoder
US7269552B1 (en) 1998-10-06 2007-09-11 Robert Bosch Gmbh Quantizing speech signal codewords to reduce memory requirements
CN101030372B (en) * 2007-02-01 2011-11-30 北京中星微电子有限公司 Speech signal processing system

Also Published As

Publication number Publication date
US5546395A (en) 1996-08-13

Similar Documents

Publication Publication Date Title
US5546395A (en) Dynamic selection of compression rate for a voice compression algorithm in a voice over data modem
EP0650286B1 (en) Ringdown and ringback signalling for a computer-based multifunction personal communications system
US5617423A (en) Voice over data modem with selectable voice compression
EP0656718B1 (en) Dual port interface for a computer-based multifunction personal communication system using the telephone network
US5790532A (en) Voice over video communication system
US7082141B2 (en) Computer implemented voice over data communication apparatus and method
US5812534A (en) Voice over data conferencing for a computer-based personal communications system
EP0669749A1 (en) Noncompressed voice and data communication over modem for a computer-based multifunction personal communications system
US6009082A (en) Computer-based multifunction personal communication system with caller ID
US5754589A (en) Noncompressed voice and data communication over modem for a computer-based multifunction personal communications system
WO1996015601A2 (en) Voice over data conferencing communications system
WO1997003513A1 (en) Mode switching system for a voice over data modem
CA2216294C (en) Dual port interface for a computer based multifunctional personal communication system

Legal Events

Date Code Title Description
AK Designated states

Kind code of ref document: A1

Designated state(s): CA JP

AL Designated countries for regional patents

Kind code of ref document: A1

Designated state(s): AT BE CH DE DK ES FR GB GR IE IT LU MC NL PT SE

DFPE Request for preliminary examination filed prior to expiration of 19th month from priority date (pct application filed before 20040101)
121 Ep: the epo has been informed by wipo that ep was designated in this application
122 Ep: pct application non-entry in european phase