CA2355250A1 - Prioritized instruction scheduling for multi-streaming processors - Google Patents
Prioritized instruction scheduling for multi-streaming processors Download PDFInfo
- Publication number
- CA2355250A1 CA2355250A1 CA002355250A CA2355250A CA2355250A1 CA 2355250 A1 CA2355250 A1 CA 2355250A1 CA 002355250 A CA002355250 A CA 002355250A CA 2355250 A CA2355250 A CA 2355250A CA 2355250 A1 CA2355250 A1 CA 2355250A1
- Authority
- CA
- Canada
- Prior art keywords
- priority
- stream
- streams
- record
- processor
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Abandoned
Links
- 238000012545 processing Methods 0.000 claims abstract description 88
- 238000000034 method Methods 0.000 claims abstract description 46
- 230000006870 function Effects 0.000 claims description 20
- 230000004044 response Effects 0.000 claims description 18
- 230000004075 alteration Effects 0.000 claims description 17
- 230000003068 static effect Effects 0.000 claims description 17
- 241001522296 Erithacus rubecula Species 0.000 description 10
- 230000007246 mechanism Effects 0.000 description 8
- 238000007667 floating Methods 0.000 description 6
- 238000010586 diagram Methods 0.000 description 4
- 230000000694 effects Effects 0.000 description 3
- 238000005516 engineering process Methods 0.000 description 3
- 230000006872 improvement Effects 0.000 description 3
- 230000008859 change Effects 0.000 description 2
- 238000007726 management method Methods 0.000 description 2
- 230000008569 process Effects 0.000 description 2
- 239000000872 buffer Substances 0.000 description 1
- 238000007796 conventional method Methods 0.000 description 1
- 230000003111 delayed effect Effects 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 235000003642 hunger Nutrition 0.000 description 1
- 238000007639 printing Methods 0.000 description 1
- 238000012913 prioritisation Methods 0.000 description 1
- 230000001105 regulatory effect Effects 0.000 description 1
- 238000012827 research and development Methods 0.000 description 1
- 238000000638 solvent extraction Methods 0.000 description 1
- 230000037351 starvation Effects 0.000 description 1
- 238000012546 transfer Methods 0.000 description 1
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F9/00—Arrangements for program control, e.g. control units
- G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
- G06F9/30—Arrangements for executing machine instructions, e.g. instruction decode
- G06F9/38—Concurrent instruction execution, e.g. pipeline, look ahead
- G06F9/3836—Instruction issuing, e.g. dynamic instruction scheduling or out of order instruction execution
- G06F9/3851—Instruction issuing, e.g. dynamic instruction scheduling or out of order instruction execution from multiple instruction streams, e.g. multistreaming
Abstract
A multi-streaming processor (14) has multiple streams (4) for processing multiple threads (1-3), and an instruction scheduler (5) including a priorit y record of priority codes (7, 8) for one or more of the streams (4). The priority codes (7, 8) determine in some embodiments relative access to resources (10-13) as well as which stream (4) has access at any point in tim e. In other embodiments priorities are determined dynamically and altered on-th e- fly, which may be done by various criteria, such as on-chip processing statistics, by executing one or more priority algorithms, by input from off- chip (9), according to stream loading, or by combinations of these and other methods. In one embodiment a special code is used for disabling a stream, an d streams may be enabled and disabled dynamically by various methods, such as by on-chip events, processing statistics, input from off-chip, and by processor interrupts. Some specific applications are taught, including for IP-routers and digital signal processors.
Description
Prioritized Instruction Scheduling for Multi-Streaming Processors By Irmeruor(.s) Mario D. Nemirovskt%, Adolfo M. Nemirov sky, arid Nerendra. ,Sankar Field of the Invention The present invention is in the field of digital microprocessors, and pertains more particularly to such devices capable of operating with multiple processing streams, which are termed mufti-streaming processors in the art.
Background of the Invention Mufti-streaming processors capable of processing multiple threads are known in the art, and have been the subject of considerable research and development. The present invention takes notice of the prior work in this field, and builds upon that work, bringing new and non-obvious improvements in apparatus and methods to the art. The inventors have provided with this patent application an Information Disclosure Statement listing a number of published papers in the technical field of mufti-streaming processors. which together provide additional background and context for the several aspects of the present invention disclosed herein.
For purposes of definition, this specification regards a wream in reference to a processor as principally hardware structure on the processor capable of supporting and processing an instruction thread. A thread is defined by software or application context. For example, a mufti-streaming processor implemented as a CPU for operating a desktop computer may simultaneously process threads from two or more applications, such as a word processing program and an object-oriented drawing program. As another example, a mufti-stream-capable processor may operate a machine without regular human direction, such as a router in a data-packet network.
In this context there may be, for example, one or more applications (code sets) for processing and forwarding data packets on the network, and another for such as quality-of service (QoS) negotiation with other routers and servers connected to the network. The nature of data received for processing, together with pre-programmed scheduling for internal functions will determine the calling and serving of application routines In either of the above cases the maximum capability of the processor to process multiple threads remains fixed at the number of hardware-limited streams. A
multi-streaming processor operating a single thread therefore operates as a single-stream processor.
As described above and in the papers provided by IDS in the present case, supersca(ar processors are also known in the art. This term refers to processors that have more than one functional unit implemented on the processor chip, and an ability to issue instructions to individual ones of the functional units available.
Most CPU
processors built today have more than a single functional unit. Some have many such I S units, including such as Floating Point units, Integer Units, Logic Units, Branch Prediction units, Load/Store units and so forth. Mufti-streaming superscalar processors are known in the art as well.
The inventors have determined that there is a significantly neglected field in the art, relative to scheduling instructions from streams to functional resources, whether there are one or more functional units. The issue is priority, and which stream is to be given priority to the functional resources. This is an issue in all mufti-streaming processors, and can be a more complicated issue in superscalar processors running multiple instruction threads. In most development in the art, scheduling has been developed to maximize processor ei~ciency. The inventors have discovered that rapid extension of digital processing into growing technology fields has created a critical need for dynamic prioritizing of thread processing and access to processor resources.
In many application mixes it has become clear to the inventors that application criticality is a dominant issue, rather than processor utilization, although both need to be considered. Up to the present most attention has been given to processor utilization. As an example, in most real applications for mufti-streaming processors, as opposed to theoretical, or academic exercises, there are real-time requirements.
Moreover, the criticality of some application threads may change relative to others during run time, depending on a number of issues, and the unsophisticated means of sharing and scheduling presently available in the art do not address real-world issues.
S Accordingly, what is clearly needed in the art is apparatus and methods for more sophisticated and dynamic scheduling and prioritizing of tasks and threads for mufti-streaming processors, including superscalar processors. The present invention teaches such apparatus and methods, which are disclosed below in enabling detail.
Summary of the Invention In a preferred embodiment of the present invention a mufti-streaming processor is provided, comprising a plurality of streams for , streaming one or more 1 S instruction threads; a set of functional resources for processing instructions from streams; an instruction scheduler for managing access for the streams to the functional resources; and a priority record of priority codes associated with streams. At any point in time the instruction scheduler manages access for a stream to the functional resources according to the priority record.
In some embodiments the priority record comprises one or more priority codes associated with at least one of the streams, and the priority record is static and not varying. In some other embodiments the priority record is varied in a consistently repeating manner. In some embodiments the processor has a priority controller coupled to the priority record, wherein the priority controller alters the one or more 2S priority codes dynamically during processing. Alteration of priority codes may be accomplished at least in part in a manner determined by changes in on-chip processing statistics. Determination of priority codes may also, in some embodiments, be accomplished at least in part off chip, and communicated to the priority controller. In yet other embodiments the priority controller alters priority codes according to instant states of stream instruction loading.
Background of the Invention Mufti-streaming processors capable of processing multiple threads are known in the art, and have been the subject of considerable research and development. The present invention takes notice of the prior work in this field, and builds upon that work, bringing new and non-obvious improvements in apparatus and methods to the art. The inventors have provided with this patent application an Information Disclosure Statement listing a number of published papers in the technical field of mufti-streaming processors. which together provide additional background and context for the several aspects of the present invention disclosed herein.
For purposes of definition, this specification regards a wream in reference to a processor as principally hardware structure on the processor capable of supporting and processing an instruction thread. A thread is defined by software or application context. For example, a mufti-streaming processor implemented as a CPU for operating a desktop computer may simultaneously process threads from two or more applications, such as a word processing program and an object-oriented drawing program. As another example, a mufti-stream-capable processor may operate a machine without regular human direction, such as a router in a data-packet network.
In this context there may be, for example, one or more applications (code sets) for processing and forwarding data packets on the network, and another for such as quality-of service (QoS) negotiation with other routers and servers connected to the network. The nature of data received for processing, together with pre-programmed scheduling for internal functions will determine the calling and serving of application routines In either of the above cases the maximum capability of the processor to process multiple threads remains fixed at the number of hardware-limited streams. A
multi-streaming processor operating a single thread therefore operates as a single-stream processor.
As described above and in the papers provided by IDS in the present case, supersca(ar processors are also known in the art. This term refers to processors that have more than one functional unit implemented on the processor chip, and an ability to issue instructions to individual ones of the functional units available.
Most CPU
processors built today have more than a single functional unit. Some have many such I S units, including such as Floating Point units, Integer Units, Logic Units, Branch Prediction units, Load/Store units and so forth. Mufti-streaming superscalar processors are known in the art as well.
The inventors have determined that there is a significantly neglected field in the art, relative to scheduling instructions from streams to functional resources, whether there are one or more functional units. The issue is priority, and which stream is to be given priority to the functional resources. This is an issue in all mufti-streaming processors, and can be a more complicated issue in superscalar processors running multiple instruction threads. In most development in the art, scheduling has been developed to maximize processor ei~ciency. The inventors have discovered that rapid extension of digital processing into growing technology fields has created a critical need for dynamic prioritizing of thread processing and access to processor resources.
In many application mixes it has become clear to the inventors that application criticality is a dominant issue, rather than processor utilization, although both need to be considered. Up to the present most attention has been given to processor utilization. As an example, in most real applications for mufti-streaming processors, as opposed to theoretical, or academic exercises, there are real-time requirements.
Moreover, the criticality of some application threads may change relative to others during run time, depending on a number of issues, and the unsophisticated means of sharing and scheduling presently available in the art do not address real-world issues.
S Accordingly, what is clearly needed in the art is apparatus and methods for more sophisticated and dynamic scheduling and prioritizing of tasks and threads for mufti-streaming processors, including superscalar processors. The present invention teaches such apparatus and methods, which are disclosed below in enabling detail.
Summary of the Invention In a preferred embodiment of the present invention a mufti-streaming processor is provided, comprising a plurality of streams for , streaming one or more 1 S instruction threads; a set of functional resources for processing instructions from streams; an instruction scheduler for managing access for the streams to the functional resources; and a priority record of priority codes associated with streams. At any point in time the instruction scheduler manages access for a stream to the functional resources according to the priority record.
In some embodiments the priority record comprises one or more priority codes associated with at least one of the streams, and the priority record is static and not varying. In some other embodiments the priority record is varied in a consistently repeating manner. In some embodiments the processor has a priority controller coupled to the priority record, wherein the priority controller alters the one or more 2S priority codes dynamically during processing. Alteration of priority codes may be accomplished at least in part in a manner determined by changes in on-chip processing statistics. Determination of priority codes may also, in some embodiments, be accomplished at least in part off chip, and communicated to the priority controller. In yet other embodiments the priority controller alters priority codes according to instant states of stream instruction loading.
In one embodiment of the invention a particular priority code effectively disables a stream, preventing access for that stream to functional resources.
In some cases the priority controller alters the priority record to enable and disable a stream in response to on-chip events, processing statistics, or external input. In some cases according to a processor interrupt.
In yet other embodiments of the invention the processor further comprises a tie-breaker function, the tie-breaker resolving access to functional resources for two or more streams having equal priority in the priority record.
In another aspect of the invention a multi-streaming processor is provided, comprising a plurality of streams for streaming a plurality of instruction threads; a set of functional resources for processing instructions from stream resources; a fetch unit for fetching instructions to the streams; an instruction scheduler for managing access for streams to the functional resources; a priority record of priority codes associated with streams; and a priority controller dynamically determining priorities and altering the priority record during processing.
In this aspect as well, alteration of the priority record may be accomplished at least in part in a manner determined by on-chip processing statistics. And in some embodiments alteration of the priority record may be accomplished at least in part off chip, and communicated to the priority controller. In some embodiments a particular priority code may be used to effectively disable a stream, preventing access for that stream to functional resources. Enabling and disabling may be done in response to on-chip events, processing statistics, or external input. In some cases according to a processor interrupt. In some cases priority may be altered according to stream instruction loading. In this as well as other aspects a tie-breaker function may be provided, the tie-breaker resolving access to functional resources for two or more streams having equal priority in the priority record.
According to another aspect of the invention a method for processing instructions from streams by priority in a multi-streaming processor is provided, comprising steps of (a) associating priority codes with one or more of the streams and storing the codes in a priority record; (b) checking priority codes in the priority record by an instruction scheduler during processing; and (c) managing access for streams to functional resources preferentially based on the priority codes. The priority codes in the priority record in this method may be static and not varying, or varied in a consistently repeating manner.
In some embodiments of this method there is a further step for altering the priority codes in the priority record dynamically during processing by a priority controller coupled to the priority record. The alteration of priority codes may be accomplished at least in part in a manner determined by changes in on-chip processing statistics, or accomplished at least in part ofI=chip, and communicated to the priority controller.
In some embodiments of the invention a particular priority code ei~ectively disables a stream, preventing access for that stream to functional resources:
Enabling and disabling may be in response to on-chip events, processing statistics, or external input. In some cases according to a processor interrupt. Priority I S codes may also be altered according to instant states of stream instruction loading. In this method a step may also be provided for a tie-breaker function, the tie-breaker resolving access to functional resources for two or more streams having equal priority in the priority record.
In yet another aspect of the invention a method is provided for processing instructions from streams by priority in a multi-streaming processor, comprising steps of (a) associating priority codes with one or more of the streams and storing the codes in a priority record; (b) checking priority codes in the priority record by an instruction scheduler during processing; (c) managing access for streams to functional resources preferentially based on the priority codes; and (d) dynamically altering priority codes in the priority record by a priority controller during processing.
In this method, in step (d), the alteration of priority codes may be accomplished at least in part in a manner determined by changes in on-chip processing statistics.
Also in this method determination of priority codes may be accomplished at least in pan off chip, and communicated to the priority controller. In this method as well a special priority code may be used to effectively disable a stream, preventing access for -G-that stream to functional resources. Enabling and disabling may be done in response to on-chip events, processing statistics, or external input. In some cases according to a processor interrupt.
Further in this method priority may be altered according to instant states of stream instruction loading. Further yet in this method a tie-breaker function may be provided, the tie-breaker resolving access to functional resources for two or more streams having equal priority in the priority record.
In yet another aspect of the invention a computer is provided, comprising a memory for storing application programs and data; and a mufti-streaming processor coupled to the memory and having a plurality of streams for processing a plurality of instruction threads, a set of functional resources for processing instructions from the streams,.-an.mstruction scheduler for managing access for the streams to the functional resources, and a priority record of priority codes associated with streams. At any point in time the instruction scheduler manages access for a stream to the functional I 5 resources according to the priority record.
In some embodiments of this computer the priority record comprises one or more priority codes associated with at least one of the streams, and the priority record is static and not varying. In other the priority record is varied in a consistently repeating manner. Also in some embodiments the priority record comprises one or more priority codes associated with one or more of the streams, and the processor further comprises a priority controller coupled to the priority record, wherein the priority controller alters the one or more priority codes dynamically during processing.
In some cases the alteration of priority codes may be accomplished at least in part in a manner determined by changes in on-chip processing statistics. In the same embodiments and others determination of priority codes may be accomplished at least in part off chip, and communicated to the priority controller.
In some embodiments of this computer a particular priority code effectively disables a stream, preventing access for that stream to functional resources.
In some cases the priority controller alters the priority record to enable and disable a stream in - '7 -response to on-chip events, processing statistics, or external input. In some cases according to a processor interrupt.
The priority controller may also alter priority codes according to instant states of stream instruction loading. In some cases there is tie-breaker function, the tie-breaker resolving access to functional resources for two or more streams having equal priority in the priority record.
In yet another aspect of the invention a computer is provided, comprising a memory for storing application programs and data; and a mufti-streaming processor coupled to the memory and having a plurality of streams for streaming a plurality of instruction threads, a set of functional resources for processing instructions from stream resources, an instruction scheduler for manaeing access for the streams to the functional resources, and -a- priority record. of priority codes associated with the streams. A priority controller dynamically determines priority codes during processing and alters the priority record accordingly.
In some embodiments this computer alteration of the priority record is accomplished at least in part in a manner determined by on-chip processing statistics.
In others alteration of the priority record is accomplished at least in part ofd chip, and communicated to the priority controller. In some embodiments a particular priority code effectively disables a stream, preventing access for that stream to functional resources. The priority controller may alter the priority record to enable and disable a stream m response to on-chip events, processing statistics, or external input.
In some cases according to a processor interrupt.
Further, the priority controller may alter priority codes according to instant states of stream instruction loading. In this computer there may also be provided a tie-breaker function, the tie-breaker resolving access to functional resources for two or more streams having equal priority in the priority record.
In yet another aspect of the invention a packet-data router for a packet data network is provided, comprising at least one port for connecting to the packet-data network; a memory for storing application code; and a mufti-streaming processor coupled to the memory and having a plurality of streams for streaming a plurality of _g_ instruction threads, a set of functional resources for processing instructions from stream resources, an instruction scheduler for managing access for the streams to the functional resources, and a priority record of priority codes associated with the streams. A priority controller dynamically determines priority codes during processing and alters the priority record accordingly.
In yet another aspect a digital signal processor is provided, comprising a plurality of streams for streaming a plurality of signals as separate threads;
a set of functional resources for processing signals; a scheduler for managing access for the signals to the functional resources; and a priority record of priority codes associated with the streams. A priority controller dynamically determines priority codes during processing and alters the priority record accordingly.
In the several .eFnbodiments of the invention described and taught im-enabling detail below, for the first time in the computer arts a mufti-streaming processor is provided wherein access for streams to functional processor resources is selectively managed, and wherein priorities for streams to access functional resources may be dynamically managed, bringing increased processing power, more efficient use of resources, and, in particular, attention to real-time processing needs.
Brief Description of the Drawings Fig. 1 is a diagram illustrating a prioritized instruction scheduler's role in allocating threads to processor resources according to an embodiment of the present invention.
Fig. 2 is a block diagram illustrating a system architecture for a mufti-streaming processor, including a prioritized instruction scheduler according to an embodiment of the present invention.
Description of the Preferred Embodiments A mufti-streaming processor is a processor having resources adapted to execute multiple instruction streams in parallel from multiple available program threads. The present invention in one aspect comprises an instruction scheduler in combination with a priority controller that prioritizes and coordinates efficient and timely allocation of concurrent streams to one or more processing resources, including functions! units.
In a preferred embodiment of the present invention, each stream is assigned a priority, representing the associated stream's claim to processing resources relative to competing instruction streams. Priorities may be implemented by a single number representing the associated stream's relative claim on all processor resources, or by a list containing priorities for each of several resources. In addition priorities can include degree of access to available resources, and limitations to access among available I ~ resources. Logic for determining and issuing priorities in various embodiments of the invention may be implemented in a variety of ways, as indicated in descriptions below.
In some embodiments, priorities may be fixed by stream, but access to resources may be managed in addition to priority access. In others priority by stream may vary, and access may be dynamically managed as well. Criteria for both access and priority determination may be from varied sources as well; in some cases according to on-chip statistics, such as current cache and memory requests, functional unit utilization or branch prediction, among other things; in others according to data arrival and availability, in others by input from ofd chip, and in combinations of these and other criteria. In preferred embodiments priority issue logic controls and manages each stream's access to the processor's functional resources in accordance with current priority. Also in preferred embodiments priority control and instruction issue functions can be dynamically changed to assure that each thread is serviced in timely fashion, while also efficiently managing utilization of processor resources within the restraints of real priorities.
Fig. 1 is a diagram illustrating flow of instructions and exemplary operation of a mufti-streaming processor 14 in an embodiment of the invention, including a prioritizing instruction scheduler 5 allocating streams to available processor functional resources I 0-13. Thread 1, thread 2 and thread 3 represent in this example programs stored in memory that are to be executed as concurrent processor streams.
Threads may come from a variety of sources, such as, but not limited to separate application programs, portions of a single mufti-threaded program, or instruction threads fetched as a result of interrupt service routines. The processor in this example fetches and decodes instructions from active threads 1 and 2, gathering a pool of streams containing instructions ready to execute. Thread 3 in this example is treated as inactive. Scheduler ~ allocates streams to resources 10 through 13.
Each of the act-ive streams has an associated instant priority, shown as -priority 7, associated with the stream running thread l, and priority 8, associated with the stream running thread 2. The priority of each stream determines its instant access to resources 10-13, and, in an additional feature of the invention, also determines relative claim to resources 10 - 13. Priority issue network 6 uses priorities 7 and 8 to assign instructions from each prioritized stream to resources 10 - 13 according to one or more mechanisms.
A priority control unit 9 monitors priority status for streams, and in some cases determines or amends priority according to accessible criteria, including for example, a history of processing activity, such as cache and memory requests and utilization of resources, varying priorities dynamically, as frequently in some embodiments as each processor cycle, as necessary to meet the timing requirements of threads and optimize the utilization of processing resources. In sophisticated embodiments, logic in priority control unit 9 may switch among scheduling mechanisms dynamically, depending on the requirements of threads I - 3.
Fig. 2 is a block diagram illustrating architecture in a preferred embodiment of mufti-streaming processor 14 of Fig. 1. Solid lines represent paths of instructions and data; dotted lines represent control paths. Memory 201 in this example contains instructions for one or more threads, which rnay be programs or portions of programs to be executed concurrently in the processor. The processor reads instructions from multiple threads into instruction cache 202 and data associated with the instructions into data cache 211. Typically, under the control of mufti-threaded fetch unit 203, instructions from instruction cache 202 are transferred into mufti-threaded fetch unit S 203, where they are stored in prefetch buffers, decoded and placed in one or more queues. A single queue may be shared among streams or partitioned into units for each stream in various embodiments. In some cases a queue may be dedicated to one or a set of resources, or any combination of streams and resources.
The net effect of the queues is that there are concurrent streams of instructions from which eligible instructions may be issued to functional resources. Each stream that the processor is equipped to execute has a context frame containing the program counter and register file for that stream. A thread is made active by loading an available context frame with the thread's program counter address and register values and by assigning it an active priority. There may be only a single thread to be executed, 1 S in which case there is a single stream of instructions to execute. When there are more active threads than streams available to execute threads, a number of threads up to the available number of context frames are made active and the remaining threads remain temporarily inactive. It is typically a function of an operating system to assign threads to streams of a mufti-streaming processor.
20 Instructions from multiple streams may be interleaved for execution on a cycle by-cycle basis, or less frequently, for example, during long latency memory operations.
Instruction scheduler 5 determines the order in which instructions from multiple streams are executed and dispatches selected instructions to priority issue network 6.
Instructions that load and store from memory may be monitored by instruction 25 scheduler 5 so that operation of memory 201, data cache 21 l, instruction cache 202, and other resources may be regulated as well as functional units 207 through 210.
Within instruction scheduler S, instructions are temporarily stored in reservation stations and evaluated for dependencies, so that instructions that depend on the prior execution of other instructions are delayed appropriately. Priority issue 30 network 6 assigns each instruction to appropriate functional units 207 -210 for execution. Functional units may comprise one or more integer units 208 and may include branch units 207, floating point units 209 and load/store units 210.
When multiple functional units of any type are available, instruction scheduler 204 and priority issue network 206 manage the allocation of instructions to any available functional unit. Instruction scheduler 5 contains a priority record, which may be a file or a set of registers, with priorities recorded for one or more of the streams. There may therefore be fewer priorities than streams, with streams that lack active priority being handled at a default level, or every stream may have a specific priority.
Whenever there are multiple streams there must be a mechanism for selecting which stream is allowed access to resources. Any means of managing access among streams may be considered broadly a priority scheme. It is common in the art, for example, to assign static priority in descending order to streams: In this scheme one stream always has the highest priority, and the other streams lesser priority in descending order. In the static case for four streams labeled A, B, C, and D, Table 1 below is the priority table, with 0 indicating highest priority, 1 next lower, 2 next lower, and 3 indicating the lowest priority.
Table I:
Stream A Stream B Stream C Stream D
Priority 0 I 2 3 In a static priority scheme as indicated in Table I, stream A always has the highest priority, and waiting instructions will be issued from stream A to functional units until there are no waiting instructions in stream A. At that point in time stream B, having next lower priority to stream A, is granted access to functional units and, and instructions are issued from stream B until there are no instructions waiting for stream B. It may be, of course, that there are no instructions in stream B
when access WO 00/36487 PCT/US99/29b45 shifts to stream B, in which case access goes to stream C, and so on. The constraint is that the priority for each stream remains constant, that is, static.
It has been found in the art that in many cases, especially as stream plurality increases, the static scheme causes problems, such as starvation of threads assigned to S streams of lower priority. In reaction, to promote fairness in access to functional resources, a round robin scheme has been proposed and implemented in the art wherein priority is shifted regularly among streams. Such a round robin scheme is represented in Table II below:
Table II:
-- ~ Stream A Stream B -Stream C Stream D
The rows in Table II represent time slices. At time Tl the priorities in that row apply until time T2. At time T2 the priorities in that row apply, and so on.
In the round robin scheme, priority rotates at specific time intervals as shown, and at least theoretically, each stream is granted equal access to the functional resources.
The inventors have discovered in their work that there are many and significant drawbacks to the static and round robin schemes with unlimited resource access, as described immediately above for prior art devices. These techniques simply do not address changing conditions, real-time demands, and the structural nature of different threads in their need for predominantly one class or another of resources.
More needs to be done. The inventors have accordingly provided apparatus and methods for significantly improving priority scheduling and issue of instructions.
WO 00/3b487 PCT/US99/29645 A closer examination of the matter of priority, broadly addressed, reveals that there are more issues than simple priority. These issues may, in one view, be stated as follows:
I. Which stream is to be granted access to functional resources?
2. How much access is to be granted?
3. Which stream is to have access neat ?
4. What happens in case of a tie?
In present and conventional systems these questions are at best only very poorly addressed, if at all. In various embodiments of the present invention all of these questions (issues) are addressed, and in a variety of~ways for a variety of purposes.
In some embodiments of the present invention a single number is used, as to represent a stream's priority and that number is used by the scheduler to allocate access to resources such as, but not limited to, functional units, memory and caches.
In other embodiments, a list of numbers stores multiple priorities for a stream, each number representing the associated stream's priority claim to a class of resources, a class being a set of integer units, floating point units, or the like. In still other embodiments a stream is granted access as the instant highest priority stream, but limited in that access to a single functional unit.
In another embodiment a list of numbers for each stream stores a stream's claim to individual resources. For example, in a processor with multiple integer and floating point units, a priority number can be used in connection with each integer unit and each floating point unit. More complex representations of priority are used when a finer-grained control over resources is needed to satisfy more demanding timing reqmrements or assure more complete utilization of resources.
Specifically, in embodiments of the present invention, perturbations of round robin and static schemes are still used for moving a pointer among streams.
Much more sophisticated mechanisms for priority are implemented however than in the prior art. For example, in an embodiment of the present invention a static priority may be assigned among four streams, as in Table 1 above. The mechanism for issuing instructions, however, may limit access for instructions from the streams to one or a specific combination of classes of resources. This selectivity of classes of resources may be a property of the priority for just one stream, the highest priority stream for S example, or for more than one, or for all of the streams, with access to resources outside the limited class allowed under special conditions.
In other embodiments of the invention two or more streams may have the same priority, but different access rights to functional resources, including exclusivity or some amount of overlap in access. In this unique scheme there may be conflict 10 requiring a tie-breaker, and a tie-breaker unit is provided for the purpose of determining access in case of a tie, which may be according to recent processing history on the chip (wha had last access?), or by- other criteria as conditions may dictate. For example, in case of a tie, access may be partitioned equally among tied streams.
15 In conventional processors interrupts (for those processors and applications where interrupts are used) are prioritized. That is, the nature of an interrupt is to stop the processor from what it is currently doing and to vector its activity to an interrupt service routine. In embodiments of the present invention, in cases where an interrupt service routine must be serviced within a small number of cycles, it may be given a high 20 priority assuring that all necessary resources are available to it.
However, normal threads may have, in some cases, more stringent timing requirements than that of certain interrupts, in which case they may be assigned higher priorities than interrupts.
Beyond the new and novel features of access rights as a part of priority and tie breaking logic, in specific embodiments of the present invention a powerful new 25 concept is brought to the art: Dynamic determination and management of priority in mufti-streaming processors.
In embodiments of the invention priority control unit 9 determines the context wherein priorities are interpreted by instruction scheduler 5 to allocate instructions.
For example, the stream with the highest priority may always take precedence over a 30 stream with a lower priority. Alternatively, the scheduler may guarantee minimal access to all streams, but increase access in proportion to a stream's priority. Round robin or random scheduling may be used, as described above, with a number of processor cycles allocated in turn to each stream varied according to the stream's priority. That is, in a conventional limited round robin scheme, streams are selected in order, and each stream selected is allocated the same attention or resources.
In embodiments of the present invention, however, streams are serviced in a round robin order, but each stream is allocated resources according to instant priority.
As an example of priority management, as described above, each stream accessed may be allocated access to all resources for a number of cycles deternuned by that stream's instant priority. In another embodiment, each stream accessed may be allocated access to functional units according to instant priority. For example, a stream-may, in- a static scheme, be allowed to-use certain functionai-units, but as its priority changes, it will be allowed access to more or fewer of available functional units. Importantly, the issue order and access rights may be dynamically varied by priority controller 9.
Priorities in some embodiments may be interpreted as fractions representing a stream's desired average utilization rate of one or more resources. In particularly sophisticated embodiments, processors may be provided with more than one of the aforementioned scheduling methods in combination. wherein priority control unit 9 may dynamically choose among methods or use multiple methods in various combinations. In other embodiments, scheduling methods and individual priorities may also be chosen under software control. When software does not specify a method, priority control unit 9 may default to a conventional method, such as round robin or static scheduling.
When a list of numbers is used for each priority, priority controller 9 manages each class of resources or each resource individually. Conflicting demands on a resource or class of resources are resolved by comparing like entries in each stream's priority list, according to any of the scheduling methods described above, alone or in combination.
In some cases, priorities of two or more streams may be identical. In this case instruction scheduler 5 has a tiebreaker mechanism, as introduced above. The tiebreaker can resolve conflicts using dynamic or static methods. For example, if round robin scheduling is used, each stream with identical priority would receive an equal share of resources. Alternatively, conflicts could be resolved on the basis of which resources the stream's current instruction requires or the utilization rate of various resources, or by random scheduling.
Priority control unit 9 also can change any stream's priority. Such changes may take place as frequently as in a fraction of a processor cycle, or less frequently, for example each memory cycle, or when long latency memory instructions are issued.
Changes in priorities may be made under software control or in response to conditions within the . processor or . other system components. In one embodiment;
priority control unit 9 monitors utilization of one or more processing resources such as frequency of access to functional units, memory and caches. Priorities are then varied to optimize throughput of streams or maximal utilization of one or more resources, or to strike a balance between throughput and utilization. When memory is monitored, priority may be changed based upon the range of addresses or memory segment being accessed. In embodiments wherein memory 201 is segmented. memory cycles are slower than processor cycles and multiple segments may be accessed concurrently, instruction scheduler 5 may then interleave access to multiple segments to optimize memory utilization. In an embodiment that monitors two or more resources, priorities may be set to optimize utilization of one resource or to balance utilization of multiple resources, and such a balance may be varied dynamically.
In some embodiments, resources such as integer units 208 or floating point units 209 may be dynamically reconfigured, changing the data path to be more efficient for certain instructions. For example, an integer unit could be reconfigured between instructions to either multiply two numbers together or add them. In one such embodiment, instruction scheduler 5 examines instructions in its reservation stations and/or in the instruction queue of mufti-threaded fetch unit 203 to determine optimal functional unit configurations and priority issue network 206 performs reconfigurations as necessary.
In the prior art, processors have used fixed scheduling mechanisms that do not allow flexible assignment of resources to multiple program threads. Dynamic prioritization of streams permits a dynamic configuration of processing resources to meet the needs of the combination of concurrent streams at any and every point in time. For example, real-time threads with stringent timing requirements may be given a higher priority to assure that their requirements are rnet, while less demanding streams may be serviced in the background. Moreover, because a priority control unit I O can monitor various aspects of processing , such as the content of an instruction cache, priorities can be varied during execution to achieve processing goals, such as servicing a stream of oncoming data that arrives at a variable rate. Alternatively, at-times when no threads have stringent requirements, scheduling may be reconfigured to keep all available resources busy, thereby maximizing total processor throughput. By permitting more efficient uses of resources, a smaller, less expensive processor may be designed using the present prioritized scheduler than using conventional technology.
In one preferred embodiment of the present invention a unique priority number is assigned to a stream to disable that stream in the issuing order, until a predetermined event or set of conditions signals to re-enable the stream. For example, in such an embodiment a mufti-streaming processor having four streams may have five priority numbers 0-4, wherein priority of zero may be set for a stream, and zero is interpreted by the system to disable the stream. Priority 1 is then the lowest priority, 2 the next higher, and 4 the highest.
There exist many reasons in the art for which it may be desired to disable a stream, and assignment of the disable priority may be based on any of a variety of criteria, including availability of data or instructions, input from ofd chip, a particular combination of threads, and so on. In one embodiment a processor interrupt may be used to enable and disable a stream. In this embodiment a disabled stream may be signaled to wake up by an interrupt. The priority controller in this embodiment would modify the priority file to assign a non-zero priority to the disabled (sleeping) stream, In another embodiment priority may be managed according to stream loading.
In this scheme, thresholds may be set, and as streams fetch available instructions that are able to be issued, priority is assigned according to the thresholds. The granularity in such a scheme may be course or fine, as needed.
In the embodiments described priority controller 9 has been described as managing priority, including access rights and so on, and placing the necessary criteria in a priority file in instruction scheduler 5. It wilt be apparent to the skilled artisan that the table of criteria for priority and access could reside elsewhere, and the priority control could also be implemented in a number of ways, all within the skill of a competent engineer having knowledge of the teachings herein. The specific architecture shown is therefore not limiting.
Further to the above; several mechanisms and criteria for dynamically managing priority and access have been disclosed as functions of Priority Controller 9.
Priority Controller 9 may be implemented in a variety of ways, and may perform its functions I S by a mix of hardware and software techniques. In some embodiments controller 9 may, for example, access registers indexed by counters to ascertain statistics pertaining to recent processing history, such as use of FP units as opposed to Integer units, and manage priority rights as a result. In some embodiments the priority controller may execute one or more code routines (algorithms) for determining priority and access rights. In still other embodiments the priority controller may be programmable to some extent, and accept input from off chip to determine and set priority and access rights.
The features of the present invention permit improvement in many types of devices that use multiple streams. For example, modern network routers and switches are called upon to handle multiple streams or flows of packets of incoming data and dispatch them to various destinations on the network. Certain network protocols, such as Asynchronous Transfer Mode, can provide guarantees of services to data flows, assuring timely forwarding of data through a network device. The present invention can be used to optimize processing within such a device by, for example, giving higher priority to threads handling network data than to threads that negotiate quality of WO 00/36487 PCTNS99/29b45 service or reconfigure the paths that data takes through the device. When the quality of service of each of several data flows may be different, streams with differing priorities may be used to meet the service guarantees.
In another aspect of the invention processors, according to embodiments of the invention may enhance workstations. Workstations are typically general-purpose computers that are called upon to handle a wide variety of mixes of concurrent programs. For example, a workstation may be concurrently playing an MPEG
video, sending data to a printer, responding to typing and other inputs from a user and running application programs such as a Web browser and a word processing program.
Using the teachings of the present invention in processors for workstations permits improvements in responding to the varied demands of each stream. For example, the MPEG video stream can be given high priority access- to resources needed for decoding frames and to video memory, while an interrupt service routine for the printer is given a priority sufficient to drive the current printer at its maximum printing rate. Application programs may be given second-level priority to video memory.
In another aspect, robotic devices are known that must respond in real time to sensors, actuators and control inputs. By partitioning the operating software for such devices into threads and assigning priorities appropriately, several sets of timing requirements may be met simultaneously, and robotic devices may be operated more ef$ciently with less powerful, and therefore less expensive processors than has been the case in the current art.
In yet another embodiment of the invention features of the present invention are implemented in special processors known in the art as Digital Signal Processors (DSPs), which are special processors for processing what may be termed "natural data", typically streamed in an analog fashion, by representing the data in a digital protocol, then processing the data in pre-determined ways. Many such processors are used for audio processing in telephony systems and other systems utilizing audio streams. This technology is extended as well into the video realm. In many cases there exist opportunities in such systems for mufti-threading, hence for mufti-streaming, and thence for priority control according to the teachings of the present invention.
WO 00/36487 PCT/US99/29b45 It is emphasized that there are few, if any, limitations in the types and sizes of processors that may be improved in functionality by application of the teachings of the present invention. Small processors with single functional units, such as embedded controllers for hard-to-reach equipment, can be thus enhanced, if there are multiple threads that may be processed. Applications extend to special microcontrollers implemented as ASICs, and to essentially all other sorts of digital processors. Only a few examples of the many are mentioned here.
It will be apparent to the skilled artisan that many alterations may be made in embodiments of the invention described within the spirit and scope of the invention.
There are, for example, many ways that hardware functionality may be provided in a processor, while accomplishing essentially the same purpose or function.
Similarly, - ----- there are many ways that software and firmware may be structured by different programmers, or the same programmer, while still accomplishing essentially the same purpose or function. Additionally processors according to embodiments of the present invention may have widely varying architecture regarding such things as number of stream resources, number of functional units, and the like. Such variations should be considered within the scope of the invention, and the invention is limited only by the claims below:
In some cases the priority controller alters the priority record to enable and disable a stream in response to on-chip events, processing statistics, or external input. In some cases according to a processor interrupt.
In yet other embodiments of the invention the processor further comprises a tie-breaker function, the tie-breaker resolving access to functional resources for two or more streams having equal priority in the priority record.
In another aspect of the invention a multi-streaming processor is provided, comprising a plurality of streams for streaming a plurality of instruction threads; a set of functional resources for processing instructions from stream resources; a fetch unit for fetching instructions to the streams; an instruction scheduler for managing access for streams to the functional resources; a priority record of priority codes associated with streams; and a priority controller dynamically determining priorities and altering the priority record during processing.
In this aspect as well, alteration of the priority record may be accomplished at least in part in a manner determined by on-chip processing statistics. And in some embodiments alteration of the priority record may be accomplished at least in part off chip, and communicated to the priority controller. In some embodiments a particular priority code may be used to effectively disable a stream, preventing access for that stream to functional resources. Enabling and disabling may be done in response to on-chip events, processing statistics, or external input. In some cases according to a processor interrupt. In some cases priority may be altered according to stream instruction loading. In this as well as other aspects a tie-breaker function may be provided, the tie-breaker resolving access to functional resources for two or more streams having equal priority in the priority record.
According to another aspect of the invention a method for processing instructions from streams by priority in a multi-streaming processor is provided, comprising steps of (a) associating priority codes with one or more of the streams and storing the codes in a priority record; (b) checking priority codes in the priority record by an instruction scheduler during processing; and (c) managing access for streams to functional resources preferentially based on the priority codes. The priority codes in the priority record in this method may be static and not varying, or varied in a consistently repeating manner.
In some embodiments of this method there is a further step for altering the priority codes in the priority record dynamically during processing by a priority controller coupled to the priority record. The alteration of priority codes may be accomplished at least in part in a manner determined by changes in on-chip processing statistics, or accomplished at least in part ofI=chip, and communicated to the priority controller.
In some embodiments of the invention a particular priority code ei~ectively disables a stream, preventing access for that stream to functional resources:
Enabling and disabling may be in response to on-chip events, processing statistics, or external input. In some cases according to a processor interrupt. Priority I S codes may also be altered according to instant states of stream instruction loading. In this method a step may also be provided for a tie-breaker function, the tie-breaker resolving access to functional resources for two or more streams having equal priority in the priority record.
In yet another aspect of the invention a method is provided for processing instructions from streams by priority in a multi-streaming processor, comprising steps of (a) associating priority codes with one or more of the streams and storing the codes in a priority record; (b) checking priority codes in the priority record by an instruction scheduler during processing; (c) managing access for streams to functional resources preferentially based on the priority codes; and (d) dynamically altering priority codes in the priority record by a priority controller during processing.
In this method, in step (d), the alteration of priority codes may be accomplished at least in part in a manner determined by changes in on-chip processing statistics.
Also in this method determination of priority codes may be accomplished at least in pan off chip, and communicated to the priority controller. In this method as well a special priority code may be used to effectively disable a stream, preventing access for -G-that stream to functional resources. Enabling and disabling may be done in response to on-chip events, processing statistics, or external input. In some cases according to a processor interrupt.
Further in this method priority may be altered according to instant states of stream instruction loading. Further yet in this method a tie-breaker function may be provided, the tie-breaker resolving access to functional resources for two or more streams having equal priority in the priority record.
In yet another aspect of the invention a computer is provided, comprising a memory for storing application programs and data; and a mufti-streaming processor coupled to the memory and having a plurality of streams for processing a plurality of instruction threads, a set of functional resources for processing instructions from the streams,.-an.mstruction scheduler for managing access for the streams to the functional resources, and a priority record of priority codes associated with streams. At any point in time the instruction scheduler manages access for a stream to the functional I 5 resources according to the priority record.
In some embodiments of this computer the priority record comprises one or more priority codes associated with at least one of the streams, and the priority record is static and not varying. In other the priority record is varied in a consistently repeating manner. Also in some embodiments the priority record comprises one or more priority codes associated with one or more of the streams, and the processor further comprises a priority controller coupled to the priority record, wherein the priority controller alters the one or more priority codes dynamically during processing.
In some cases the alteration of priority codes may be accomplished at least in part in a manner determined by changes in on-chip processing statistics. In the same embodiments and others determination of priority codes may be accomplished at least in part off chip, and communicated to the priority controller.
In some embodiments of this computer a particular priority code effectively disables a stream, preventing access for that stream to functional resources.
In some cases the priority controller alters the priority record to enable and disable a stream in - '7 -response to on-chip events, processing statistics, or external input. In some cases according to a processor interrupt.
The priority controller may also alter priority codes according to instant states of stream instruction loading. In some cases there is tie-breaker function, the tie-breaker resolving access to functional resources for two or more streams having equal priority in the priority record.
In yet another aspect of the invention a computer is provided, comprising a memory for storing application programs and data; and a mufti-streaming processor coupled to the memory and having a plurality of streams for streaming a plurality of instruction threads, a set of functional resources for processing instructions from stream resources, an instruction scheduler for manaeing access for the streams to the functional resources, and -a- priority record. of priority codes associated with the streams. A priority controller dynamically determines priority codes during processing and alters the priority record accordingly.
In some embodiments this computer alteration of the priority record is accomplished at least in part in a manner determined by on-chip processing statistics.
In others alteration of the priority record is accomplished at least in part ofd chip, and communicated to the priority controller. In some embodiments a particular priority code effectively disables a stream, preventing access for that stream to functional resources. The priority controller may alter the priority record to enable and disable a stream m response to on-chip events, processing statistics, or external input.
In some cases according to a processor interrupt.
Further, the priority controller may alter priority codes according to instant states of stream instruction loading. In this computer there may also be provided a tie-breaker function, the tie-breaker resolving access to functional resources for two or more streams having equal priority in the priority record.
In yet another aspect of the invention a packet-data router for a packet data network is provided, comprising at least one port for connecting to the packet-data network; a memory for storing application code; and a mufti-streaming processor coupled to the memory and having a plurality of streams for streaming a plurality of _g_ instruction threads, a set of functional resources for processing instructions from stream resources, an instruction scheduler for managing access for the streams to the functional resources, and a priority record of priority codes associated with the streams. A priority controller dynamically determines priority codes during processing and alters the priority record accordingly.
In yet another aspect a digital signal processor is provided, comprising a plurality of streams for streaming a plurality of signals as separate threads;
a set of functional resources for processing signals; a scheduler for managing access for the signals to the functional resources; and a priority record of priority codes associated with the streams. A priority controller dynamically determines priority codes during processing and alters the priority record accordingly.
In the several .eFnbodiments of the invention described and taught im-enabling detail below, for the first time in the computer arts a mufti-streaming processor is provided wherein access for streams to functional processor resources is selectively managed, and wherein priorities for streams to access functional resources may be dynamically managed, bringing increased processing power, more efficient use of resources, and, in particular, attention to real-time processing needs.
Brief Description of the Drawings Fig. 1 is a diagram illustrating a prioritized instruction scheduler's role in allocating threads to processor resources according to an embodiment of the present invention.
Fig. 2 is a block diagram illustrating a system architecture for a mufti-streaming processor, including a prioritized instruction scheduler according to an embodiment of the present invention.
Description of the Preferred Embodiments A mufti-streaming processor is a processor having resources adapted to execute multiple instruction streams in parallel from multiple available program threads. The present invention in one aspect comprises an instruction scheduler in combination with a priority controller that prioritizes and coordinates efficient and timely allocation of concurrent streams to one or more processing resources, including functions! units.
In a preferred embodiment of the present invention, each stream is assigned a priority, representing the associated stream's claim to processing resources relative to competing instruction streams. Priorities may be implemented by a single number representing the associated stream's relative claim on all processor resources, or by a list containing priorities for each of several resources. In addition priorities can include degree of access to available resources, and limitations to access among available I ~ resources. Logic for determining and issuing priorities in various embodiments of the invention may be implemented in a variety of ways, as indicated in descriptions below.
In some embodiments, priorities may be fixed by stream, but access to resources may be managed in addition to priority access. In others priority by stream may vary, and access may be dynamically managed as well. Criteria for both access and priority determination may be from varied sources as well; in some cases according to on-chip statistics, such as current cache and memory requests, functional unit utilization or branch prediction, among other things; in others according to data arrival and availability, in others by input from ofd chip, and in combinations of these and other criteria. In preferred embodiments priority issue logic controls and manages each stream's access to the processor's functional resources in accordance with current priority. Also in preferred embodiments priority control and instruction issue functions can be dynamically changed to assure that each thread is serviced in timely fashion, while also efficiently managing utilization of processor resources within the restraints of real priorities.
Fig. 1 is a diagram illustrating flow of instructions and exemplary operation of a mufti-streaming processor 14 in an embodiment of the invention, including a prioritizing instruction scheduler 5 allocating streams to available processor functional resources I 0-13. Thread 1, thread 2 and thread 3 represent in this example programs stored in memory that are to be executed as concurrent processor streams.
Threads may come from a variety of sources, such as, but not limited to separate application programs, portions of a single mufti-threaded program, or instruction threads fetched as a result of interrupt service routines. The processor in this example fetches and decodes instructions from active threads 1 and 2, gathering a pool of streams containing instructions ready to execute. Thread 3 in this example is treated as inactive. Scheduler ~ allocates streams to resources 10 through 13.
Each of the act-ive streams has an associated instant priority, shown as -priority 7, associated with the stream running thread l, and priority 8, associated with the stream running thread 2. The priority of each stream determines its instant access to resources 10-13, and, in an additional feature of the invention, also determines relative claim to resources 10 - 13. Priority issue network 6 uses priorities 7 and 8 to assign instructions from each prioritized stream to resources 10 - 13 according to one or more mechanisms.
A priority control unit 9 monitors priority status for streams, and in some cases determines or amends priority according to accessible criteria, including for example, a history of processing activity, such as cache and memory requests and utilization of resources, varying priorities dynamically, as frequently in some embodiments as each processor cycle, as necessary to meet the timing requirements of threads and optimize the utilization of processing resources. In sophisticated embodiments, logic in priority control unit 9 may switch among scheduling mechanisms dynamically, depending on the requirements of threads I - 3.
Fig. 2 is a block diagram illustrating architecture in a preferred embodiment of mufti-streaming processor 14 of Fig. 1. Solid lines represent paths of instructions and data; dotted lines represent control paths. Memory 201 in this example contains instructions for one or more threads, which rnay be programs or portions of programs to be executed concurrently in the processor. The processor reads instructions from multiple threads into instruction cache 202 and data associated with the instructions into data cache 211. Typically, under the control of mufti-threaded fetch unit 203, instructions from instruction cache 202 are transferred into mufti-threaded fetch unit S 203, where they are stored in prefetch buffers, decoded and placed in one or more queues. A single queue may be shared among streams or partitioned into units for each stream in various embodiments. In some cases a queue may be dedicated to one or a set of resources, or any combination of streams and resources.
The net effect of the queues is that there are concurrent streams of instructions from which eligible instructions may be issued to functional resources. Each stream that the processor is equipped to execute has a context frame containing the program counter and register file for that stream. A thread is made active by loading an available context frame with the thread's program counter address and register values and by assigning it an active priority. There may be only a single thread to be executed, 1 S in which case there is a single stream of instructions to execute. When there are more active threads than streams available to execute threads, a number of threads up to the available number of context frames are made active and the remaining threads remain temporarily inactive. It is typically a function of an operating system to assign threads to streams of a mufti-streaming processor.
20 Instructions from multiple streams may be interleaved for execution on a cycle by-cycle basis, or less frequently, for example, during long latency memory operations.
Instruction scheduler 5 determines the order in which instructions from multiple streams are executed and dispatches selected instructions to priority issue network 6.
Instructions that load and store from memory may be monitored by instruction 25 scheduler 5 so that operation of memory 201, data cache 21 l, instruction cache 202, and other resources may be regulated as well as functional units 207 through 210.
Within instruction scheduler S, instructions are temporarily stored in reservation stations and evaluated for dependencies, so that instructions that depend on the prior execution of other instructions are delayed appropriately. Priority issue 30 network 6 assigns each instruction to appropriate functional units 207 -210 for execution. Functional units may comprise one or more integer units 208 and may include branch units 207, floating point units 209 and load/store units 210.
When multiple functional units of any type are available, instruction scheduler 204 and priority issue network 206 manage the allocation of instructions to any available functional unit. Instruction scheduler 5 contains a priority record, which may be a file or a set of registers, with priorities recorded for one or more of the streams. There may therefore be fewer priorities than streams, with streams that lack active priority being handled at a default level, or every stream may have a specific priority.
Whenever there are multiple streams there must be a mechanism for selecting which stream is allowed access to resources. Any means of managing access among streams may be considered broadly a priority scheme. It is common in the art, for example, to assign static priority in descending order to streams: In this scheme one stream always has the highest priority, and the other streams lesser priority in descending order. In the static case for four streams labeled A, B, C, and D, Table 1 below is the priority table, with 0 indicating highest priority, 1 next lower, 2 next lower, and 3 indicating the lowest priority.
Table I:
Stream A Stream B Stream C Stream D
Priority 0 I 2 3 In a static priority scheme as indicated in Table I, stream A always has the highest priority, and waiting instructions will be issued from stream A to functional units until there are no waiting instructions in stream A. At that point in time stream B, having next lower priority to stream A, is granted access to functional units and, and instructions are issued from stream B until there are no instructions waiting for stream B. It may be, of course, that there are no instructions in stream B
when access WO 00/36487 PCT/US99/29b45 shifts to stream B, in which case access goes to stream C, and so on. The constraint is that the priority for each stream remains constant, that is, static.
It has been found in the art that in many cases, especially as stream plurality increases, the static scheme causes problems, such as starvation of threads assigned to S streams of lower priority. In reaction, to promote fairness in access to functional resources, a round robin scheme has been proposed and implemented in the art wherein priority is shifted regularly among streams. Such a round robin scheme is represented in Table II below:
Table II:
-- ~ Stream A Stream B -Stream C Stream D
The rows in Table II represent time slices. At time Tl the priorities in that row apply until time T2. At time T2 the priorities in that row apply, and so on.
In the round robin scheme, priority rotates at specific time intervals as shown, and at least theoretically, each stream is granted equal access to the functional resources.
The inventors have discovered in their work that there are many and significant drawbacks to the static and round robin schemes with unlimited resource access, as described immediately above for prior art devices. These techniques simply do not address changing conditions, real-time demands, and the structural nature of different threads in their need for predominantly one class or another of resources.
More needs to be done. The inventors have accordingly provided apparatus and methods for significantly improving priority scheduling and issue of instructions.
WO 00/3b487 PCT/US99/29645 A closer examination of the matter of priority, broadly addressed, reveals that there are more issues than simple priority. These issues may, in one view, be stated as follows:
I. Which stream is to be granted access to functional resources?
2. How much access is to be granted?
3. Which stream is to have access neat ?
4. What happens in case of a tie?
In present and conventional systems these questions are at best only very poorly addressed, if at all. In various embodiments of the present invention all of these questions (issues) are addressed, and in a variety of~ways for a variety of purposes.
In some embodiments of the present invention a single number is used, as to represent a stream's priority and that number is used by the scheduler to allocate access to resources such as, but not limited to, functional units, memory and caches.
In other embodiments, a list of numbers stores multiple priorities for a stream, each number representing the associated stream's priority claim to a class of resources, a class being a set of integer units, floating point units, or the like. In still other embodiments a stream is granted access as the instant highest priority stream, but limited in that access to a single functional unit.
In another embodiment a list of numbers for each stream stores a stream's claim to individual resources. For example, in a processor with multiple integer and floating point units, a priority number can be used in connection with each integer unit and each floating point unit. More complex representations of priority are used when a finer-grained control over resources is needed to satisfy more demanding timing reqmrements or assure more complete utilization of resources.
Specifically, in embodiments of the present invention, perturbations of round robin and static schemes are still used for moving a pointer among streams.
Much more sophisticated mechanisms for priority are implemented however than in the prior art. For example, in an embodiment of the present invention a static priority may be assigned among four streams, as in Table 1 above. The mechanism for issuing instructions, however, may limit access for instructions from the streams to one or a specific combination of classes of resources. This selectivity of classes of resources may be a property of the priority for just one stream, the highest priority stream for S example, or for more than one, or for all of the streams, with access to resources outside the limited class allowed under special conditions.
In other embodiments of the invention two or more streams may have the same priority, but different access rights to functional resources, including exclusivity or some amount of overlap in access. In this unique scheme there may be conflict 10 requiring a tie-breaker, and a tie-breaker unit is provided for the purpose of determining access in case of a tie, which may be according to recent processing history on the chip (wha had last access?), or by- other criteria as conditions may dictate. For example, in case of a tie, access may be partitioned equally among tied streams.
15 In conventional processors interrupts (for those processors and applications where interrupts are used) are prioritized. That is, the nature of an interrupt is to stop the processor from what it is currently doing and to vector its activity to an interrupt service routine. In embodiments of the present invention, in cases where an interrupt service routine must be serviced within a small number of cycles, it may be given a high 20 priority assuring that all necessary resources are available to it.
However, normal threads may have, in some cases, more stringent timing requirements than that of certain interrupts, in which case they may be assigned higher priorities than interrupts.
Beyond the new and novel features of access rights as a part of priority and tie breaking logic, in specific embodiments of the present invention a powerful new 25 concept is brought to the art: Dynamic determination and management of priority in mufti-streaming processors.
In embodiments of the invention priority control unit 9 determines the context wherein priorities are interpreted by instruction scheduler 5 to allocate instructions.
For example, the stream with the highest priority may always take precedence over a 30 stream with a lower priority. Alternatively, the scheduler may guarantee minimal access to all streams, but increase access in proportion to a stream's priority. Round robin or random scheduling may be used, as described above, with a number of processor cycles allocated in turn to each stream varied according to the stream's priority. That is, in a conventional limited round robin scheme, streams are selected in order, and each stream selected is allocated the same attention or resources.
In embodiments of the present invention, however, streams are serviced in a round robin order, but each stream is allocated resources according to instant priority.
As an example of priority management, as described above, each stream accessed may be allocated access to all resources for a number of cycles deternuned by that stream's instant priority. In another embodiment, each stream accessed may be allocated access to functional units according to instant priority. For example, a stream-may, in- a static scheme, be allowed to-use certain functionai-units, but as its priority changes, it will be allowed access to more or fewer of available functional units. Importantly, the issue order and access rights may be dynamically varied by priority controller 9.
Priorities in some embodiments may be interpreted as fractions representing a stream's desired average utilization rate of one or more resources. In particularly sophisticated embodiments, processors may be provided with more than one of the aforementioned scheduling methods in combination. wherein priority control unit 9 may dynamically choose among methods or use multiple methods in various combinations. In other embodiments, scheduling methods and individual priorities may also be chosen under software control. When software does not specify a method, priority control unit 9 may default to a conventional method, such as round robin or static scheduling.
When a list of numbers is used for each priority, priority controller 9 manages each class of resources or each resource individually. Conflicting demands on a resource or class of resources are resolved by comparing like entries in each stream's priority list, according to any of the scheduling methods described above, alone or in combination.
In some cases, priorities of two or more streams may be identical. In this case instruction scheduler 5 has a tiebreaker mechanism, as introduced above. The tiebreaker can resolve conflicts using dynamic or static methods. For example, if round robin scheduling is used, each stream with identical priority would receive an equal share of resources. Alternatively, conflicts could be resolved on the basis of which resources the stream's current instruction requires or the utilization rate of various resources, or by random scheduling.
Priority control unit 9 also can change any stream's priority. Such changes may take place as frequently as in a fraction of a processor cycle, or less frequently, for example each memory cycle, or when long latency memory instructions are issued.
Changes in priorities may be made under software control or in response to conditions within the . processor or . other system components. In one embodiment;
priority control unit 9 monitors utilization of one or more processing resources such as frequency of access to functional units, memory and caches. Priorities are then varied to optimize throughput of streams or maximal utilization of one or more resources, or to strike a balance between throughput and utilization. When memory is monitored, priority may be changed based upon the range of addresses or memory segment being accessed. In embodiments wherein memory 201 is segmented. memory cycles are slower than processor cycles and multiple segments may be accessed concurrently, instruction scheduler 5 may then interleave access to multiple segments to optimize memory utilization. In an embodiment that monitors two or more resources, priorities may be set to optimize utilization of one resource or to balance utilization of multiple resources, and such a balance may be varied dynamically.
In some embodiments, resources such as integer units 208 or floating point units 209 may be dynamically reconfigured, changing the data path to be more efficient for certain instructions. For example, an integer unit could be reconfigured between instructions to either multiply two numbers together or add them. In one such embodiment, instruction scheduler 5 examines instructions in its reservation stations and/or in the instruction queue of mufti-threaded fetch unit 203 to determine optimal functional unit configurations and priority issue network 206 performs reconfigurations as necessary.
In the prior art, processors have used fixed scheduling mechanisms that do not allow flexible assignment of resources to multiple program threads. Dynamic prioritization of streams permits a dynamic configuration of processing resources to meet the needs of the combination of concurrent streams at any and every point in time. For example, real-time threads with stringent timing requirements may be given a higher priority to assure that their requirements are rnet, while less demanding streams may be serviced in the background. Moreover, because a priority control unit I O can monitor various aspects of processing , such as the content of an instruction cache, priorities can be varied during execution to achieve processing goals, such as servicing a stream of oncoming data that arrives at a variable rate. Alternatively, at-times when no threads have stringent requirements, scheduling may be reconfigured to keep all available resources busy, thereby maximizing total processor throughput. By permitting more efficient uses of resources, a smaller, less expensive processor may be designed using the present prioritized scheduler than using conventional technology.
In one preferred embodiment of the present invention a unique priority number is assigned to a stream to disable that stream in the issuing order, until a predetermined event or set of conditions signals to re-enable the stream. For example, in such an embodiment a mufti-streaming processor having four streams may have five priority numbers 0-4, wherein priority of zero may be set for a stream, and zero is interpreted by the system to disable the stream. Priority 1 is then the lowest priority, 2 the next higher, and 4 the highest.
There exist many reasons in the art for which it may be desired to disable a stream, and assignment of the disable priority may be based on any of a variety of criteria, including availability of data or instructions, input from ofd chip, a particular combination of threads, and so on. In one embodiment a processor interrupt may be used to enable and disable a stream. In this embodiment a disabled stream may be signaled to wake up by an interrupt. The priority controller in this embodiment would modify the priority file to assign a non-zero priority to the disabled (sleeping) stream, In another embodiment priority may be managed according to stream loading.
In this scheme, thresholds may be set, and as streams fetch available instructions that are able to be issued, priority is assigned according to the thresholds. The granularity in such a scheme may be course or fine, as needed.
In the embodiments described priority controller 9 has been described as managing priority, including access rights and so on, and placing the necessary criteria in a priority file in instruction scheduler 5. It wilt be apparent to the skilled artisan that the table of criteria for priority and access could reside elsewhere, and the priority control could also be implemented in a number of ways, all within the skill of a competent engineer having knowledge of the teachings herein. The specific architecture shown is therefore not limiting.
Further to the above; several mechanisms and criteria for dynamically managing priority and access have been disclosed as functions of Priority Controller 9.
Priority Controller 9 may be implemented in a variety of ways, and may perform its functions I S by a mix of hardware and software techniques. In some embodiments controller 9 may, for example, access registers indexed by counters to ascertain statistics pertaining to recent processing history, such as use of FP units as opposed to Integer units, and manage priority rights as a result. In some embodiments the priority controller may execute one or more code routines (algorithms) for determining priority and access rights. In still other embodiments the priority controller may be programmable to some extent, and accept input from off chip to determine and set priority and access rights.
The features of the present invention permit improvement in many types of devices that use multiple streams. For example, modern network routers and switches are called upon to handle multiple streams or flows of packets of incoming data and dispatch them to various destinations on the network. Certain network protocols, such as Asynchronous Transfer Mode, can provide guarantees of services to data flows, assuring timely forwarding of data through a network device. The present invention can be used to optimize processing within such a device by, for example, giving higher priority to threads handling network data than to threads that negotiate quality of WO 00/36487 PCTNS99/29b45 service or reconfigure the paths that data takes through the device. When the quality of service of each of several data flows may be different, streams with differing priorities may be used to meet the service guarantees.
In another aspect of the invention processors, according to embodiments of the invention may enhance workstations. Workstations are typically general-purpose computers that are called upon to handle a wide variety of mixes of concurrent programs. For example, a workstation may be concurrently playing an MPEG
video, sending data to a printer, responding to typing and other inputs from a user and running application programs such as a Web browser and a word processing program.
Using the teachings of the present invention in processors for workstations permits improvements in responding to the varied demands of each stream. For example, the MPEG video stream can be given high priority access- to resources needed for decoding frames and to video memory, while an interrupt service routine for the printer is given a priority sufficient to drive the current printer at its maximum printing rate. Application programs may be given second-level priority to video memory.
In another aspect, robotic devices are known that must respond in real time to sensors, actuators and control inputs. By partitioning the operating software for such devices into threads and assigning priorities appropriately, several sets of timing requirements may be met simultaneously, and robotic devices may be operated more ef$ciently with less powerful, and therefore less expensive processors than has been the case in the current art.
In yet another embodiment of the invention features of the present invention are implemented in special processors known in the art as Digital Signal Processors (DSPs), which are special processors for processing what may be termed "natural data", typically streamed in an analog fashion, by representing the data in a digital protocol, then processing the data in pre-determined ways. Many such processors are used for audio processing in telephony systems and other systems utilizing audio streams. This technology is extended as well into the video realm. In many cases there exist opportunities in such systems for mufti-threading, hence for mufti-streaming, and thence for priority control according to the teachings of the present invention.
WO 00/36487 PCT/US99/29b45 It is emphasized that there are few, if any, limitations in the types and sizes of processors that may be improved in functionality by application of the teachings of the present invention. Small processors with single functional units, such as embedded controllers for hard-to-reach equipment, can be thus enhanced, if there are multiple threads that may be processed. Applications extend to special microcontrollers implemented as ASICs, and to essentially all other sorts of digital processors. Only a few examples of the many are mentioned here.
It will be apparent to the skilled artisan that many alterations may be made in embodiments of the invention described within the spirit and scope of the invention.
There are, for example, many ways that hardware functionality may be provided in a processor, while accomplishing essentially the same purpose or function.
Similarly, - ----- there are many ways that software and firmware may be structured by different programmers, or the same programmer, while still accomplishing essentially the same purpose or function. Additionally processors according to embodiments of the present invention may have widely varying architecture regarding such things as number of stream resources, number of functional units, and the like. Such variations should be considered within the scope of the invention, and the invention is limited only by the claims below:
Claims (59)
1. A multi-streaming processor comprising:
a plurality of streams for streaming one or more instruction threads;
a set of functional resources for processing instructions from streams;
an instruction scheduler for managing access for the streams to the functional resources; and a priority record of priority codes associated with streams;
wherein at any point in time the instruction scheduler manages access for a stream to the functional resources according to the priority record.
a plurality of streams for streaming one or more instruction threads;
a set of functional resources for processing instructions from streams;
an instruction scheduler for managing access for the streams to the functional resources; and a priority record of priority codes associated with streams;
wherein at any point in time the instruction scheduler manages access for a stream to the functional resources according to the priority record.
2. The processor of claim 1 wherein the priority record comprises one or more priority codes associated with at least one of the streams, and the priority record is static and not varying.
3. The processor of claim 1 wherein the priority record is varied in a consistently repeating manner.
4. The processor of claim 1 wherein the priority record comprises one or more priority codes associated with one or more of the streams, and further comprising a priority controller coupled to the priority record, wherein the priority controller alters the one or more priority codes dynamically during processing.
5. The processor of claim 4 wherein the alteration of priority codes is accomplished at least in part in a manner determined by changes in on-chip processing statistics.
6. The processor of claim 4 wherein determination of priority codes is accomplished at least in part off-chip, and communicated to the priority controller.
7. The processor of claim 4 wherein a particular priority code effectively disables a stream, preventing access for that stream to functional resources.
8. The processor of claim 7 wherein the priority controller alters the priority record to enable and disable a stream in response to on-chip events, processing statistics, or external input.
9. The processor of claim 7 wherein the priority controller alters the priority record to enable and disable a stream in response to a processor interrupt.
10. The processor of claim 5 wherein the priority controller alters priority codes according to instant states of stream instruction loading.
11. The processor of claim 4 further comprising a tie-breaker function, the tie-breaker resolving access to functional resources for two or more streams having equal priority in the priority record.
12. A multi-streaming processor comprising:
a plurality of streams for streaming a plurality of instruction threads;
a set of functional resources for processing instructions from stream resources;
an instruction scheduler for managing access for streams to the functional resources;
a priority record of priority codes associated with streams; and a priority controller dynamically determining priorities and altering the priority record during processing.
a plurality of streams for streaming a plurality of instruction threads;
a set of functional resources for processing instructions from stream resources;
an instruction scheduler for managing access for streams to the functional resources;
a priority record of priority codes associated with streams; and a priority controller dynamically determining priorities and altering the priority record during processing.
13. The processor of claim 12 wherein the alteration of the priority record is accomplished at least in part in a manner determined by on-chip processing statistics.
14. The processor of claim 12 wherein alteration of the priority record is accomplished at least in part off-chip, and communicated to the priority controller.
15. The processor of claim 12 wherein a particular priority code effectively disables a stream, preventing access for that stream to functional resources.
16. The processor of claim 15 wherein the priority controller alters the priority record to enable and disable a stream in response to on-chip events, processing statistics, or external input.
17. The processor of claim 15 wherein the priority controller alters the priority record to enable and disable a stream according to a processor interrupt.
18. The processor of claim 13 wherein the priority controller alters priority codes according to instant states of stream instruction loading.
19. The processor of claim 12 further comprising a tie-breaker function, the tie-breaker resolving access to functional resources for two or more streams having equal priority in the priority record.
20. A method for processing instructions from streams by priority in a multi-streaming processor, comprising steps of:
(a) associating priority codes with one or more of the streams and storing the codes in a priority record;
(b) checking priority codes in the priority record by an instruction scheduler during processing; and (c) managing access for streams to functional resources preferentially based on the priority codes.
(a) associating priority codes with one or more of the streams and storing the codes in a priority record;
(b) checking priority codes in the priority record by an instruction scheduler during processing; and (c) managing access for streams to functional resources preferentially based on the priority codes.
21. The method of claim 20 wherein, in step (a), the priority codes in the priority record are static and not varying.
22. The method of claim 20 wherein, in step (a), the priority codes in the priority record are varied in a consistently repeating manner.
23. The method of claim 20 further comprising a step for altering the priority codes in the priority record dynamically during processing by a priority controller coupled to the priority record.
24. The method of claim 20 wherein the alteration of priority codes is accomplished at least in part in a manner determined by changes in on-chip processing statistics:
25. The method of claim 23 wherein determination of priority codes is accomplished at least in part off-chip, and communicated to the priority controller.
26. The method of claim 20 wherein a particular priority code effectively disables a stream, preventing access for that stream to functional resources.
27. The method of claim 26 wherein the priority controller alters the priority record to enable and disable a stream in response to on-chip events, processing statistics, or external input.
28. The method of claim 26 wherein the priority controller alters the priority record to enable and disable a stream in response to a processor interrupt.
29. The method of claim 23 wherein the priority controller alters priority codes according to instant states of stream instruction loading.
30. The method of claim 20 further comprising a tie-breaker function, the tie-breaker resolving access to functional resources for two or more streams having equal priority in the priority record.
31. A method for processing instructions from streams by priority in a mufti-streaming processor, comprising steps of:
(a) associating priority codes with one or more of the streams and storing the codes in a priority record;
(b) checking priority codes in the priority record by an instruction scheduler during processing;
(c) ) managing access for streams to functional resources preferentially based on the priority codes; and (d) dynamically altering priority codes in the priority record by a priority controller during processing.
(a) associating priority codes with one or more of the streams and storing the codes in a priority record;
(b) checking priority codes in the priority record by an instruction scheduler during processing;
(c) ) managing access for streams to functional resources preferentially based on the priority codes; and (d) dynamically altering priority codes in the priority record by a priority controller during processing.
32. The method of claim 31 wherein, in step (d), the alteration of priority codes is accomplished at least in part in a manner determined by changes in on-chip processing statistics.
33. The method of claim 31 wherein, in step (d), determination of priority codes is accomplished at least in part off-chip, and communicated to the priority controller.
34. The method of claim 31 wherein a particular priority code effectively disables a stream, preventing access for that stream to functional resources.
35. The method of claim 34 wherein the priority controller alters the priority record to enable and disable a stream in response to on-chip events, processing statistics, or external input.
36. The method of claim 34 wherein the priority controller alters the priority record to enable and disable a stream in response to a processor interrupt.
37. The method of claim 31 wherein the priority controller alters priority codes according to instant states of stream instruction loading.
38. The method of claim 31 further comprising a tie-breaker function, the tie-breaker resolving access to functional resources for two or more streams having equal priority in the priority record.
39. A computer comprising:
a memory for storing application programs and data; and a multi-streaming processor coupled to the memory and having a plurality of streams for processing a plurality of instruction threads, a set of functional resources for processing instructions from the streams, an instruction scheduler for managing access for the streams to the functional resources, and a priority record of priority codes associated with streams;
wherein at any point in time the instruction scheduler manages access for a stream to the functional resources according to the priority record.
a memory for storing application programs and data; and a multi-streaming processor coupled to the memory and having a plurality of streams for processing a plurality of instruction threads, a set of functional resources for processing instructions from the streams, an instruction scheduler for managing access for the streams to the functional resources, and a priority record of priority codes associated with streams;
wherein at any point in time the instruction scheduler manages access for a stream to the functional resources according to the priority record.
40. The computer of claim 39 wherein the priority record comprises one or more priority codes associated with at least one of the streams, and the priority record is static and not varying.
41. The computer of claim 39 wherein the priority record is varied in a consistently repeating manner.
42. The computer of claim 39 wherein the priority record comprises one or more priority codes associated with one or more of the streams, and further comprising a priority controller coupled to the priority record, wherein the priority controller alters the one or more priority codes dynamically during processing.
43. The computer of claim 42 wherein the alteration of priority codes is accomplished at least in part in a manner determined by changes in on-chip processing statistics.
44. The computer of claim 42 wherein determination of priority codes is accomplished at least in part off-chip, and communicated to the priority controller.
45. The computer of claim 42 wherein a particular priority code effectively disables a stream, preventing access for that stream to functional resources.
46. The method of claim 45 wherein the priority controller alters the priority record to enable and disable a stream in response to on-chip events, processing statistics, or external input.
47. The computer of claim 45 wherein the priority controller alters the priority record to enable and disable a stream in response to a processor interrupt.
48. The computer of claim 42 wherein the priority controller alters priority codes according to instant states of stream instruction loading.
49. The computer of claim 38 further comprising a tie-breaker function, the tie-breaker resolving access to functional resources for two or more streams having equal priority in the priority record.
50. A computer comprising:
a memory for storing application programs and data; and a multi-streaming processor coupled to the memory and having a plurality of streams for streaming a plurality of instruction threads, a set of functional resources for processing instructions from stream resources, an instruction scheduler for managing access for the streams to the functional resources, and a priority record of priority codes associated with the streams;
wherein a priority controller dynamically determines priority codes during processing and alters the priority record accordingly.
a memory for storing application programs and data; and a multi-streaming processor coupled to the memory and having a plurality of streams for streaming a plurality of instruction threads, a set of functional resources for processing instructions from stream resources, an instruction scheduler for managing access for the streams to the functional resources, and a priority record of priority codes associated with the streams;
wherein a priority controller dynamically determines priority codes during processing and alters the priority record accordingly.
51. The computer of claim 50 wherein the alteration of the priority record is accomplished at least in part in a manner determined by on-chip processing statistics.
52. The computer of claim 50 wherein alteration of the priority record is accomplished at least in part-off chip, and communicated to the priority controller.
53. The computer of claim 50 wherein a particular priority code effectively disables a stream, preventing access for that stream to functional resources.
54. The computer of claim 53 wherein the priority controller alters the priority record to enable and disable a stream in response to on-chip events, processing statistics, or external input.
55. The computer of claim 53 wherein the priority controller alters the priority record to enable and disable a stream in response to a processor interrupt.
56. The computer of claim 50 wherein the priority controller alters priority codes according to instant states of stream instruction loading.
57. The computer of claim 50 further comprising a tie-breaker function, the tie-breaker resolving access to functional resources for two or more streams having equal priority in the priority record.
58. A packet-data router for a packet data network, comprising:
at least one port for connecting to the packet-data network;
a memory for storing application code; and a multi-streaming processor coupled to the memory and having a plurality of streams for streaming a plurality of instruction threads, a set of functional resources for processing instructions from stream resources, an instruction scheduler for managing access for the streams to the functional resources, and a priority record of priority codes associated with the streams;
wherein a priority controller dynamically determines priority codes during processing and alters the priority record accordingly.
at least one port for connecting to the packet-data network;
a memory for storing application code; and a multi-streaming processor coupled to the memory and having a plurality of streams for streaming a plurality of instruction threads, a set of functional resources for processing instructions from stream resources, an instruction scheduler for managing access for the streams to the functional resources, and a priority record of priority codes associated with the streams;
wherein a priority controller dynamically determines priority codes during processing and alters the priority record accordingly.
59. A digital signal processor, comprising:
a plurality of streams for streaming a plurality of signals as separate threads;
a set of functional resources for processing signals;
a scheduler for managing access for the signals to the functional resources;
and a priority record of priority codes associated with the streams;
wherein a priority controller dynamically determines priority codes during processing and alters the priority record accordingly.
a plurality of streams for streaming a plurality of signals as separate threads;
a set of functional resources for processing signals;
a scheduler for managing access for the signals to the functional resources;
and a priority record of priority codes associated with the streams;
wherein a priority controller dynamically determines priority codes during processing and alters the priority record accordingly.
Applications Claiming Priority (3)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| US09/216,017 US6477562B2 (en) | 1998-12-16 | 1998-12-16 | Prioritized instruction scheduling for multi-streaming processors |
| US09/216,017 | 1998-12-16 | ||
| PCT/US1999/029645 WO2000036487A2 (en) | 1998-12-16 | 1999-12-13 | Prioritized instruction scheduling for multi-streaming processors |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CA2355250A1 true CA2355250A1 (en) | 2000-06-22 |
Family
ID=22805346
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CA002355250A Abandoned CA2355250A1 (en) | 1998-12-16 | 1999-12-13 | Prioritized instruction scheduling for multi-streaming processors |
Country Status (6)
| Country | Link |
|---|---|
| US (1) | US6477562B2 (en) |
| EP (1) | EP1141821A4 (en) |
| JP (1) | JP3877527B2 (en) |
| AU (1) | AU2181600A (en) |
| CA (1) | CA2355250A1 (en) |
| WO (1) | WO2000036487A2 (en) |
Families Citing this family (164)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US6659939B2 (en) | 1998-11-20 | 2003-12-09 | Intuitive Surgical, Inc. | Cooperative minimally invasive telesurgical system |
| US6852107B2 (en) * | 2002-01-16 | 2005-02-08 | Computer Motion, Inc. | Minimally invasive surgical training using robotics and tele-collaboration |
| US6951535B2 (en) * | 2002-01-16 | 2005-10-04 | Intuitive Surgical, Inc. | Tele-medicine system that transmits an entire state of a subsystem |
| US6398726B1 (en) | 1998-11-20 | 2002-06-04 | Intuitive Surgical, Inc. | Stabilizer for robotic beating-heart surgery |
| US8527094B2 (en) | 1998-11-20 | 2013-09-03 | Intuitive Surgical Operations, Inc. | Multi-user medical robotic system for collaboration or training in minimally invasive surgical procedures |
| US7529907B2 (en) | 1998-12-16 | 2009-05-05 | Mips Technologies, Inc. | Method and apparatus for improved computer load and store operations |
| US7035997B1 (en) | 1998-12-16 | 2006-04-25 | Mips Technologies, Inc. | Methods and apparatus for improving fetching and dispatch of instructions in multithreaded processors |
| US7257814B1 (en) * | 1998-12-16 | 2007-08-14 | Mips Technologies, Inc. | Method and apparatus for implementing atomicity of memory operations in dynamic multi-streaming processors |
| US7020879B1 (en) | 1998-12-16 | 2006-03-28 | Mips Technologies, Inc. | Interrupt and exception handling for multi-streaming digital processors |
| US6389449B1 (en) * | 1998-12-16 | 2002-05-14 | Clearwater Networks, Inc. | Interstream control and communications for multi-streaming digital processors |
| JP2001022600A (en) * | 1999-07-06 | 2001-01-26 | Matsushita Electric Ind Co Ltd | Digital signal processor |
| US6754223B1 (en) * | 1999-08-17 | 2004-06-22 | Conexant Systems, Inc. | Integrated circuit that processes communication packets with co-processor circuitry to determine a prioritized processing order for a core processor |
| US6983350B1 (en) | 1999-08-31 | 2006-01-03 | Intel Corporation | SDRAM controller for parallel processor architecture |
| US6912586B1 (en) * | 1999-11-12 | 2005-06-28 | International Business Machines Corporation | Apparatus for journaling during software deployment and method therefor |
| US7518993B1 (en) * | 1999-11-19 | 2009-04-14 | The United States Of America As Represented By The Secretary Of The Navy | Prioritizing resource utilization in multi-thread computing system |
| JP2003517797A (en) * | 1999-12-14 | 2003-05-27 | サイエンティフィック−アトランタ， インコーポレイテッド | System and method for adaptively decoding a video signal with coordinated resource allocation |
| US6532509B1 (en) | 1999-12-22 | 2003-03-11 | Intel Corporation | Arbitrating command requests in a parallel multi-threaded processing system |
| US6694380B1 (en) | 1999-12-27 | 2004-02-17 | Intel Corporation | Mapping requests from a processing unit that uses memory-mapped input-output space |
| US7051329B1 (en) * | 1999-12-28 | 2006-05-23 | Intel Corporation | Method and apparatus for managing resources in a multithreaded processor |
| US6661794B1 (en) | 1999-12-29 | 2003-12-09 | Intel Corporation | Method and apparatus for gigabit packet assignment for multithreaded packet processing |
| US6952824B1 (en) * | 1999-12-30 | 2005-10-04 | Intel Corporation | Multi-threaded sequenced receive for fast network port stream of packets |
| US7480706B1 (en) * | 1999-12-30 | 2009-01-20 | Intel Corporation | Multi-threaded round-robin receive for fast network port |
| US7165257B2 (en) * | 2000-02-08 | 2007-01-16 | Mips Technologies, Inc. | Context selection and activation mechanism for activating one of a group of inactive contexts in a processor core for servicing interrupts |
| US7649901B2 (en) * | 2000-02-08 | 2010-01-19 | Mips Technologies, Inc. | Method and apparatus for optimizing selection of available contexts for packet processing in multi-stream packet processing |
| US7082552B2 (en) * | 2000-02-08 | 2006-07-25 | Mips Tech Inc | Functional validation of a packet management unit |
| US7058064B2 (en) * | 2000-02-08 | 2006-06-06 | Mips Technologies, Inc. | Queueing system for processors in packet routing operations |
| US7155516B2 (en) * | 2000-02-08 | 2006-12-26 | Mips Technologies, Inc. | Method and apparatus for overflowing data packets to a software-controlled memory when they do not fit into a hardware-controlled memory |
| US7032226B1 (en) | 2000-06-30 | 2006-04-18 | Mips Technologies, Inc. | Methods and apparatus for managing a buffer of events in the background |
| US7856633B1 (en) | 2000-03-24 | 2010-12-21 | Intel Corporation | LRU cache replacement for a partitioned set associative cache |
| US7149883B1 (en) * | 2000-03-30 | 2006-12-12 | Intel Corporation | Method and apparatus selectively to advance a write pointer for a queue based on the indicated validity or invalidity of an instruction stored within the queue |
| US7162540B2 (en) * | 2000-05-15 | 2007-01-09 | Catchfire Systems, Inc. | Method and system for prioritizing network services |
| US7162615B1 (en) | 2000-06-12 | 2007-01-09 | Mips Technologies, Inc. | Data transfer bus communication using single request to perform command and return data to destination indicated in context to allow thread context switch |
| US6408277B1 (en) * | 2000-06-21 | 2002-06-18 | Banter Limited | System and method for automatic task prioritization |
| US9699129B1 (en) | 2000-06-21 | 2017-07-04 | International Business Machines Corporation | System and method for increasing email productivity |
| US8290768B1 (en) | 2000-06-21 | 2012-10-16 | International Business Machines Corporation | System and method for determining a set of attributes based on content of communications |
| EP1311947B1 (en) * | 2000-07-14 | 2011-01-19 | MIPS Technologies, Inc. | Instruction fetch and dispatch in multithreaded system |
| EP2269500B1 (en) | 2000-11-28 | 2017-06-21 | Intuitive Surgical Operations, Inc. | Endoscopic beating-heart stabilizer and vessel occlusion fastener |
| JP2002164790A (en) * | 2000-11-28 | 2002-06-07 | Canon Inc | Device and method for decoding compressed stream and storage medium |
| US8015600B2 (en) | 2000-12-22 | 2011-09-06 | Oracle International Corporation | Employing electronic certificate workflows |
| US7213249B2 (en) * | 2000-12-22 | 2007-05-01 | Oracle International Corporation | Blocking cache flush requests until completing current pending requests in a local server and remote server |
| US6675261B2 (en) * | 2000-12-22 | 2004-01-06 | Oblix, Inc. | Request based caching of data store data |
| US7415607B2 (en) * | 2000-12-22 | 2008-08-19 | Oracle International Corporation | Obtaining and maintaining real time certificate status |
| US7711818B2 (en) * | 2000-12-22 | 2010-05-04 | Oracle International Corporation | Support for multiple data stores |
| US7085834B2 (en) * | 2000-12-22 | 2006-08-01 | Oracle International Corporation | Determining a user's groups |
| US7937655B2 (en) * | 2000-12-22 | 2011-05-03 | Oracle International Corporation | Workflows with associated processes |
| US7475151B2 (en) * | 2000-12-22 | 2009-01-06 | Oracle International Corporation | Policies for modifying group membership |
| US7581011B2 (en) * | 2000-12-22 | 2009-08-25 | Oracle International Corporation | Template based workflow definition |
| US7363339B2 (en) * | 2000-12-22 | 2008-04-22 | Oracle International Corporation | Determining group membership |
| US7802174B2 (en) | 2000-12-22 | 2010-09-21 | Oracle International Corporation | Domain based workflows |
| US7145913B2 (en) * | 2001-02-15 | 2006-12-05 | The Board Of Trustees Of The University Of Illinois | Thread based scalable routing for an active router |
| US7165094B2 (en) * | 2001-03-09 | 2007-01-16 | Sonics, Inc. | Communications system and method with non-blocking shared interface |
| US6996838B2 (en) * | 2001-06-12 | 2006-02-07 | Scientific Atlanta, Inc. | System and method for media processing with adaptive resource access priority assignment |
| US7487339B2 (en) * | 2001-10-12 | 2009-02-03 | Mips Technologies, Inc. | Method and apparatus for binding shadow registers to vectored interrupts |
| US7552261B2 (en) * | 2001-10-12 | 2009-06-23 | Mips Technologies, Inc. | Configurable prioritization of core generated interrupts |
| US6976154B1 (en) * | 2001-11-07 | 2005-12-13 | Juniper Networks, Inc. | Pipelined processor for examining packet header information |
| US7159216B2 (en) * | 2001-11-07 | 2007-01-02 | International Business Machines Corporation | Method and apparatus for dispatching tasks in a non-uniform memory access (NUMA) computer system |
| US7225256B2 (en) | 2001-11-30 | 2007-05-29 | Oracle International Corporation | Impersonation in an access system |
| US7274857B2 (en) | 2001-12-31 | 2007-09-25 | Scientific-Atlanta, Inc. | Trick modes for compressed video streams |
| US7069424B2 (en) * | 2002-01-02 | 2006-06-27 | Intel Corporation | Placing front instruction in replay loop to front to place side instruction into execution stream upon determination of criticality |
| US7032101B2 (en) * | 2002-02-26 | 2006-04-18 | International Business Machines Corporation | Method and apparatus for prioritized instruction issue queue in a processor |
| US7216163B2 (en) * | 2002-05-15 | 2007-05-08 | Oracle International Corporation | Method and apparatus for provisioning tasks using a provisioning bridge server |
| US7840658B2 (en) * | 2002-05-15 | 2010-11-23 | Oracle International Corporation | Employing job code attributes in provisioning |
| US6920632B2 (en) * | 2002-08-23 | 2005-07-19 | Xyron Corporation | Dynamic multilevel task management method and apparatus |
| FR2845224B1 (en) * | 2002-09-26 | 2004-12-17 | Cit Alcatel | SCHEDULING DEVICE FOR AN ASYMMETRICALLY SHARED RESOURCE SYSTEM |
| US20040073941A1 (en) * | 2002-09-30 | 2004-04-15 | Ludvig Edward A. | Systems and methods for dynamic conversion of web content to an interactive walled garden program |
| US20060149927A1 (en) * | 2002-11-26 | 2006-07-06 | Eran Dagan | Processor capable of multi-threaded execution of a plurality of instruction-sets |
| US20040139441A1 (en) * | 2003-01-09 | 2004-07-15 | Kabushiki Kaisha Toshiba | Processor, arithmetic operation processing method, and priority determination method |
| US7278141B2 (en) * | 2003-04-23 | 2007-10-02 | International Business Machines Corporation | System and method for adding priority change value corresponding with a lock to a thread during lock processing |
| US7360062B2 (en) * | 2003-04-25 | 2008-04-15 | International Business Machines Corporation | Method and apparatus for selecting an instruction thread for processing in a multi-thread processor |
| US7401207B2 (en) * | 2003-04-25 | 2008-07-15 | International Business Machines Corporation | Apparatus and method for adjusting instruction thread priority in a multi-thread processor |
| US7401208B2 (en) * | 2003-04-25 | 2008-07-15 | International Business Machines Corporation | Method and apparatus for randomizing instruction thread interleaving in a multi-thread processor |
| US20050187913A1 (en) | 2003-05-06 | 2005-08-25 | Yoram Nelken | Web-based customer service interface |
| US7966642B2 (en) * | 2003-09-15 | 2011-06-21 | Nair Ajith N | Resource-adaptive management of video storage |
| FI20031414A (en) * | 2003-09-30 | 2005-03-31 | Nokia Corp | Transmission of data in a mobile telephony in a wireless packet switching computer system |
| US7904487B2 (en) | 2003-10-09 | 2011-03-08 | Oracle International Corporation | Translating data access requests |
| US7882132B2 (en) | 2003-10-09 | 2011-02-01 | Oracle International Corporation | Support for RDBMS in LDAP system |
| US7441101B1 (en) * | 2003-12-10 | 2008-10-21 | Cisco Technology, Inc. | Thread-aware instruction fetching in a multithreaded embedded processor |
| US7360064B1 (en) * | 2003-12-10 | 2008-04-15 | Cisco Technology, Inc. | Thread interleaving in a multithreaded embedded processor |
| US7206922B1 (en) | 2003-12-30 | 2007-04-17 | Cisco Systems, Inc. | Instruction memory hierarchy for an embedded processor |
| US20050210472A1 (en) * | 2004-03-18 | 2005-09-22 | International Business Machines Corporation | Method and data processing system for per-chip thread queuing in a multi-processor system |
| US7877484B2 (en) * | 2004-04-23 | 2011-01-25 | International Business Machines Corporation | System and method for bulk processing of semi-structured result streams from multiple resources |
| US8600217B2 (en) * | 2004-07-14 | 2013-12-03 | Arturo A. Rodriguez | System and method for improving quality of displayed picture during trick modes |
| US20070143768A1 (en) * | 2004-07-28 | 2007-06-21 | Satoshi Inami | Conflict resolution apparatus |
| US7418576B1 (en) | 2004-11-17 | 2008-08-26 | Nvidia Corporation | Prioritized issuing of operation dedicated execution unit tagged instructions from multiple different type threads performing different set of operations |
| US7634773B2 (en) * | 2004-11-24 | 2009-12-15 | Hewlett-Packard Development Company, L.P. | Method and apparatus for thread scheduling on multiple processors |
| US7752627B2 (en) * | 2005-02-04 | 2010-07-06 | Mips Technologies, Inc. | Leaky-bucket thread scheduler in a multithreading microprocessor |
| US7664936B2 (en) | 2005-02-04 | 2010-02-16 | Mips Technologies, Inc. | Prioritizing thread selection partly based on stall likelihood providing status information of instruction operand register usage at pipeline stages |
| US7681014B2 (en) | 2005-02-04 | 2010-03-16 | Mips Technologies, Inc. | Multithreading instruction scheduler employing thread group priorities |
| US7657891B2 (en) * | 2005-02-04 | 2010-02-02 | Mips Technologies, Inc. | Multithreading microprocessor with optimized thread scheduler for increasing pipeline utilization efficiency |
| US7613904B2 (en) * | 2005-02-04 | 2009-11-03 | Mips Technologies, Inc. | Interfacing external thread prioritizing policy enforcing logic with customer modifiable register to processor internal scheduler |
| US7506140B2 (en) | 2005-02-04 | 2009-03-17 | Mips Technologies, Inc. | Return data selector employing barrel-incrementer-based round-robin apparatus |
| US7657883B2 (en) * | 2005-02-04 | 2010-02-02 | Mips Technologies, Inc. | Instruction dispatch scheduler employing round-robin apparatus supporting multiple thread priorities for use in multithreading microprocessor |
| US7631130B2 (en) * | 2005-02-04 | 2009-12-08 | Mips Technologies, Inc | Barrel-incrementer-based round-robin apparatus and instruction dispatch scheduler employing same for use in multithreading microprocessor |
| US7490230B2 (en) | 2005-02-04 | 2009-02-10 | Mips Technologies, Inc. | Fetch director employing barrel-incrementer-based round-robin apparatus for use in multithreading microprocessor |
| US7853777B2 (en) | 2005-02-04 | 2010-12-14 | Mips Technologies, Inc. | Instruction/skid buffers in a multithreading microprocessor that store dispatched instructions to avoid re-fetching flushed instructions |
| US8245230B2 (en) | 2005-03-14 | 2012-08-14 | Qnx Software Systems Limited | Adaptive partitioning scheduler for multiprocessing system |
| US8387052B2 (en) * | 2005-03-14 | 2013-02-26 | Qnx Software Systems Limited | Adaptive partitioning for operating system |
| US9361156B2 (en) | 2005-03-14 | 2016-06-07 | 2236008 Ontario Inc. | Adaptive partitioning for operating system |
| CA2538503C (en) * | 2005-03-14 | 2014-05-13 | Attilla Danko | Process scheduler employing adaptive partitioning of process threads |
| US7627770B2 (en) * | 2005-04-14 | 2009-12-01 | Mips Technologies, Inc. | Apparatus and method for automatic low power mode invocation in a multi-threaded processor |
| US8726292B2 (en) * | 2005-08-25 | 2014-05-13 | Broadcom Corporation | System and method for communication in a multithread processor |
| GB0519597D0 (en) * | 2005-09-26 | 2005-11-02 | Imagination Tech Ltd | Scalable multi-threaded media processing architecture |
| US20070101332A1 (en) * | 2005-10-28 | 2007-05-03 | International Business Machines Corporation | Method and apparatus for resource-based thread allocation in a multiprocessor computer system |
| US20070150585A1 (en) * | 2005-12-28 | 2007-06-28 | Microsoft Corporation | Multi-dimensional aggregation on event streams |
| CN103646009B (en) | 2006-04-12 | 2016-08-17 | 索夫特机械公司 | The apparatus and method that the instruction matrix of specifying parallel and dependent operations is processed |
| US20070277177A1 (en) * | 2006-05-29 | 2007-11-29 | Takuji Kawamoto | Information processing device, information processing method, and computer-readable information recording medium recorded with information processing program |
| US7773621B2 (en) | 2006-09-16 | 2010-08-10 | Mips Technologies, Inc. | Transaction selector employing round-robin apparatus supporting dynamic priorities in multi-port switch |
| US7961745B2 (en) | 2006-09-16 | 2011-06-14 | Mips Technologies, Inc. | Bifurcated transaction selector supporting dynamic priorities in multi-port switch |
| US7760748B2 (en) * | 2006-09-16 | 2010-07-20 | Mips Technologies, Inc. | Transaction selector employing barrel-incrementer-based round-robin apparatus supporting dynamic priorities in multi-port switch |
| US7990989B2 (en) | 2006-09-16 | 2011-08-02 | Mips Technologies, Inc. | Transaction selector employing transaction queue group priorities in multi-port switch |
| US7859548B1 (en) | 2006-10-19 | 2010-12-28 | Nvidia Corporation | Offloading cube map calculations to a shader |
| EP2122461A4 (en) | 2006-11-14 | 2010-03-24 | Soft Machines Inc | Apparatus and method for processing instructions in a multi-threaded architecture using context switching |
| US8799902B2 (en) * | 2007-04-09 | 2014-08-05 | Intel Corporation | Priority based throttling for power/performance quality of service |
| US8832702B2 (en) * | 2007-05-10 | 2014-09-09 | Freescale Semiconductor, Inc. | Thread de-emphasis instruction for multithreaded processor |
| GB2449106B (en) | 2007-05-10 | 2011-07-27 | Advanced Risc Mach Ltd | Issue policy control within a multi-threaded in-order superscalar processor |
| US7676461B2 (en) * | 2007-07-18 | 2010-03-09 | Microsoft Corporation | Implementation of stream algebra over class instances |
| US20090037918A1 (en) * | 2007-07-31 | 2009-02-05 | Advanced Micro Devices, Inc. | Thread sequencing for multi-threaded processor with instruction cache |
| US7877573B1 (en) | 2007-08-08 | 2011-01-25 | Nvidia Corporation | Work-efficient parallel prefix sum algorithm for graphics processing units |
| US7725518B1 (en) * | 2007-08-08 | 2010-05-25 | Nvidia Corporation | Work-efficient parallel prefix sum algorithm for graphics processing units |
| US20090044159A1 (en) * | 2007-08-08 | 2009-02-12 | Mplicity Ltd. | False path handling |
| JP5043560B2 (en) * | 2007-08-24 | 2012-10-10 | パナソニック株式会社 | Program execution control device |
| US8301605B2 (en) * | 2007-12-17 | 2012-10-30 | International Business Machines Corporation | Managing maintenance tasks for computer programs |
| US8300696B2 (en) * | 2008-07-25 | 2012-10-30 | Cisco Technology, Inc. | Transcoding for systems operating under plural video coding specifications |
| US20100088325A1 (en) | 2008-10-07 | 2010-04-08 | Microsoft Corporation | Streaming Queries |
| US8640133B2 (en) | 2008-12-19 | 2014-01-28 | International Business Machines Corporation | Equal duration and equal fetch operations sub-context switch interval based fetch operation scheduling utilizing fetch error rate based logic for switching between plurality of sorting algorithms |
| CN102428441B (en) * | 2009-05-18 | 2015-04-08 | 松下电器产业株式会社 | Processor |
| JP5463076B2 (en) * | 2009-05-28 | 2014-04-09 | パナソニック株式会社 | Multithreaded processor |
| JP5452125B2 (en) | 2009-08-11 | 2014-03-26 | クラリオン株式会社 | Data processing apparatus and data processing method |
| US9158816B2 (en) | 2009-10-21 | 2015-10-13 | Microsoft Technology Licensing, Llc | Event processing with XML query based on reusable XML query template |
| US8589936B2 (en) * | 2010-03-16 | 2013-11-19 | Alcatel Lucent | Method and apparatus for managing reallocation of system resources |
| US9402207B2 (en) * | 2010-05-07 | 2016-07-26 | Zte Corporation | Priority based service selection methods and apparatus |
| JP5548037B2 (en) | 2010-06-11 | 2014-07-16 | パナソニック株式会社 | Command issuing control device and method |
| EP3156896B1 (en) | 2010-09-17 | 2020-04-08 | Soft Machines, Inc. | Single cycle multi-branch prediction including shadow cache for early far branch prediction |
| US20120137289A1 (en) * | 2010-11-30 | 2012-05-31 | International Business Machines Corporation | Protecting high priority workloads in a virtualized datacenter |
| KR101620676B1 (en) | 2011-03-25 | 2016-05-23 | 소프트 머신즈, 인크. | Register file segments for supporting code block execution by using virtual cores instantiated by partitionable engines |
| KR101638225B1 (en) | 2011-03-25 | 2016-07-08 | 소프트 머신즈, 인크. | Executing instruction sequence code blocks by using virtual cores instantiated by partitionable engines |
| KR101826121B1 (en) | 2011-03-25 | 2018-02-06 | 인텔 코포레이션 | Memory fragments for supporting code block execution by using virtual cores instantiated by partitionable engines |
| CN103649931B (en) | 2011-05-20 | 2016-10-12 | 索夫特机械公司 | For supporting to be performed the interconnection structure of job sequence by multiple engines |
| WO2012162188A2 (en) | 2011-05-20 | 2012-11-29 | Soft Machines, Inc. | Decentralized allocation of resources and interconnect structures to support the execution of instruction sequences by a plurality of engines |
| KR101832679B1 (en) | 2011-11-22 | 2018-02-26 | 소프트 머신즈, 인크. | A microprocessor accelerated code optimizer |
| CN104040490B (en) | 2011-11-22 | 2017-12-15 | 英特尔公司 | Code optimizer for the acceleration of multi engine microprocessor |
| US20130179371A1 (en) * | 2012-01-05 | 2013-07-11 | Microsoft Corporation | Scheduling computing jobs based on value |
| EP2761436A1 (en) * | 2012-01-31 | 2014-08-06 | Siemens Aktiengesellschaft | Method for operating a processor |
| US9632977B2 (en) * | 2013-03-13 | 2017-04-25 | Nxp Usa, Inc. | System and method for ordering packet transfers in a data processor |
| WO2014150991A1 (en) | 2013-03-15 | 2014-09-25 | Soft Machines, Inc. | A method for implementing a reduced size register view data structure in a microprocessor |
| US9886279B2 (en) | 2013-03-15 | 2018-02-06 | Intel Corporation | Method for populating and instruction view data structure by using register template snapshots |
| US10275255B2 (en) | 2013-03-15 | 2019-04-30 | Intel Corporation | Method for dependency broadcasting through a source organized source view data structure |
| US9904625B2 (en) | 2013-03-15 | 2018-02-27 | Intel Corporation | Methods, systems and apparatus for predicting the way of a set associative cache |
| US9569216B2 (en) | 2013-03-15 | 2017-02-14 | Soft Machines, Inc. | Method for populating a source view data structure by using register template snapshots |
| US9891924B2 (en) | 2013-03-15 | 2018-02-13 | Intel Corporation | Method for implementing a reduced size register view data structure in a microprocessor |
| US10140138B2 (en) | 2013-03-15 | 2018-11-27 | Intel Corporation | Methods, systems and apparatus for supporting wide and efficient front-end operation with guest-architecture emulation |
| US9811342B2 (en) | 2013-03-15 | 2017-11-07 | Intel Corporation | Method for performing dual dispatch of blocks and half blocks |
| KR102083390B1 (en) | 2013-03-15 | 2020-03-02 | 인텔 코포레이션 | A method for emulating a guest centralized flag architecture by using a native distributed flag architecture |
| US9632825B2 (en) * | 2013-03-15 | 2017-04-25 | Intel Corporation | Method and apparatus for efficient scheduling for asymmetrical execution units |
| EP2972845B1 (en) * | 2013-03-15 | 2021-07-07 | Intel Corporation | A method for executing multithreaded instructions grouped onto blocks |
| WO2014150806A1 (en) | 2013-03-15 | 2014-09-25 | Soft Machines, Inc. | A method for populating register view data structure by using register template snapshots |
| US9998750B2 (en) | 2013-03-15 | 2018-06-12 | Cisco Technology, Inc. | Systems and methods for guided conversion of video from a first to a second compression format |
| WO2014150971A1 (en) | 2013-03-15 | 2014-09-25 | Soft Machines, Inc. | A method for dependency broadcasting through a block organized source view data structure |
| US10318294B2 (en) | 2016-06-20 | 2019-06-11 | International Business Machines Corporation | Operation of a multi-slice processor implementing dependency accumulation instruction sequencing |
| US11068274B2 (en) * | 2017-12-15 | 2021-07-20 | International Business Machines Corporation | Prioritized instructions in an instruction completion table of a simultaneous multithreading processor |
| US11367160B2 (en) * | 2018-08-02 | 2022-06-21 | Nvidia Corporation | Simultaneous compute and graphics scheduling |
| US11036515B1 (en) | 2019-06-20 | 2021-06-15 | Marvell Asia Pte, Ltd. | System and method for instruction unwinding in an out-of-order processor |
| US10996957B1 (en) * | 2019-06-20 | 2021-05-04 | Marvell Asia Pte, Ltd. | System and method for instruction mapping in an out-of-order processor |
| EP4198724A1 (en) * | 2021-12-20 | 2023-06-21 | Airbus SAS | Processing device and method for distributing data to a plurality of processing units |
Family Cites Families (14)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2845646B2 (en) | 1990-09-05 | 1999-01-13 | 株式会社東芝 | Parallel processing unit |
| WO1994027216A1 (en) * | 1993-05-14 | 1994-11-24 | Massachusetts Institute Of Technology | Multiprocessor coupling system with integrated compile and run time scheduling for parallelism |
| FR2705804B1 (en) | 1993-05-27 | 1995-08-11 | Sgs Thomson Microelectronics | Multi-tasking processor architecture. |
| US5745778A (en) * | 1994-01-26 | 1998-04-28 | Data General Corporation | Apparatus and method for improved CPU affinity in a multiprocessor system |
| US5542088A (en) * | 1994-04-29 | 1996-07-30 | Intergraph Corporation | Method and apparatus for enabling control of task execution |
| US5748468A (en) * | 1995-05-04 | 1998-05-05 | Microsoft Corporation | Prioritized co-processor resource manager and method |
| US5815733A (en) * | 1996-02-01 | 1998-09-29 | Apple Computer, Inc. | System for handling interrupts in a computer system using asic reset input line coupled to set of status circuits for presetting values in the status circuits |
| US5867725A (en) * | 1996-03-21 | 1999-02-02 | International Business Machines Corporation | Concurrent multitasking in a uniprocessor |
| US5826081A (en) * | 1996-05-06 | 1998-10-20 | Sun Microsystems, Inc. | Real time thread dispatcher for multiprocessor applications |
| CN100373331C (en) * | 1996-08-27 | 2008-03-05 | 松下电器产业株式会社 | Multithreaded processor for processing multiple instruction streams independently of each other by flexibly controlling throughput in each instruction stream |
| US5835705A (en) * | 1997-03-11 | 1998-11-10 | International Business Machines Corporation | Method and system for performance per-thread monitoring in a multithreaded processor |
| US6212544B1 (en) * | 1997-10-23 | 2001-04-03 | International Business Machines Corporation | Altering thread priorities in a multithreaded processor |
| US5987492A (en) * | 1997-10-31 | 1999-11-16 | Sun Microsystems, Inc. | Method and apparatus for processor sharing |
| US6018759A (en) * | 1997-12-22 | 2000-01-25 | International Business Machines Corporation | Thread switch tuning tool for optimal performance in a computer processor |
-
1998
- 1998-12-16 US US09/216,017 patent/US6477562B2/en not_active Expired - Lifetime
-
1999
- 1999-12-13 JP JP2000588668A patent/JP3877527B2/en not_active Expired - Fee Related
- 1999-12-13 AU AU21816/00A patent/AU2181600A/en not_active Abandoned
- 1999-12-13 EP EP99966217A patent/EP1141821A4/en not_active Withdrawn
- 1999-12-13 CA CA002355250A patent/CA2355250A1/en not_active Abandoned
- 1999-12-13 WO PCT/US1999/029645 patent/WO2000036487A2/en not_active Application Discontinuation
Also Published As
| Publication number | Publication date |
|---|---|
| JP3877527B2 (en) | 2007-02-07 |
| WO2000036487A2 (en) | 2000-06-22 |
| AU2181600A (en) | 2000-07-03 |
| EP1141821A4 (en) | 2005-06-01 |
| US20020062435A1 (en) | 2002-05-23 |
| US6477562B2 (en) | 2002-11-05 |
| JP2002532801A (en) | 2002-10-02 |
| WO2000036487A3 (en) | 2000-11-23 |
| EP1141821A2 (en) | 2001-10-10 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US6477562B2 (en) | Prioritized instruction scheduling for multi-streaming processors | |
| US7467385B2 (en) | Interrupt and exception handling for multi-streaming digital processors | |
| US6789100B2 (en) | Interstream control and communications for multi-streaming digital processors | |
| US10733032B2 (en) | Migrating operating system interference events to a second set of logical processors along with a set of timers that are synchronized using a global clock | |
| CN1310135C (en) | Multithreaded microprocessor with register allocation based on number of active threads | |
| US7904704B2 (en) | Instruction dispatching method and apparatus | |
| US5471618A (en) | System for classifying input/output events for processes servicing the events | |
| CA2704269C (en) | Uniform synchronization between multiple kernels running on single computer systems | |
| JP5284809B2 (en) | Method and apparatus for dynamically allocating resources to a plurality of virtual machines | |
| US8531955B2 (en) | Prioritizing resource utilization in multi-thread computing system | |
| US20090271549A1 (en) | Interrupt handling using simultaneous multi-threading | |
| US8769543B2 (en) | System and method for maximizing data processing throughput via application load adaptive scheduling and context switching | |
| JP5891284B2 (en) | Computer system, kernel scheduling system, resource allocation method, and process execution sharing method | |
| JP2010113524A (en) | Computer system, kernel scheduling system, resource allocation method, and process execution sharing method | |
| WO2000070482A1 (en) | Interrupt and exception handling for multi-streaming digital processors | |
| CA2316643C (en) | Fair assignment of processing resources to queued requests | |
| US20060048156A1 (en) | Unified control store | |
| GB2478194A (en) | Periodic scheduling of applications based on whether the applications are ready to use the CPU |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| EEER | Examination request | ||
| FZDE | Discontinued |