US20050144395A1 - Bandwidth-adaptive, hybrid, cache-coherence protocol - Google Patents
Bandwidth-adaptive, hybrid, cache-coherence protocol Download PDFInfo
- Publication number
- US20050144395A1 US20050144395A1 US11/063,294 US6329405A US2005144395A1 US 20050144395 A1 US20050144395 A1 US 20050144395A1 US 6329405 A US6329405 A US 6329405A US 2005144395 A1 US2005144395 A1 US 2005144395A1
- Authority
- US
- United States
- Prior art keywords
- cache
- cache coherence
- directory
- processor units
- message
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Abandoned
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F12/00—Accessing, addressing or allocating within memory systems or architectures
- G06F12/02—Addressing or allocation; Relocation
- G06F12/08—Addressing or allocation; Relocation in hierarchically structured memory systems, e.g. virtual memory systems
- G06F12/0802—Addressing of a memory level in which the access to the desired data or data block requires associative addressing means, e.g. caches
- G06F12/0806—Multiuser, multiprocessor or multiprocessing cache systems
- G06F12/0815—Cache consistency protocols
- G06F12/0817—Cache consistency protocols using directory methods
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F12/00—Accessing, addressing or allocating within memory systems or architectures
- G06F12/02—Addressing or allocation; Relocation
- G06F12/08—Addressing or allocation; Relocation in hierarchically structured memory systems, e.g. virtual memory systems
- G06F12/0802—Addressing of a memory level in which the access to the desired data or data block requires associative addressing means, e.g. caches
- G06F12/0806—Multiuser, multiprocessor or multiprocessing cache systems
- G06F12/0815—Cache consistency protocols
- G06F12/0831—Cache consistency protocols using a bus scheme, e.g. with bus monitoring or watching means
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F2212/00—Indexing scheme relating to accessing, addressing or allocation within memory systems or architectures
- G06F2212/50—Control mechanisms for virtual memory, cache or TLB
- G06F2212/502—Control mechanisms for virtual memory, cache or TLB using adaptive policy
Definitions
- the present invention relates generally to a system for coordinating cache memories in a shared-memory computer architecture, and in particular, to a system that chooses a mechanism for communicating cache coherence messages based on the bandwidth available for transmitting such messages.
- snooping Two important classes of protocols for maintaining cache coherence are “snooping” and “directories”.
- a given cache before its processor reads or writes to a block of memory, “broadcasts” a request for that block of memory to all other “nodes” in the system.
- the nodes include all other caches and the shared memory itself.
- the node “owning” that block responds directly to the requesting node, forwarding the desired block of memory.
- a refinement of snooping is “multicast snooping”, in which the requesting node attempts to predict which of the other nodes has a copy of the desired block, and rather than broadcasting its request, the requesting node performs a multicast to the predicted copy holders.
- Multicast Snooping A New Coherence Method Using a Multicast Address Network , E. Ender Bilir, Ross M. Dickson, Ying Hu, Manoj Plakal, Daniel J. Sorin, Mark D. Hill, and David A. Wood, International Symposium on Computer Architecture (ISCA), 1999, hereby incorporated by reference.
- a given cache “unicasts” its request for a block of memory to a directory which maintains information indicating those other caches using that particular memory block.
- the directory then “multicasts” requests for that block directly to a limited number of indicated caches.
- the multicast will be to a superset of the caches, over those that actually have ownership or sharing privileges, because of transactions which are not recorded in the directory, as is understood in the art.
- Snooping protocols are often used with small computers because they transmit the necessary cache messages quickly without the delaying intermediate step of using the directory. For large systems with many processors, however, snooping generates large numbers of messages which may overwhelm a communications channel. For this reason, the directory protocol, which focuses communications only to a limited number of relevant caches, may be desirable in larger, multiprocessor machines.
- the application being executed may result in a radically different demand on the cache protocol communication network for which one of the snooping or directory protocols will be preferable to the other protocol.
- the amount of memory traffic may vary significantly over time.
- the present invention provides an adaptive, hybrid protocol that is sensitive to the bandwidth available for communication of cache protocol messages. Specifically, the hybrid protocol performs like snooping if bandwidth is plentiful, and performs like a directory if bandwidth is limited.
- the adaptability of the present invention provides improved performance over a range of different sizes of multiprocessor machines, running a variety of different applications, and during different phases of the execution of those applications. Simulation suggests that not only does the hybrid protocol outperform snooping for periods of high bandwidth demand and outperform directory systems for periods of plentiful bandwidth, but also outperforms both snooping and bandwidth for intermediate bandwidth availability, a state likely to dominate in many practical system applications.
- the present invention provides a method and apparatus for coordinating cache memories in a multiprocessor computer having at least two processor units each with a processor and cache memory, and further having a shared memory, where the processor units communicate cache coherence messages over a network.
- the invention provides for two mechanisms for communicating cache coherence messages. When the first, snooping mechanism is used, the cache coherence messages are sent directly from a given processor to another processor. When the second, directory mechanism is used, the cache coherence messages are sent directly from a given processor to a directory and then to multiple processor units indicated by the directory. Available bandwidth on the network, used to communicate the cache coherence messages, is evaluated and for a given cache coherence message, different mechanisms for communication of the cache coherence message are used depending on the evaluation of available bandwidth.
- the snooping mechanism may broadcast the given cache coherence message to all other processor units.
- the given cache coherence message may be related to a portion of the shared memory and the directory may provide an index linking portions of the memory to a given set of processor units and the directory mechanism may send the cache coherence message to the given set of processor units linked to the portion of the shared memory related to the given cache coherence message.
- the directory may send the cache coherence message directly over the network to the given set of processor units.
- the invention streamlines the directory process over the process normally used in multicast snooping by eliminating the need to send a NACK signal to the originating processor requiring the originating processor to start over with the request.
- the method may include the steps of detecting insufficiency in the set of processor units to which coherence messages are sent, when using the directory, and retrying the transmission a predetermined number of times if there is an insufficiency, and afterwards, reverting to a broadcasting of the given cache coherence message to all processor units.
- the processor units in responding to a retry of the cache coherence message may add a retry number to the forwarded data to link it to a specific cache coherence message.
- the evaluation of available bandwidth may compare the available bandwidth against a predetermine threshold and select the mechanism of snooping in situations where the available bandwidth is greater than the threshold and the mechanism of directory in situations where the available bandwidth is less than the threshold. This decision may be a simple or complex function of the thresholding process.
- the threshold may be less than all the bandwidth of the network.
- the step of selecting the mechanism for communication of cache coherence messages may provide a mix of selections of snooping and directory mechanisms where the mix is a function of the evaluation of the available bandwidth and has greater than two values.
- the mix may be generated pseudorandomly according to a probability function based on the evaluation of available bandwidth.
- the mechanism of snooping may use multicast snooping where the cache coherence message is transmitted to a selected set of processor units based on a prediction as to which processor units have caches loaded with relevant data.
- the directory monitors the multicast to determine insufficiency in the set of targets of the multicast resulting from erroneous prediction to initiate a retransmission of the cache coherence message.
- the step of evaluating the available bandwidth may monitor the communication on the network at the processor unit transmitting the given cache coherence messages.
- FIG. 1 is a fragmentary block diagram of multiprocessor architecture employing a number of processor units, each processor unit having a processor, a cache, the latter including a cache controller, the processor units communicating on multiple logical networks with a memory having a directory;
- FIG. 2 is a simplified representation of the processor units and memory of FIG. 1 showing a snooping, cache coherence message transmission mechanism used in the present invention
- FIG. 3 is a figure similar to that of FIG. 2 , showing a directory cache coherence message transmission mechanism also used in the present invention
- FIG. 4 is a detailed fragmentary view of the cache controller of FIG. 1 showing the functional elements of the bandwidth monitoring of the present invention to selected between a snooping and directory protocol;
- FIG. 5 is a simplified graph plotting performance of the cache communications in the multiprocessor unit versus available bandwidth of the network for each of the snooping mechanism alone, the directory mechanism alone, and for the present invention which switches between the snooping and directory mechanisms based on network bandwidth, the graph showing the superiority of the present invention
- FIG. 6 is a flow chart showing the steps of a program executing by the directory of the memory of FIG. 1 in responding to a broadcast or dual-cast message, or in a second embodiment, to a multicast message;
- FIG. 7 is a figure similar to that of FIG. 2 showing the multicasting cache coherence message transmission mechanism of FIG. 5 ;
- FIG. 8 is a detail of a processor unit similar to that of FIG. 1 showing the addition of a predictor to the cache controller to allow multicasting of FIGS. 5 and 6 .
- a multiprocessor, shared-memory, computer system 10 includes a number of processor units 12 communicating on a network 14 with a shared memory system 16 .
- the shared memory system 16 is depicted as a single unitary structure, in practice, the physical memory of the shared memory system 16 may be distributed among different processor units 12 to be shared over a network or the like.
- the shared memory system 16 includes a shared memory 17 of conventional architecture and storing a number of memory blocks 19 , a directory 21 , and a memory controller 11 as will be described below.
- Each processor unit 12 includes a processor 18 connected over an internal bus 20 with a cache memory 22 and cache controller 26 . Only two processor units are shown in FIG. 1 , however, the present invention is applicable to architectures having an arbitrary number of processor units and is particularly well suited for multiprocessor, shared-memory, computer systems 10 accepting variable numbers of processor units 12 .
- the cache memory 22 may receive a copy of a block 19 of the shared memory 17 to speed execution of reading or writing of that block 19 by its associated processor 18 .
- the directory 21 records which cache memory 22 holds which block 19 , providing a table that links each block 19 to all cache memories 22 having a copy of that block 19 .
- the directory 21 may also indicate the status of that block 19 in each cache memory 22 as, for example “owned” indicating the processor unit 12 associated with the cache memory may perform reads or writes to the block 19 , or “shared” indicating that the processor associated with the cache memory 22 may only read the block, as is understood in the art.
- the cache controllers 26 communicate cache coherence messages with the memory controller 11 of the shared memory system 16 or other cache controllers 26 along an ordered request network 28 .
- the ordered request network 28 observes the requirement that each of the cache controllers 26 and the directory 21 receive the requests in the same order although not necessarily synchronously.
- the invention is not limited to this type of ordered network, but may also be used with networks that allow certain reordering of the requests.
- the cache coherence messages generally help to provide a consistent ordering of reads and writes of multiple processor units 12 as is understood in the art.
- the present invention is applicable to a variety of cache coordination messages but of particular importance is a request for a memory block 19 that must be made by a cache memory 22 prior to writing to the cache memory 22 .
- the cache memories 22 may receive data (also broadly part of the cache coherence messages as the term is used herein) from the shared memory system 16 or other cache memories 22 along a nonordered data network 24 providing rapid transfer of data between cache memories 22 and the shared memory 17 or other cache memories 22 .
- the cache coherence message is duplicated and broadcast over the ordered request network 28 to each of the remaining processor units 12 b through 12 f and the memory controller 11 of the shared memory system 16 as indicated by the arrows 23 of FIG. 2 .
- the cache coherence message is a request for a block 19
- that cache memory 22 owning the block 19 or the shared memory system 16 if it is the owner
- Snooping is rapid, but requires a large number of messages as is apparent from FIG. 2 .
- the processor unit 12 a when a directory mechanism is used for the transmission of cache coherence messages, the processor unit 12 a dual-casts the cache coherence message (arrow 27 ) to itself and the directory 21 which identifies those processor units, for example, processor units 12 c and 12 d (or the memory systems 16 itself) having the desired block 19 (e.g. as an owner or sharer of the block 19 ).
- the directory 21 then multicasts the cache coherence message (arrows 29 ) to those specifically identified processor units ( 12 c and 12 d ) and the originating, processor 12 a and itself only.
- the number of cache coherence messages required to be transferred over ordered request network 28 is much reduced with respect to the snooping mechanism. This disparity grows even more pronounced as additional processor units 12 are added.
- the two-step process with the communication with the directory 21 imposes a delay in the transmission of cache coherence messages.
- the cache controller 26 implements a state machine 29 that may execute either a snooping mechanism 30 or a directory mechanism 32 .
- This state machine 29 provides for a switch 34 whose state selects between these mechanisms for the transmission of a given cache coherence message over the ordered request network 28 .
- the state of the switch 34 is determined by monitoring the message traffic on the ordered request network 28 .
- the cache controller 26 receives a network usage signal 36 having a high state indicating that the ordered request network 28 is receiving or transmitting messages related to the cache memory 22 and a low state indicating that the ordered request network 28 is idle with respect to cache memory 22 .
- a weighting may be applied to the network usage signal 36 to create a threshold as will be explained below.
- a +1 weighting is assigned to the high state of the network usage signal 36 and a ⁇ 3 weighting is assigned to the low state of the network usage signal 36 .
- This weighted signal is periodically sampled and integrated by integrator 38 implemented, for example, by a saturating seven-bit signed adder.
- the adder adds 1 to its value, whereas if at the sampling time the network usage signal 36 is in the low state, the adder subtracts 3 from its value.
- the weighting described above causes the output 40 of the integrator 38 to swing about a zero value when the utilization of the network is about 75%; saturation of the adder effectively limits the range of the output 40 of the integrator 38 to between ⁇ 64 and +64.
- the output 40 of integrator 38 provides a value dependent on the duty cycle of the network usage signal 36 and thus provides an approximation of available network bandwidth, with negative output values representing less than 75% of the bandwidth being used and positive values representing more than 75% of the bandwidth being used.
- This threshold of 75% may be adjusted by changing the weighting to account for the limited sampling of the ordered request network 28 at only one processor unit 12 and may be adjusted empirically.
- bandwidth is intended to indicate generally a measure of the amount of data that can be transmitted per time on the ordered request network 28 and is intended to include the effects both of the speed of the network (e.g. how many bits per second can be transmitted on a network line), and the width of the network (e.g. how many lines are run in parallel for the network).
- the output 40 of integrator 38 is periodically sampled (every 128 cycles) by a second integrator 41 implemented by a saturating six-bit unsigned counter, each sampling resetting the integrator 38 to provide an average utilization signal 42 . If the output 40 of integrator 38 is positive, this indicates that the utilization of the ordered request network 28 is greater than 75% and the counter of the second integrator 41 counts up one, whereas if the average output 40 of integrator 38 is negative this indicates that the utilization of the ordered request network 28 is less than 75% and the counter of the integrator 41 counts down one.
- This average utilization signal 42 could be provided directly to a comparator whose output is used to directly control the state of switch 34 so that the snooping mechanism 30 is used whenever the utilization indicated by the average utilization signal 42 is below a threshold (for example, half its output range) and directory mechanism 32 is used whenever the average utilization signal 42 is above threshold.
- a threshold for example, half its output range
- the average utilization signal 42 is treated as a probability function to be compared with a pseudorandom sequence 44 produced by pseudorandom sequence generator 46 . Only if the average utilization signal 42 is greater than the pseudorandom sequence 44 is the directory mechanism 32 used and in all other cases, snooping mechanism 30 is used to create a probabilistic mix 50 of selections of the snooping mechanism 30 and directory mechanism 32 for each cache protocol message being transmitted. The balance of the mix 50 varies continuously as a function of the deviation of average utilization signal 42 from the selected threshold so that as the network utilization increases, the mix 50 favors directory transactions and as it decreases, the mix 50 favors snooping transactions.
- the performance 51 of a directory mechanism 32 is superior reflecting, intuitively, the fact that broadcast systems will tend to overuse the bandwidth of the ordered request network 28 slowing the net transfer of information.
- the performance 55 of a snooping mechanism 30 during periods 54 of high available bandwidth will exceed the directory mechanism 32 , the latter which is fundamentally limited by the indirection through the directory 21 , which increases latency.
- empirical studies have shown that the performance 53 of the present invention can provide comparable performance to both the snooping mechanism 30 and the directory mechanism 32 in these periods 52 and 54 yet superior performances to both mechanisms in periods 56 of mid-bandwidth utilization. This surprising result reflects the fact that the present system better utilizes available bandwidth creating fewer issues of interference.
- each of the processor units 12 responds to a cache coherence message from another processor unit 12 or from the memory controller 11 of the shared memory system 16 requesting a block 19 , by evaluating whether they have that block 19 in their cache memory 22 . If they have that block in the capacity of an owner, and the request is for sharing, they downgrade their ownership to a sharing status. If on the other hand, the request is for ownership, they invalidate their cache memory 22 and transmit ownership and the data of that block 19 to the requesting processor unit 12 . If on the other hand, the request is for ownership and the cache 22 has a shared copy, it downgrades its shared copy to invalid.
- the procedure executed by the memory controller 11 of the shared memory system 16 is somewhat more involved. If a cache coherence message requesting a block 19 is received as part of a broadcast request, as determined by decision block 60 implemented in circuitry within the memory controller 11 , then the memory controller 11 proceeds to decision block 62 to determine whether the requested data is owned by the shared memory 17 . If so, as indicated by process block 64 , the memory controller 11 replies with the block 19 and updates its directory 21 indicating the new copy holders as identified to one or more cache memories 22 . Invalidation of the other caches is performed by the broadcast message only if necessary due to an ownership change.
- the directory 21 is updated to indicate new copyholders as needed but no data is sent.
- the memory controller 11 proceeds to process block 68 to determine whether the message is part of a dual-cast request to the directory 21 . If so, memory controller 11 proceeds to decision block 70 to determine if the requested block 19 is owned by the shared memory 17 . If so, then at process block 72 , the shared memory 17 replies with the data and the memory controller 11 updates its directory 21 .
- the memory controller 11 proceeds to process block 74 and a retry number (stored within the messages) is initialized to zero. The memory controller 11 then proceeds to check to see if a message can be injected on the ordered request network 28 as indicated by decision block 75 .
- a network buffer is not available (as a necessary condition to getting on the ordered request network 28 )
- the memory controller 11 proceeds to process block 82 to send a NACK (no acknowledgement) signal to the cache controller 26 originating processor unit 12 for it to start over.
- the memory controller 11 proceeds from decision block 75 to process block 76 and the retry number is incremented, and at process block 78 a multicast message is sent only those processor units 12 indicated by its directory 21 to have relevant data in their cache memories 22 and to the processor unit 12 originating the request, and to itself. The value of the retry number is appended to the multicast messages.
- the multicast message will be received by the memory controller 11 and reviewed at decision block 79 by comparing the scope of the multicast with the directory 21 . If no intervening request has changed the directory 21 so that the multicast addressees are still sufficient, then the multicast is sufficient and the memory controller 11 branches to decision block 62 as described above. If the set of targets of the multicast is insufficient, however, the memory controller 11 moves to decision block 80 to check if the value of the retry number is at its maximum (set in the preferred embodiment to three).
- the memory controller 11 branches to decision block 75 as has been described to undertake yet another retry multicast.
- Processor units 12 responding to a multicast append the retry number to their responses to allow the origination processor unit to match responses with retry requests on the ordered request network 28 .
- the memory controller 11 checks at decision block 81 (similar to decision block 75 ) whether there is a buffer available on the ordered request network 28 so as to forestall a deadlock situation. If a buffer is available, the memory controller 11 moves to process block 83 and sends a broadcast request to all other processor units 12 . If there is no buffer available, a NACK is sent to the origination processor unit 12 to let it initiate the process again.
- the invention may alternate between a directory mechanism 32 and a snooping mechanism 30 where the latter undertakes less than a full broadcast to all of the processor units 12 and memory controller 11 but instead multicasts (as indicated by arrows 100 ) only to itself, processor units 12 likely to have the desired block 19 and memory controller 11 .
- This multicast also includes the retry number.
- the cache controller 26 is augmented by a predictor 98 , which endeavors to predict those processors units 12 a through 12 f likely to have copies of the block 19 being sought.
- the predictor 98 may make its predictions in a number of ways including, for example, storing information about recent mispredictions to the same block 19 , recent mispredictions to any block 19 , behavior of spatially adjacent blocks 19 , recent mispredictions of the same static load or store instructions (indexed to the program counter), input form the software (the programmer, compiler, library or runtime system or some combination of these).
- the memory controller 11 may detect a multicast as one of the possibilities after decision block 68 and monitor the multicast by the originating processor unit 12 as indicated by process block 79 . This monitoring checks the success of the multicast, as with the multicast from the memory controller 11 .
- the memory controller 11 will do nothing except update its directory 21 per the path of decision block 62 , but if the multicast is insufficient, meaning that it was sent to fewer than the necessary processor units 12 , the memory controller 11 may initiate its own multicasting message per the path of decision block 80 . No NACK need be sent to the initiating processor unit 12 which may deduce an error occurred by receipt of the multicasting message from the memory controller 11 .
Abstract
A cache coordination mechanism for a multiprocessor, shared-memory computer switches between a snooping mechanism where an individual processor unit broadcasts or multicasts cache coherence messages to each other node on the system and a directory system where the individual processor unit transmits the cache control message to a directory which then identifies potential candidates to receive that message. The switching is according to the activity on the communication network used by the cache coherence messages. When network activity is high, a directory protocol is used to conserve bandwidth but when network activity is low, a snooping system is used to provide faster response.
Description
- This application is a divisional of U.S. patent application Ser. No. 10/037,727, filed Oct. 19, 2001, which claims the benefit of Provisional Application No. 60/275,743, filed Mar. 14, 2001.
- This invention was made with United States government support awarded by the following agencies:
-
- NSF 9971256
- The United States has certain rights in this invention.
- The present invention relates generally to a system for coordinating cache memories in a shared-memory computer architecture, and in particular, to a system that chooses a mechanism for communicating cache coherence messages based on the bandwidth available for transmitting such messages.
- Large computer software applications, such as simulators and database servers, require cost-effective computation beyond that which can be provided by a single microprocessor. Shared-memory, multiprocessor computers have emerged as a popular solution for running such applications.
- Most shared memory multiprocessor computers provide each constituent processor with a cache memory into which blocks of the shared memory may be loaded. The cache memory allows faster memory access. A coherence protocol ensures that the contents of the cache memories accurately reflect the contents of the shared memory. Generally, such protocols invalidate all other cache memories when one cache is written to, and updating of the main memory before a changed cache is flushed.
- Two important classes of protocols for maintaining cache coherence are “snooping” and “directories”. In the snooping protocols, a given cache, before its processor reads or writes to a block of memory, “broadcasts” a request for that block of memory to all other “nodes” in the system. The nodes include all other caches and the shared memory itself. The node “owning” that block responds directly to the requesting node, forwarding the desired block of memory. A refinement of snooping, is “multicast snooping”, in which the requesting node attempts to predict which of the other nodes has a copy of the desired block, and rather than broadcasting its request, the requesting node performs a multicast to the predicted copy holders. This technique is described in Multicast Snooping: A New Coherence Method Using a Multicast Address Network, E. Ender Bilir, Ross M. Dickson, Ying Hu, Manoj Plakal, Daniel J. Sorin, Mark D. Hill, and David A. Wood, International Symposium on Computer Architecture (ISCA), 1999, hereby incorporated by reference.
- In the directory protocols, a given cache “unicasts” its request for a block of memory to a directory which maintains information indicating those other caches using that particular memory block. The directory then “multicasts” requests for that block directly to a limited number of indicated caches. Generally, the multicast will be to a superset of the caches, over those that actually have ownership or sharing privileges, because of transactions which are not recorded in the directory, as is understood in the art.
- Snooping protocols are often used with small computers because they transmit the necessary cache messages quickly without the delaying intermediate step of using the directory. For large systems with many processors, however, snooping generates large numbers of messages which may overwhelm a communications channel. For this reason, the directory protocol, which focuses communications only to a limited number of relevant caches, may be desirable in larger, multiprocessor machines.
- While the above principals guide the system designer in selecting between snooping and directory protocols, the decision can be complicated. First, many multiprocessor units are designed to accommodate a range of different processor numbers. Selecting one of a directory protocol or a snooping protocol will result in less than optimal performance when the same system is configured with different numbers of processors or in certain upgrade operations where more processors are added to the system.
- Second, even for a fixed number of processors, the application being executed may result in a radically different demand on the cache protocol communication network for which one of the snooping or directory protocols will be preferable to the other protocol. For any given system, the amount of memory traffic may vary significantly over time.
- What is needed is a cache coherence protocol that works better with these varying real-world conditions.
- The present invention provides an adaptive, hybrid protocol that is sensitive to the bandwidth available for communication of cache protocol messages. Specifically, the hybrid protocol performs like snooping if bandwidth is plentiful, and performs like a directory if bandwidth is limited.
- The adaptability of the present invention provides improved performance over a range of different sizes of multiprocessor machines, running a variety of different applications, and during different phases of the execution of those applications. Simulation suggests that not only does the hybrid protocol outperform snooping for periods of high bandwidth demand and outperform directory systems for periods of plentiful bandwidth, but also outperforms both snooping and bandwidth for intermediate bandwidth availability, a state likely to dominate in many practical system applications.
- Specifically then, the present invention provides a method and apparatus for coordinating cache memories in a multiprocessor computer having at least two processor units each with a processor and cache memory, and further having a shared memory, where the processor units communicate cache coherence messages over a network. The invention provides for two mechanisms for communicating cache coherence messages. When the first, snooping mechanism is used, the cache coherence messages are sent directly from a given processor to another processor. When the second, directory mechanism is used, the cache coherence messages are sent directly from a given processor to a directory and then to multiple processor units indicated by the directory. Available bandwidth on the network, used to communicate the cache coherence messages, is evaluated and for a given cache coherence message, different mechanisms for communication of the cache coherence message are used depending on the evaluation of available bandwidth.
- Thus, it is a first object of the invention to provide multiple communication mechanisms for cache coherence messages, where the particular mechanism may be selected dynamically as a function of the available bandwidth.
- The snooping mechanism may broadcast the given cache coherence message to all other processor units.
- Thus, it is an object of the invention to provide a direct communication mechanism when bandwidth is plentiful.
- The given cache coherence message may be related to a portion of the shared memory and the directory may provide an index linking portions of the memory to a given set of processor units and the directory mechanism may send the cache coherence message to the given set of processor units linked to the portion of the shared memory related to the given cache coherence message.
- Thus, it is another object of the invention to provide for a focused transmission of cache coherence messages to less than all the processors when bandwidth is limited.
- When used in a hybrid system with multicast snooping, the directory may send the cache coherence message directly over the network to the given set of processor units.
- In this way, the invention streamlines the directory process over the process normally used in multicast snooping by eliminating the need to send a NACK signal to the originating processor requiring the originating processor to start over with the request.
- The method may include the steps of detecting insufficiency in the set of processor units to which coherence messages are sent, when using the directory, and retrying the transmission a predetermined number of times if there is an insufficiency, and afterwards, reverting to a broadcasting of the given cache coherence message to all processor units.
- Thus, it is another object of the invention to address possible problems of live lock wherein one processor unit using the directory technique is unable to compete with other processor units using a direct broadcast technique.
- The processor units in responding to a retry of the cache coherence message may add a retry number to the forwarded data to link it to a specific cache coherence message.
- Thus, it is another object of the invention to eliminate ambiguity at the receiving node when the directory undertakes retries.
- The evaluation of available bandwidth may compare the available bandwidth against a predetermine threshold and select the mechanism of snooping in situations where the available bandwidth is greater than the threshold and the mechanism of directory in situations where the available bandwidth is less than the threshold. This decision may be a simple or complex function of the thresholding process. The threshold may be less than all the bandwidth of the network.
- Thus, it is another object of the invention to provide a flexible method of dynamically selecting between cache coherence message transmission mechanisms based on a simple threshold that may be empirically derived.
- The step of selecting the mechanism for communication of cache coherence messages may provide a mix of selections of snooping and directory mechanisms where the mix is a function of the evaluation of the available bandwidth and has greater than two values. In one embodiment, the mix may be generated pseudorandomly according to a probability function based on the evaluation of available bandwidth.
- Thus, it is another object of the invention to provide an effectively continuous variation in the mechanism selection process to provide improved control dynamics.
- In this hybrid directory/snooping system, the mechanism of snooping may use multicast snooping where the cache coherence message is transmitted to a selected set of processor units based on a prediction as to which processor units have caches loaded with relevant data.
- Thus, it is another object of the invention to provide the benefits of this hybrid system together with an alternative to broadcasting to all processors during snooping.
- The directory monitors the multicast to determine insufficiency in the set of targets of the multicast resulting from erroneous prediction to initiate a retransmission of the cache coherence message.
- It is another object of the invention to provide a lower latency correction mechanism for speculatively multicasting.
- The step of evaluating the available bandwidth may monitor the communication on the network at the processor unit transmitting the given cache coherence messages.
- Thus it yet another object of the invention to provide for a simple approximation of network bandwidth that may be performed locally at each processor unit.
- The foregoing objects and advantages may not apply to all embodiments of the invention and are not intended to define the scope of the invention, for which purpose claims are provided. In the following description, reference is made to the accompanying drawings, which form a part hereof, and in which there is shown by way of illustration, a preferred embodiment of the invention. Such embodiment also does not define the scope of the invention and reference must be made therefore to the claims for this purpose.
-
FIG. 1 is a fragmentary block diagram of multiprocessor architecture employing a number of processor units, each processor unit having a processor, a cache, the latter including a cache controller, the processor units communicating on multiple logical networks with a memory having a directory; -
FIG. 2 is a simplified representation of the processor units and memory ofFIG. 1 showing a snooping, cache coherence message transmission mechanism used in the present invention; -
FIG. 3 is a figure similar to that ofFIG. 2 , showing a directory cache coherence message transmission mechanism also used in the present invention; -
FIG. 4 is a detailed fragmentary view of the cache controller ofFIG. 1 showing the functional elements of the bandwidth monitoring of the present invention to selected between a snooping and directory protocol; -
FIG. 5 is a simplified graph plotting performance of the cache communications in the multiprocessor unit versus available bandwidth of the network for each of the snooping mechanism alone, the directory mechanism alone, and for the present invention which switches between the snooping and directory mechanisms based on network bandwidth, the graph showing the superiority of the present invention; -
FIG. 6 is a flow chart showing the steps of a program executing by the directory of the memory ofFIG. 1 in responding to a broadcast or dual-cast message, or in a second embodiment, to a multicast message; -
FIG. 7 is a figure similar to that ofFIG. 2 showing the multicasting cache coherence message transmission mechanism ofFIG. 5 ; and -
FIG. 8 is a detail of a processor unit similar to that ofFIG. 1 showing the addition of a predictor to the cache controller to allow multicasting ofFIGS. 5 and 6 . - Referring now to
FIG. 1 , a multiprocessor, shared-memory,computer system 10 includes a number ofprocessor units 12 communicating on anetwork 14 with a sharedmemory system 16. Although the sharedmemory system 16 is depicted as a single unitary structure, in practice, the physical memory of the sharedmemory system 16 may be distributed amongdifferent processor units 12 to be shared over a network or the like. The sharedmemory system 16 includes a sharedmemory 17 of conventional architecture and storing a number of memory blocks 19, adirectory 21, and amemory controller 11 as will be described below. - Each
processor unit 12 includes aprocessor 18 connected over aninternal bus 20 with acache memory 22 andcache controller 26. Only two processor units are shown inFIG. 1 , however, the present invention is applicable to architectures having an arbitrary number of processor units and is particularly well suited for multiprocessor, shared-memory,computer systems 10 accepting variable numbers ofprocessor units 12. - During operation of the
computer system 10, thecache memory 22 may receive a copy of ablock 19 of the sharedmemory 17 to speed execution of reading or writing of thatblock 19 by its associatedprocessor 18. Thedirectory 21 records whichcache memory 22 holds whichblock 19, providing a table that links eachblock 19 to allcache memories 22 having a copy of thatblock 19. Thedirectory 21 may also indicate the status of thatblock 19 in eachcache memory 22 as, for example “owned” indicating theprocessor unit 12 associated with the cache memory may perform reads or writes to theblock 19, or “shared” indicating that the processor associated with thecache memory 22 may only read the block, as is understood in the art. - The
cache controllers 26 communicate cache coherence messages with thememory controller 11 of the sharedmemory system 16 orother cache controllers 26 along an orderedrequest network 28. The orderedrequest network 28 observes the requirement that each of thecache controllers 26 and thedirectory 21 receive the requests in the same order although not necessarily synchronously. The invention, however, is not limited to this type of ordered network, but may also be used with networks that allow certain reordering of the requests. - The cache coherence messages generally help to provide a consistent ordering of reads and writes of
multiple processor units 12 as is understood in the art. The present invention is applicable to a variety of cache coordination messages but of particular importance is a request for amemory block 19 that must be made by acache memory 22 prior to writing to thecache memory 22. - The
cache memories 22 may receive data (also broadly part of the cache coherence messages as the term is used herein) from the sharedmemory system 16 orother cache memories 22 along anonordered data network 24 providing rapid transfer of data betweencache memories 22 and the sharedmemory 17 orother cache memories 22. - Referring now to
FIG. 2 , when a snooping mechanism is used for the transmission of cache coherence messages, for example, from aprocessor unit 12 a, the cache coherence message is duplicated and broadcast over the orderedrequest network 28 to each of the remainingprocessor units 12 b through 12 f and thememory controller 11 of the sharedmemory system 16 as indicated by thearrows 23 ofFIG. 2 . When the cache coherence message is a request for ablock 19, thatcache memory 22 owning the block 19 (or the sharedmemory system 16 if it is the owner) responds by relinquishing theblock 19 to thecache memory 22 of the requestingprocessor unit 12 a. Snooping is rapid, but requires a large number of messages as is apparent fromFIG. 2 . - Alternatively, referring to
FIG. 3 , when a directory mechanism is used for the transmission of cache coherence messages, theprocessor unit 12 a dual-casts the cache coherence message (arrow 27) to itself and thedirectory 21 which identifies those processor units, for example,processor units memory systems 16 itself) having the desired block 19 (e.g. as an owner or sharer of the block 19). Thedirectory 21 then multicasts the cache coherence message (arrows 29) to those specifically identified processor units (12 c and 12 d) and the originating,processor 12 a and itself only. As is apparent from this example, the number of cache coherence messages required to be transferred over orderedrequest network 28 is much reduced with respect to the snooping mechanism. This disparity grows even more pronounced asadditional processor units 12 are added. However, it will also be evident, that the two-step process with the communication with thedirectory 21 imposes a delay in the transmission of cache coherence messages. - Referring now to
FIG. 4 in the present invention, thecache controller 26 implements astate machine 29 that may execute either asnooping mechanism 30 or adirectory mechanism 32. Thisstate machine 29 provides for aswitch 34 whose state selects between these mechanisms for the transmission of a given cache coherence message over the orderedrequest network 28. - Generally, the state of the
switch 34 is determined by monitoring the message traffic on the orderedrequest network 28. Specifically, thecache controller 26 receives anetwork usage signal 36 having a high state indicating that the orderedrequest network 28 is receiving or transmitting messages related to thecache memory 22 and a low state indicating that the orderedrequest network 28 is idle with respect tocache memory 22. A weighting may be applied to thenetwork usage signal 36 to create a threshold as will be explained below. In the preferred embodiment, a +1 weighting is assigned to the high state of thenetwork usage signal 36 and a −3 weighting is assigned to the low state of thenetwork usage signal 36. This weighted signal is periodically sampled and integrated byintegrator 38 implemented, for example, by a saturating seven-bit signed adder. If at the sampling time, thenetwork usage signal 36 is in the high state, the adder adds 1 to its value, whereas if at the sampling time thenetwork usage signal 36 is in the low state, the adder subtracts 3 from its value. The weighting described above causes theoutput 40 of theintegrator 38 to swing about a zero value when the utilization of the network is about 75%; saturation of the adder effectively limits the range of theoutput 40 of theintegrator 38 to between −64 and +64. - It will thus be understood that the
output 40 ofintegrator 38 provides a value dependent on the duty cycle of thenetwork usage signal 36 and thus provides an approximation of available network bandwidth, with negative output values representing less than 75% of the bandwidth being used and positive values representing more than 75% of the bandwidth being used. This threshold of 75% may be adjusted by changing the weighting to account for the limited sampling of the orderedrequest network 28 at only oneprocessor unit 12 and may be adjusted empirically. - The term bandwidth as used herein is intended to indicate generally a measure of the amount of data that can be transmitted per time on the ordered
request network 28 and is intended to include the effects both of the speed of the network (e.g. how many bits per second can be transmitted on a network line), and the width of the network (e.g. how many lines are run in parallel for the network). - The
output 40 ofintegrator 38 is periodically sampled (every 128 cycles) by asecond integrator 41 implemented by a saturating six-bit unsigned counter, each sampling resetting theintegrator 38 to provide anaverage utilization signal 42. If theoutput 40 ofintegrator 38 is positive, this indicates that the utilization of the orderedrequest network 28 is greater than 75% and the counter of thesecond integrator 41 counts up one, whereas if theaverage output 40 ofintegrator 38 is negative this indicates that the utilization of the orderedrequest network 28 is less than 75% and the counter of theintegrator 41 counts down one. - This
average utilization signal 42 could be provided directly to a comparator whose output is used to directly control the state ofswitch 34 so that thesnooping mechanism 30 is used whenever the utilization indicated by theaverage utilization signal 42 is below a threshold (for example, half its output range) anddirectory mechanism 32 is used whenever theaverage utilization signal 42 is above threshold. - This approach, however, would provide a relatively coarse control system, so accordingly, in preferred embodiment of the present invention, the
average utilization signal 42 is treated as a probability function to be compared with apseudorandom sequence 44 produced bypseudorandom sequence generator 46. Only if theaverage utilization signal 42 is greater than thepseudorandom sequence 44 is thedirectory mechanism 32 used and in all other cases, snoopingmechanism 30 is used to create aprobabilistic mix 50 of selections of thesnooping mechanism 30 anddirectory mechanism 32 for each cache protocol message being transmitted. The balance of themix 50 varies continuously as a function of the deviation ofaverage utilization signal 42 from the selected threshold so that as the network utilization increases, themix 50 favors directory transactions and as it decreases, themix 50 favors snooping transactions. - Referring now to
FIG. 5 , for aperiod 52 of low available bandwidth, generally, theperformance 51 of adirectory mechanism 32 is superior reflecting, intuitively, the fact that broadcast systems will tend to overuse the bandwidth of the orderedrequest network 28 slowing the net transfer of information. In contrast, theperformance 55 of asnooping mechanism 30 duringperiods 54 of high available bandwidth will exceed thedirectory mechanism 32, the latter which is fundamentally limited by the indirection through thedirectory 21, which increases latency. Interestingly, empirical studies have shown that theperformance 53 of the present invention can provide comparable performance to both thesnooping mechanism 30 and thedirectory mechanism 32 in theseperiods periods 56 of mid-bandwidth utilization. This surprising result reflects the fact that the present system better utilizes available bandwidth creating fewer issues of interference. - Referring again to
FIG. 1 , generally each of theprocessor units 12 responds to a cache coherence message from anotherprocessor unit 12 or from thememory controller 11 of the sharedmemory system 16 requesting ablock 19, by evaluating whether they have thatblock 19 in theircache memory 22. If they have that block in the capacity of an owner, and the request is for sharing, they downgrade their ownership to a sharing status. If on the other hand, the request is for ownership, they invalidate theircache memory 22 and transmit ownership and the data of thatblock 19 to the requestingprocessor unit 12. If on the other hand, the request is for ownership and thecache 22 has a shared copy, it downgrades its shared copy to invalid. - Referring now to
FIG. 6 , the procedure executed by thememory controller 11 of the sharedmemory system 16 is somewhat more involved. If a cache coherence message requesting ablock 19 is received as part of a broadcast request, as determined bydecision block 60 implemented in circuitry within thememory controller 11, then thememory controller 11 proceeds todecision block 62 to determine whether the requested data is owned by the sharedmemory 17. If so, as indicated byprocess block 64, thememory controller 11 replies with theblock 19 and updates itsdirectory 21 indicating the new copy holders as identified to one ormore cache memories 22. Invalidation of the other caches is performed by the broadcast message only if necessary due to an ownership change. - If the
block 19 is not owned by thememory controller 11 as determined bydecision block 62, then atprocess block 66, thedirectory 21 is updated to indicate new copyholders as needed but no data is sent. - If at
decision block 60, the cache coherence message is not a broadcast request, thememory controller 11 proceeds to process block 68 to determine whether the message is part of a dual-cast request to thedirectory 21. If so,memory controller 11 proceeds todecision block 70 to determine if the requestedblock 19 is owned by the sharedmemory 17. If so, then atprocess block 72, the sharedmemory 17 replies with the data and thememory controller 11 updates itsdirectory 21. - If the
block 19 of a dual-cast request is not owned by thememory controller 11, as indicated atdecision block 70, and as determined through review of thedirectory 21, thememory controller 11 proceeds to processblock 74 and a retry number (stored within the messages) is initialized to zero. Thememory controller 11 then proceeds to check to see if a message can be injected on the orderedrequest network 28 as indicated bydecision block 75. - If a network buffer is not available (as a necessary condition to getting on the ordered request network 28), then at
decision block 75, a deadlock situation is possible and thememory controller 11 proceeds to process block 82 to send a NACK (no acknowledgement) signal to thecache controller 26 originatingprocessor unit 12 for it to start over. - When a network buffer is available, the
memory controller 11 proceeds fromdecision block 75 to processblock 76 and the retry number is incremented, and at process block 78 a multicast message is sent only thoseprocessor units 12 indicated by itsdirectory 21 to have relevant data in theircache memories 22 and to theprocessor unit 12 originating the request, and to itself. The value of the retry number is appended to the multicast messages. - The multicast message will be received by the
memory controller 11 and reviewed atdecision block 79 by comparing the scope of the multicast with thedirectory 21. If no intervening request has changed thedirectory 21 so that the multicast addressees are still sufficient, then the multicast is sufficient and thememory controller 11 branches todecision block 62 as described above. If the set of targets of the multicast is insufficient, however, thememory controller 11 moves todecision block 80 to check if the value of the retry number is at its maximum (set in the preferred embodiment to three). - If the retries have not been exhausted, the
memory controller 11 branches todecision block 75 as has been described to undertake yet another retry multicast.Processor units 12 responding to a multicast, append the retry number to their responses to allow the origination processor unit to match responses with retry requests on the orderedrequest network 28. - If the number of multicast retries have been exhausted then the
memory controller 11 checks at decision block 81 (similar to decision block 75) whether there is a buffer available on the orderedrequest network 28 so as to forestall a deadlock situation. If a buffer is available, thememory controller 11 moves to processblock 83 and sends a broadcast request to allother processor units 12. If there is no buffer available, a NACK is sent to theorigination processor unit 12 to let it initiate the process again. - Referring now to
FIG. 7 , in an alternative embodiment, the invention may alternate between adirectory mechanism 32 and asnooping mechanism 30 where the latter undertakes less than a full broadcast to all of theprocessor units 12 andmemory controller 11 but instead multicasts (as indicated by arrows 100) only to itself,processor units 12 likely to have the desiredblock 19 andmemory controller 11. This multicast also includes the retry number. - Referring also to
FIG. 8 , in this embodiment, thecache controller 26 is augmented by apredictor 98, which endeavors to predict thoseprocessors units 12 a through 12 f likely to have copies of theblock 19 being sought. Thepredictor 98 may make its predictions in a number of ways including, for example, storing information about recent mispredictions to thesame block 19, recent mispredictions to anyblock 19, behavior of spatiallyadjacent blocks 19, recent mispredictions of the same static load or store instructions (indexed to the program counter), input form the software (the programmer, compiler, library or runtime system or some combination of these). - Referring again to
FIG. 6 , when multicasting snooping is allowed, thememory controller 11 may detect a multicast as one of the possibilities afterdecision block 68 and monitor the multicast by the originatingprocessor unit 12 as indicated byprocess block 79. This monitoring checks the success of the multicast, as with the multicast from thememory controller 11. - If the multicast by the originating
processor unit 12 is successful, thememory controller 11 will do nothing except update itsdirectory 21 per the path ofdecision block 62, but if the multicast is insufficient, meaning that it was sent to fewer than thenecessary processor units 12, thememory controller 11 may initiate its own multicasting message per the path ofdecision block 80. No NACK need be sent to the initiatingprocessor unit 12 which may deduce an error occurred by receipt of the multicasting message from thememory controller 11. - It is specifically intended that the present invention not be limited to the embodiments and illustrations contained herein, but that modified forms of those embodiments including portions of the embodiments and combinations of elements of different embodiments also be included as come within the scope of the following claims.
Claims (14)
1. A method of coordinating at least two processor units, each having a processor and cache memory, and communicating cache coherence messages with each other and a directory over a network, the method comprising the steps of:
(a) multicasting from a given processor unit, a cache coherence message to a selected set of other processor units, based on a prediction as to which other processor units have cache memories loaded with relevant data;
(b) using the directory to detect insufficiency in the selected set of other processor units to which transmission of the cache coherence message is made; and
(c) upon a detected insufficiency, causing the directory to retry the multicast transmission of the cache coherence message.
2. The method recited in claim 1 including the step of
(d) upon repeated insufficiency in step (c), broadcasting the given cache coherence message to all processor units.
3. The method recited in claim 1 wherein the repeated insufficiency is a predetermined number less than ten.
4. The method recited in claim 1 wherein the directory sends the retry multicast transmissions to processor units likely to have the relevant data based on a monitoring of cache coherence messages from processor units.
5. The method of claim 1 wherein the directory appends a retry number to retires of the cache coherence message.
6. The method of claim 5 wherein the processor units responding to the retries appends the retry number to the responses to the retried cache coherence message.
7. The method recited in claim 1 wherein at step (c) the multicast transmission of the cache coherence message is also sent to the given processor unit originating the cache coherence message.
8. Cache-coherence circuitry for a computer architecture having: (a) a shared memory, (b) at least two processor units, each having a processor and cache memory, and (c) a network for communicating cache coherence messages among the processor units and the shared memory, the cache-coherence circuitry comprising:
(a) predictive multicasting circuitry, multicasting from a given processor unit, a cache coherence message to a selected set of other processor units, based on a prediction as to which other processor units have cache memories loaded with relevant data; and
(b) a directory detecting insufficiency in the selected set of other processor units to which transmission of the cache coherence message is made, the directory operating upon a detected insufficiency, to retry the multicast transmission of the cache coherence message.
9. The cache coherence circuitry recited in claim 8 wherein the directory further, upon repeated insufficiency in the selected set of other processor units, broadcasts the given cache coherence message to all processor units.
10. The cache coherence circuitry recited in claim 8 wherein the repeated insufficiency is a predetermined number less than ten.
11. The cache coherence circuitry recited in claim 8 wherein the directory sends the retry multicast transmissions to processor units likely to have the relevant data based on a monitoring of cache coherence messages from processor units.
12. The method of claim 8 wherein the directory appends a retry number to retires of the cache coherence message.
13. The method of claim 12 including circuitry within the processor units responding to the retries appends the retry number to the responses to the retried cache coherence message.
14. The cache coherence circuitry recited in claim 8 wherein the predictive multicasting circuitry sends the cache coherence message also to the given processor unit originating the cache coherence message.
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US11/063,294 US20050144395A1 (en) | 2001-03-14 | 2005-02-22 | Bandwidth-adaptive, hybrid, cache-coherence protocol |
Applications Claiming Priority (3)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US27574301P | 2001-03-14 | 2001-03-14 | |
US10/037,727 US6883070B2 (en) | 2001-03-14 | 2001-10-19 | Bandwidth-adaptive, hybrid, cache-coherence protocol |
US11/063,294 US20050144395A1 (en) | 2001-03-14 | 2005-02-22 | Bandwidth-adaptive, hybrid, cache-coherence protocol |
Related Parent Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US10/037,727 Division US6883070B2 (en) | 2001-03-14 | 2001-10-19 | Bandwidth-adaptive, hybrid, cache-coherence protocol |
Publications (1)
Publication Number | Publication Date |
---|---|
US20050144395A1 true US20050144395A1 (en) | 2005-06-30 |
Family
ID=26714423
Family Applications (2)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US10/037,727 Expired - Lifetime US6883070B2 (en) | 2001-03-14 | 2001-10-19 | Bandwidth-adaptive, hybrid, cache-coherence protocol |
US11/063,294 Abandoned US20050144395A1 (en) | 2001-03-14 | 2005-02-22 | Bandwidth-adaptive, hybrid, cache-coherence protocol |
Family Applications Before (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US10/037,727 Expired - Lifetime US6883070B2 (en) | 2001-03-14 | 2001-10-19 | Bandwidth-adaptive, hybrid, cache-coherence protocol |
Country Status (1)
Country | Link |
---|---|
US (2) | US6883070B2 (en) |
Cited By (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US7174430B1 (en) * | 2004-07-13 | 2007-02-06 | Sun Microsystems, Inc. | Bandwidth reduction technique using cache-to-cache transfer prediction in a snooping-based cache-coherent cluster of multiprocessing nodes |
US7315919B1 (en) | 2004-06-15 | 2008-01-01 | Sun Microsystems, Inc. | Bandwidth reduction technique in a snooping-based cache-coherent cluster of multiprocessing nodes |
US20130007376A1 (en) * | 2011-07-01 | 2013-01-03 | Sailesh Kottapalli | Opportunistic snoop broadcast (osb) in directory enabled home snoopy systems |
CN104252423A (en) * | 2013-06-26 | 2014-12-31 | 华为技术有限公司 | Consistency processing method and device based on multi-core processor |
US20150248350A1 (en) * | 2014-03-03 | 2015-09-03 | Tmaxsoft. Co., Ltd. | Apparatus and method for managing cache in cache distributed environment |
Families Citing this family (33)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US6883070B2 (en) * | 2001-03-14 | 2005-04-19 | Wisconsin Alumni Research Foundation | Bandwidth-adaptive, hybrid, cache-coherence protocol |
US7222220B2 (en) * | 2001-05-01 | 2007-05-22 | Sun Microsystems, Inc. | Multiprocessing system employing address switches to control mixed broadcast snooping and directory based coherency protocols transparent to active devices |
EP1255201B1 (en) * | 2001-05-01 | 2009-12-23 | Sun Microsystems, Inc. | Shared memory multiprocessing system employing mixed broadcast snooping and directory based coherency protocols |
US8185602B2 (en) | 2002-11-05 | 2012-05-22 | Newisys, Inc. | Transaction processing using multiple protocol engines in systems having multiple multi-processor clusters |
US7225298B2 (en) * | 2003-04-11 | 2007-05-29 | Sun Microsystems, Inc. | Multi-node computer system in which networks in different nodes implement different conveyance modes |
US7962696B2 (en) * | 2004-01-15 | 2011-06-14 | Hewlett-Packard Development Company, L.P. | System and method for updating owner predictors |
US7818391B2 (en) | 2004-01-20 | 2010-10-19 | Hewlett-Packard Development Company, L.P. | System and method to facilitate ordering point migration |
US20050160238A1 (en) * | 2004-01-20 | 2005-07-21 | Steely Simon C.Jr. | System and method for conflict responses in a cache coherency protocol with ordering point migration |
US7620696B2 (en) * | 2004-01-20 | 2009-11-17 | Hewlett-Packard Development Company, L.P. | System and method for conflict responses in a cache coherency protocol |
US7769959B2 (en) | 2004-01-20 | 2010-08-03 | Hewlett-Packard Development Company, L.P. | System and method to facilitate ordering point migration to memory |
US8145847B2 (en) * | 2004-01-20 | 2012-03-27 | Hewlett-Packard Development Company, L.P. | Cache coherency protocol with ordering points |
US7395374B2 (en) * | 2004-01-20 | 2008-07-01 | Hewlett-Packard Company, L.P. | System and method for conflict responses in a cache coherency protocol with ordering point migration |
US8176259B2 (en) * | 2004-01-20 | 2012-05-08 | Hewlett-Packard Development Company, L.P. | System and method for resolving transactions in a cache coherency protocol |
US8468308B2 (en) * | 2004-01-20 | 2013-06-18 | Hewlett-Packard Development Company, L.P. | System and method for non-migratory requests in a cache coherency protocol |
US8090914B2 (en) * | 2004-01-20 | 2012-01-03 | Hewlett-Packard Development Company, L.P. | System and method for creating ordering points |
US7657710B2 (en) * | 2006-11-17 | 2010-02-02 | Sun Microsystems, Inc. | Cache coherence protocol with write-only permission |
US8239633B2 (en) * | 2007-07-11 | 2012-08-07 | Wisconsin Alumni Research Foundation | Non-broadcast signature-based transactional memory |
US20090089510A1 (en) * | 2007-09-28 | 2009-04-02 | Mips Technologies, Inc. | Speculative read in a cache coherent microprocessor |
US8392663B2 (en) | 2007-12-12 | 2013-03-05 | Mips Technologies, Inc. | Coherent instruction cache utilizing cache-op execution resources |
US8266381B2 (en) * | 2008-02-01 | 2012-09-11 | International Business Machines Corporation | Varying an amount of data retrieved from memory based upon an instruction hint |
US20090198910A1 (en) * | 2008-02-01 | 2009-08-06 | Arimilli Ravi K | Data processing system, processor and method that support a touch of a partial cache line of data |
US8140771B2 (en) * | 2008-02-01 | 2012-03-20 | International Business Machines Corporation | Partial cache line storage-modifying operation based upon a hint |
US8108619B2 (en) * | 2008-02-01 | 2012-01-31 | International Business Machines Corporation | Cache management for partial cache line operations |
US8117401B2 (en) * | 2008-02-01 | 2012-02-14 | International Business Machines Corporation | Interconnect operation indicating acceptability of partial data delivery |
US8255635B2 (en) * | 2008-02-01 | 2012-08-28 | International Business Machines Corporation | Claiming coherency ownership of a partial cache line of data |
US8250307B2 (en) * | 2008-02-01 | 2012-08-21 | International Business Machines Corporation | Sourcing differing amounts of prefetch data in response to data prefetch requests |
US20090248988A1 (en) * | 2008-03-28 | 2009-10-01 | Mips Technologies, Inc. | Mechanism for maintaining consistency of data written by io devices |
US8117390B2 (en) * | 2009-04-15 | 2012-02-14 | International Business Machines Corporation | Updating partial cache lines in a data processing system |
US8140759B2 (en) * | 2009-04-16 | 2012-03-20 | International Business Machines Corporation | Specifying an access hint for prefetching partial cache block data in a cache hierarchy |
US8914466B2 (en) * | 2011-07-07 | 2014-12-16 | International Business Machines Corporation | Multi-level adaptive caching within asset-based web systems |
US10691602B2 (en) * | 2018-06-29 | 2020-06-23 | Intel Corporation | Adaptive granularity for reducing cache coherence overhead |
US11321495B2 (en) * | 2020-04-01 | 2022-05-03 | International Business Machines Corporation | Anomalous cache coherence transaction detection in a heterogeneous system |
US11188471B2 (en) * | 2020-04-03 | 2021-11-30 | Alibaba Group Holding Limited | Cache coherency for host-device systems |
Citations (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US6026461A (en) * | 1995-08-14 | 2000-02-15 | Data General Corporation | Bus arbitration system for multiprocessor architecture |
US6631448B2 (en) * | 1998-03-12 | 2003-10-07 | Fujitsu Limited | Cache coherence unit for interconnecting multiprocessor nodes having pipelined snoopy protocol |
US20040073755A1 (en) * | 2000-08-31 | 2004-04-15 | Webb David A.J. | Broadcast invalidate scheme |
US6883070B2 (en) * | 2001-03-14 | 2005-04-19 | Wisconsin Alumni Research Foundation | Bandwidth-adaptive, hybrid, cache-coherence protocol |
Family Cites Families (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP4123621B2 (en) * | 1999-02-16 | 2008-07-23 | 株式会社日立製作所 | Main memory shared multiprocessor system and shared area setting method thereof |
US6535957B1 (en) * | 1999-11-09 | 2003-03-18 | International Business Machines Corporation | System bus read data transfers with bus utilization based data ordering |
-
2001
- 2001-10-19 US US10/037,727 patent/US6883070B2/en not_active Expired - Lifetime
-
2005
- 2005-02-22 US US11/063,294 patent/US20050144395A1/en not_active Abandoned
Patent Citations (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US6026461A (en) * | 1995-08-14 | 2000-02-15 | Data General Corporation | Bus arbitration system for multiprocessor architecture |
US6631448B2 (en) * | 1998-03-12 | 2003-10-07 | Fujitsu Limited | Cache coherence unit for interconnecting multiprocessor nodes having pipelined snoopy protocol |
US20040073755A1 (en) * | 2000-08-31 | 2004-04-15 | Webb David A.J. | Broadcast invalidate scheme |
US6883070B2 (en) * | 2001-03-14 | 2005-04-19 | Wisconsin Alumni Research Foundation | Bandwidth-adaptive, hybrid, cache-coherence protocol |
Cited By (6)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US7315919B1 (en) | 2004-06-15 | 2008-01-01 | Sun Microsystems, Inc. | Bandwidth reduction technique in a snooping-based cache-coherent cluster of multiprocessing nodes |
US7174430B1 (en) * | 2004-07-13 | 2007-02-06 | Sun Microsystems, Inc. | Bandwidth reduction technique using cache-to-cache transfer prediction in a snooping-based cache-coherent cluster of multiprocessing nodes |
US20130007376A1 (en) * | 2011-07-01 | 2013-01-03 | Sailesh Kottapalli | Opportunistic snoop broadcast (osb) in directory enabled home snoopy systems |
CN104252423A (en) * | 2013-06-26 | 2014-12-31 | 华为技术有限公司 | Consistency processing method and device based on multi-core processor |
WO2014206232A1 (en) * | 2013-06-26 | 2014-12-31 | 华为技术有限公司 | Consistency processing method and device based on multi-core processor |
US20150248350A1 (en) * | 2014-03-03 | 2015-09-03 | Tmaxsoft. Co., Ltd. | Apparatus and method for managing cache in cache distributed environment |
Also Published As
Publication number | Publication date |
---|---|
US20020133674A1 (en) | 2002-09-19 |
US6883070B2 (en) | 2005-04-19 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US6883070B2 (en) | Bandwidth-adaptive, hybrid, cache-coherence protocol | |
US5761721A (en) | Method and system for cache coherence despite unordered interconnect transport | |
US6704842B1 (en) | Multi-processor system with proactive speculative data transfer | |
US7032078B2 (en) | Shared memory multiprocessing system employing mixed broadcast snooping and directory based coherency protocols | |
US7386680B2 (en) | Apparatus and method of controlling data sharing on a shared memory computer system | |
US8402225B2 (en) | Method for performing cache coherency in a computer system | |
TWI393005B (en) | Data processing system, cache system and method for handling a flush operation in a data processing system having multiple coherency domains | |
US7529893B2 (en) | Multi-node system with split ownership and access right coherence mechanism | |
US7222220B2 (en) | Multiprocessing system employing address switches to control mixed broadcast snooping and directory based coherency protocols transparent to active devices | |
TWI386810B (en) | Directory-based data transfer protocol for multiprocessor system | |
US20050010615A1 (en) | Multi-node computer system implementing memory-correctable speculative proxy transactions | |
US20050013294A1 (en) | Multi-node computer system with active devices employing promise arrays for outstanding transactions | |
US20050044174A1 (en) | Multi-node computer system where active devices selectively initiate certain transactions using remote-type address packets | |
US20050027947A1 (en) | Multi-node computer system including a mechanism to encode node ID of a transaction-initiating node in invalidating proxy address packets | |
US7225298B2 (en) | Multi-node computer system in which networks in different nodes implement different conveyance modes | |
US8024526B2 (en) | Multi-node system with global access states | |
CN110235113B (en) | Memory controller and system and method for data processing | |
US6970979B2 (en) | System with virtual address networks and split ownership and access right coherence mechanism | |
US8010749B2 (en) | Multi-node computer system with proxy transaction to read data from a non-owning memory device | |
US7360029B2 (en) | Multi-node computer system in which interfaces provide data to satisfy coherency transactions when no owning device present in modified global access state node | |
US20040268056A1 (en) | Multi-node computer system implementing global access state dependent transactions | |
US7814278B2 (en) | Multi-node system with response information in memory | |
US20050005075A1 (en) | Multi-node computer system employing multiple memory response states | |
EP4109282A1 (en) | Methods for bias mode management in memory systems | |
Bianchini et al. | Eliminating useless messages in write-update protocols on scalable multiprocessors |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
AS | Assignment |
Owner name: WISCONSIN ALUMNI RESEARCH FOUNDATION, WISCONSIN Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:MARTIN, MILO M.K.;WOOD, DAVID A.;HILL, MARK D.;AND OTHERS;REEL/FRAME:016316/0202;SIGNING DATES FROM 20011031 TO 20011213 |
|
STCB | Information on status: application discontinuation |
Free format text: ABANDONED -- FAILURE TO RESPOND TO AN OFFICE ACTION |