WO2003065155A2 - Architecture to thwart denial of service attacks - Google Patents

Architecture to thwart denial of service attacks Download PDF

Info

Publication number
WO2003065155A2
WO2003065155A2 PCT/US2003/002441 US0302441W WO03065155A2 WO 2003065155 A2 WO2003065155 A2 WO 2003065155A2 US 0302441 W US0302441 W US 0302441W WO 03065155 A2 WO03065155 A2 WO 03065155A2
Authority
WO
WIPO (PCT)
Prior art keywords
network
traffic
cluster head
probes
gateway
Prior art date
Application number
PCT/US2003/002441
Other languages
French (fr)
Other versions
WO2003065155A3 (en
Inventor
Massimiliano Antonio Poletto
Dimitri Stratton Vlachos
Original Assignee
Mazu Networks, Inc.
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Mazu Networks, Inc. filed Critical Mazu Networks, Inc.
Priority to AU2003225533A priority Critical patent/AU2003225533A1/en
Publication of WO2003065155A2 publication Critical patent/WO2003065155A2/en
Publication of WO2003065155A3 publication Critical patent/WO2003065155A3/en

Links

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L63/00Network architectures or network communication protocols for network security
    • H04L63/14Network architectures or network communication protocols for network security for detecting or protecting against malicious traffic
    • H04L63/1408Network architectures or network communication protocols for network security for detecting or protecting against malicious traffic by monitoring network traffic
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L63/00Network architectures or network communication protocols for network security
    • H04L63/14Network architectures or network communication protocols for network security for detecting or protecting against malicious traffic
    • H04L63/1408Network architectures or network communication protocols for network security for detecting or protecting against malicious traffic by monitoring network traffic
    • H04L63/1416Event detection, e.g. attack signature detection
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L63/00Network architectures or network communication protocols for network security
    • H04L63/14Network architectures or network communication protocols for network security for detecting or protecting against malicious traffic
    • H04L63/1408Network architectures or network communication protocols for network security for detecting or protecting against malicious traffic by monitoring network traffic
    • H04L63/1425Traffic logging, e.g. anomaly detection
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L63/00Network architectures or network communication protocols for network security
    • H04L63/14Network architectures or network communication protocols for network security for detecting or protecting against malicious traffic
    • H04L63/1441Countermeasures against malicious traffic
    • H04L63/1458Denial of Service

Definitions

  • This invention relates to techniques to thwart network-related denial of service attacks.
  • an attacker sends a large volume of malicious traffic to a victim.
  • an attacker via a computer system connected to the Internet infiltrates one or a plurality of computers at various data centers. Often the attacker will access the Internet through an Internet Service Provider (ISP) .
  • ISP Internet Service Provider
  • the attacker by use of a malicious software program places the plurality of computers at the data centers under its control. When the attacker issues a command to the computers at the data centers, the machines send data out of the data centers at arbitrary times. These computers can simultaneously send large volumes of data over various times to the victim preventing the victim from responding to legitimate traffic.
  • a monitoring device disposed for thwarting denial of service attacks on the data center includes a plurality of probe devices that are disposed to collect statistical information on packets that are sent between the network and the data center and a cluster head coupled to each of the plurality of probe devices, the cluster head receiving collected statistical information from the probe devices and determining from the collected information whether the data center is under a denial of service attack.
  • a method of thwarting denial of service attacks on a victim data center coupled to a network includes monitoring network traffic through probes that are disposed between the victim data center and the network and communicating data from the probes, over a dedicated network, to a cluster head device.
  • a gateway for thwarting denial of service attacks on a victim includes a cluster head and a plurality of probes disposed between a network and a victim center, the probes collecting statistical data, for performance of intelligent traffic analysis and filtering by the cluster head, to identify malicious traffic for thwarting denial of service attacks.
  • a monitoring device disposed for thwarting denial of service attacks on the data center includes a device that collects statistical information on packets that are sent between the network and the data center over a plurality of links and that produces statistical information from network traffic over the plurality of links to determine from the statistical information whether the data center is under a denial of service attack.
  • a method of thwarting denial of service attacks on a victim data center coupled to a network includes monitoring network traffic over a plurality of links between the victim data center and the network and communicating data, over a dedicated network, to a control center
  • One or more aspects of the invention may provide one or more of the following advantages .
  • Aspects of the invention provide a clustered monitor to detect and determine packets that are part of a denial of service attack for data centers that have multiple links to the Internet or traffic levels that are beyond what a single monitor device, e.g. gateway can handle.
  • the technique protects multiple links between the Internet and a potential victim data center as well as devices located within the data center.
  • the invention can accommodate an arbitrary number of probes and share sufficient information with the probes to monitor traffic passing through the clustered monitor.
  • the clustered monitor can determine if an attack is underway involving the data center.
  • the invention can provide a customer with a single graphical user interface that summarizes cluster's traffic and attack status history.
  • a probe is statically assigned or hardwired via a network, whereas in other embodiments a probe can dynamically leave or join a clustered monitor and is as stateless as possible, thus minimizing disruptions to the clustered monitor in the event of failure or other replacement.
  • Probes in a clustered monitor can query and push information to or from the clustered monitor.
  • a full set of detection mechanisms as well as responses to denial of service attacks exist at the cluster level enabling the clustered monitor to be a stand-alone monitor.
  • the arrangement allows the clustered monitor to be coupled to a control center via a hardened redundant network.
  • the clustered monitor can be of a data collector type or a gateway type.
  • FIG. 1 is a block diagram of networked computers showing an architecture to thwart denial of service attacks .
  • FIG. 2 is a block diagram depicting the architecture of a clustered gateway.
  • FIG. 3 is a block diagram depicting processes that execute on a cluster head.
  • FIG. 4 is a block diagram depicting processes that execute on a probe gateway.
  • FIG. 5 is a flow chart depicting a joining process for a probe member.
  • FIGS. 6A and 6B depict respectively probe and cluster head functionality.
  • FIG. 7 is a flow chart depicting exemplary analysis processes in the cluster head.
  • the arrangement 10 is used to thwart an attack on a victim data center 12, e.g., a web site or other network site under attack.
  • the victim 12 is coupled to the Internet 14 or other network.
  • the victim 12 has a web server located at a data center (not shown) .
  • the attacker by use of a malicious software program that is generally surreptitiously loaded on the computers of the data centers 20a-20c, places the plurality of computers in the data centers 20a-20c under its control.
  • the attacker issues a command to the data centers 20a-20c the data centers 20a-20c send data out at arbitrary times.
  • These data centers 20a-20c can simultaneously send large volumes of data at various times to the victim 12 to prevent the victim 12 from responding to legitimate traffic.
  • the arrangement 10 to protect the victim includes a control center 24 that communicates with and controls monitor devices, e.g., gateways 26 and data collectors 28 disposed in the network 14.
  • the arrangement protects against DoS attacks via intelligent traffic analysis and filtering that is distributed throughout the network.
  • the control center 24 is coupled to the gateways 26 and data collectors 28 by a hardened, redundant network 30. In preferred embodiments, the network is inaccessible to the attacker.
  • the gateway 26 devices are located at the edges of the Internet 14, for instance, at the entry points of data centers. The gateway devices constantly analyze traffic, looking for congestion or traffic levels that indicate the onset of a DoS attack.
  • the data collectors 28 are located inter alia at major peering points and network points of presence (PoPs) . The data collectors 28 sample packet traffic, accumulate, and collect statistical information about network flows.
  • All deployed monitor devices e.g., gateways 26 and data collectors 28 are linked to the central control center 24.
  • the control center 24 aggregates traffic information and coordinates measures to track down and block the sources of an attack.
  • the arrangement uses a distributed approach that analyzes and determines the underlying characteristics of a DoS attack to produce a robust and comprehensive DoS solution.
  • this architecture 10 can stop new attacks rather than some solutions that can only stop previously seen attacks.
  • the distributed architecture 10 will frequently stop an attack near its source, before it uses bandwidth on the wider Internet 14 or congests access links to the targeted victim 12.
  • a virus is one way to get attacks started.
  • a user may download something, which contains a virus that puts the user' s computer under the control of some hacker. In the future, that machine can be one of the machines that launches the attack.
  • clustered monitors can include clustered gateways and clustered data collectors that are linked to the central control center 24.
  • the gateway 26 is a clustered device and is hereinafter referred to as clustered gateway 26.
  • the data collectors 28 could also be clustered devices.
  • the arrangement 10 could be comprised of clustered and nonclustered devices.
  • a clustered monitor e.g., a clustered gateway 26 monitors a plurality of links that exist between the victim center 12 and the Internet 14.
  • the clustered monitor includes the use of stateless probes that are scaleable.
  • the clustered monitor itself is not vulnerable to a denial of service attack. That is, when a system behind the cluster is being attacked, the cluster head itself should not see a huge increase in traffic load.
  • the cluster head can also analyze traffic on asymmetric links and treat the traffic on all of the monitored links as if the traffic originated on one virtual link.
  • the data center 20 has a plurality of links 21a-21n with the Internet 14.
  • the links exist through various network architectural arrangements, the details of which are not an important consideration here.
  • the data center 20 is protected by a clustered gateway 26 that comprises a plurality of probe devices 26a-26n, which are here shown coupled in-line with the links between the data center 20 and the Internet 14.
  • the probe devices 26a-26n have connections to a cluster head device 27.
  • the cluster head device 27 likewise can have an optional and/or hardened redundant network interface 39 connection to a hardened/redundant network 30. This interface is used to connect the cluster head device 27 to the control center 24 (FIG. 1) or to allow an operator access to the clustered monitor.
  • Probes 26a-26n perform several functions such as sampling of packets and collecting statistical information of packets that they see. In preferred embodiments, the probes 26a-26n examine every packet for statistical analysis purposes and randomly choose selected numbers of packets per second to pass to the cluster head 27.
  • the cluster head 27 is responsible for receiving the sampled traffic packets and summary information provided from the probes 26a-26n.
  • the cluster head 27 analyzes the traffic for detection of denial of service attacks using any known algorithms or the algorithms described below.
  • the cluster head 27 also provides a user interface into the traffic analysis and also communicates with the control center 24.
  • the cluster head 27 is connected to the probes 26a-26n.
  • a network type of connection provides connectivity between the cluster head 27 and probes 26a- 26n.
  • An exemplary type of network connection is a 100 Mbit Ethernet network. Other connections and other network configurations, of course, could be used.
  • this connection is a private network used only for intra-cluster communications. As a probe 26a-26n starts up and joins the cluster, it obtains an IP address on the network and begins sending sample packets and statistical information to the cluster head 27 as will be described below.
  • the arrangement provides a straightforward manner to set up a cluster topology.
  • the arrangement does not need a leader election protocol. Rather, a single cluster head 27 is used per cluster with all other probes as members.
  • the cluster head 27 need not know explicitly about any particular cluster member.
  • the new cluster member can dynamically discover its cluster head and join the cluster.
  • the cluster head will allow/deny the member to join the cluster or can be directly connected in a hardwired point-to-point connection.
  • the cluster head will keep a minimal amount of information for each member of the cluster to facilitate debugging and analysis.
  • the links between cluster heads and probes can be fast connections, e.g., 100 Mb/s Ethernet. To achieve this a cluster member must be on the same IP network as the cluster head.
  • the DHCP protocol can be used whereas, in others a Cluster Discovery Protocol (CDP) described below can be used.
  • CDP Cluster Discovery Protocol
  • FIG. 3 exemplary processes 50 that run on a cluster head 27 are shown.
  • the cluster head 27 will include a kernel level configuration process 52 and a user level configuration process 54.
  • the kernel level 52 configuration process in one implementation can be a Click kernel process, as described in the Appendix.
  • the kernel level configuration process aggregates 52 traffic from various probes 26a-26n.
  • the user-level configuration process 54 produces logs and runs detection algorithms.
  • the cluster head 27 also includes a HTTP server or web server 56 such as an Apache server, as well as a time synchronization process such as NTP (network time protocol) 58.
  • the cluster head 27 also includes a process 60 to allow the cluster head 27 to automatically assign an IP address to the probe.
  • One example of such a process is the DHCP, e.g., dynamic host configuration protocol, which is a network protocol that enables an DHCP server to automatically assign an IP address to individual computers .
  • exemplary processes 70 that execute on probe 26a are shown.
  • the probe 26a executes a joining process 72 to permit the probe 26a to join an existing, operating cluster.
  • the probe 26a also includes a monitor process 74 that collects statistical information on packets.
  • the packets can pass through the probe 26a in implementations where the probe 26a is disposed in-line, or are sampled by the probe 26a in implementations where the probed is disposed to tap copied packets from a link. In either event the probe 26a is disposed between the data center and the network.
  • the probe 26a also executes a packet flow process 76 that statistically samples random packets and sends those packets to the cluster head 27.
  • the joining process 72 on the probes 26a-26n is shown for probe 26a.
  • the probe is booted 82. Once the probe boots, the probe executes a script.
  • the script installs 84 kernel Click config (which is shown as 74 and 76 in FIG. 4), and runs a DHCP client application) to obtain a IP address from the cluster head. Once the IP address is assigned, the join process 72 will start 88 a NTP (Network Time Protocol, or equivalent) synchronization process between cluster head and probe to allow the probe to maintain the same time as other probes in the cluster, as well as the cluster head 27.
  • NTP Network Time Protocol, or equivalent
  • the process 72 configures 90 the monitor configuration in the Click kernel to enable the probe to collect statistical information concerning traffic flow to the probe, e.g., 26a, as well as to sample selected numbers of packets to send to the cluster head 27.
  • a probe can have a serial port for debugging/configuring that is accessed via the cluster network.
  • FIGS. 6A and 6B an exemplary operational process that can occur on one or more probes 26a-26n and the cluster head 27 is shown.
  • a process 100 is used to sample 102 one in every N packets or to provide a random sampling of said packets.
  • the process 100 also collects 104 and logs source information from all packets and will collect and log 106 destination information from all packets.
  • the process 100 also collects information regarding the packet type and so forth.
  • the process 100 will transmit 108 the collected destination and source information as well as other statistical information to the cluster head 27 and will likewise transmit sample packets to the cluster head 27.
  • the cluster head 27 can maintain a stable log or file system to maintain the information for an indefinite period of time.
  • a process 110 executes on the cluster head 27.
  • the process 110 includes a process 112 to analyze collected source and destination information and to determine 114 whether or not the information corresponds to an attack on the victim center. If the information corresponds to an attack, the process 110 generates 116 a response to the attack. Exemplary responses can be to send a message to the data center 24 that an attack is underway.
  • a response can involve determining the nature of the attack and source of the attack at the gateway.
  • the gateway 26 can determine corrective measures such as installing filters on nearby routers or by installing a filter in one or more of the probes 26a- 26n (if the probes are in-line) .
  • the cluster head 27 makes decisions about the health of the traffic passing by the cluster 26 and keeps logs (not shown) of the traffic. To do this the cluster head 27 examines a subset of the packets flowing by the cluster members, and the counters obtained from probes 26a-26n. The cluster head 27 uses the counter information and sampled packets to determine if a cluster 26 is involved in an attack and the traffic subset will be used for logging.
  • packets are delivered from cluster probes 26a-26n to a cluster head 27. This can present a problem since the system needs to both maintain contents (including annotations) of a packet as it is transported from probe 26a-26n to head 27, and needs to distinguish different types of packets at the cluster head 27.
  • IPEncap IPEncap
  • IPClassifier PackWithAnno
  • UnpackWithAnno UnpackWithAnno.
  • reliable queue ⁇ Rx, Tx ⁇ is used for reliable delivery.
  • the traffic on the intra-cluster network would include:
  • NTP traffic for time synchronization (bidirectional)
  • DHCP traffic for IP address management (bi- directional)
  • RSH protocol a bi-directional protocol for probe traffic.
  • IP protocol 127 randomly sampled packets (probe to cluster head)
  • IP protocol 128 counter summary log packets (probe to cluster head)
  • the specific traffic flows can be bi-directional and are encapsulated via the PackWithAnno element on the probe and decapsulated with the UnpackeWithAnno element at the cluster head.
  • the packets are raw IP packets, i.e., the packets do not run over a user datagram or Transport UDP/TCP. With this deliver process packet size is watched carefully so as to not exceed the MTU.
  • the counter summary packets can be sent once per second, the TCP monitoring packets can be sent twice per report. Sampled packets are sent according to a sampling rate set for the probe. An exemplary setting is 10,000 PPS although slower or faster rates could be used. The sample packets produce the logs mentioned above.
  • the counter summary log packets and the TCP rate monitor packets are used in attack detection heuristics.
  • the traffic rate on the intra-cluster network should be predictable regardless of the traffic rate the cluster itself is seeing. This prevents dos attacks from loading the cluster's network. With the parameter values mentioned above the predicted traffic per probe rates: 10, 000 (sample) + 1 (counter summary) + 2 (IP Rate monitor) .
  • the NTP and DHCP packet loads are negligible.
  • the gateway 26 monitoring process 74 (FIG. 4) monitors traffic that passes through the gateway and includes a communication process (not shown) that communicates statistics collected in the gateway 26 with the data center 24.
  • the gateway 26 uses a separate interface over a private, redundant network, such as a modem 39 over the telephone network or a leased line, a network adapter over a LAN, etc. to communicate with the control center 24.
  • Other interface types are possible.
  • the gateway 26 can include processes (not shown) to allow an administrator to insert filters to block, i.e., discard packets that the device deems to be part of an attack, as determined by heuristics described below. Referring to FIG. 7, exemplary techniques 130 to determine if a data center is under attack are shown.
  • the gateway 26 collects statistics 132 and analyzes the statistics according to one or more of the algorithms 134a-134e described below. Other algorithms can be used. Several methods can be used separately or in combination to detect malicious traffic flows. For example, the gateway 26 can detect DoS attacks using at least one or more of the following methods including: analyzing packet ratios of TCP-like traffic; analyzing "repressor" traffic for particular types of normal traffic; performing TCP handshake analysis; performing various types of packet analysis at packet layers 3-7; and logging/historical analysis.
  • TCP Transmission Control Protocol
  • a connection between two hosts a client C, e.g. a web browser, and a server S, e.g. a web server, involves packets traveling in both directions, between C and S and between S and C.
  • S replies with an ACK ("acknowledgement") packet. If C does not receive the ACK, it will eventually try to retransmit the data to S, to implement TCP's reliable delivery property.
  • a server S will acknowledge (send an ACK) for every packet or every second packet.
  • the monitoring process in the gateway 26 can examine a ratio of incoming to outgoing TCP packets for a particular set of machines, e.g. web servers.
  • the monitoring process can compare the ratio to a threshold value.
  • the monitoring process can store this ratio, time stamp it, etc. and conduct an ongoing analysis to determine over time for example how much and how often it exceeds that ratio.
  • the ratio grows increasingly beyond 2:1, e.g., up to about 3:1 or so, it is an increasing indication that the machines are receiving bad TCP traffic, e.g., packets that are not part of any established TCP connection, or that they are too overloaded to acknowledge the requests.
  • the monitoring process can monitor rates as bytes/sec and packets/sec rates of total, UDP, ICMP, and fragmented traffic in addition to TCP traffic.
  • the thresholds are set manually by an operator.
  • the device can provide a "threshold wizard" which uses historical data to help the user to set thresholds.
  • An alternate implementation could automatically generate time-based thresholds using historical data.
  • the gateway 26 divides traffic into multiple buckets, e.g. by source network address, and tracks the ratio of ingoing to outgoing traffic for each bucket. As the ratio for one bucket becomes skewed, the gateway 26 may subdivide that bucket to obtain a more detailed view. The gateway 26 raises 90 a warning or alarm to the data center 24 and/or to the administrators at the victim site 12.
  • Another alternate implementation could combine thresholds with a histogram analysis, and trigger traffic characterization whenever a histogram for some parameter differed significantly (by a uniformity test, or for example, by subtracting normalized histograms) from the historical histogram.
  • Repressor traffic 134b could combine thresholds with a histogram analysis, and trigger traffic characterization whenever a histogram for some parameter differed significantly (by a uniformity test, or for example, by subtracting normalized histograms) from the historical histogram.
  • repressor traffic refers to any network traffic that is indicative of problems or a potential attack in a main flow of traffic.
  • a gateway 26 may use repressor traffic analysis to identify such problems and stop or repress a corresponding attack.
  • repressor traffic is ICMP port unreachable messages. These messages are generated by an end host when the end host receives a packet on a port that is not responding to requests. The message contains header information from the packet in question.
  • the gateway 26 can analyze the port unreachable messages and use them to generate logs for forensic purposes or to selectively block future messages similar to the ones that caused the ICMP messages.
  • a TCP connection between two hosts on the network is initiated via a three-way handshake.
  • the client e.g. C
  • sends the server e.g. S
  • a SYN "synchronize" packet
  • S replies with a SYN ACK ("synchronize acknowledgment") packet
  • the client C replies to the SYN ACK with an ACK (“acknowledgment”) packet.
  • appropriate states to manage the connection are established on both sides.
  • a server is sent many SYN packets but the attacking site never responds to the corresponding SYN ACKs with ACK packets.
  • the resulting "half-open" connections take up state on the server and can prevent the server from opening up legitimate connections until the half-open connection expires, which usually takes 2-3 minutes.
  • an attacker can effectively prevent a server from serving any legitimate connection requests.
  • One type of attack occurs during connection setup.
  • the gateway forwards a SYN packet from the client to the server.
  • the gateway forwards a resulting SYN ACK packet from a server to client and immediately sends ACK packet to the server, closing a three-way handshake.
  • the gateway maintains the resulting connection for a variable timeout period. If the packet does not arrive from client to server, the gateway sends a RST ("reset") to the server to close the connection. If the ACK arrives, gateway forwards the ACK and forgets about the connection, forwarding subsequent packets for that connection.
  • the variable timeout period can be inversely proportional to number of connections for which a first ACK packet from client has not been received.
  • a cluster 26 can keep track of ratios of SYNs to SYN ACKs and SYN ACKs to ACKs, and raise appropriate alarms when a SYN flood attack situation occurs.
  • the gateway 26 looks at various traffic properties at network packet layers 3 through 7 to identify attacks and malicious flows. These layers are often referred to as layers of the Open System Interconnection (OSI) reference model and are network, transport, session, presentation and application layers respectively. Some examples of characteristics that the gateway may look for include: 1. Unusual amounts of IP fragmentation, or fragmented IP packets with bad or overlapping fragment offsets .
  • OSI Open System Interconnection
  • IP packets with obviously bad source addresses or ICMP packets with broadcast destination addresses.
  • the monitoring process determines the rates or counts of these events. If any of the rates/counts exceeds a particular threshold, the cluster device considers this a suspicious event and begins attack characterization process.
  • the gateways 26 and data collectors 28 keep statistical summary information of traffic over different periods of time and at different levels of detail.
  • a gateway 26 may keep mean and standard deviation for a chosen set of parameters across a chosen set of time-periods.
  • the parameters may include source and destination host or network addresses, protocols, types of packets, number of open connections or of packets sent in either direction, etc.
  • Time periods for statistical aggregation may range from minutes to weeks.
  • the device will have configurable thresholds and will raise warnings when one of the measured parameters exceeds the corresponding threshold.
  • the gateway 26 can also log packets. In addition to logging full packet streams, the gateway 26 has the capability to log only specific packets identified as part of an attack (e.g., fragmented UDP packets or TCP SYN packets that are part of a SYN flood attack) . This feature of the gateway 26 enables administrators to quickly identify the important properties of the attack.
  • a gateway 26 can tap a network line without being deployed physically in line, and it can control network traffic, for example, by dynamically installing filters on nearby routers. The gateway 26 would install these filters on the appropriate routers via an out of band connection, i.e. a serial line or a dedicated network connection. Other arrangements are of course possible.
  • a Click router is an interconnected collection of modules or elements used to control a router's behavior when implemented on a computer system. Other implementations can be used.

Abstract

A method or apparatus (14) for monitoring (28) for denial of service attacks on a data center (20, 24).

Description

ARCHITECTURE TO THWART DENIAL OF SERVICE ATTACKS
Background This invention relates to techniques to thwart network-related denial of service attacks.
In denial of service attacks, an attacker sends a large volume of malicious traffic to a victim. In one approach an attacker, via a computer system connected to the Internet infiltrates one or a plurality of computers at various data centers. Often the attacker will access the Internet through an Internet Service Provider (ISP) . The attacker by use of a malicious software program places the plurality of computers at the data centers under its control. When the attacker issues a command to the computers at the data centers, the machines send data out of the data centers at arbitrary times. These computers can simultaneously send large volumes of data over various times to the victim preventing the victim from responding to legitimate traffic.
Summary According to an aspect of the invention, a monitoring device disposed for thwarting denial of service attacks on the data center includes a plurality of probe devices that are disposed to collect statistical information on packets that are sent between the network and the data center and a cluster head coupled to each of the plurality of probe devices, the cluster head receiving collected statistical information from the probe devices and determining from the collected information whether the data center is under a denial of service attack.
According to an additional aspect of the invention, a method of thwarting denial of service attacks on a victim data center coupled to a network includes monitoring network traffic through probes that are disposed between the victim data center and the network and communicating data from the probes, over a dedicated network, to a cluster head device. According to a still further aspect of the invention, a gateway for thwarting denial of service attacks on a victim includes a cluster head and a plurality of probes disposed between a network and a victim center, the probes collecting statistical data, for performance of intelligent traffic analysis and filtering by the cluster head, to identify malicious traffic for thwarting denial of service attacks. According to a still further aspect of the invention, a monitoring device disposed for thwarting denial of service attacks on the data center includes a device that collects statistical information on packets that are sent between the network and the data center over a plurality of links and that produces statistical information from network traffic over the plurality of links to determine from the statistical information whether the data center is under a denial of service attack.
According to a still further aspect of the invention, a method of thwarting denial of service attacks on a victim data center coupled to a network includes monitoring network traffic over a plurality of links between the victim data center and the network and communicating data, over a dedicated network, to a control center
One or more aspects of the invention may provide one or more of the following advantages . Aspects of the invention provide a clustered monitor to detect and determine packets that are part of a denial of service attack for data centers that have multiple links to the Internet or traffic levels that are beyond what a single monitor device, e.g. gateway can handle. Thus, the technique protects multiple links between the Internet and a potential victim data center as well as devices located within the data center. The invention can accommodate an arbitrary number of probes and share sufficient information with the probes to monitor traffic passing through the clustered monitor. The clustered monitor can determine if an attack is underway involving the data center. The invention can provide a customer with a single graphical user interface that summarizes cluster's traffic and attack status history. In some embodiments, a probe is statically assigned or hardwired via a network, whereas in other embodiments a probe can dynamically leave or join a clustered monitor and is as stateless as possible, thus minimizing disruptions to the clustered monitor in the event of failure or other replacement. Probes in a clustered monitor can query and push information to or from the clustered monitor. A full set of detection mechanisms as well as responses to denial of service attacks exist at the cluster level enabling the clustered monitor to be a stand-alone monitor. Alternatively, the arrangement allows the clustered monitor to be coupled to a control center via a hardened redundant network. The clustered monitor can be of a data collector type or a gateway type.
The details of one or more embodiments of the invention are set forth in the accompanying drawings and the description below. Other features, objects, and advantages of the invention will be apparent from the description and drawings, and from the claims.
Brief description of the drawings FIG. 1 is a block diagram of networked computers showing an architecture to thwart denial of service attacks . FIG. 2 is a block diagram depicting the architecture of a clustered gateway.
FIG. 3 is a block diagram depicting processes that execute on a cluster head.
FIG. 4 is a block diagram depicting processes that execute on a probe gateway.
FIG. 5 is a flow chart depicting a joining process for a probe member.
FIGS. 6A and 6B depict respectively probe and cluster head functionality. FIG. 7 is a flow chart depicting exemplary analysis processes in the cluster head.
Detailed Description Referring to FIG. 1, an arrangement 10 to thwart denial of service attacks (DoS attacks) is shown. The arrangement 10 is used to thwart an attack on a victim data center 12, e.g., a web site or other network site under attack. The victim 12 is coupled to the Internet 14 or other network. For example, the victim 12 has a web server located at a data center (not shown) .
An attacker via a computer system (not shown) that is connected to the Internet e.g., via an Internet Service Provider (ISP) 18 (not shown) other approach, infiltrates one or a plurality of computers at various other sites or data centers 20a-20c. The attacker by use of a malicious software program that is generally surreptitiously loaded on the computers of the data centers 20a-20c, places the plurality of computers in the data centers 20a-20c under its control. When the attacker issues a command to the data centers 20a-20c, the data centers 20a-20c send data out at arbitrary times. These data centers 20a-20c can simultaneously send large volumes of data at various times to the victim 12 to prevent the victim 12 from responding to legitimate traffic.
The arrangement 10 to protect the victim includes a control center 24 that communicates with and controls monitor devices, e.g., gateways 26 and data collectors 28 disposed in the network 14. The arrangement protects against DoS attacks via intelligent traffic analysis and filtering that is distributed throughout the network. The control center 24 is coupled to the gateways 26 and data collectors 28 by a hardened, redundant network 30. In preferred embodiments, the network is inaccessible to the attacker. The gateway 26 devices are located at the edges of the Internet 14, for instance, at the entry points of data centers. The gateway devices constantly analyze traffic, looking for congestion or traffic levels that indicate the onset of a DoS attack. The data collectors 28 are located inter alia at major peering points and network points of presence (PoPs) . The data collectors 28 sample packet traffic, accumulate, and collect statistical information about network flows.
All deployed monitor devices e.g., gateways 26 and data collectors 28 are linked to the central control center 24. The control center 24 aggregates traffic information and coordinates measures to track down and block the sources of an attack. The arrangement uses a distributed approach that analyzes and determines the underlying characteristics of a DoS attack to produce a robust and comprehensive DoS solution. Thus, this architecture 10 can stop new attacks rather than some solutions that can only stop previously seen attacks. Furthermore, the distributed architecture 10 will frequently stop an attack near its source, before it uses bandwidth on the wider Internet 14 or congests access links to the targeted victim 12.
A virus is one way to get attacks started. When surfing a web page a user may download something, which contains a virus that puts the user' s computer under the control of some hacker. In the future, that machine can be one of the machines that launches the attack.
Some or all of the deployed monitor devices in the "arrangement are clustered monitors. Such clustered monitors can include clustered gateways and clustered data collectors that are linked to the central control center 24. As shown in FIG. 1, the gateway 26 is a clustered device and is hereinafter referred to as clustered gateway 26. However, the data collectors 28 could also be clustered devices. Further, the arrangement 10 could be comprised of clustered and nonclustered devices.
A clustered monitor, e.g., a clustered gateway 26 monitors a plurality of links that exist between the victim center 12 and the Internet 14. Features of the clustered monitor include the use of stateless probes that are scaleable. The clustered monitor itself is not vulnerable to a denial of service attack. That is, when a system behind the cluster is being attacked, the cluster head itself should not see a huge increase in traffic load. The cluster head can also analyze traffic on asymmetric links and treat the traffic on all of the monitored links as if the traffic originated on one virtual link.
Referring now to FIG. 2, the data center 20 has a plurality of links 21a-21n with the Internet 14. The links exist through various network architectural arrangements, the details of which are not an important consideration here. The data center 20 is protected by a clustered gateway 26 that comprises a plurality of probe devices 26a-26n, which are here shown coupled in-line with the links between the data center 20 and the Internet 14. The probe devices 26a-26n have connections to a cluster head device 27.
The cluster head device 27 likewise can have an optional and/or hardened redundant network interface 39 connection to a hardened/redundant network 30. This interface is used to connect the cluster head device 27 to the control center 24 (FIG. 1) or to allow an operator access to the clustered monitor. Probes 26a-26n perform several functions such as sampling of packets and collecting statistical information of packets that they see. In preferred embodiments, the probes 26a-26n examine every packet for statistical analysis purposes and randomly choose selected numbers of packets per second to pass to the cluster head 27. The cluster head 27 is responsible for receiving the sampled traffic packets and summary information provided from the probes 26a-26n. The cluster head 27 analyzes the traffic for detection of denial of service attacks using any known algorithms or the algorithms described below. The cluster head 27 also provides a user interface into the traffic analysis and also communicates with the control center 24. The cluster head 27 is connected to the probes 26a-26n. In one embodiment, a network type of connection provides connectivity between the cluster head 27 and probes 26a- 26n. An exemplary type of network connection is a 100 Mbit Ethernet network. Other connections and other network configurations, of course, could be used. Preferably this connection is a private network used only for intra-cluster communications. As a probe 26a-26n starts up and joins the cluster, it obtains an IP address on the network and begins sending sample packets and statistical information to the cluster head 27 as will be described below.
The arrangement provides a straightforward manner to set up a cluster topology. The arrangement does not need a leader election protocol. Rather, a single cluster head 27 is used per cluster with all other probes as members. The cluster head 27 need not know explicitly about any particular cluster member. When a new cluster member is added to a cluster, the new cluster member can dynamically discover its cluster head and join the cluster. The cluster head will allow/deny the member to join the cluster or can be directly connected in a hardwired point-to-point connection. The cluster head will keep a minimal amount of information for each member of the cluster to facilitate debugging and analysis.
The links between cluster heads and probes can be fast connections, e.g., 100 Mb/s Ethernet. To achieve this a cluster member must be on the same IP network as the cluster head. In some embodiments, the DHCP protocol can be used whereas, in others a Cluster Discovery Protocol (CDP) described below can be used. Referring now to FIG. 3, exemplary processes 50 that run on a cluster head 27 are shown. The cluster head 27 will include a kernel level configuration process 52 and a user level configuration process 54. The kernel level 52 configuration process in one implementation can be a Click kernel process, as described in the Appendix. The kernel level configuration process aggregates 52 traffic from various probes 26a-26n. The user-level configuration process 54 produces logs and runs detection algorithms. The cluster head 27 also includes a HTTP server or web server 56 such as an Apache server, as well as a time synchronization process such as NTP (network time protocol) 58. The cluster head 27 also includes a process 60 to allow the cluster head 27 to automatically assign an IP address to the probe. One example of such a process is the DHCP, e.g., dynamic host configuration protocol, which is a network protocol that enables an DHCP server to automatically assign an IP address to individual computers . Referring now to FIG. 4, exemplary processes 70 that execute on probe 26a are shown. The probe 26a executes a joining process 72 to permit the probe 26a to join an existing, operating cluster. The probe 26a also includes a monitor process 74 that collects statistical information on packets. The packets can pass through the probe 26a in implementations where the probe 26a is disposed in-line, or are sampled by the probe 26a in implementations where the probed is disposed to tap copied packets from a link. In either event the probe 26a is disposed between the data center and the network. The probe 26a also executes a packet flow process 76 that statistically samples random packets and sends those packets to the cluster head 27.
Referring to FIG. 5, the joining process 72 on the probes 26a-26n, is shown for probe 26a. During the joining process 72 the probe is booted 82. Once the probe boots, the probe executes a script. The script installs 84 kernel Click config (which is shown as 74 and 76 in FIG. 4), and runs a DHCP client application) to obtain a IP address from the cluster head. Once the IP address is assigned, the join process 72 will start 88 a NTP (Network Time Protocol, or equivalent) synchronization process between cluster head and probe to allow the probe to maintain the same time as other probes in the cluster, as well as the cluster head 27. After the NTP synchronization process 88, the process 72 configures 90 the monitor configuration in the Click kernel to enable the probe to collect statistical information concerning traffic flow to the probe, e.g., 26a, as well as to sample selected numbers of packets to send to the cluster head 27.
A probe can have a serial port for debugging/configuring that is accessed via the cluster network.
Referring now to FIGS. 6A and 6B, an exemplary operational process that can occur on one or more probes 26a-26n and the cluster head 27 is shown. On the probes a process 100 is used to sample 102 one in every N packets or to provide a random sampling of said packets. The process 100 also collects 104 and logs source information from all packets and will collect and log 106 destination information from all packets. The process 100 also collects information regarding the packet type and so forth. At respective points in time, the process 100 will transmit 108 the collected destination and source information as well as other statistical information to the cluster head 27 and will likewise transmit sample packets to the cluster head 27. The cluster head 27 can maintain a stable log or file system to maintain the information for an indefinite period of time.
Referring to FIG. 6B, a process 110 is shown that executes on the cluster head 27. The process 110 includes a process 112 to analyze collected source and destination information and to determine 114 whether or not the information corresponds to an attack on the victim center. If the information corresponds to an attack, the process 110 generates 116 a response to the attack. Exemplary responses can be to send a message to the data center 24 that an attack is underway. Optionally, a response can involve determining the nature of the attack and source of the attack at the gateway. In this option, the gateway 26 can determine corrective measures such as installing filters on nearby routers or by installing a filter in one or more of the probes 26a- 26n (if the probes are in-line) . These filters block undesired network traffic as will be discussed below. The cluster head 27 makes decisions about the health of the traffic passing by the cluster 26 and keeps logs (not shown) of the traffic. To do this the cluster head 27 examines a subset of the packets flowing by the cluster members, and the counters obtained from probes 26a-26n. The cluster head 27 uses the counter information and sampled packets to determine if a cluster 26 is involved in an attack and the traffic subset will be used for logging.
With an implementation using Click, all information is contained in packets. Thus, packets are delivered from cluster probes 26a-26n to a cluster head 27. This can present a problem since the system needs to both maintain contents (including annotations) of a packet as it is transported from probe 26a-26n to head 27, and needs to distinguish different types of packets at the cluster head 27.
One specific implementation to solve these problems includes four Click elements: IPEncap, IPClassifier, PackWithAnno, and UnpackWithAnno. Also, reliable queue {Rx, Tx} is used for reliable delivery. The traffic on the intra-cluster network would include:
NTP traffic: for time synchronization (bidirectional)
DHCP traffic: for IP address management (bi- directional)
RSH protocol a bi-directional protocol for probe traffic.
IP protocol 127: randomly sampled packets (probe to cluster head) IP protocol 128: counter summary log packets (probe to cluster head)
The specific traffic flows can be bi-directional and are encapsulated via the PackWithAnno element on the probe and decapsulated with the UnpackeWithAnno element at the cluster head. Note that the packets are raw IP packets, i.e., the packets do not run over a user datagram or Transport UDP/TCP. With this deliver process packet size is watched carefully so as to not exceed the MTU. As exemplary parameters, the counter summary packets can be sent once per second, the TCP monitoring packets can be sent twice per report. Sampled packets are sent according to a sampling rate set for the probe. An exemplary setting is 10,000 PPS although slower or faster rates could be used. The sample packets produce the logs mentioned above. The counter summary log packets and the TCP rate monitor packets are used in attack detection heuristics. The traffic rate on the intra-cluster network should be predictable regardless of the traffic rate the cluster itself is seeing. This prevents dos attacks from loading the cluster's network. With the parameter values mentioned above the predicted traffic per probe rates: 10, 000 (sample) + 1 (counter summary) + 2 (IP Rate monitor) . The NTP and DHCP packet loads are negligible.
The gateway 26 monitoring process 74 (FIG. 4) monitors traffic that passes through the gateway and includes a communication process (not shown) that communicates statistics collected in the gateway 26 with the data center 24. The gateway 26 uses a separate interface over a private, redundant network, such as a modem 39 over the telephone network or a leased line, a network adapter over a LAN, etc. to communicate with the control center 24. Other interface types are possible. In addition, the gateway 26 can include processes (not shown) to allow an administrator to insert filters to block, i.e., discard packets that the device deems to be part of an attack, as determined by heuristics described below. Referring to FIG. 7, exemplary techniques 130 to determine if a data center is under attack are shown. The gateway 26 collects statistics 132 and analyzes the statistics according to one or more of the algorithms 134a-134e described below. Other algorithms can be used. Several methods can be used separately or in combination to detect malicious traffic flows. For example, the gateway 26 can detect DoS attacks using at least one or more of the following methods including: analyzing packet ratios of TCP-like traffic; analyzing "repressor" traffic for particular types of normal traffic; performing TCP handshake analysis; performing various types of packet analysis at packet layers 3-7; and logging/historical analysis.
Packet ratios for TCP-like traffic 134a. The Transmission Control Protocol (TCP) is a protocol in which a connection between two hosts, a client C, e.g. a web browser, and a server S, e.g. a web server, involves packets traveling in both directions, between C and S and between S and C. When C sends data to S and S receives it, S replies with an ACK ("acknowledgement") packet. If C does not receive the ACK, it will eventually try to retransmit the data to S, to implement TCP's reliable delivery property. In general, a server S will acknowledge (send an ACK) for every packet or every second packet.
The monitoring process in the gateway 26 can examine a ratio of incoming to outgoing TCP packets for a particular set of machines, e.g. web servers. The monitoring process can compare the ratio to a threshold value. The monitoring process can store this ratio, time stamp it, etc. and conduct an ongoing analysis to determine over time for example how much and how often it exceeds that ratio. As the ratio grows increasingly beyond 2:1, e.g., up to about 3:1 or so, it is an increasing indication that the machines are receiving bad TCP traffic, e.g., packets that are not part of any established TCP connection, or that they are too overloaded to acknowledge the requests.
The monitoring process can monitor rates as bytes/sec and packets/sec rates of total, UDP, ICMP, and fragmented traffic in addition to TCP traffic. The thresholds are set manually by an operator. In some embodiments the device can provide a "threshold wizard" which uses historical data to help the user to set thresholds. An alternate implementation could automatically generate time-based thresholds using historical data.
The gateway 26 divides traffic into multiple buckets, e.g. by source network address, and tracks the ratio of ingoing to outgoing traffic for each bucket. As the ratio for one bucket becomes skewed, the gateway 26 may subdivide that bucket to obtain a more detailed view. The gateway 26 raises 90 a warning or alarm to the data center 24 and/or to the administrators at the victim site 12.
Another alternate implementation could combine thresholds with a histogram analysis, and trigger traffic characterization whenever a histogram for some parameter differed significantly (by a uniformity test, or for example, by subtracting normalized histograms) from the historical histogram. Repressor traffic 134b.
The phrase "repressor traffic" as used herein refers to any network traffic that is indicative of problems or a potential attack in a main flow of traffic. A gateway 26 may use repressor traffic analysis to identify such problems and stop or repress a corresponding attack.
One example of repressor traffic is ICMP port unreachable messages. These messages are generated by an end host when the end host receives a packet on a port that is not responding to requests. The message contains header information from the packet in question. The gateway 26 can analyze the port unreachable messages and use them to generate logs for forensic purposes or to selectively block future messages similar to the ones that caused the ICMP messages.
TCP handshake analysis 134c.
A TCP connection between two hosts on the network is initiated via a three-way handshake. The client, e.g. C, sends the server, e.g. S, a SYN ("synchronize") packet. S the server replies with a SYN ACK ("synchronize acknowledgment") packet. The client C replies to the SYN ACK with an ACK ("acknowledgment") packet. At this point, appropriate states to manage the connection are established on both sides.
During a TCP SYN flood attack, a server is sent many SYN packets but the attacking site never responds to the corresponding SYN ACKs with ACK packets. The resulting "half-open" connections take up state on the server and can prevent the server from opening up legitimate connections until the half-open connection expires, which usually takes 2-3 minutes. By constantly sending more SYN packets, an attacker can effectively prevent a server from serving any legitimate connection requests.
One type of attack occurs during connection setup. At setup the gateway forwards a SYN packet from the client to the server. The gateway forwards a resulting SYN ACK packet from a server to client and immediately sends ACK packet to the server, closing a three-way handshake. The gateway maintains the resulting connection for a variable timeout period. If the packet does not arrive from client to server, the gateway sends a RST ("reset") to the server to close the connection. If the ACK arrives, gateway forwards the ACK and forgets about the connection, forwarding subsequent packets for that connection. The variable timeout period can be inversely proportional to number of connections for which a first ACK packet from client has not been received. In a passive configuration, a cluster 26 can keep track of ratios of SYNs to SYN ACKs and SYN ACKs to ACKs, and raise appropriate alarms when a SYN flood attack situation occurs.
Layer 3-7 analysis 134d.
With layer 3-7 analysis, the gateway 26 looks at various traffic properties at network packet layers 3 through 7 to identify attacks and malicious flows. These layers are often referred to as layers of the Open System Interconnection (OSI) reference model and are network, transport, session, presentation and application layers respectively. Some examples of characteristics that the gateway may look for include: 1. Unusual amounts of IP fragmentation, or fragmented IP packets with bad or overlapping fragment offsets .
2. IP packets with obviously bad source addresses, or ICMP packets with broadcast destination addresses.
3. TCP or UDP packets to unused ports.
4. TCP segments advertising unusually small window sizes, which may indicate load on server, or TCP ACK packets not belonging to a known connection. 5. Frequent reloads that are sustained at a rate higher than plausible for a human user over a persistent HTTP connection.
The monitoring process determines the rates or counts of these events. If any of the rates/counts exceeds a particular threshold, the cluster device considers this a suspicious event and begins attack characterization process.
Several attack characterization processes can be used. One type in particular uses histograms to characterize the type of attack that was detected. Co- pending US Patent Application Serial No. Filed on , and entitled "DENIAL OF SERVICE ATTACKS CHARACTERIZATION", which is assigned to the assignee of the present invention and incorporated herein by reference.
Logging and historical traffic analysis 134e.
The gateways 26 and data collectors 28 keep statistical summary information of traffic over different periods of time and at different levels of detail. For example, a gateway 26 may keep mean and standard deviation for a chosen set of parameters across a chosen set of time-periods. The parameters may include source and destination host or network addresses, protocols, types of packets, number of open connections or of packets sent in either direction, etc. Time periods for statistical aggregation may range from minutes to weeks. The device will have configurable thresholds and will raise warnings when one of the measured parameters exceeds the corresponding threshold.
The gateway 26 can also log packets. In addition to logging full packet streams, the gateway 26 has the capability to log only specific packets identified as part of an attack (e.g., fragmented UDP packets or TCP SYN packets that are part of a SYN flood attack) . This feature of the gateway 26 enables administrators to quickly identify the important properties of the attack. Alternatively, a gateway 26 can tap a network line without being deployed physically in line, and it can control network traffic, for example, by dynamically installing filters on nearby routers. The gateway 26 would install these filters on the appropriate routers via an out of band connection, i.e. a serial line or a dedicated network connection. Other arrangements are of course possible.
Aspects of the processes described herein can use "Click, " a modular software router system developed by
The Massachusetts Institute of Technology's Parallel and Distributed Operating Systems group. A Click router is an interconnected collection of modules or elements used to control a router's behavior when implemented on a computer system. Other implementations can be used.
Other embodiments are within the scope of the appended claims .

Claims

What is claimed is:
1. A monitoring device disposed for thwarting denial of service attacks on the data center, the monitoring device comprising: a plurality of probe devices that are disposed to collect statistical information on packets that are sent between the network and the data center; a cluster head coupled to each of the plurality of probe devices, the cluster head receiving collected statistical information from the probe devices and determining from the collected information whether the data center is under a denial of service attack.
2. The device of claim 1 wherein the cluster head is coupled to the plurality of probe devices through a dedicated, private network.
3. The device of claim 2 wherein the cluster head further comprises: a communication process that communicates statistics collected in the probe devices with a control center, and that receives queries or instructions from the control center .
4. The device of claim 3 wherein the monitoring device is a gateway device and further comprises: a process to install filters to thwart denial of service attacks by removing network traffic that is deemed part of an attack.
5. The device of claim 1 wherein the probes are physically deployed in line in the network.
6. The device of claim 1 wherein the probes execute a joining process that allows a probe to join a cluster.
7. The device of claim 1 wherein the cluster head comprises a process to aggregate traffic from the various probes and to produce logs and apply detection heuristics.
8. A method of thwarting denial of service attacks on a victim data center coupled to a network comprises: monitoring network traffic through probes that are disposed between the victim data center and the network; and communicating data from the probes, over a dedicated network, to a cluster head device.
9. The method of claim 8 further comprising: communicating data from the cluster head device to a control center over a hardened network.
10. The method of claim 8 further comprising: analyzing network traffic statistics to identify malicious network traffic; and filtering network traffic, which is identified as malicious network traffic, during analyzing of the network traffic.
11. The method of claim 8 wherein the cluster head device and the probe devices comprise a clustered gateway.
12. The method of claim 11 wherein when a new cluster probe is added to the clustered gateway, the method further comprises: dynamically discovering the new cluster probe that seeks to join the cluster.
13. The method of claim 8 further comprising: performing intelligent traffic analysis and filtering to identify the malicious traffic and to eliminate the malicious traffic.
14. The method of claim 13 wherein performing intelligent traffic analysis is controlled by the cluster head and filtering is performed by the probes.
15. A gateway for thwarting denial of service attacks on a victim comprises: a cluster head; and a plurality of probes disposed between a network and a victim, the probes collecting statistical data, for performance of intelligent traffic analysis and filtering by the probed, to identify malicious traffic for thwarting denial of service attacks.
16. The gateway of claim 15 wherein the gateway includes a process to insert filters to discard packets that are deemed to be part of an attack.
17. A monitoring device disposed for thwarting denial of service attacks on the data center, the monitoring device comprising: a device that collects statistical information on packets that are sent between the network and the data center over a plurality of links and that produces statistical information from network traffic over the plurality of links to determine from the statistical information whether the data center is under a denial of service attack.
18. The monitoring device of claim 17 wherein the monitoring device is coupled to a control center through a hardened network.
19. The monitoring device of claim 17 wherein the device further comprises: a communication process that communicates statistics with a control center, and that receives queries or instructions from the control center.
20. The monitoring device of claim 17 wherein the monitoring device is a gateway device and further comprises : a process to install filters to thwart denial of service attacks by removing network traffic that is deemed part of an attack.
21. The monitoring device of claim 20 wherein the gateway comprises: a process to aggregate traffic from the various links and to produce logs and detection heuristics.
22. A method of thwarting denial of service attacks on a victim data center coupled to a network comprises: monitoring network traffic over a plurality of links between the victim data center and the network; and communicating data, over a hardened network, to a control center.
23. The method of claim 22 wherein monitoring is performed by probe devices that sample network traffic at a constant rate.
24. The method of claim 23 wherein the sampled network traffic by the probes is delivered to a clustered head for traffic analysis.
25. The method of claim 23 wherein the probes send the sampled network traffic to the cluster head at a substantially constant rate irrespective of traffic on the monitored network.
PCT/US2003/002441 2002-01-31 2003-01-28 Architecture to thwart denial of service attacks WO2003065155A2 (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
AU2003225533A AU2003225533A1 (en) 2002-01-31 2003-01-28 Architecture to thwart denial of service attacks

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US10/062,974 US7213264B2 (en) 2002-01-31 2002-01-31 Architecture to thwart denial of service attacks
US10/062,974 2002-01-31

Publications (2)

Publication Number Publication Date
WO2003065155A2 true WO2003065155A2 (en) 2003-08-07
WO2003065155A3 WO2003065155A3 (en) 2004-02-12

Family

ID=27610395

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/US2003/002441 WO2003065155A2 (en) 2002-01-31 2003-01-28 Architecture to thwart denial of service attacks

Country Status (3)

Country Link
US (1) US7213264B2 (en)
AU (1) AU2003225533A1 (en)
WO (1) WO2003065155A2 (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN100350769C (en) * 2004-01-14 2007-11-21 国际商业机器公司 Intrusion detection using a network processor and a parallel pattern detection engine

Families Citing this family (38)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7752665B1 (en) * 2002-07-12 2010-07-06 TCS Commercial, Inc. Detecting probes and scans over high-bandwidth, long-term, incomplete network traffic information using limited memory
WO2004071004A1 (en) * 2003-02-04 2004-08-19 Tracespan Communications Ltd. Non-intrusive modem performance analysis
US8640234B2 (en) * 2003-05-07 2014-01-28 Trustwave Holdings, Inc. Method and apparatus for predictive and actual intrusion detection on a network
US7397766B2 (en) * 2004-03-31 2008-07-08 Lucent Technologies Inc. High-speed traffic measurement and analysis methodologies and protocols
ES2547716T3 (en) 2004-04-14 2015-10-08 Mbalance Research B.V. Method to prevent the delivery of a junk message from the short message service
US20060037077A1 (en) * 2004-08-16 2006-02-16 Cisco Technology, Inc. Network intrusion detection system having application inspection and anomaly detection characteristics
US7937761B1 (en) * 2004-12-17 2011-05-03 Symantec Corporation Differential threat detection processing
US7774849B2 (en) * 2005-04-15 2010-08-10 Tekelec Methods, systems, and computer program products for detecting and mitigating denial of service attacks in a telecommunications signaling network
US8006285B1 (en) * 2005-06-13 2011-08-23 Oracle America, Inc. Dynamic defense of network attacks
US20070016767A1 (en) * 2005-07-05 2007-01-18 Netdevices, Inc. Switching Devices Avoiding Degradation of Forwarding Throughput Performance When Downloading Signature Data Related to Security Applications
US8266696B2 (en) * 2005-11-14 2012-09-11 Cisco Technology, Inc. Techniques for network protection based on subscriber-aware application proxies
US7610622B2 (en) * 2006-02-06 2009-10-27 Cisco Technology, Inc. Supporting options in a communication session using a TCP cookie
US9392009B2 (en) * 2006-03-02 2016-07-12 International Business Machines Corporation Operating a network monitoring entity
US8484733B2 (en) * 2006-11-28 2013-07-09 Cisco Technology, Inc. Messaging security device
CN101796774A (en) * 2007-09-03 2010-08-04 朗讯科技公司 Method and system for checking automatically connectivity status of an IP link on IP network
US8072894B2 (en) * 2007-11-07 2011-12-06 Juniper Networks, Inc. Systems and methods for flow monitoring
US8069471B2 (en) * 2008-10-21 2011-11-29 Lockheed Martin Corporation Internet security dynamics assessment system, program product, and related methods
JP6071809B2 (en) * 2013-08-30 2017-02-01 Kddi株式会社 Traffic analysis system, traffic analysis method, and computer program
US9306818B2 (en) * 2014-07-17 2016-04-05 Cellos Software Ltd Method for calculating statistic data of traffic flows in data network and probe thereof
US10721154B2 (en) 2015-06-12 2020-07-21 At&T Intellectual Property I, L.P. Virtual probes
US10601849B2 (en) * 2017-08-24 2020-03-24 Level 3 Communications, Llc Low-complexity detection of potential network anomalies using intermediate-stage processing
CN110110160B (en) 2017-12-29 2020-04-14 阿里巴巴集团控股有限公司 Method and device for determining data exception
US11010233B1 (en) 2018-01-18 2021-05-18 Pure Storage, Inc Hardware-based system monitoring
US10868828B2 (en) * 2018-03-19 2020-12-15 Fortinet, Inc. Mitigation of NTP amplification and reflection based DDoS attacks
US11720714B2 (en) 2019-11-22 2023-08-08 Pure Storage, Inc. Inter-I/O relationship based detection of a security threat to a storage system
US11520907B1 (en) 2019-11-22 2022-12-06 Pure Storage, Inc. Storage system snapshot retention based on encrypted data
US11657155B2 (en) 2019-11-22 2023-05-23 Pure Storage, Inc Snapshot delta metric based determination of a possible ransomware attack against data maintained by a storage system
US11651075B2 (en) 2019-11-22 2023-05-16 Pure Storage, Inc. Extensible attack monitoring by a storage system
US11720692B2 (en) 2019-11-22 2023-08-08 Pure Storage, Inc. Hardware token based management of recovery datasets for a storage system
US11687418B2 (en) 2019-11-22 2023-06-27 Pure Storage, Inc. Automatic generation of recovery plans specific to individual storage elements
US11615185B2 (en) 2019-11-22 2023-03-28 Pure Storage, Inc. Multi-layer security threat detection for a storage system
US11941116B2 (en) 2019-11-22 2024-03-26 Pure Storage, Inc. Ransomware-based data protection parameter modification
US11675898B2 (en) 2019-11-22 2023-06-13 Pure Storage, Inc. Recovery dataset management for security threat monitoring
US11625481B2 (en) 2019-11-22 2023-04-11 Pure Storage, Inc. Selective throttling of operations potentially related to a security threat to a storage system
US11755751B2 (en) 2019-11-22 2023-09-12 Pure Storage, Inc. Modify access restrictions in response to a possible attack against data stored by a storage system
US11645162B2 (en) 2019-11-22 2023-05-09 Pure Storage, Inc. Recovery point determination for data restoration in a storage system
US11341236B2 (en) 2019-11-22 2022-05-24 Pure Storage, Inc. Traffic-based detection of a security threat to a storage system
US11500788B2 (en) 2019-11-22 2022-11-15 Pure Storage, Inc. Logical address based authorization of operations with respect to a storage system

Citations (14)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5793753A (en) * 1996-09-17 1998-08-11 Coherent Communications Systems Corp. Telecommunications network management observation and response system
EP1079583A1 (en) * 1999-08-20 2001-02-28 International Business Machines Corporation Method and system for optimizing performance and availability of a dynamic host configuration protocol (DHCP) service
US6269401B1 (en) * 1998-08-28 2001-07-31 3Com Corporation Integrated computer system and network performance monitoring
US6282546B1 (en) * 1998-06-30 2001-08-28 Cisco Technology, Inc. System and method for real-time insertion of data into a multi-dimensional database for network intrusion detection and vulnerability assessment
US20020032774A1 (en) * 2000-09-07 2002-03-14 Kohler Edward W. Thwarting source address spoofing-based denial of service attacks
US20020032871A1 (en) * 2000-09-08 2002-03-14 The Regents Of The University Of Michigan Method and system for detecting, tracking and blocking denial of service attacks over a computer network
US20020032880A1 (en) * 2000-09-07 2002-03-14 Poletto Massimiliano Antonio Monitoring network traffic denial of service attacks
US20020035698A1 (en) * 2000-09-08 2002-03-21 The Regents Of The University Of Michigan Method and system for protecting publicly accessible network computer services from undesirable network traffic in real-time
US20020035683A1 (en) * 2000-09-07 2002-03-21 Kaashoek Marinus Frans Architecture to thwart denial of service attacks
US20020038339A1 (en) * 2000-09-08 2002-03-28 Wei Xu Systems and methods for packet distribution
US20020103886A1 (en) * 2000-12-04 2002-08-01 International Business Machines Corporation Non-local aggregation of system management data
US20020116491A1 (en) * 2000-09-01 2002-08-22 Boyd Eric L. Method and system for probing a network
US20030046577A1 (en) * 2001-08-31 2003-03-06 International Business Machines Corporation System and method for the detection of and reaction to computer hacker denial of service attacks
US6578147B1 (en) * 1999-01-15 2003-06-10 Cisco Technology, Inc. Parallel intrusion detection sensors with load balancing for high speed networks

Family Cites Families (42)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
GB9405406D0 (en) 1994-03-18 1994-05-04 Netcomm Ltd Atm cell switch
WO1997025801A1 (en) 1996-01-12 1997-07-17 International Business Machines Corporation Secure anonymous information exchange in a network
US6034945A (en) 1996-05-15 2000-03-07 Cisco Technology, Inc. Method and apparatus for per traffic flow buffer management
US5892903A (en) 1996-09-12 1999-04-06 Internet Security Systems, Inc. Method and apparatus for detecting and identifying security vulnerabilities in an open network computer communication system
US5886643A (en) 1996-09-17 1999-03-23 Concord Communications Incorporated Method and apparatus for discovering network topology
US5991881A (en) 1996-11-08 1999-11-23 Harris Corporation Network surveillance system
US5796942A (en) 1996-11-21 1998-08-18 Computer Associates International, Inc. Method and apparatus for automated network-wide surveillance and security breach intervention
US6108782A (en) 1996-12-13 2000-08-22 3Com Corporation Distributed remote monitoring (dRMON) for networks
US6167027A (en) 1997-09-09 2000-12-26 Cisco Technology, Inc. Flow control technique for X.25 traffic in a high speed packet switching network
US6061341A (en) 1997-12-16 2000-05-09 Telefonaktiebolaget Lm Ericsson (Publ) Use of transmission control protocol proxy within packet data service transmissions in a mobile network
US6088804A (en) 1998-01-12 2000-07-11 Motorola, Inc. Adaptive system and method for responding to computer network security attacks
US6442694B1 (en) 1998-02-27 2002-08-27 Massachusetts Institute Of Technology Fault isolation for communication networks for isolating the source of faults comprising attacks, failures, and other network propagating errors
US6279113B1 (en) 1998-03-16 2001-08-21 Internet Tools, Inc. Dynamic signature inspection-based network intrusion detection
US6738814B1 (en) 1998-03-18 2004-05-18 Cisco Technology, Inc. Method for blocking denial of service and address spoofing attacks on a private network
US6725378B1 (en) 1998-04-15 2004-04-20 Purdue Research Foundation Network protection for denial of service attacks
US6370116B1 (en) 1998-05-26 2002-04-09 Alcatel Canada Inc. Tolerant CIR monitoring and policing
US6304262B1 (en) 1998-07-21 2001-10-16 Raytheon Company Information security analysis system
US6807667B1 (en) 1998-09-21 2004-10-19 Microsoft Corporation Method and system of an application program interface for abstracting network traffic control components to application programs
US6308214B1 (en) 1998-09-23 2001-10-23 Inktomi Corporation Self-tuning dataflow I/O core
US6321338B1 (en) 1998-11-09 2001-11-20 Sri International Network surveillance
US6301668B1 (en) 1998-12-29 2001-10-09 Cisco Technology, Inc. Method and system for adaptive network security using network vulnerability assessment
US6487666B1 (en) 1999-01-15 2002-11-26 Cisco Technology, Inc. Intrusion detection signature analysis using regular expressions and logical operators
US6381649B1 (en) 1999-02-05 2002-04-30 Pluris, Inc. Data flow monitoring at a network node using periodically incremented counters for comparison to predetermined data flow thresholds
US6609205B1 (en) 1999-03-18 2003-08-19 Cisco Technology, Inc. Network intrusion detection signature analysis using decision graphs
US6678827B1 (en) 1999-05-06 2004-01-13 Watchguard Technologies, Inc. Managing multiple network security devices from a manager device
US6597661B1 (en) 1999-08-25 2003-07-22 Watchguard Technologies, Inc. Network packet classification
US6363489B1 (en) 1999-11-29 2002-03-26 Forescout Technologies Inc. Method for automatic intrusion detection and deflection in a network
US6389448B1 (en) 1999-12-06 2002-05-14 Warp Solutions, Inc. System and method for load balancing
US6597957B1 (en) 1999-12-20 2003-07-22 Cisco Technology, Inc. System and method for consolidating and sorting event data
US6775657B1 (en) 1999-12-22 2004-08-10 Cisco Technology, Inc. Multilayered intrusion detection system and method
US6816910B1 (en) 2000-02-17 2004-11-09 Netzentry, Inc. Method and apparatus for limiting network connection resources
US7039641B2 (en) 2000-02-24 2006-05-02 Lucent Technologies Inc. Modular packet classification
US6789203B1 (en) 2000-06-26 2004-09-07 Sun Microsystems, Inc. Method and apparatus for preventing a denial of service (DOS) attack by selectively throttling TCP/IP requests
US6353385B1 (en) 2000-08-25 2002-03-05 Hyperon Incorporated Method and system for interfacing an intrusion detection system to a central alarm system
US7278159B2 (en) 2000-09-07 2007-10-02 Mazu Networks, Inc. Coordinated thwarting of denial of service attacks
US7398317B2 (en) 2000-09-07 2008-07-08 Mazu Networks, Inc. Thwarting connection-based denial of service attacks
US7702806B2 (en) 2000-09-07 2010-04-20 Riverbed Technology, Inc. Statistics collection for network traffic
US7836498B2 (en) 2000-09-07 2010-11-16 Riverbed Technology, Inc. Device to protect victim sites during denial of service attacks
US20020032797A1 (en) * 2000-09-08 2002-03-14 Wei Xu Systems and methods for service addressing
WO2002023934A1 (en) * 2000-09-15 2002-03-21 Mspect, Inc. Wireless network monitoring
US6691213B1 (en) 2001-02-28 2004-02-10 Western Digital Ventures, Inc. Computer system and method for accessing a protected partition of a disk drive that lies beyond a limited address range of a host computer's BIOS
US7657934B2 (en) * 2002-01-31 2010-02-02 Riverbed Technology, Inc. Architecture to thwart denial of service attacks

Patent Citations (14)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5793753A (en) * 1996-09-17 1998-08-11 Coherent Communications Systems Corp. Telecommunications network management observation and response system
US6282546B1 (en) * 1998-06-30 2001-08-28 Cisco Technology, Inc. System and method for real-time insertion of data into a multi-dimensional database for network intrusion detection and vulnerability assessment
US6269401B1 (en) * 1998-08-28 2001-07-31 3Com Corporation Integrated computer system and network performance monitoring
US6578147B1 (en) * 1999-01-15 2003-06-10 Cisco Technology, Inc. Parallel intrusion detection sensors with load balancing for high speed networks
EP1079583A1 (en) * 1999-08-20 2001-02-28 International Business Machines Corporation Method and system for optimizing performance and availability of a dynamic host configuration protocol (DHCP) service
US20020116491A1 (en) * 2000-09-01 2002-08-22 Boyd Eric L. Method and system for probing a network
US20020032880A1 (en) * 2000-09-07 2002-03-14 Poletto Massimiliano Antonio Monitoring network traffic denial of service attacks
US20020035683A1 (en) * 2000-09-07 2002-03-21 Kaashoek Marinus Frans Architecture to thwart denial of service attacks
US20020032774A1 (en) * 2000-09-07 2002-03-14 Kohler Edward W. Thwarting source address spoofing-based denial of service attacks
US20020035698A1 (en) * 2000-09-08 2002-03-21 The Regents Of The University Of Michigan Method and system for protecting publicly accessible network computer services from undesirable network traffic in real-time
US20020038339A1 (en) * 2000-09-08 2002-03-28 Wei Xu Systems and methods for packet distribution
US20020032871A1 (en) * 2000-09-08 2002-03-14 The Regents Of The University Of Michigan Method and system for detecting, tracking and blocking denial of service attacks over a computer network
US20020103886A1 (en) * 2000-12-04 2002-08-01 International Business Machines Corporation Non-local aggregation of system management data
US20030046577A1 (en) * 2001-08-31 2003-03-06 International Business Machines Corporation System and method for the detection of and reaction to computer hacker denial of service attacks

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN100350769C (en) * 2004-01-14 2007-11-21 国际商业机器公司 Intrusion detection using a network processor and a parallel pattern detection engine

Also Published As

Publication number Publication date
US7213264B2 (en) 2007-05-01
WO2003065155A3 (en) 2004-02-12
AU2003225533A1 (en) 2003-09-02
US20030145231A1 (en) 2003-07-31

Similar Documents

Publication Publication Date Title
US7213264B2 (en) Architecture to thwart denial of service attacks
US7657934B2 (en) Architecture to thwart denial of service attacks
US7581023B2 (en) Architecture to thwart denial of service attacks
US7743415B2 (en) Denial of service attacks characterization
US7043759B2 (en) Architecture to thwart denial of service attacks
US7124440B2 (en) Monitoring network traffic denial of service attacks
US7278159B2 (en) Coordinated thwarting of denial of service attacks
US7743134B2 (en) Thwarting source address spoofing-based denial of service attacks
US7836498B2 (en) Device to protect victim sites during denial of service attacks
US7702806B2 (en) Statistics collection for network traffic
US7398317B2 (en) Thwarting connection-based denial of service attacks
US7301899B2 (en) Prevention of bandwidth congestion in a denial of service or other internet-based attack
US7359962B2 (en) Network security system integration
CN108063765B (en) SDN system suitable for solving network security
US8020207B2 (en) Containment mechanism for potentially contaminated end systems
US20040148520A1 (en) Mitigating denial of service attacks
US20040250158A1 (en) System and method for protecting an IP transmission network against the denial of service attacks
TW201124876A (en) System and method for guarding against dispersive blocking attacks
Agarwal et al. An infrastructure for passive network monitoring of application data streams
Zagar et al. IPv6 security threats and possible solutions
Strother Denial of service protection the nozzle
Algamdi et al. Intrusion Detection in Critical SD-IoT Ecosystem
de Andrade An Efficient Intrusion Detection System for Networks with Centralized Routing
Agarwal et al. An infrastructure for passive network monitoring of application data

Legal Events

Date Code Title Description
AK Designated states

Kind code of ref document: A2

Designated state(s): AE AG AL AM AT AU AZ BA BB BG BR BY BZ CA CH CN CO CR CU CZ DE DK DM DZ EC EE ES FI GB GD GE GH GM HR HU ID IL IN IS JP KE KG KP KR KZ LC LK LR LS LT LU LV MA MD MG MK MN MW MX MZ NO NZ OM PH PL PT RO RU SD SE SG SK SL TJ TM TN TR TT TZ UA UG US UZ VN YU ZA ZM ZW

AL Designated countries for regional patents

Kind code of ref document: A2

Designated state(s): GH GM KE LS MW MZ SD SL SZ TZ UG ZM ZW AM AZ BY KG KZ MD RU TJ TM AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HU IE IT LU MC NL PT SE SI SK TR BF BJ CF CG CI CM GA GN GQ GW ML MR NE SN TD TG

121 Ep: the epo has been informed by wipo that ep was designated in this application
DFPE Request for preliminary examination filed prior to expiration of 19th month from priority date (pct application filed before 20040101)
122 Ep: pct application non-entry in european phase
NENP Non-entry into the national phase

Ref country code: JP

WWW Wipo information: withdrawn in national office

Country of ref document: JP