Processing...
All posts tagged with: "Outage"

When the Kill Shot is All of Us: Anatomy of a Fortnite Outage

Posted by on July 30th, 2018
July 30th, 2018

A few months back, on March 18th, some users connecting to Fortnite: Battle Royale would have experienced first a total outage, then significant performance degradation, lasting over a course of about thirty minutes. The cause of the outage wasn’t due to an application issue, or even network performance. In this case it was caused by instability of advertised Internet routes — also known as BGP route flapping.… Read More »

Comcast Fiber Outage Rips the Internet

Posted by on June 29th, 2018
July 2nd, 2018

Earlier today, beginning at 9:20am Pacific Time, Comcast suffered a network outage on its backbone that left millions of Internet users in the United States—even beyond their own subscriber base—unable to reach critical sites and services. The outage wasn’t contained to a particular region, as Internet users from Seattle to New York were affected. The significance of this outage was not only in its massive scope but also in its length, which stretched for nearly three hours—effectively an eternity in Internet timescale.… Read More »

AWS US-East-2 Outage and Monitoring Microservices

Posted by on May 31st, 2018
May 31st, 2018

On the morning of May 31st, 2018, shortly after midnight Pacific Time, users reported an outage in Amazon Web Services’ (AWS) US-East-2 region. An issue with Internet connectivity caused this data center to lose reachability to the Internet, impacting the functioning of any apps with external dependencies such as API services and integration with 3rd party SaaS applications.… Read More »

Network Monitoring to Measure CDN Performance

Posted by on May 2nd, 2018
May 2nd, 2018

Content Delivery Networks (CDNs) have become the architectural cornerstone of network design for enterprises looking to deliver fast and highly available digital experience to their customers. When you rely on a third-party service, like a CDN, to deliver business critical services, it is crucial to continuously monitor their performance and SLA commitments. Because when any one of the cogs in your well oiled digital experience machine fails, your business fails.… Read More »

Anatomy of a BGP Hijack on Amazon’s Route 53 DNS Service

Posted by on April 24th, 2018
April 24th, 2018

How does one steal crypto-coins? By hacking DNS and BGP – the two cornerstone protocols governing the Internet. With any cryptographic system, one way to compromise it is to be a man in the middle (MITM) when a transaction is taking place. Both ends of the transaction believe they’re talking to a legitimate party at the other end, but in reality, a malicious actor sits in the middle and alters the information being passed through to their advantage. In case of cryptocurrency, it could be the public key of the transfer recipient. … Read More »

Amazon AWS Outage a Lesson in Managing Cloud First Risks

Posted by on March 2nd, 2018
March 6th, 2018

On Friday, March 2nd, 2018, a power outage hit the AWS-East Region (Ashburn), affecting hundreds of critical enterprise services like Atlassian, Slack and Twilio. Significant corporate websites and Amazon’s own service offerings were impacted as well. ThousandEyes operates a global set of software agents performing Internet-aware network monitoring. We were able to catch this outage in the act, which rippled very quickly outward towards other services. Even customers relying on Amazon private connectivity service known as AWS Direct connect were affected.… Read More »

How GitHub Successfully Mitigated a DDoS Attack

Posted by on March 1st, 2018
March 5th, 2018

On Wednesday, February 28th, 2018 at 9:15am Pacific Standard Time, GitHub, the popular web-based hosting service for software development, was a victim of a powerful DDoS attack that impacted its global user base of 20M. It was one of the largest DDoS attacks, with attack traffic peaking at 1.3Tbps. Concerned users, some who were in the midst of a code check-in, took to Twitter to express their feelings while simultaneously looking for answers. Unfortunately for GitHub, their status page was also affected, adding a bit of anxiety to the equation.… Read More »

Comcast Suffers Outage Due to Significant Level 3 BGP Route Leak

Posted by on November 7th, 2017
November 8th, 2017

On Monday morning, November 6th 2017, from 9:45am-11:25am Pacific, Comcast suffered a nationwide outage sending several million users of the popular Internet Service Provider into a frenzy. Our analysis has revealed that Level 3 leaked over a thousand routes belonging to Comcast subsidiary networks and their customers. The immediate effect was that instead of traffic going through the Comcast backbone to reach these networks, traffic was forced to go via Level 3.… Read More »

How to Analyze a DDoS Attack on DNS Infrastructure

Posted by on June 23rd, 2016
November 10th, 2017

On May 16th, 2016, NS1, a DNS and traffic management vendor, was a victim of a widespread DDoS attack that affected a number of prominent websites and services, including Yelp and Alexa. The DDoS attack was broadly targeted at NS1, affecting their DNS infrastructure, the hosting provider of their website and other online-facing assets.… Read More »