šŸ“š node [[the 2014 internet peering playbook]]
  • Author:: [[William B. Norton]]
  • Full Title:: The 2014 Internet Peering Playbook
  • Category:: [[books]]
  • Highlights first synced by [[readwise]] [[September 2nd, 2020]]

    • Definition: Internet Transit is the business relationship whereby an Internet Service Provider provides (usually sells) access to the global Internet. (LocationĀ 292)
    • Definition: An Internet Service Provider (ISP), also called a ā€œTransit Provider,ā€ is an entity that provides (usually sells) access to the Internet. (LocationĀ 297)
    • The Internet Transit service has two primary functions: 1. to announce Internet routes to the customer, and 2. to announce the customer routes to the rest of the Internet (LocationĀ 302)
    • Definition: The 95th Percentile Measurement Method (also (LocationĀ 332)
      1. Every 5 minutes the meter on the service is sampled. 2. The delta is calculated between the two adjacent samples and the result is stored. (It is in this step that corrections are made for wrapped counters, counter resets from reboots, anomalies in the measurement on the metering device, etc.) 3. At the end of the month, the 5-minute deltas are converted into Mbps and stacked lowest to highest. It is the 95th percentile value that is used to calculate the traffic volume for the month. (LocationĀ 337)
    • The 95th percentile measurement uses the greater of in versus out, as shown in the following equation: (LocationĀ 375)
    • You will pay for the cost of getting there, but the open-market effect may result in transit pricing 30% or more lower than if the transit provider has to build into your location. (LocationĀ 634)
      1. Both content and eyeball networks pay you. Scenario #3 is the best-case scenario since you are being paid by your eyeball customers to reach content that you are also being paid to deliver. You are being paid on both sides and simultaneously reducing your transit fees. The only costs are the costs of the infrastructure to carry this traffic across your network. Economists call this scenario a ā€œtwo-sidedā€ market. (LocationĀ 739)
    • Internet Peering is a local routing optimization, (LocationĀ 845)
    • Definition: Internet Peering is the business relationship whereby two companies reciprocally provide access to each otherā€™s customers. (LocationĀ 890)
    • the dominant form of peering is settlement-free. (LocationĀ 899)
    • Internet Peering is not a transitive relationship. The fact that WestNet is peering with MidNet and MidNet is peering with EastNet does not imply that EastNet customers can reach WestNet customers. (LocationĀ 929)
    • Internet Peering is not a perfect substitute for Internet Transit. (LocationĀ 933)
    • Internet Peering is typically settlement-free, (LocationĀ 936)
      1. Transit costs are reduced. (LocationĀ 942)
    • If the cost of exchanging traffic in peering relationships is less than the cost of sending that traffic through a transit service, then peering can be proven to be a financially rational decision. (LocationĀ 945)
      1. End-user experience is better. (LocationĀ 952)
    • Transit usually provides a more circuitous path than peering (LocationĀ 953)
      1. Control over routing is strategic. (LocationĀ 961)
    • the end-user experience was the primary driver for peering, and that control over routing was the means to accomplish a good end-user experience. (LocationĀ 969)
      1. Traffic billing is usage-based. (LocationĀ 974)
    • ISPs Make More Money by Peering Dave Rand first highlighted this effect, and conversations with European ISPs showed increasing adoption of the usage-based billing model. (LocationĀ 980)
      1. ISPs enjoy marketing benefits. (LocationĀ 983)
    • ā€¢ Phase 1 ā€“ Identification of Peering Target ā€¢ Phase 2 ā€“ Contact, Qualification, and Peering Negotiation ā€¢ Phase 3 ā€“ Peering Implementation (LocationĀ 995)
    • ISPs determine where their traffic is going to and coming from. They are looking for peering partners that should be similarly incentivized to directly interconnect their network, to save money, to improve performance, etc., (LocationĀ 1004)
    • Finding the right person to speak with at the target ISP is more difficult than you might expect; in fact, it is a time-intensive process. (LocationĀ 1032)
    • The top 10 ways seasoned peering coordinators contact target ISPs follow: (LocationĀ 1039)
    • Traffic volume is often a key determinant. As a rule, the decision hinges upon whether or not there is sufficient value from peering to justify spending time and money. A Bilateral Peering Agreement (BLPA) is the legal form that details each partyā€™s understanding of acceptable behavior, and it legally defines the arms-length (loosely coupled) relationship that each side agrees to. (LocationĀ 1098)
    • Regional interconnection has two dominant forms: The Direct-Circuit Peering model and the Internet Exchange Point peering model. (LocationĀ 1107)
    • Definition: Direct-Circuit Peering is peering using a point-to-point circuit. (LocationĀ 1110)
    • The Direct-Circuit Peering cost model scales linearly; the more interconnections one has, the more it costs to interconnect. (LocationĀ 1135)
    • Definition: An Internet Exchange Point (IXP) is a place where multiple ISPs interconnect their networks together (LocationĀ 1140)
    • Transport fees for getting the traffic to the exchange point ā€¢ Colocation fees ā€¢ Equipment expenses ā€¢ Peering port fees on the exchange point shared fabric (LocationĀ 1159)
    • Definition: Transport Fees refer to the monthly recurring expenses associated with a physical/data link layer media interconnection into a peering location. (LocationĀ 1169)
    • Unlike transit service, transport is not metered; it is sold as a fixed-capacity circuit that costs the same regardless of the amount of traffic exchanged over it. (LocationĀ 1171)
    • Definition: A Colocation Facility refers to a specialized data center that houses telecommunications equipment for multiple network operators. (LocationĀ 1181)
    • Definition: Colocation Fees are the expenses paid to the colocation facility operator for housing the telecommunications equipment and facilitating interconnections. (LocationĀ 1184)
    • Not only do colocation facilities provide the operations environment necessary for the equipment, but the better ones also make it easy and cost-effective for their population to interconnect with each other. They understand their customersā€™ businesses and seek to establish and grow a community of participants. A handful of these colocation centers provide much more than space, power, and cross-connects. They facilitate peering. (LocationĀ 1186)
    • Definition: Equipment Fees are the amortized costs of the networking equipment used for Internet Peering. (LocationĀ 1190)
    • Definition: Peering Port Fees are the monthly recurring costs associated with peering across a shared peering fabric. (LocationĀ 1195)
    • For the cost of the interconnection, both parties can then send and receive as much traffic as can fit across the transport circuit and peering fabric. (LocationĀ 1199)
    • Definition: Private Peering is peering across a dedicated layer 2 circuit between exactly two parties, typically using a fiber cross-connect or a VLAN between two parties at an IXP. (LocationĀ 1204)
    • In the U.S. the Private Peering cross-connects are run by the colocation provider with a nominal (~$300/month) recurring monthly charge. (LocationĀ 1212)
    • Definition: Public Peering is peering across a shared fabric such as an Ethernet switch. Public Peering is the dominant method of peering in the peering ecosystems we studied, (LocationĀ 1220)
    • Peering makes sense when it is cheaper to send traffic to peers than through a transit provider. (LocationĀ 1230)
    • Definition: A Paid Peering relationship is a peering relationship with an exchange of compensation from one party to the other (LocationĀ 1234)
    • When does peering become Paid Peering? My litmus test: If the peering is not a settlement-free and no-strings-attached peering relationship, then it is Paid Peering. (LocationĀ 1241)
    • Paid Peering for Cash. (LocationĀ 1247)
    • Why would you pay the market transit price when you receive only the Comcast routes? Peering generally provides a better performing path to the eyeballs, and if it costs the same and performs better, why wouldnā€™t you prefer to buy Paid Peering? (LocationĀ 1249)
    • Paid Peering via Barter. (LocationĀ 1252)
    • Paid Peering via Bundling/Barter. (LocationĀ 1255)
    • The Peering Break-Even Point answers the question, ā€œHow much traffic do I have to peer for free to save enough money to cover the cost of peering?ā€ (LocationĀ 1333)
    • The Effective Peering Bandwidth answers the question, ā€œWhat is the maximum amount of traffic I can realistically push through the peering infrastructure?ā€ ā€¢ The Effective Peering Range answers the question, ā€œWhere is the peering sweet spot ā€“ the peering bandwidth range where peering is financially rational?ā€ ā€¢ The Minimum Cost for Traffic Exchange answers the question, ā€œWhat is the best possible unit cost for peering?ā€ (LocationĀ 1336)
    • Definition: The Effective Peering Bandwidth is the maximum amount of traffic that can be safely transported (without packet loss) across peering infrastructure. (LocationĀ 1387)
    • The first thing to point out is that the ISPs generally have the following goals with respect to setting up peering: ā€¢ Get peering set up as soon as possible ā€¢ Minimize the cost of the interconnection and transit costs ā€¢ Maximize the benefits of a systematic approach to peering ā€¢ Execute the regional operations plan as strategy dictates ā€¢ Fulfill obligations of a larger business arrangement (LocationĀ 1461)
      1. How will I get transport into the IXP? (Telecommunications access) 2. How will I get equipment into the IXP? (Ease of deployment) 3. Am I and my target peer both in the IXP already? (Current presences) 4. How easy will it be for me to operate at the IXP? (Operations support) 5. Will a competitor benefit from my participation at the IXP? (Business alignment) 6. How much will it cost to peer at the IXP? (Cost issues) 7. Will the IXP be successful? (Credibility issues) 8. Whom else can I peer with at the IXP? (Exchange population issues) 9. Does the IXP exist today? (Existing vs. new IXP?) 10. What routes will I pick up at the IXP? (Regional route strength) (LocationĀ 1474)
    • Access into the IXP data center is one of the most important issues that peers explore when selecting an IXP. (LocationĀ 1535)
    • This fact may seem obvious, but ISPs tend to prefer to peer at IXPs where one or both ISPs are already present. (LocationĀ 1561)
    • A network can easily aggregate a large number of relatively small peering sessions across a single fixed-cost peering port, with zero incremental cost for each peer. (LocationĀ 1727)
    • Public Peering Administration Is Easier. (LocationĀ 1742)
    • It is common for a network to set up a trial peering session to determine the amount of traffic that would be exchanged should a session be turned up. (LocationĀ 1746)
    • Definition: The Global Internet Peering Ecosystem is the set of loosely coupled Internet Regions, each of which contains an autonomous Internet Peering Ecosystem. (LocationĀ 2015)
    • Definition: An Internet Region is a portion of the Internet contained within the boundaries of a country. (LocationĀ 2021)
    • Definition: The Internet Peering Ecosystem is the collection of Internet services providers that interconnect their networks in various business relationships within an Internet Region. (LocationĀ 2043)
    • Definition: A Tier 1 ISP is an ISP that has access to the entire Internet Region routing table only through its settlement-free peering relationships. (LocationĀ 2058)
    • Tier 1 ISPs are not motivated to peer with anyone else to reduce the cost of transit since, by definition, Tier 1 ISPs donā€™t pay for transit. (LocationĀ 2106)
    • Definition: A Peering Inclination is a predisposition towards or against peering in a particular Internet Peering Ecosystem. (LocationĀ 2126)
    • Definition: A Peering Policy is an articulation of the Peering Inclination; it documents and defines (for others) the prerequisites to peering. (LocationĀ 2128)
    • Definition: A Restrictive Peering Policy is an articulation of an inclination not to peer with any more entities. (LocationĀ 2166)
    • Definition: A Tier 2 ISP is an Internet Service Provider that purchases transit to reach some destination(s) within an Internet Region. (LocationĀ 2219)
    • The basic Content Provider does not peer. A separate type of Content Provider, called a ā€œLarge-Scale Network-Savvy Content Provider,ā€ has a strong network engineering team and does peer. (LocationĀ 2272)
    • Definition: Content Providers are companies that operate an Internet-based service but do not sell transit within the Internet Peering Ecosystem. (LocationĀ 2274)
    • Definition: A Large-Scale Network-Savvy Content Provider (LSNSCP) is a content provider that sees networking as strategic enough to build a backbone and peer. (LocationĀ 2399)
    • Examples of these Large-Scale Content Players are Yahoo!, Google, Microsoft, Amazon, Walmart.com, Apple, Electronic Arts, and Sony Online. (LocationĀ 2430)
    • The Access Power Peering scenario however is problematic in that it leverages the lack of alternative paths to the eyeballs. (LocationĀ 2637)
    • ā€œBro-lo,ā€ (LocationĀ 3183)
    • real estate to house the gear ā€¢ security infrastructure to prevent unauthorized access to the equipment ā€¢ reliable power infrastructure to make sure the gear continues to operate even when utility power fails ā€¢ Heating, Venting, and Air Conditioning (HVAC) systems to keep the equipment within its operating range ā€¢ data center operations staff to monitor and manage the operations environment in the data center (LocationĀ 3513)
    • Gallery 12-3. Colocation facilities are being built to support the nationwide fiber plants being incrementally built across the U.S. (LocationĀ 3546)
    • Since fiber often runs along preexisting rights-of-way along railroad tracks, real estate that opens up near these locations often comes up as key IDC locations. (LocationĀ 3556)
      1. Fiber. Ideal sites will be near or on fiber paths, or within a couple miles of dark fiber and telephone company Points of Presences (POPs). (LocationĀ 3562)
      1. Size, floor loading, configuration, expandability. Sites must be large enough to support the intended operations, with floor loading sufficient for the equipment expected. (LocationĀ 3575)
    • Definition: Carriers are layer 2 transport providers. (LocationĀ 3907)
    • Definition: A Carrier POP is space within a carrier data center that is operated solely for the use of the carrier itself. (LocationĀ 3915)
    • Definition: A Carrier Hosting Facility is space within a carrier data center that is purpose-built for the use of hosting the carrier and its customers. (LocationĀ 3921)
    • Definition: A Carrier-Neutral Data Center is a data center that is neither owned nor operated by a company that offers carrier services. (LocationĀ 3926)
    • Definition: An Internet Data Center is a data center with Internet access. (LocationĀ 3985)
    • Definition: An ISP POP is space within a data center operated by an ISP that is solely for the use of the ISP itself. (LocationĀ 3995)
    • Definition: An ISP Hosting Facility is space within a data center that is operated by an ISP providing conditioned space and power along with Internet Transit services for its customers. (LocationĀ 4001)
    • Definition: Remote Peering (aka ā€˜tetheringā€™)is peering without oneā€™s own physical presence at the peering point. (LocationĀ 5134)
    • Definition: A Remote Peering Provider is an entity that sells access to exchange points across their transport infrastructure. (LocationĀ 5137)
    • I believe the video ecosystem will require wider distribution across many more peering points, perhaps helping to establish the viability for many more IXPs across the Tier 2 and Tier 3 cities. (LocationĀ 5883)
Receiving pushes... (requires JavaScript)
Loading context... (requires JavaScript)