You are on page 1of 84

BGP Best Practices for ISPs

Prefix List, AS PATH filters, Bogon Filters, Anycast, Mailing Lists, INOC DBA


Gaurab Raj Upadhaya
Packet Clearing House

What are Best Practices
 Established or known good ways of
doing things.
 Being a good Internet citizen.
 Trying TO restrict damage to your
network and FROM you network
 A lot of RFCs devoted on different BCP,
but here we’ll just cover a few topics

BGP Security

Protocols are vulnerable
 Routing protocols, like BGP, OSPF can
be attacked and weakness exploited
 False Information
 Man-in-middle situation
 Denial of service
 Routing Conditions

BGP Security Issues  Prefix Lists  Why. How and Where  Prefix Lists  Customers  Peers  Upstream  Protocol Authentication  MD5  BGP BCP  Bogons .

Why Prefix Filter? .

. we don't do prefix-filters AS1 AS2 We are not happy We are happy with our provider with our provider AS65535 AS65534 . we can make mistakes AS101 We do filters AS1 We are AS1. We are new ISP. learning how to do BGP.

Let's see how we can do BGP. we don't do prefix-filters. I see wrong ?. my traffic no problems not going to this /8 AS65534 5 AS65534 . and may be a /8 AS101 Woo!! no effect AS1 We are AS1. so we will send the garbage through to peers and customers AS1 AS2 Ouch ! something Which /8. we'll announce our prefixes all in /24s.

 Garbage in – Garbage out.  Frequent Messages on IXes mailing list about hitting max prefix limits. . It's REAL. this happened with AS 7007 - which was the most visible of all. does happen  In 1997.

So. what should we do ?  Don't send Junk  Filter your own advertisement  Filter your customers  Don't Accept Junk  Filter your customers  Filter your peers  Help Others mitigate impact .Net Police  Help others and they'll help you .

Prefix Filter .How .

widely used.easy to use. highly scalable Distribute list is now considered obsolete  Two filtering techniques:  Explicit Permit (permit then deny any)  Explicit Deny (deny then permit any) . BGP Prefix Filtering  Two ways to implement prefix filtering:  Prefix list . not highly scalable  AS-PATH .

0/8 le 32 ip prefix-list rfc1918 deny 10.0/8 le 32 ip prefix-list rfc1918 deny le 32 ip prefix-list rfc1918 deny BGP Route Filtering Prefix-List example ip prefix-list rfc1918 deny 0.0/16 le 32 ip prefix-list rfc1918 deny 224.0/0 le 32 .0/12 le 32 ip prefix-list rfc1918 deny le 32 ip prefix-list rfc1918 permit le 32 ip prefix-list rfc1918 deny le 32 ip prefix-list rfc1918 deny 192.

231.231.200 prefix-list rfc1918 in neighbor prefix-list rfc1918 out no auto-summary ! .210 prefix-list rfc1918 in neighbor 198. BGP Filtering Applying the previous prefix-list to peers router bgp 65564 no synchronization neighbor remote-as 65200 neighbor 198.231.210 remote-as 65210 neighbor prefix-list rfc1918 out neighbor 198.

Using AS-PATH filters .

32.12.231. can use regular expressions  Example Configuration: router bgp 65564 network mask 255.32.200 filter-list 200 in ! ip as-path access-list 1 permit ^65564$ ip as-path access-list 200 permit ^65200$ . Using AS-PATH filters  Filter routes based on AS path  Applied same way as prefix-list filters  AS-PATH syntax is different.0.200 remote-as 65200 neighbor 198.200 filter-list 1 out neighbor 198.231.0 neighbor 198.

Regular Expressions • Most router OS uses Unix regular expressions . end. brace | Or () brackets to contain expression . white-space. Match one character * Match any number of preceding expression + Match at least one of preceding expression ^ Beginning of line $ End of line _ Beginning.

Regular Expressions examples  Examples .+
 match at least one character ^$
 match routes local to this AS _3856$

 originated by AS3856 ^3856_

 received from AS3856 _3856_

 via AS3856 _3856_42_
 via AS3856 and AS42 _(3856_)+
 multiple AS3856 in sequence
 (used to match AS-PATH prepends) .*
 match anything .


 Match anything of origin AS42 
 and passed through AS2914 . Regular Expressions examples • Complex Examples ^[0-9]+$
 Match AS_PATH length of one ^[0-9]+_[0-9]+$

 Match AS_PATH length of two ^[0-9]*_[0-9]+$
 Match AS_PATH length of one or two ^[0-9]*_[0-9]*$
 Match AS_PATH length of one or two 
 (will also match zero) ^[0-9]+_[0-9]+_[0-9]+$
 Match AS_PATH length of three _(3856|42)_
 Match anything which has gone 
 through AS42 or AS3856 _2914(_.

Where to Prefix Filter? .

Where to Prefix Filter? "Customers "Ingress / Egress Filter to / from upstream "Upstream "Ingress / Egress AS101 "Use default if Customer s single homed Filter Peers AS1 "Peers Peers Customer s "Ingress and AS2 AS1 Egress at all points of Upstream peering Upstream Filter filter upstrea Upstream only default m AS65535 AS65534 .

What to Prefix Filter? Special Use Addresses (RFC3330) and Bogons .

Special Use Addresses  There are routes that should NOT be routed on the Internet  RFC 1918 and “Martian” networks  127.txt  BGP should have filters applied so that these routes are not advertised to or propagated through the Internet .org/rfc/rfc3330.0.rfc-editor.0.0/8 and multicast blocks  Certain RFC3330 addresses: 

0.0/8 and 0.0.0/8—Host loopback  192.0/12.0.2. and—Default and broadcast  127. 172.0/24—TEST-NET for documentation  10.0.0/16—End node auto-configuration .0.0. Special Use Addresses  Quick review — RFC 1918 private addresses 

0.0/16 le 32 ip prefix-list deny-sua deny le 32 ip prefix-list deny-sua deny 10.0.0/8 le 32 ip prefix-list deny-sua deny Special Use Addresses ip prefix-list deny-sua deny 0.0.0/3 le 32 ip prefix-list deny-sua deny 0.0.0/16 le 32 ip prefix-list deny-sua deny 172.0/0 ge 25 ip prefix-list deny-sua permit 0.0.0/0 le 32 .0/24 le 32 ip prefix-list deny-sua deny le 32 ip prefix-list deny-sua deny 169.0/12 le 32 ip prefix-list deny-sua deny

org/assignments/ipv4-address-space  Only these blocks of IPv4 addresses should be visible and used on the Internet.  Filters should be applied on Ingress / Egress of your AS for all other address range .iana. Bogons  IANA publishes the list of IP Address that have been assigned to RIRs and end-users  http://www.  Not all IP Address are allocated by IANA  Few are not to be used on the public internet (RFC 1918)  Few blocks are reserved (> 223/8 )  The IP Address that are not supposed to be seen on the Internet are known as ‘Bogons’.255. sometime also referred to as “Martian” .0 to 255. The range is  0. Bogons  The IP Address is 32 Bits.

ISPs should not route them  Many DoS attacks originate from these unallocated address blocks. afnog etc. so it’s also good security  ISPs can get the bogons list from IANA and set up their prefix filters to route traffic  When new address is assigned. generally the announcements are sent far and wide on many different mailing lists (eg. apops. Bogons  To be a good Internet citizen.)  Same procedure is also applied for IPv6 address space . nanog. sanog.

good idea for RFC1918 space  ip route 192.0.x prefix-list bogons  ip prefix-list bogons seq 5 deny 10.x. Router Configuration  This is how you configure your Cisco routers in your networks  Static Route to Null0.0 mask 255.0/0 le 32 .0/0 le 32  ip prefix-list bogons seq 10 deny null0  BGP prefix-list for Unallocated blocks  neighbor x.

new people start managing the network  New engineers may have no clue on why those configurations are in there  The network is working. so let’s leave it there triumphs over further digging . Router Configuration  The problem with the static configuration is many fold  The Bogons list keeps on changing  People move into new jobs.

 You can run a BGP session with the Bogon route server  You receive the bogons list through BGP. There are four Bogons Route Server. Bogon Route Server Project  Thus. the Bogon Route Server Project  Provides bogons over a eBGP Multihop session. Connecting to at least two is recommended. then you can either  Either set the next-hop for the bogons to a static IP address and help in research work  Or set the next-hop for the bogons to a static IP address that is statically routed to Null0 .

x.x.x.x remote-as 65333 
 neighbor x.x.x.x.255.x.x.255 null0 !
 ip community-list 10 permit 65333:888 ! route-map CYMRUBOGONS permit 10 
 description Filter bogons learned from cymru.x description <your description> 
 neighbor bogon route-servers 
 match community 10 .x prefix-list cymru-out out 
 neighbor password <your password> 
 neighbor x.x.255.x.x ebgp-multihop 255 
 neighbor x.html router bgp <your asn> 
 neighbor x.x.x.x.x maximum-prefix 100 threshold 90 ! ip bgp-community new-format ! ip route 192.x route-map CYMRUBOGONS in 
 neighbor x.x. Configuring Routers for Bogon RS  Full Details are available at http://www.

if you have one (not mandatory)  The session is set up through eBGP multihop with a private you should include the following information in your email:  Your AS number  The IP address(es) you want to use for peering  If your equipment support MD5 passwords for BGP sessions?  Your PGP/GPG public key.  contact team-cymru@cymru. Your router must at least support these requirements. How do I set up the peering ?  To peer with the Bogon Route Server. .  When requesting a peering session. It currently has 95 prefixes.

you can also take a look at the secure Router Configuration Template  You’ll find loads of useful information for ISPs and Network people there .cymru. Team Cymru  The bogon list is maintained by the Team Cymru (  While you are at the Team Cymru website.

Prefix Filters on Customers .

Prefix Filters on Customers  Apply prefix filters on all your customers! AS101 AS1 AS2 AS1 AS65535 AS65534 Peers ISP Customer .

g  If the RIR has assigned 202.0/19 to your customer.  E. if required .224. accept only that from it  If your customer is mulihomed. Customer Prefixes  Service Providers should only accept assigned or allocated prefixes from their downstream peer/customer. then accept specific prefix assigned to them by the other ISP.52.

0.201 remote-as 201 neighbor 198.32. Receiving Customer Prefixes  Configuration example on upstream: router bgp 65534 neighbor 198.32.0/20 ip prefix-list CUSTOMER-AS201 deny prefix-list CUSTOMER-AS201 in ! ip prefix-list CUSTOMER-AS201 permit 201.0/0 le 32 .0.

Prefixes to Peers .

Prefixes to Peers  Apply prefix filters. AS-PATH filters to AS101 your peers! AS1 AS2 AS1 AS65535 AS65534 Peers ISP Customer .

 Bogons – assume garbage will leak into your iBGP.  Prefixes longer than /24.  Customer's Provider Independent (PI) prefixes  More specific customers prefixes (customers who are multihoming)  What do you not send to other network?  RFC3330 Prefixes – assume junk will leak into your iBGP. Prefixes to Peers  What do you announce to other networks?  Your prefixes. i. /25 to /32 .e.

 Specific blocks from other ISPs  AS-PATH filters are more scalable  Peer Mailing lists generally send updates about new downstream prefixes . Egress Filter to Peers  The egress prefix list can grow to be very large:  More specifics for customers.

Ingress Prefix Filtering from Peers .

Prefixes from Peers  Filter all routes from your peers! AS101 AS1 AS2 AS1 AS65535 AS65534 Peers ISP Customer .

full routes are not required. Filtering Ingress Routes  Peers and Upstream provide access to the Internet routes  Ingress filters with Peers  The peering policy should have requirements so that filters can be built  Max Prefix limit are important  Ingress filters with Upstream  Unless you multihome. accept only default .

Best Practices for ingress filters  Don’t accept RFC1918 etc prefixes  Don’t accept your own prefix  Don’t accept default (unless you need it)  Don’t accept prefixes longer than /24  Consider Net Police Filtering .

Ingress example - Cisco IOS
router bgp 65534
network mask
neighbor remote-as 201
neighbor prefix-list in-filter in
ip prefix-list in-filter deny ! Block default
ip prefix-list in-filter deny le 32
ip prefix-list in-filter deny le 32
ip prefix-list in-filter deny le 32
ip prefix-list in-filter deny le 32
ip prefix-list in-filter deny le 32
ip prefix-list in-filter deny le 32
ip prefix-list in-filter deny le 32
ip prefix-list in-filter deny le 32 ! Block local prefix
ip prefix-list in-filter deny le 32
ip prefix-list in-filter deny ge 25 ! Block prefixes >/24
ip prefix-list in-filter permit le 32

Packet Filtering Principles

 Filter as close to the edge as possible
 Filter as precisely as possible
 Filter both source and destination
where possible

Routing Protocol Updates MD5

Route Authentication
Hashed Routing

Router1 Network
Signs Route

Certifies Authenticity of Neighbor
and Integrity of Route Updates

1 remote-as 201 neighbor 2.2 password 7 cisco . description Link to AS-201-Peer neighbor password 7 cisco  Router2 Example router bgp 201 neighbor remote-as 200 neighbor 2.2.2 description Link to AS-200-Peer neighbor 2.2. BGP Route Authentication  Router1 Example router bgp 200 neighbor 2.2.

Additional BGP Knobs .

can be setup renew the session after a time period  Vendor Implementation varies a little bit .BGP Maximum Prefix Tracking  Allow configuration of the maximum number of prefixes a BGP router will receive from a peer  Two level control  Warning threshold: Log warning message  Maximum: Tear down the BGP peering.

x> maximum-prefix <max> [<threshold>] [warning-only]  Threshold is an optional parameter between 1 to 100 percent  Specify the percentage of <max> that a warning message will be generated.Cisco neighbor <x. BGP Maximum-prefix . Default is 75%  Warning-only is an optional keyword which allows log messages to be generated but peering session will not be torn down .x.x.

 Dropping backscatter traffic might overload the router. If there is a default. then this traffic will go to this one router and get dropped.  DOS/DDOS attack use spoofed addresses from the un-allocated IPV4 space for the latest macro allocations.  Backscatter traffic from DOS/DDOS targets need to go somewhere.iana. .  See http://www. Avoid Default Routes  ISPs with full BGP feeds should avoid default routes.

RFC 2827/BCP 38 RFC 2827/BCP 38 Network Ingress Filtering: Defeating Denial of Service Attacks which employ IP Source Address Spoofing "Thou shalt only sendth and receiveth IP packets you have rights for" .

RFC 2827/BCP 38 Ingress Packet Filtering  Packets should be sourced from valid. consistent with the topology and space allocation . allocated address space.

Guidelines for BCP38  Networks connecting to the Internet Must use inbound and outbound packet filters to protect network  Configuration example Outbound—only allow my network source addresses out Inbound—only allow specific ports to specific destinations in .

NO BCP38 may mean :  Devices can (wittingly or unwittingly) send traffic with spoofed and/or randomly changing source addresses out to the network  Complicates traceback immensely  Sending bogus traffic is not free .

Techniques for BCP 38 Filtering  Static ACLs on the edge of the network  Dynamic ACLs with AAA profiles  Unicast RPF strict mode  IP source guard  Cable source verify (DHCP) .

Using ACLs to Enforce BCP38  Static ACLs are the traditional method of ensuring that source addresses are not spoofed: Permit all traffic whose source address equals the allocation block Deny any other packet  Principles: Filter as close to the edge as possible Filter as precisely as possible Filter both source and destination where possible .

0/19 BCP 38 Filter = Allow Only Source Addresses from the Customer’s 96.0/24 any 96.0/24 access-list 121 deny ip any any log ! interface serial 1/1/1.X/24 Internet Core 96.X.0/24 access-list 121 permit ip 96.21. ip access-group 121 in ! BCP 38 Filter Applied on Leased Line Aggregation Router .3 description T1 Link to XYZ.0.Cisco Block: 96. Static Allocation ACL example .

BCP ACL Guidelines  ISPs Make sure your customers install filters on their routers—give them a template they can use  Customer end-sites Make sure you install strong filters on routers you use to connect to the Internet First line of defense—never assume your ISP will do it .

IPv4 Anycast Routing .

 Doesn’t break or confuse existing infrastructure. not a different version of IP.  Doesn’t require any special capabilities in the servers. clients. nobody’s proprietary technology. What isn’t Anycast?  Not a protocol. or network. .

 It’s been the basis for large-scale content- distribution networks since at least 1995. in numerous RFCs since time immemorial.  Mentioned. . as well as much of the periphery of the world wide web.  It’s gradually taking over the core of the DNS infrastructure. although not described in detail. What is Anycast?  Just a configuration methodology.

How Does Anycast Work?  The basic idea is extremely simple:  Multiple instances of a service share the same IP address.  What little complexity exists is in the optional details.  The routing infrastructure directs any packet to the topologically nearest instance of the service. .

Example Router 2 Server Instance A Client Router 1 Router 3 Router 4 Server Instance B .

1 10.0. Example 192.0.1 Router 2 Server Instance A Client Router 1 Router 3 Router 4 Server Instance B 192.0.2 .

168.server.1 DNS lookup for http://www.0.server.0.168.0. IN A produces a single answer: www. Example 192.1 Router 2 Server Instance A Client Router 1 Router 3 Router 4 Server Instance B 192.0.1 .

 127.168.2 10.0.1 Router 2 Server Instance A Client Router 1 Router 3 Router 4 Server Instance B
 2 .168.0.0. Example
 1 10.1 10.1
 0 Routing Table from Router 1: Destination
 Distance 192.0.0.
 0 10.0.1 Router 2 Server Instance A Client Router 1 Router 3 Router 4 Server Instance B 192.0.1 10.2
 2 .0.0.1
 1 Example 192.1 Routing Table from Router 1: Destination

168. Example
 /32 Routing Table from Router 1: Destination
 Distance Router 2 Server Instance A Client Router 1 Router 3 Router 4 Server Instance B 192.0.0
 1 10.1 10.0.2
 2 .0.
 1 Routing Table from Router 1: Destination
 Distance 192.1 Router 2 10.0.1
 127.168.0. Example What the routers think the topology looks like: 192.1 Client Router 1 Server Router 3 Router 4 192.0.1
 2 .1

leaving all other instances unaffected.  This is still of some utility even when DOS sources are widely distributed. A Security Ramification  Anycast server clouds have the useful property of sinking DOS attacks at the instance nearest to the source of the attack. .

More things to know .

Update your whois Information 
 “Please expect that advanced parts of the community are building filters straight . Deutsche Telecom 
 (VIX Mailing List.a benefit which is painfully missing in most other RIR's service areas). 05) .from routing registry data (at least for the RIPE community this is fairly solid data . August 17.” 
 Ruediger Volk.and strictly .

What else should I know ?  Good ISPs know about their networks. and never block ICMP as a result of some virus activity  ISPs should not be involved in blocking ports over their network  But they can always create a best practice document for their customers not to send internal information on the public internet  Keep their abuse desk functional and have valid e- mails address for abuse  Anycast can provide critical service redundancy .

NANOG is North America. Mailing Lists  Most countries have regional if not local mailing lists for operational / bogons updates  SANOG is South Asia.. AfNOG is Africa. NZNog is Kiwis…. list is long  Security updates from vendors are sent to most of the list above plus  NSP-Sec Mailing List  Cisco-NSP. Juniper-NSP and other vendor specific lists  CERT mailing list . Swinog is Swiss. EOF is for Europe. APOPS is Asia Pacific.

the IX mailing list can be the ideal list for such technical discussion  Remember. and chances of attacks originating near your own network is always higher. a rouge user anywhere on the Internet can effect you. Participate  Networks are only useful when people can use it  The only way you can make your network work for everyone is by talking to others.  If you have an IX. . so you should participate in these forums.

exchange points. INOC DBA  INOC-DBA: Inter-NOC Dial-by-ASN  Global Voice-over-IP hotline phone system. and vendors. . directly interconnecting NOCs and SIRTs within carriers. ISPs.

(example: 42*WEW )  Also. et cetera. abuse. well-known extensions for NOC. routing. it’ll ring the phones belonging to that person. How does it work?  If you just dial an Autonomous System Number. it’ll ring a predefined group of phones within that AS. (example: 42 )  If you dial an ASN and an extension number. . SIRT.

Questions ? .

Rob / resources / tutorials / ispbcp . Thank You Gaurab Raj Upadhaya Peering and Network Group Packet Clearing House gaurab@pch. Merike Kaeo and Bill Woodcock The Best Practices for ISPs tutorial can be found at http:// With acknowledgements to Philip Fredrick Smith.pch.