EMFCAMP	
  2012	
  
                  Internet	
  to	
  a	
  field	
  
                                            	
  
    Nat	
  Morris	
  and	
  Will	
  Hargrave	
  
                                                        	
  
                       UKNOF23	
  9th	
  October	
  2012	
  
What	
  was	
  EMFCamp	
  2012?	
  




   •    3	
  day	
  fes)val	
  –	
  Fri	
  31st	
  Aug	
  to	
  Sun	
  2nd	
  Sept	
  
   •    Ran	
  by	
  volunteers	
  
   •    Geeks	
  /	
  hackers	
  /	
  makers	
  
   •    500	
  licensed	
  capacity	
  –	
  sold	
  out	
  
                                                                                         Photo:	
  Russ	
  GarreL	
  
Site	
  locaNon	
  
Site	
  locaNon	
  




  Rented	
  from	
  Milton	
  Keynes	
  Parks	
  Trust	
  -­‐	
  £1,900	
  
FesNval	
  site	
  




    Talks	
  and	
  presenta)ons	
  
                                       Photo:	
  KiLy	
  Wong	
  
FesNval	
  site	
  




                      Balloon	
  launch	
  
                                              Photo:	
  Lionel	
  Montrieux	
  	
  
FesNval	
  site	
  




Radio	
  sta)on	
  and	
  video	
  streaming	
  
                                                   Photo:	
  Graham	
  Morris	
  
FesNval	
  site	
  




Workshops	
  
	
                    Photo:	
  NoRnghack	
  
FesNval	
  site	
  




    Licensed	
  bar	
  under	
  M1	
  bridge	
  
                                                   Photo:	
  Russ	
  GarreL	
  
FesNval	
  site	
  




    Licensed	
  bar	
  under	
  M1	
  bridge	
  
                                                   Photo:	
  Russ	
  GarreL	
  
FesNval	
  site	
  




  Retro	
  gaming	
  tent	
  
  	
                            Photo:	
  Andy	
  Brockhurst	
  
Badge	
  
                                        IR	
  tx	
  
        IR	
  rx	
  
                               Atmega328	
  	
  
                               Microcontroller	
  
   MicroUSB	
  




  Sponsored	
  by	
  UCL	
     2.4ghz	
  radio	
  
  	
                                    Photo:	
  Lionel	
  Montrieux	
  	
  
Infrastructure	
  
  Requirements:	
  
  •  100mbit+	
  
  •  Site-­‐wide	
  wireless	
  
  •  Ethernet	
  +	
  power	
  to	
  every	
  tent	
  
  •  Fully	
  dual	
  stack	
  
  •  Visibility	
  of	
  the	
  whole	
  network	
  
  •  Mul)cast	
  video	
  


                                                         Photo:	
  Andy	
  Brockhurst	
  
Infrastructure	
                                                Graham	
  




Benny	
                            Jasper	
  


            David	
  
                                                  Mat	
  




                        Will	
       Claire	
               Nat	
  
Address	
  space	
  
AUempted	
  to	
  apply	
  for	
  temporary	
  address	
  space	
  from	
  
RIPE	
  NCC,	
  sponsored	
  by	
  Goscomb.	
  
	
  
Issued	
  ASN,	
  v4	
  +	
  v6	
  PI	
  then	
  retracted	
  by	
  hostmaster	
  a[er	
  
they	
  realized	
  they	
  could	
  only	
  issue	
  it	
  7	
  days	
  before	
  the	
  
event.	
  Far	
  too	
  late	
  –	
  equipment	
  was	
  already	
  configured	
  
and	
  boxed	
  by	
  then.	
  
	
  
RIPE-­‐526	
  –	
  broken	
  L	
  
	
  
Going	
  back	
  to	
  address-­‐policy-­‐wg	
  to	
  alter	
  the	
  policy.	
  
	
  
Address	
  space	
  
CCC	
  /	
  Chaos	
  Computer	
  Club	
  to	
  the	
  rescue!	
  
	
  
Loaned	
  us:	
  
•  AS13020	
  
•  2001:067c:20a1::/48	
  
•  94.45.224.0/19	
  
	
  
But	
  now	
  Google	
  is	
  in	
  German	
  and	
  BBC	
  website	
  
carries	
  adverts	
  –	
  never	
  mind.	
  
Backhaul	
  




 •  No	
  exis)ng	
  copper	
  or	
  fibre	
  
 •  BlueSquare	
  Milton	
  Keynes	
  (now	
  Pulsant)	
  
 •  2.9km	
  away	
  
Backhaul	
  
Backhaul	
  




 •  Hired	
  two	
  30m	
  mobile	
  masts	
  /	
  VersaTowers	
  
    –  £1,440	
  for	
  7	
  days	
  inc	
  delivery	
  +	
  collec)on	
  
                                                                             Photo:	
  David	
  Cro]	
  
Backhaul	
  
                              Jasper’s	
  cycling	
  jacket	
  




27m	
  cherry	
  picker	
  
                                                   Photo:	
  Jasper	
  Wallace	
  
Backhaul	
  
                                 SpoRng	
  




   17m	
  cherry	
  picker	
  
                                              Photo:	
  Mat	
  Burnham	
  
Backhaul	
  




                           Looking	
  from	
  the	
  site	
  towards	
  Pulsant	
  

Frank	
  +	
  Mervyn	
                                            Photo:	
  Rapid	
  Wireless	
  
Backhaul	
  




Primary	
  link	
  
•  DragonWave	
  Horizon	
  Compact	
  
•  400mbit/s	
  full	
  duplex	
  
•  18ghz	
  OFCOM	
  licensed	
  
•  Hired	
  from	
  RapidWireless	
  -­‐	
  £2,300	
  
                                                         Photo:	
  NoRnghack	
  
Backhaul	
  




Secondary	
  link	
  
•  Ubiqui)	
  Nanobridge	
  M	
  
•  100mbit/s	
  
•  5.4ghz	
  
•  Bought	
  from	
  Linitx	
  -­‐	
  £112	
  (for	
  2)	
  
                                                               Photo:	
  NoRnghack	
  
Backhaul	
  




•  2	
  x	
  Cisco	
  7206	
  NPE-­‐G2	
  
•  Installed	
  in	
  June	
  /	
  July	
  
Pineham	
  Park	
  
Backhaul	
  
                                                    1G	
         DragonWave	
           DragonWave	
  

                         MK	
  L3	
  Switch	
  
                                                                    UbiquiN	
              UbiquiN	
                  1G	
  
                          ME3400	
                  100M	
  
                                     1G	
                                               100M	
  

Pulsant	
           1G	
      MK	
  Router	
             OOB	
                                              1G	
  
Transit	
                    7206	
  NPE-­‐G2	
                                             Core	
  1	
                   Core	
  2	
  
                                                                                            3750G	
                       3750G	
  
                                                                                                             1G	
  
                                         1G	
  

                                                                Telehouse	
  East	
  
    OOB	
                    THDO	
  Router	
  
                             7206	
  NPE-­‐G2	
  
                                         1G	
  

                                LONAP	
  


V4	
  +	
  V6	
                 V4	
                           Goscomb	
  
Peering	
                     MulNcast	
                        Transit	
  
Backhaul	
  




    hLp://Nnyurl.com/emfcore	
  
NOC	
  




    £25	
  dona)on	
  to	
  the	
  Scouts	
  
                                                Photo:	
  David	
  Cro]	
  
NOC	
  




Network	
  required	
  power	
  so	
  ended	
  up	
  running	
  that	
  
	
  
NOC	
  
NOC	
  




    Food	
  /	
  work	
  /	
  social	
  area	
  
NOC	
  




    Data	
  centre	
  par))oning!	
  
NOC	
  




    Core	
  rack	
  
NOC	
  




Nagvis	
  
	
  
NOC	
  




          Bandwidth	
  monitor	
  
          	
  
AutomaNon	
  
                                                         DNS	
  Zones	
  
                                                         -­‐  Forward	
  
                                                         -­‐  Reverse	
  
                                                         -­‐  DNSSEC	
  Signing	
  

                                                         DHCP	
  Scopes	
  
                             Google	
  Data	
  API	
     -­‐	
  dhcpd.conf	
  
                                                         	
  
                                                         Nagios	
  
 Google	
  Spreadsheet	
                                 -­‐	
  Services	
  per	
  host	
  
 -­‐  Schedule	
  
 -­‐  Budget	
  
                                                         Rancid	
  
 -­‐  IP	
  Plan	
  
 -­‐  DHCP	
  Scopes	
  
 -­‐  Monitoring	
                                       Switch	
  IOS	
  config	
  


    hLps://github.com/emfcamp/emfnoc	
  
DistribuNon	
  
DistribuNon	
  




    hLp://Nnyurl.com/emfdistro	
  
DistribuNon	
  




 SFP’s	
  sponsored	
  by	
  FlexOp)x	
  
DistribuNon	
  




                  •  Staging	
  from	
  June	
  in	
  Nat’s	
  lo[	
  
                  •  GRE	
  tunneled	
  back	
  to	
  MK	
  
                  •  Config,	
  document	
  +	
  monitoring	
  
DistribuNon	
  




 £60/wk	
  hire	
  
                      Photo:	
  Paul	
  Miller	
  
DistribuNon	
  




                  Photo:	
  David	
  Cro]	
  
DistribuNon	
  
DistribuNon	
  




      Typical	
  Datkenklo	
  
DistribuNon	
  




      Raspberry	
  Pi	
  colo	
  
DistribuNon	
  


                         Mul)cast	
  video	
  
                         •  BBC	
  R&D	
  trial	
  over	
  LONAP	
  
                         •  On	
  wired	
  +	
  wireless	
  
                         •  Local	
  SAP	
  server	
  




                  hUp://support.bbc.co.uk/mul)cast/	
  
Wireless	
  




 Dual	
  Cisco	
  WLC	
  4402	
  Controllers	
  
Wireless	
  


               WCS	
  AP	
  mapping	
  
Wireless	
  

hLp://stats.emfcamp.org/luke/	
  


                           Luke’s	
  AP	
  associa)on	
  hack	
  

    Luke	
  Brookes	
  
 TwiUer:	
  @propuke	
  
Stats	
  
Stats	
  




More	
  at	
  hUp://stats.emfcamp.org	
  
Feedback	
  
What	
  next?	
  




                    Photo:	
  Andy	
  Davidson	
  
QuesNons?	
  




                Photo:	
  Russ	
  GarreL	
  

EMFCamp 2012 Network Infrastructure

  • 1.
    EMFCAMP  2012   Internet  to  a  field     Nat  Morris  and  Will  Hargrave     UKNOF23  9th  October  2012  
  • 2.
    What  was  EMFCamp  2012?   •  3  day  fes)val  –  Fri  31st  Aug  to  Sun  2nd  Sept   •  Ran  by  volunteers   •  Geeks  /  hackers  /  makers   •  500  licensed  capacity  –  sold  out   Photo:  Russ  GarreL  
  • 3.
  • 4.
    Site  locaNon   Rented  from  Milton  Keynes  Parks  Trust  -­‐  £1,900  
  • 5.
    FesNval  site   Talks  and  presenta)ons   Photo:  KiLy  Wong  
  • 6.
    FesNval  site   Balloon  launch   Photo:  Lionel  Montrieux    
  • 7.
    FesNval  site   Radio  sta)on  and  video  streaming   Photo:  Graham  Morris  
  • 8.
    FesNval  site   Workshops     Photo:  NoRnghack  
  • 9.
    FesNval  site   Licensed  bar  under  M1  bridge   Photo:  Russ  GarreL  
  • 10.
    FesNval  site   Licensed  bar  under  M1  bridge   Photo:  Russ  GarreL  
  • 11.
    FesNval  site   Retro  gaming  tent     Photo:  Andy  Brockhurst  
  • 12.
    Badge   IR  tx   IR  rx   Atmega328     Microcontroller   MicroUSB   Sponsored  by  UCL   2.4ghz  radio     Photo:  Lionel  Montrieux    
  • 13.
    Infrastructure   Requirements:   •  100mbit+   •  Site-­‐wide  wireless   •  Ethernet  +  power  to  every  tent   •  Fully  dual  stack   •  Visibility  of  the  whole  network   •  Mul)cast  video   Photo:  Andy  Brockhurst  
  • 14.
    Infrastructure   Graham   Benny   Jasper   David   Mat   Will   Claire   Nat  
  • 15.
    Address  space   AUempted  to  apply  for  temporary  address  space  from   RIPE  NCC,  sponsored  by  Goscomb.     Issued  ASN,  v4  +  v6  PI  then  retracted  by  hostmaster  a[er   they  realized  they  could  only  issue  it  7  days  before  the   event.  Far  too  late  –  equipment  was  already  configured   and  boxed  by  then.     RIPE-­‐526  –  broken  L     Going  back  to  address-­‐policy-­‐wg  to  alter  the  policy.    
  • 16.
    Address  space   CCC  /  Chaos  Computer  Club  to  the  rescue!     Loaned  us:   •  AS13020   •  2001:067c:20a1::/48   •  94.45.224.0/19     But  now  Google  is  in  German  and  BBC  website   carries  adverts  –  never  mind.  
  • 17.
    Backhaul   • No  exis)ng  copper  or  fibre   •  BlueSquare  Milton  Keynes  (now  Pulsant)   •  2.9km  away  
  • 18.
  • 19.
    Backhaul   • Hired  two  30m  mobile  masts  /  VersaTowers   –  £1,440  for  7  days  inc  delivery  +  collec)on   Photo:  David  Cro]  
  • 20.
    Backhaul   Jasper’s  cycling  jacket   27m  cherry  picker   Photo:  Jasper  Wallace  
  • 21.
    Backhaul   SpoRng   17m  cherry  picker   Photo:  Mat  Burnham  
  • 22.
    Backhaul   Looking  from  the  site  towards  Pulsant   Frank  +  Mervyn   Photo:  Rapid  Wireless  
  • 23.
    Backhaul   Primary  link   •  DragonWave  Horizon  Compact   •  400mbit/s  full  duplex   •  18ghz  OFCOM  licensed   •  Hired  from  RapidWireless  -­‐  £2,300   Photo:  NoRnghack  
  • 24.
    Backhaul   Secondary  link   •  Ubiqui)  Nanobridge  M   •  100mbit/s   •  5.4ghz   •  Bought  from  Linitx  -­‐  £112  (for  2)   Photo:  NoRnghack  
  • 25.
    Backhaul   •  2  x  Cisco  7206  NPE-­‐G2   •  Installed  in  June  /  July  
  • 26.
    Pineham  Park   Backhaul   1G   DragonWave   DragonWave   MK  L3  Switch   UbiquiN   UbiquiN   1G   ME3400   100M   1G   100M   Pulsant   1G   MK  Router   OOB   1G   Transit   7206  NPE-­‐G2   Core  1   Core  2   3750G   3750G   1G   1G   Telehouse  East   OOB   THDO  Router   7206  NPE-­‐G2   1G   LONAP   V4  +  V6   V4   Goscomb   Peering   MulNcast   Transit  
  • 27.
    Backhaul   hLp://Nnyurl.com/emfcore  
  • 28.
    NOC   £25  dona)on  to  the  Scouts   Photo:  David  Cro]  
  • 29.
    NOC   Network  required  power  so  ended  up  running  that    
  • 30.
  • 31.
    NOC   Food  /  work  /  social  area  
  • 32.
    NOC   Data  centre  par))oning!  
  • 33.
    NOC   Core  rack  
  • 34.
  • 35.
    NOC   Bandwidth  monitor    
  • 36.
    AutomaNon   DNS  Zones   -­‐  Forward   -­‐  Reverse   -­‐  DNSSEC  Signing   DHCP  Scopes   Google  Data  API   -­‐  dhcpd.conf     Nagios   Google  Spreadsheet   -­‐  Services  per  host   -­‐  Schedule   -­‐  Budget   Rancid   -­‐  IP  Plan   -­‐  DHCP  Scopes   -­‐  Monitoring   Switch  IOS  config   hLps://github.com/emfcamp/emfnoc  
  • 37.
  • 38.
    DistribuNon   hLp://Nnyurl.com/emfdistro  
  • 39.
    DistribuNon   SFP’s  sponsored  by  FlexOp)x  
  • 40.
    DistribuNon   •  Staging  from  June  in  Nat’s  lo[   •  GRE  tunneled  back  to  MK   •  Config,  document  +  monitoring  
  • 41.
    DistribuNon   £60/wk  hire   Photo:  Paul  Miller  
  • 42.
    DistribuNon   Photo:  David  Cro]  
  • 43.
  • 44.
    DistribuNon   Typical  Datkenklo  
  • 45.
    DistribuNon   Raspberry  Pi  colo  
  • 46.
    DistribuNon   Mul)cast  video   •  BBC  R&D  trial  over  LONAP   •  On  wired  +  wireless   •  Local  SAP  server   hUp://support.bbc.co.uk/mul)cast/  
  • 47.
    Wireless   Dual  Cisco  WLC  4402  Controllers  
  • 48.
    Wireless   WCS  AP  mapping  
  • 49.
    Wireless   hLp://stats.emfcamp.org/luke/   Luke’s  AP  associa)on  hack   Luke  Brookes   TwiUer:  @propuke  
  • 50.
  • 51.
    Stats   More  at  hUp://stats.emfcamp.org  
  • 52.
  • 53.
    What  next?   Photo:  Andy  Davidson  
  • 54.
    QuesNons?   Photo:  Russ  GarreL