41. Installation pitfalls
1. Proper cable
installation is
critical
3. This makes it impossible to
manage, maintain and
troubleshoot
2. No matter the
hardware, shoddy
cable installation
will result in a poor
network
42. Importance of the Physical Layer
“A significant portion of network
downtime, approx. 80%, is attributed
to Physical Layer Connections.”
Sage Research
43. Designing the Physical Layer for Ethernet/IP
What do Physical Layer Reference
Architecture based best practices
look like?
44. Physical Layer Design Considerations
•
•
•
•
•
Design and implement a
robust physical layer
Environment Classification - MICE
More than cable
– Connectors
– Patch panels
– Cable management LAN Troubleshooting Guide
– Grounding, Bonding and
Shielding
(noise mitigation)
Standard Physical Media
– Wired vs. Wireless
Industrial Ethernet Physical
– Copper vs. Fiber
Infrastructure Reference
– UTP vs. STP
Architecture Design Guide
– Singlemode vs. Multimode
– SFP – LC vs. SC
Standard Topology Choices
ODVA Guide
– Switch-Level & Device-Level
Cable Selection
ENET-WP007
7
45. Logical
8
Rockwell/Cisco RA
Enterprise Zone (EZ)
De-Militarized Zone (DMZ)
Windows 2003 Servers
• Remote Desktop
Connection
• VNC
• PCAnywhere
FIREWALL
(STANDBY)
FIREWALL
(ACTIVE)
GE Link for Failover
Detection
Automation Apps
• Historian
• Data Distribution
• Asset Security
• Engineering Applications
• Databases
Network Services
• DNS, DHCP, Syslog Server
• Network & Security Management
De-Militarized Zone (DMZ)
Manufacturing Zone
LAYER 3
ROUTER
LAYER 3
SWITCH
LAYER 3
ROUTER
LAYER 3
SWITCH
Manufacturing Zone
Cell/Area Zone
(Redundant Star Topology)
(Ring Topology)
(Bus/Star Topology)
48. Panduit Industrial Automation
5 Core Solutions
IN-ROOM
ININ ROOMTM
Control Room, Data Center,
Telco Closet
IN-ROUTE
ININ ROUTETM
Industrial Pathways, Network
Zone Enclosures
IN-PANEL
ININ PANELTM
Control Panels, Electrical
Panels and MCC
IN-FIELD
ININ FIELDTM
On the Machine, In the
Process Area, or Outdoors
IN-FRASTRUCTURE
ININ FRASTRUCTURETM
Power Distribution, Lighting,
HVAC Security, Safety
49. Simplify with validated building blocks
Physical Layer Design Considerations
Micro Data Center
Zone Enclosures
Control Panel Solutions
50. IN-ROOM
ININ ROOMTM
Micro Data Center – IN-Room Solution
Enterprise/Office
Patchfield used to uplink switch
to level 4 & 5 Enterprise
Server Patching
Cross connect between production
servers and switch
Firewall and DMZ
Logical buffer zone between the
Enterprise and Manufacturing
Manufacturing Zone
Patchfield used to connect layer 3
switch to layer 2 switches used on
plant floor
51. IN-ROOM
ININ ROOMTM
Physical Network Security
IN-ROUTE
ININ ROUTETM
IN-PANEL
ININ PANELTM
IN-FIELD
ININ FIELDTM
•
•
•
Keyed solutions for copper
and fiber
USB Type A, B Ports
Lock-in, Blockout products
secure connections
52. IN-ROOM
ININ ROOMTM
Micro Data Center Solutions
15
Physical Layer Design Considerations
Micro Data Center Simplification - Organize, Secure, and Standardize
BEFORE
Challenges:
• Disorganized
• Network performance issues
• Frequent moves, adds & changes
AFTER
Solutions:
• Structured approach
• Media selection/security
• Visual identification
56. IN-ROUTE
ININ ROUTETM
IN-Route - Zone Cabling Methods
Z
Z
Z
TR
Centralized Cabling – Home runs from
each node back to the telecommunication room.
TR
Zone Cabling – Provides for Reduced
home-run wiring, easy moves / adds /
changes and reduced size of telecommunication room
19
57. Pathways
• Overhead cable
tray routing
system
• Designed to
route and
manage copper,
fiber optic, or
power cables
IN-ROUTE
ININ ROUTETM
60. IN-ROUTE
ININ ROUTETM
Zone Enclosures – Pre-configured
Best way to structure
manufacturing network
•Leverages Cisco/RA recommended
architecture for best network
performance
•Built for capability of rapid network
expansion
•Touch-safe for Facility IT access
•Significantly reduces lead time to
deploy
23
61. Zone Enclosures – Optimized for Stratix
Physical Layer Design Considerations
• Pre-configured,
Pre-tested for
Stratix 8300, 8000
and 5700 switches
• Safe, Secure,
Thermally tested
• Save time/cost/risk:
– IT/controls
convergence point
– Machine Builders
IN-ROUTE
ININ ROUTETM
62. IN-Route: Network Distribution Simplification
IN-ROUTE
ININ ROUTETM
Physical Layer Design Considerations
Robust, Secure, Future-Ready Network Distribution
BEFORE
Challenges:
• Scalability issues
• Diagnostics & troubleshooting
• Evolving cable mgmt
AFTER
Solutions:
• Zone enclosure
• Media selection & security
• Cable routing
25
63. IN-PANEL
ININ PANELTM
IN-Panel - Understanding the Problem
There are several market trends that are exerting
pressure on the design and architecture of a Control
Panel.
–
–
–
–
–
Space Optimization
Terminations
Network Cabling
Noise Mitigation
Safety/Security
64. IN-PANEL
ININ PANELTM
EtherNet in the Control Panel
• Additional requirements and
solutions are required with the
addition of EtherNet into the Control
Panel.
65. IN-PANEL
ININ PANELTM
Planning for networking in the panel
N
• What are common networking
challenges in the panel?
– Overall concerns
• Diagnostics/troubleshooting
• Maintenance
• Future system upgrades
– Performance in potentially high
noise environment
• Zoned layouts
• Shielding
– Finding panel space for new
components
Clean
Noisy
Very Noisy
69. Space Optimization Increases Design Flexibility
IN-PANEL
ININ PANELTM
Physical Layer Design Considerations
• Maximizes panel space utilization
• Easier to design for future system upgrades
• Provide up to 30% space savings
Design
Flexibility
Panduit PanelMax™ Offering:
DIN Rail Wiring Duct
Corner Wiring
Duct
Utilizes space
typically unusable in
enclosure corner
Uses enclosure depth to save
panel footprint space ;improve
component access
Shielded Wiring Duct
Mitigates EMI noise to reduce
wire separation distance
Conventional
Wiring Duct
All of these products contribute to cost savings
Shielded Wiring Duct
70. Panduit Network Solutions for the Control Panel
IN-PANEL
ININ PANELTM
Physical Layer Design Considerations
• Optimized solutions for
Machine Builder Stratix
5700 deployments
DIN Rail Mount Adapter
Modular DIN rail mounting for
Copper or Fiber connectivity
Patch Panel
Facilitate testing, and future
Moves, Adds and Changes
Fiber, Cat6 Patch Cords
Performance guaranteed
Insert product
photo
71. IN-Panel: Optimized with Partners
IN-PANEL
ININ PANELTM
Physical Layer Design Considerations
•
•
Leverage power of EtherNet/IP and
eco-system partners
– Panduit Fiber, Patching, Noise
Mitigation, Space Optimization,
Grounding/Bonding
– RA Stratix 5700 for machine
builder
– RA 1585 patch cords
– Test with Fluke Networks
EtherNet/IP connects to Zone
Enclosures and Micro Data Center for
convergence aligned with Cisco/RA
CPwE
72. IN-FIELD
ININ FIELDTM
IN-Field Challenges
ON Machine or Process areas
• High MICE levels
–
–
–
–
Vibration
Chemical
Temperature
Wash down
• Wire management
rated for environment
• Food safety
73. IN-Field Solutions: Manage and Protect
IN-FIELD
ININ FIELDTM
• Harsh rated cable management
and identification
• Abrasion protection
• Grounding/Bonding
Metal detectable
wire management
for Food industry
74. IN-Frastructure: Challenges
• Facility Grounding/Bonding, Power
• Costs of safety incidences
• Lockout/Tagout implementation
IN-FRASTRUCTURE
ININ FRASTRUCTURETM
79. Easy Building Block Approach
Design your system using cost effective and easy to
troubleshoot Network Architectures
Micro Data Center
SM
Zone Enclosure
Control Panel Solutions
80. 43
Industry Level Thought Leadership
All wrapped up in a 450
page, “How To” manual
with contributions from
Fluke and Rockwell
Automation, on designing
and installing the physical
infrastructure for an
Industrial Ethernet
Network
Enterprise
Functional
Design
Logical Level
Shared
Architecture
Environmental
Requirements
(M.I.C.E.)
Physical Level
Plant Floor
Design
Panduit: Physical Infrastructure
Reference Architecture
SM
86. Industrial Networks Live in the Real World
• Industrial Networks Must take
into consideration the physical
challenges of the facilities
environment.
Plant Ethernet
Controller
Switch
• Location, routing and equipment
choices should be based on the
complete understanding of cause
and effect conditions.
Ethernet
I/O
• Environmental Focus
– M.I.C.E. (TIA-1005)
SM
Drive
Sensor
87. Fiber that Fits Both the Environment and the Application
Fiber is now being used in all areas of an Industrial Network Deployment
SM
88. Benefits of Fiber in an Industrial Space
• Fiber is completely noise immune
• Fiber can be used in high M.I.C.E.
environments
• Fiber can be rated for indoor,
outdoor and transition spaces
• Armored Fiber (available in both
metallic and all-dielectric) reduces
the need for, and installations costs
of, innerduct and conduits
• Smaller footprint of cables
(one fiber cable vs. bundle
copper (UTP))
• Reliability and speed of installation
reduces the
total cost of ownership
SM
Corporate Network
Office
Applications,
Internetworking,
Data Servers,
Storage
Back-Office Mainframes and
Servers (ERP, MES, etc.)
Human Machine
Interface (HMI)
Supervisory
Control
Robotics
Controller
Motors, Drives
Actuators
Sensors and other
Input/Output Devices
Converged Ethernet
Manufacturing Network Model
89. Key Elements of a Successful
EtherNet/IP Network Design
• Understanding application
and functional
requirements
• Developing a logical
framework (roadmap)
• Developing a physical
framework
• Determining security
requirements and
partnering with IT
• Using technology and
industry standards,
reference models and
reference architectures
ERP, Email,
Wide Area Network
(WAN)
Demilitarized Zone (DMZ)
Patch Management
Remote Gateway Services
Application Mirror
AV Server
Gbps Link
for Failover
Detection
Firewall
(Standby)
Plant Firewall:
Inter-zone traffic segmentation
ACLs, IPS and IDS
VPN Services
Portal and Terminal Server proxy
Cisco
ASA 5500
Firewall
(Active)
Industrial Zone
Site Operations and Control
Level 3
FactoryTalk Application Servers
Enterprise Zone
Levels 4 and 5
View
Historian
AssetCentre,
Transaction Manager
Catalyst
6500/4500
FactoryTalk Services
Platform
Directory
Security/Audit
Remote
Access
Server
Data Servers
Catalyst 3750
StackWise
Switch Stack
Network Services
DNS, DHCP, syslog server
Network and security mgmt
Cell/Area Zones
Levels 0–2
Rockwell Automation
Stratix 8000
Layer 2 Access Switch
HMI
Controller
HMI
Drive
Controller
HMI
I/O
Controller
SM
Cell/Area Zone #1
Redundant Star Topology
Flex Links Resiliency
Drive
Drive
I/O
I/O
Cell/Area Zone #2
Ring Topology
Resilient Ethernet Protocol (REP)
I/O
Cell/Area Zone #3
Bus/Star Topology
91. Selecting the Right Fiber Requires
…
Knowing the Application
Environment.
…
Knowing the Distance
Requirements.
…
Knowing the Equipment
you are connecting to.
SM
92. Let’s take a sample application and go thru it step-by-step.
Knowing the Capability of Your Equipment
The Equipment – The first step in choosing the right fiber
is to look at the capability of your equipment.
• Look at the specifications
of the equipment to
determine the speed of
the connections
• The Fiber you choose
should at least be able to
handle the fastest mode of
the existing system
SM
93. Knowing the Capability of Your Equipment
The Stratix is a good switch to use as an example
because it has both Uplink ports and
Data ports running at different speeds.
• The uplink port speed is determined by the
use of copper or fiber. If it’s fiber the
configuration of the “SFP” module
determines the speed of the system.
SFP Stands for “Small
Form Pluggable”
Module
SM
94. Knowing the Capability of Your Equipment
The Stratix is a good switch to use as an example
because it has both Uplink ports and
Data ports running at different speeds.
SFP Stands for “Small
SFP Stands for “Small
Form Pluggable”
Form Pluggable”
Module
Module
SM
95. Understanding Your Expansion
or Upgrade Path
The following is an example list of specifications for the fiber-optic SFP module
connections. It’s IMPORTANT that each port must match the wave-length
specifications on the other end of the cable, and for reliable communication, the cable
must not exceed the rated maximum cable length.
SFP Module
Type
Cat. No.
Wavelength
(nm)
Fiber Type
Core Size/Cladding
Size (micron)
Modal
Bandwidth
(MHz/km)(1)
Cable Distance
100BASE-FX
1783SFP100FX
1310
MMF
50/125
62.5/125
500
500
2 km (6562 ft)
2 km (6562 ft)
100BASE-LX
1783SFP100LX
1310
SMF
G.6522
1000BASE-SX
1783SFP1GSX
850
MMF
62.5/125
62.5/125
50/125
50/125
1000BASELX/LH
1783SFP1GLX
1310
SMF
G.6522
(1) Modal bandwidth applies only to multimode fiber.
SM
10 km (32,810 ft)
160
200
400
500
220 m (722 ft)
275 m (902 ft))
500 m (1640 ft)
550 m (1804 ft)
10 km (32,810 ft)
* Information comes from Stratix Users Manual
96. Answers Always Lead to More Questions
The Equipment – The result of our equipment investigation
is that we learned:
• The max speed for the uplink is 1GBase-T
• The max speed for the data port is 100Base-T
• There are several choices for SFP modules
that can support both Single and Multimode.
The next question:
“Is there an existing system of fiber, and
what core size is being used?”
SM
Core size?
….yes, Core
size?
97. What Makes Up a Fiber Cable?
The Cable – There are two classes of Fiber in use today:
• Single Mode – Long Distance Fiber, more expensive technology
• Multi Mode – Shorter Distance, more cost effective for inside plant use.
• To understand the differences between core sizes, and why they matter,
you need to know what makes up a fiber cable.
SM
98. How Big is the Fiber, (relatively)?
Buffer
Cladding
125µm 230µm
Core
9
50
62.5
200µm
Core size will tell
you the OMx of
the Fiber
All sizes expressed In Microns
SM
102. What Do the OM Ratings Mean?
If you see OM in the Fiber grade it always means Multi-Mode.
– The US Adopted a Grading System Invented By ISO, The International Standards
Organization in Geneva, Switzerland. The “Optical Multimode” Rating System
•
•
•
•
“OM 1” --- 62.5 Micron (Mostly legacy systems)
“OM 2” --- 50 Micron (plain vanilla variety)
“OM 3” --- 50 Micron (Laser optimized to work with VCELS)
“OM 4” --- 50 micron (Extended Bandwidth – Further refined to reduce pulse
spreading and enable longer distances)
And just like with Copper Categories –
A bigger number means better cable!
SM
103. What Do the OS Ratings Mean?
• If you see OS in the Fiber grade it always means Single-Mode.
• “OS 1” --- 9 Micron (Used with wavelengths of 1310 nm)
• “OS 2” --- 9 Micron (Used with wavelengths of 1550 nm)
Why does the core size make such a difference in Fiber performance?
• OS (single-mode) vs. OM (multi-mode).
Think of it like the difference between a rifle shot and a shotgun blast.
SM
104. Example of Single-mode vs. Multi-mode
Singlemode – more efficient – goes FURTHER
A Fabry-Perot LASER
Multimode – less efficient – doesn’t go as far
A Cheap, Slow LED
SM
105. Light Pulse Spreading (“Modal Dispersion”)
The Enemy of Throughput
A Cheap Slow LED
• Some of the photons (light particles) go straight, some ricochet around the
outside, the further they travel the closer the leading edge from one pulse
gets to the trailing edge of the one before it.
• Eventually you can’t tell one pulse from another.
SM
106. The Further You Go, the Worse it Gets.
Hey, I
sent a
“1”
What?
You can only go so far with a given grade of multimode fiber before light
pulses begin to overlap
SM
107. How the OM/OS Ratings Equate to Distance
ANSI/TIA-568-C.0 (D.3) Optical fiber
cabling supportable distances table.
• Table 7 - lists maximum supportable
distances and maximum channel
attenuation
for applications using optical
fiber cabling
• The table is based on the minimum
performance requirements of
62.5/125 µm, 50/125 µm, 850 nm
laser-optimized 50/125 µm, and
single-mode fiber established by
ANSI/TIA-568-C.3
SM
108. Remember the MICE Table?
Where you put the fiber, “The Environment”,
determines the type of fiber you choose.
SM
109. Applications for “Indoor” Fiber
• Indoor Opti-Core Fiber
Distribution
• Indoor Opti-Core
Interlocking Armor
• Indoor Industrial-Net
(PCF) Polymer Clad
Fiber
• Indoor Dielectric
Conduited Fiber (DCF)
SM
Used when you
have sufficient
protection for the
fiber
**NEW**
Electrician Friendly
crimp on connector
for direct connect
node to node
Used when the
fiber has to
protect itself
**NEW** All the benefits
of an armored fiber
without the metal. Use in
area suspected of unequal
potential grounds
110. Applications for “Indoor-Outdoor” Fiber
• Indoor/Outdoor Opti-Core All-Dielectric Fiber Cable
• Indoor/Outdoor Opti-Core Gel-Free Fiber
Interlocking Aluminum Armored Cable
Used to transition
from indoor to
outdoor in a
protected area, tray
or conduit.
SM
Used to transition from
indoor to outdoor yet still
protect the cable from
harsh mechanical
conditions
111. Applications for “Outdoor” Fiber
• Opti-Core Gel-Free Fiber Optic Outside Plant All-Dielectric Cable
• Opti-Core Gel-Free Fiber Optic Outside Plant Armored Cable
Allows installation
using loose tube
cable methods for
aerial and duct
applications
SM
Allows installation using
loose tube cable methods
for aerial, duct and direct
burial applications
112. One Last Thought When
Choosing a Fiber Type – Choosing the Connector
Traditional Puck and
Polish type
Connectors
(5-7min.)
OptiCam Factory
Polished Connectors
(2 - 3min.)
Industrial Strip &
Crimp no-Polish
Required Fiber
Connectors
(aprox 1 min.)
SM
118. Fiber Optic Infrastructure Planning
Physical Layer Design Considerations
New joint application guide
Increase the integrity and availability of
EtherNet/IP networks with fiber solutions
from trusted partners!
Physical infrastructure
Integrated Architecture,
Stratix Switches, ETAPs,
more
Higher level switches
SM
Fiber Guide
ENET-TD003
81 81
119. Easy to follow Fiber best practices!
Physical Layer Design Considerations
• Partner validated application guide
SM
82
120. Summary
Physical Infrastructure for Fiber
Deployments
Understanding the Environment and the Application
Fiber Selection
Knowing how to determine equipment and system requirements
Saving Time/Cost with Fiber
Choosing the proper network design for application
SM
183. Securing Controls Networks
Protecting against the bad dumb guys ;)
Steve Matthews (stmatthe@cisco.com)
Consulting Systems Engineer IoT Sales EMEAR
11th Feb 2014