Industrial Ethernet - Guide to Network Redundancy
For a very good reason, a commercial airliner crossing the ocean must have more than one engine. In the same way, when an industrial network failure creates a safety risk or other possible major loss, backup systems are vital to reduce the risk.
Ethernet’s ability to deliver reliable control in industrial settings was once a major concern. Now that industrial grade managed switches make it simple to segment and manage industrial networks, the speed of recovery from a typical network fault can be measured in microseconds (thousandths of a second). With these short recovery times, many applications are now able to use Ethernet and take advantage of the most up-
This white paper reviews how network topology, transport layer protocols, and network management tools affect recovery speed, and the practical comparison of these technologies in the real world.
TOPOLOGY: THE BASIS OF SECURITY & SPEED
Network topology, or the means by which devices are connected, is key to redundancy and recovery time. Three typical topologies are: mesh networks, link aggregation and redundant rings.
These three topologies deal very well with recovery from link failure – often the weakest part of a network. The evaluation factors described as follows can apply to other redundancy plans, as well.
While redundant ring topology is the most common of these, a review of mesh and trunked networks helps to understanding why redundant rings are used the most. The ideal choice for an industrial network is based on the best mix of cost, ability to heal, and speed of recovery.
In a mesh network, devices or nodes are interconnected.
Figure 1. Mesh Network
Mesh networks are also more costly as they require more wiring and ports. Additionally, recovery from a mesh network failure is much slower because the system has to re-learn paths and configure ports to work around the broken link.
Link aggregation or “trunking” also uses multiple links between devices but, in a simpler way:
Figure 2. Link Aggregation
If one link fails, a parallel cable takes over. Recovery is fast due to the simple configuration and bandwidth is greater because of the higher capacity of two or more lines. But, cabling costs are higher and, if a switch goes down, the switches connected through it are also disabled.
There is also a higher risk of total link failure. When one link fails the same event may also damage parallel cabling. This increases the chance of a more serious disruption.
Redundant rings are connected in a loop. One link
Figure 3. Redundant Ring Group of Switches
This solution has lower cabling costs and faster recovery from a failed data pathway. These, along with support for other switches if one fails, are reasons that the redundant ring is the clear choice for industrial settings.
TRANSPORT LAYER TOOLS: TCP & UDP
TCP and UDP are transport layer programs. Each has its advantages but, with
TCP guarantees data delivery, checks receiving device status, verifies the message is correct and
Industrial control often uses UDP as it improves
NETWORK MANAGEMENT PROTOCOLS
Some network management protocols are capable of handling a wide variety of configurations. Others are useful for only one type of
The Spanning Tree Protocol or STP was adopted as IEEE 802.1D standard in 1990. The Rapid Spanning Tree Protocol or RSTP (similar to, but faster and more capable than, STP) came out as the IEEE 802.1w standard in 1998.
Each of these does substantially the same thing by allowing Ethernet to connect with mesh and ring networks. They do this by putting selected links into standby to prevent
Standby links are activated to “heal” the network when a link fails. Recovery time difference between STP and RSTP is great but, RSTP is still slow for many industrial applications.
Proprietary Ring protocols answer this problem. They expand redundant ring applications to situations that require faster recovery times.
These only deal with redundant ring topologies, not mesh networks. As they are proprietary, they may not allow the mixing of different brands of switches. However, they have been well received in industrial settings needing the benefits of quick recovery.
In some cases, manufacturers accomplish this by using the simple routines of RSTP to fix redundant ring failures but, take out the time-consuming ones needed to manage mesh networks.
Link aggregation, or IEEE 802.3ad, is the standard that formalizes the management of parallel Ethernet network cables and ports to expand bandwidth and provide for faster recovery.
With link aggregation, the connection is never totally lost as it is duplicated by a parallel line. But, bits of data can be lost when a link goes down and bandwidth is reduced by the loss of a link.
REDUNDANCY, RECOVERY & COST COMPARISON
While real-life networks may require additional redundancy measures, all are subject to the trade-offs of protection vs. resources.
It is impossible to fill in the blanks precisely. The combinations and variations of redundant networks could fill volumes. Results for every piece of equipment and network will vary. But, every situation will use the same type of analysis.
Here is a comparison overview of the topologies and protocols reviewed in this paper:
MANAGED ETHERNET SWITCHES – THE HARDWARE THAT MAKES IT HAPPEN
All this protection and speed is, of course, dependent on the up-to-date hardware that works with these configurations and protocols.
Industrial managed switches from B+B SmartWorx deliver redundant, ultra-fast recovery. With features such as IEEE 802.3x flow control, redundant ring or RSTP capability, under 300ms recovery and other industrial grade features, these switches form the hardware backbone of many industrial networks.
These switches are capable of greater redundancy for even more security. For instance, dual homing prevents loss of connectivity between the redundant ring and the
As an example, a power company uses B+B SmartWorx Ethernet switches with dual homing and coupling ring configuration to remotely manage hard-to-reach substations. Substations use “step down” transformers to convert high voltages from the power grid to lower levels for homes and businesses. A bus splits electricity to distribution lines.
Circuit breakers and switches disconnect from the power grid or lines in a split second to protect from lightning or overloads, then reconnect just as quickly to restore power – and profits.
This is an example of how the additional cost of cabling and equipment is justified by the extra level of security.
B+B SmartWorx powered by Advantech offers a comprehensive line of the industrial network, communications and automation equipment, including industrial grade managed switches.