Myrinet

Myrinet, ANSI/VITA 26-1998, is a high-speed local area networking system designed by the company Myricom to be used as an interconnect between multiple machines to form computer clusters.

Description

Myrinet was promoted as having lower protocol overhead than standards such as Ethernet, and therefore better throughput, less interference, and lower latency while using the host CPU. Although it can be used as a traditional networking system, Myrinet is often used directly by programs that "know" about it, thereby bypassing a call into the operating system.

Myrinet physically consists of two fibre optic cables, upstream and downstream, connected to the host computers with a single connector. Machines are connected via low-overhead routers and switches, as opposed to connecting one machine directly to another. Myrinet includes a number of fault-tolerance features, mostly backed by the switches. These include flow control, error control, and "heartbeat" monitoring on every link. The "fourth-generation" Myrinet, called Myri-10G, supported a 10 Gbit/s data rate and can use 10 Gigabit Ethernet on PHY, the physical layer (cables, connectors, distances, signaling). Myri-10G started shipping at the end of 2005.

Myrinet was approved in 1998 by the American National Standards Institute for use on the VMEbus as ANSI/VITA 26-1998.^[1] One of the earliest publications on Myrinet is a 1995 IEEE article.^[2]

Performance


Generation		Year^[3]	Bandwidth	Notes
1	Myrinet	1994	0.64 Gbit/s	PECL PHY
2	Myrinet-LAN	1996	1.28 Gbit/s	Backwards compatible with original Myrinet. LVDS PHY for 1.28 Gbit/s operation.^[4]
2	Myrinet-SAN	1996	1.28 Gbit/s	System-Area Network, shorter reach (3m) but lower cost^[5]
3	Myrinet-2000	2000	2 Gbit/s	Backwards-compatible with Gigabit Ethernet
4	Myri-10G	2005	10 Gbit/s	Backwards-compatible with 10 Gigabit Ethernet

Myrinet is a lightweight protocol with little overhead that allows it to operate with throughput close to the basic signaling speed of the physical layer. For supercomputing, the low latency of Myrinet is even more important than its throughput performance, since, according to Amdahl's law, a high-performance parallel system tends to be bottlenecked by its slowest sequential process, which in all but the most embarrassingly parallel supercomputer workloads is often the latency of message transmission across the network.

Deployment

According to Myricom, 141 (28.2%) of the June 2005 TOP500 supercomputers used Myrinet technology. In the November 2005 TOP500, the number of supercomputers using Myrinet was down to 101 computers, or 20.2%, in November 2006, 79 (15.8%), and by November 2007, 18 (3.6%), a long way behind gigabit Ethernet at 54% and InfiniBand at 24.2%.

In the June 2014 TOP500 list, the number of supercomputers using Myrinet interconnect was 1 (0.2%).^[6]^[7]

In November, 2013, the assets of Myricom (including the Myrinet technology) were acquired by CSP Inc.^[8] In 2016, it was reported that Google had also offered to buy the company.^[9]

References

^ American National Standard for Myrinet-on-VME Protocol Specification (PDF). VMEbus International Trade Association. November 2, 1998. ISBN 1-885731-15-9. Archived (PDF) from the original on November 11, 2014. Retrieved September 1, 2016.
^ Boden, N.J.; Cohen, D.; Felderman, R.E.; Kulawik, A.E.; Seitz, C.L.; Seizovic, J.N.; Wen-King Su (1995). "Myrinet: A gigabit-per-second local area network". IEEE Micro. 15: 29–36. doi:10.1109/40.342015.
^ Padua, David, ed. (2011). Encyclopedia of Parallel Computing. IEEE. pp. 1239–1247. doi:10.1007/978-0-387-09766-4. ISBN 978-0-387-09765-7.
^ "M2M-M2F description". 1997-01-17. Archived from the original on 1997-01-17. Retrieved 2023-11-11.
^ "Myrinet - A Brief, Technical Overview". 1997-01-17. Archived from the original on 1997-01-17. Retrieved 2023-11-11.
^ "List Statistics". Archived from the original on 2018-07-18. Retrieved 2014-01-13.
^ "Deployment Time Series Chart". Archived from the original on 2014-02-01. Retrieved 2014-01-16.
^ "CSP, Inc. Broadens MultiComputer Business Opportunities With Asset Purchase of Myricom, Inc". Press Release. November 6, 2013. Archived from the original on September 11, 2016. Retrieved September 1, 2016.
^ Chris Williams (February 9, 2016). "Google crafts custom networking CPU with parallel computing links". The Register. Archived from the original on August 11, 2016. Retrieved September 1, 2016.

External links

Myrinet site at the Wayback Machine (archived August 16, 2013)
CSPI, current owner or Myrinet.

[1] American National Standard for Myrinet-on-VME Protocol Specification (PDF). VMEbus International Trade Association. November 2, 1998. ISBN 1-885731-15-9. Archived (PDF) from the original on November 11, 2014. Retrieved September 1, 2016.

[2] Boden, N.J.; Cohen, D.; Felderman, R.E.; Kulawik, A.E.; Seitz, C.L.; Seizovic, J.N.; Wen-King Su (1995). "Myrinet: A gigabit-per-second local area network". IEEE Micro. 15: 29–36. doi:10.1109/40.342015.

[3] Padua, David, ed. (2011). Encyclopedia of Parallel Computing. IEEE. pp. 1239–1247. doi:10.1007/978-0-387-09766-4. ISBN 978-0-387-09765-7.

[4] "M2M-M2F description". 1997-01-17. Archived from the original on 1997-01-17. Retrieved 2023-11-11.

[5] "Myrinet - A Brief, Technical Overview". 1997-01-17. Archived from the original on 1997-01-17. Retrieved 2023-11-11.

[6] "List Statistics". Archived from the original on 2018-07-18. Retrieved 2014-01-13.

[7] "Deployment Time Series Chart". Archived from the original on 2014-02-01. Retrieved 2014-01-16.

[8] "CSP, Inc. Broadens MultiComputer Business Opportunities With Asset Purchase of Myricom, Inc". Press Release. November 6, 2013. Archived from the original on September 11, 2016. Retrieved September 1, 2016.

[9] Chris Williams (February 9, 2016). "Google crafts custom networking CPU with parallel computing links". The Register. Archived from the original on August 11, 2016. Retrieved September 1, 2016.

[1]

[2]

[3]

[4]

[5]

[6]

[7]

[8]

[9]