Analyst Insights: The AI Middle Mile and Federated Wavelengths

on Posted on Reading Time: 7 minutes

Spotlight: Ian Redpath, Research Director, Omdia & Dave Ward, CTPO, Lumen Technologies

Omdia

Omdia research director, Ian Redpath, recently had the opportunity to speak with MEF board member, Dave Ward, who is the new Chief Technology and Product Officer (CTPO) of Lumen Technologies (Lumen). 

Dave opened with the following:  

AI and the cloud are driving the largest expansion of networks in our lifetime. 

Dave’s new role includes updating the AI middle mile and building a more agile and responsive digital platform to support the growing demand for temporal wavelength services. A federated and automated environment is required for global connectivity, service turn-up speed, and scale. 

The MEF Lifecycle Service Orchestration (LSO) framework has been implemented by over 39 communications service providers (CSPs) for carrier Ethernet services across various use cases. The industry’s next steps include broadening the ecosystem to include more CSPs (already in progress) and extending the LSO-supported payloads to include 100G, 400G, and 800G wavelengths.  

Dave summarized with the following:  

The demand for ultra-high capacity is huge, and MEF APIs are critical. The 400G market momentum is massive; we exceeded our entire 2024 400G service forecast by mid-year, driven by AI. 

What is the Wavelength Market?

A wavelength is a high-capacity service sold directly from an optical platform. The wavelengths under discussion today are 100Gbps and 400Gbps. A wavelength seller can offer wavelengths from A to B using their optical network. Typical performance parameters include primary and backup path latency.  

A wavelength buyer has complete access to all the uncontended bandwidth with guaranteed latency performance. In the past, typical wavelength buyers included communications or cloud service providers who needed to complete backbone portions of their networks where they did not have their own fiber assets. A select group of enterprises with very high bandwidth-intensive needs have also purchased wavelengths.  

A wavelength service is a high bandwidth option that fills the gap between carrier Ethernet and IP/MPLS services, and a leased/owned fiber network.  

What is changing? 

Enterprises Re-Architecting Networks for AI and the Cloud

Enterprises have embraced the cloud service model, resulting in over $250B in cloud service revenue for just three major cloud service providers that reported their revenue publicly. At the same time, enterprises desire flexibility and choice and prefer not to be locked into a single cloud supplier. What they seek is a multi-cloud model. 

Moving on to AI, enterprises are interested in a flexible AI environment. They want to be able to use the large language model (LLM) of their choice for their specific needs. They prefer to work with multiple LLM providers and not to be restricted to a one-supplier ecosystem. 

Enterprises have lakes and oceans of data. Often, an enterprise’s data lake and the AI training center of choice physically reside in different locations (e.g., across town or across the country). This means a lot of data needs to be moved, potentially up to all the data ever created by a major company. 

Dave noted the following: 

Moving the data into the AI training data centers is a bottleneck. As the enterprises work through their AI and cloud strategy—their data strategy— the need for a refreshed network strategy becomes apparent. When the enterprises re-architect their networks, they go with 100G access. The middle mile CSPs will aggregate the client’s 100G wavelengths to 400G for transport across their multi-terabit optical networks. 

As enterprises consider upgrading their key sites to 100Gbps access, questions arise regarding the state of the middle mile and the core. If access is 100G, how many terabits are required in the middle mile and core portions of the network?  

Performance expectations are also increasing. Enterprises have become much more sensitive to latency and want the network latency statistics on primary and secondary routes under consideration. Are the traditional optical network paths, often originally deployed along pipelines and rail lines, the optimal low-latency path between today’s enterprise data lake and the LLM training center? 

Figure 1: Enterprises Consuming Waves for the Cloud and AI

Cloud AI Provider Perspective

Cloud and AI providers have massive network requirements. Many of these providers have their own optical cores, which include metro, long haul, and international subsea segments. The emergence of the new AI ecosystem is creating new and enhanced network needs for these providers. They are typically constrained in terms of network capillarity and have limited access to end customers, particularly enterprises. 

For the cloud and AI provider communities, their immediate needs start at the physical fiber level: 

  • Expanded connectivity into all new and expanding cloud and AI properties.
  • Primary and secondary latency-optimized routes for today’s traffic patterns.  

The next set of requirements focuses on the ingestion of client traffic from access through the middle mile with the attributes of speed, flexibility, agility, and reliability. The traditional wavelength paradigm was quite static, but today’s high-capacity bandwidth needs are much more dynamic. AI training projects may be occasional but massive endeavors and, in such cases, the win-win solution for all parties would be large-scale but temporary bandwidth. Industry scale would involve numerous enterprises, verticals, and AI models, with growth and evolution over time.  

How would this network be built? The traditional paradigm of static wavelength, with “set-and-forget” provisioning, would not be agile and responsive enough for the new environment. The new environment requires the following: 

  • A robust, federated ecosystem, including last- and middle-mile network operators. 
  • An automated, agile, silicon-speed business process environment. 
  • An automated and responsive operational environment. 

New expectations for business processes would include visibility on-route inventory with key performance parameters and pricing.  

On the operations side, cloud and AI providers and more enterprises are becoming sophisticated optical network clients. They desire real-time photonic operational data, including: 

  • Photonic performance of the reconfigurable optical add-drop multiplexers (ROADMs), optical line amplifiers, and optical transceivers. 
  • Performance statistics, such as latency, optical loss, and optical pluggable temperature. 

Access to the photonic performance datasets would enable a more predictive and proactive operational stance. Policies could be set to enable pre-emptive actions based on typical degradation scenarios to maintain optimal network performance.  

Dave captured the current state of affairs as follows: 

Non-standard APIs do exist, but the industry needs to evolve to a fully standardized environment to achieve the scale needed. ed environment to achieve the scale needed.

MEF’s LSO Framework

Over the course of decades, MEF has established a framework that would meet the industry’s needs—a multi-carrier Ethernet federated and automated network specification known as the LSO framework. 

The LSO framework consists of MEF-defined specifications that enable standardized service orchestration based on the standardized lifecycles of end-to-end connectivity services across one or more network service domains. It is an agile approach to streamlining and automating the service lifecycle in a sustainable fashion for coordinated management and control across all network domains responsible for delivering an end-to-end connectivity service (e.g., carrier Ethernet, IP VPN, and MPLS).  

MEF 55.1 Lifecycle Service Orchestration (LSO): Reference Architecture and Framework describes a reference architecture and framework for orchestrating the service lifecycle. It includes a set of functional management entities that enable cooperative service lifecycle orchestration for the MEF 3.0 Connectivity Services standard. The framework also provides high-level functional requirements and outlines high-level operational threads describing orchestrated connectivity service behavior as well as interactions among management and control entities.  

The management interface reference points that characterize interactions between LSO functional management entities are identified in the reference architecture and are described in such a manner that they can be realized by interface profiles (and further by APIs), which can be used to enable automated and orchestrated connectivity services.  

MEF has also focused industry efforts on specific high-value use cases. Multi-cloud connectivity has emerged as a key use case. 

Figure 2: Network-as-a-Service (NaaS) Use Case: Multi-Cloud Connectivity

MEF has over 39 CSPs with LSO networks in production and at least another 36 working towards production. MEF has developed both business and operational process frameworks.

Figure 3: MEF LSO Business and Operational APIs Support

The next step is to build upon the Wavelength-as-a-Service definitions in standards MEF 63 Subscriber Layer 1 Service Attributes and MEF 64 Operator Layer 1 Service Attributes and Services to create standardized wavelength product models that can be used in the LSO business APIs as product payloads. The first pre-standard version of the LSO wavelength product payload for use with LSO APIs should be available on the MEF LSO Marketplace by the end of 2024. This will be alongside Carrier Ethernet, internet access, multi-cloud, and edge compute product payloads, which can already be integrated with the LSO business APIs using MEF’s LSO Blending Tool

The ability to implement and use the same LSO business APIs with a wide range of LSO product payloads—including wavelength product payloads—enables a high ROI on LSO API implementation. It also empowers NaaS and communication service providers to quickly support the latest connectivity and other products needed to support the emerging AI middle mile and federated wavelength use cases comprehensively. 

Appendix

MEF Resources:

Omdia Resources:

Learn More

Tags:
Ian Redpath

Ian Redpath

Research Director, Transport Networks and Components | Omdia

Ian is the Research Director for Omdia’s optical transport, components, routing, and networked edge services. He is responsible for strategy, client, product, and team development. Managing a team of communications technology professionals, he covers how communications and cloud service providers and enterprises utilize and deploy leading-edge optical networks, components, routing, and edge technologies.

Ian and the team have been advising clients on how to evolve and grow networks based on a rapidly evolving 5G, cloud, and edge world. Ian’s past advisory efforts have included work on the evolution of open optics and transport SDN, right of way value for new entrants, and cloud-communications SP partnering. He has also supported open industry fora, built hot topic conference tracks, and supported industry player mergers and acquisitions. Ian is the 2019 winner of the NGON & DCI World People’s Choice Award and is a regular speaker at industry events. He received his MBA from Queen’s University at Kingston in Canada and a degree in electrical engineering from the University of Manitoba.