CETI Network Infrastructure -- Final Draft, Rev 8 -- December 2, 1997 11:00 AM

 

Network Infrastructure Build-out

The CETI corporate partners, in collaboration with CSU campus and Chancellor’s Office staff have developed a draft model for the build-out of the CSU Telecommunications Infrastructure. The proposed infrastructure will use a scalable ATM/SONET architecture to support enhanced voice, video and data applications. The ATM/SONET architecture will provide the CSU with a stable "state-of-the-art" base from which to build and grow the network.

This framework incorporates both "wired" and "wireless" provisioning for inter- and intra-campus deployment. This "draft of a model" is intended to provide a generic target infrastructure which will guide CETI and Campus staff in designing the actual build-out on each individual campus. This model is not intended to be prescriptive in regards to any specific campus plant, but expected to be a "starting point", based upon the CSU developed minimum baseline, from which to work with in developing the network build-out plan. In consultation with the campuses, each campus network plan will be developed using existing network infrastructure where possible and augmenting that design and infrastructure to more closely approximate the model.

Future network growth capabilities will be a factor in the selection of all hardware and software deployed by CETI. Currently, CSU participates as a member of the University Corporation for Advanced Internet Design (UCAID) and is an active player in Internet 2 development. The proposed infrastructure will continue to evolve as Internet 2 standards are adopted and deployed through CETI.

Inter-Campus Network Infrastructure

  1. Backbone will be OC48 SONET (Dual Ring) with OC3 and/or OC12 drops.
    1. SONET is a synchronous optical transport that provides very high bandwidth along with high availability and self-healing topologies. It also makes increasing the inter-campus bandwidth straightforward by allowing the nodes' electronics to be replaced while the physical medium remains the same.
    2. Providing a SONET dual ring depends on the ability of CETI to build or lease dark fiber between backbone locations. If this proves impossible or cost-prohibitive, a point-to-point or public ATM solution could be used instead. In this event, the bandwidth available to a campus would remain unchanged but other SONET benefits (such as self-healing topologies) would not be available or would be lessened.
  2. SONET equipment will be placed at strategic locations and selected campuses.
    1. Strategic locations may include GTE or other provider points of presence. SONET equipment may be placed on campuses where necessary but may not be present on all campuses.
  3. Campuses will be served with an OC3 or OC12 connection.
    1. The bandwidth available to a given campus will be determined by (in no particular order):
    2. a) educational requirements
    3. b) geography
    4. c) cost
    5. d) revenue generation requirements
    6. e) facilities availability
  4. An ATM switch and/or router will be used at each campus to gain access to the inter-campus backbone.
    1. At each campus, an ATM switch will be connected to the inter-campus infrastructure with one or more OC-3 or OC-12 connections as appropriate. The campus ATM backbone switch will be utilized to support quality of service (QoS) applications (voice, video, multi-media, etc.) that have specific latency, jitter, or delivery requirements. For applications such as voice which require guaranteed bandwidth, the ATM switch could interconnect campus voice switching systems to one another across the inter-campus backbone.
    2. A campus backbone router will provide inter-campus backbone access and have an OC-3 or better ATM connection to the campus ATM backbone switch. The router's connection to the campus LANs will consist of multiple 10 Mb, 100Mb, and 1Gb interfaces as needed.
    3. At campuses with projected high bandwidth needs, the campus backbone router will connect directly to the inter-campus infrastructure with two OC-3 or OC-12 Internet Protocol Packet over SONET interfaces (IPoS). The individual OC-3 or OC-12 interfaces will connect over the inter-campus infrastructure to neighboring backbone routers connected in the same manner.
  5. CETI will continue to provide 4CNet connections using the CETI inter-campus backbone.
    1. Dedicated Internet and video teleconferencing services for the California Community Colleges and other subscribers (libraries, county offices of education, etc.) commonly known as "4CNET" services will remain intact with no direct improvements from the CETI program. However, the access and quality of the connectivity will be preserved by utilizing the CETI infrastructure as it is built-out for the CSU. Further, the network will be built out such that network capacity of current 4CNET backbone node sites will not be impacted from serving 4CNET subscribers.
  6. Traditional terrestrial based services along with satellite, short and long haul microwave will be considered for transporting voice/data/video applications across the network.
    1. Because of needed capacity upgrades tied to revenue, the costly one-time build-outs required for satellite and microwave will need to be considered as they can provide early enabling of technology in areas that would be difficult to service with terrestrial based services in the same time frames. Additionally, satellite services by their broadcast nature have a much broader audience and coverage and thus their utilization may be very attractive for generation of new revenues.
  7. Backhaul video services intended for broadcast via CSUSat, local/regional ITFS, MMDS, Cable TV, or Hughes broadcast services (e.g. DirecTV) will use digital and analog transports that are at least equal quality to the delivery system that they are connecting to.
    1. The CSUSat system shall rely on 4CNET for the interconnectivity necessary to transport programs originating at contributing institutions to the satellite uplink(s). In all cases, the transport mechanism shall be greater than or equal to the final data rate utilized via satellite. For routine educational content, 2-3 Mbps shall be typical. Those programs having a high degree of action (fire or law enforcement training, for instance, with video taken in the field) may transmit at up to 4-6 Mbps. "Near broadcast quality" shall be considered to occur at 12 Mbps. 4CNET/CSUSat interconnectivity may be supplemented with point to point microwave, ITFS, CATV and other traditional broadcast systems where it is available between contributing institutions and uplink. One or more MPEG-2 DVB encoders will be located at the originating institution as well as the satellite uplink(s).
  8. CSUSat private satellite communication service will conform to MPEG-2 DVB standards supporting MCPC and SCPC "Ku" digital transmission multi-channel (three to eleven) streams per transponder.
    1. Inaugurated in January of 1996, the CSUSat satellite service augmented network multimedia resources by allowing transmission of two television signals via satellite to receive sites throughout the state and nation. Utilizing the "Spectrum Saver" digital video transmission system (based upon a "legacy" system in use at California State University, Chico) two 3.3 Mbps carriers are uplinked continuously to PanAmSat "SBS 5". Transmitting in Single Channel Per Carrier (SCPC) mode the two individual carriers are time shared between CSU institutions and used to televise classes via satellite to High Schools, Community Colleges, County Offices of Education, Corporate Offices, Prisons, military installations and other private and public institutions not otherwise connected to 4CNET.
    2. Currently uplinked from facilities located at CSU, Chico the two carriers support different antenna sizes. CSUSat "Channel 1" is engineered for a 1.8m receive antenna (supporting a "legacy" network developed by CSU, Chico in the early ’90s). CSUSat "Channel 2" is engineered for a larger 3.7m receive antenna minimizing the power required from the satellite and, hence, ongoing satellite costs. Both carriers occupy 14% of SBS 5, transponder 11. SBS 5, an older satellite, will soon to be replaced (in the same orbital slot) by PanAmSat Galaxy 10. Having different transponder characteristics, the two CSUSat carriers will occupy 17% of transponder 5 on the new satellite (as proposed by PanAmSat).
    3. The "Spectrum Saver" compressed digital video (CDV) transmission system currently in use at Chico predated modern MPEG-2 Digital Video Broadcast (DVB) equipment. MPEG-2 has evolved as a standard of television coding and interchange at data rates greater than 1.5 Mbps. CETI presents a unique opportunity to implement MPEG-2 Digital Video Broadcast (DVB) standards in the CSUSat system. The conversion would:
    4. • Allow for seamless transport of CDV signals between the terrestrial and satellite network (without decoding to audio and video).
    5. • Increase the potential number of viewers by taking advantage of existing MPEG-2 DVB satellite receive sites in place for other services and systems.
    6. • Increase the potential number of satellite channels by taking advantage of the robust coding scheme and Multiple Channel Per Carrier (MCPC) statistical multiplexing employed in most MPEG-2 satellite systems.
    7. In implementing an MPEG-2 DVB compliant transmission system, network operations should also support the following:
    8. • Continued operation or replacement of "legacy" systems and networks previously developed by CSU institutions.
    9. • Regional diversity and redundancy through the operation of multiple uplinks contributing to the network operating in both SCPC and MCPC modes.
    10. • Sufficient satellite capacity for a minimum of four (4) and up to twelve (12) simultaneous CDV channels.
    11. • Unidirectional or asymmetric data services.
    12. • Full bandwidth analog satellite operation meeting EIA RS-250C quality standards on an occasional and reoccurring basis.
    13. • Cultural diversity (along with related revenue opportunities) through national and international broadcast of CSUSat programs
    14. • Common conditional access, control and network administration for coordination of contributing uplinks and network receiver authorization.
    15. • Coordinated equipment installation and utilization at CSUSat receive sites so that telephone talk-back, recording and viewing facilities may be easily shared between multiple program originators and institutions.
  9. CSUSat programming intended to reach CSU mass audiences will exploit Hughes broadcast services (e.g. DirecTV and PC) as a public satellite medium.
    1. Direct Broadcast Satellite (DBS) and related data services such as Hughes Communications’ "Direct-TV", "Direct-PC", "Direct-Duo" and "Insight" may be utilized for "Direct To Home" (DTH) program delivery. One (1) or more CSUSat CDV channels may serve as a back-haul carrier to the DBS MCPC aggregated uplink location (CSUSat is unable to transmit directly to the DBS satellites). Back-haul data rates shall be commensurate with the final satellite transmission rate.
  10. Voice transport services across the inter-campus backbone will occur at a quality at least equal to the delivery system they are connecting to.
    1.  

Intra-Campus Network Infrastructure

  1. The campus backbone will be either a star or ring topology. Star backbones will use 100 Mb to 155 Mb connections to a backbone switch. Ring backbones must support OC-3c drops at a minimum.
    1. The campus backbone may be built as either a star or ring network. In special instances, a combination of the two topologies may be used.
    2. In a star topology, all campus buildings would connect to a central switch and/or router. If a campus building does not have any QoS, or higher bandwidth needs, this connection could be a 100Mb ethernet drop connected directly to a high-end ethernet switch or router. For QoS, or higher bandwidth needs, an OC-3 ATM connection from a central ATM switch to a building ATM switch would be used.
    3. For a ring topology, point-to-point ATM connections from building to building, at either OC-3 or OC-12, would be used. If the intra-campus infrastructure supports sufficient fiber for dual building entrances, SONET equipment may be used to build the campus backbone. In lieu of SONET switching equipment, ATM switches may be connected directly to one another.
    4. Where ATM capable equipment is used or required, an OC-3c drop is the minimum necessary to meet the baseline requirement of 100-155 Mb/s access to a particular building. In some cases, it may be difficult or cost-prohibitive to build a full ring throughout the campus; in this event the majority of buildings may be served by home runs back to a smaller higher speed ring in order to preserve the minimum baseline requirement of 100-155Mb/s access to the building.
  2. Existing intra-campus infrastructure will be re-used where it meets infrastructure needs. Where necessary, ATM switches will be used to connect campus premise buildings.
    1. TIP guidelines provide for the placement of multimode and/or single mode fiber cable interconnecting buildings on campus. All buildings equipped with ample unused fiber optic facilities will be considered to have met TIP guidelines and these facilities will be reused.
    2. Hubs, ethernet switches, routers, LAN concentrators, ATM switches, and other network elements will be used to provide intra-campus connectivity. ATM switching is one method of providing for high bandwidths between buildings where quality of service (QoS) is a requirement by an application. These bandwidths range up to and include OC-3.
  3. PBX switches (new, existing or upgraded) will be connected to the inter-campus network and the PSTN providing uniform dialing, unified multi-media messaging, and other voice/data/video services. The inter-campus uniform dialing will be based on the public switched network numbering plan currently used by each campus. Automatic Route Selection and Automatic Alternative Routing will be used to route calls on private, software defined (SDN), and public (PSDN) networks. Changes to existing campus numbering plans will be allowed if a switch replacement, upgrade, or expansion leaves no alternative solutions. Unified multi-media messaging will utilize non-proprietary, open standard interfaces (whenever possible) between the voice, data, and video networks and platforms.
    1. The PBX system will provide telephony type services to the campus and associated remote locations. The system will provide traditional analog services and ISDN voice and video communications as well as voice applications such as voice mail, audio conferencing, and Automatic Call Distribution (ACD).
    2. The ISDN feature set will satisfy requirements for Primary Rate Interface (PRI), Basic Rate Interface (BRI) and both the station and Telco side of the system interface. The interface will support both NI-1 and NI-2 features. Call by Call service for Central Office and QSIG messaging for other vendor PBX networking will be provided. ISDN video conferencing will be available within the campus and to remote systems or campuses.
    3. Voice application processors will provide the campus with unified voice messaging via AMIS protocol. The campus user will have access to voice mail services such as message store and forward, distribution lists, and notification features from any location. Audio conferencing features will provide the user with a scheduling feature, secure meeting arrangements, and LAN or telephone based administration. ACD features will provide LAN based agent and supervisor administration features, custom reports, and real-time routing control.
    4. Administration features of the PBX system will include centralized administration of systems and remote campus units as well as associated applications processors. Call accounting features will be provided by the centralized administration processor system. Emergency services will be provided an E911 processor system.
    5. The PBX system will be implemented utilizing existing campus infrastructure where possible and will be converted to the new distribution following build out.
    6. Inter campus dialing and long distance call routing will remain with existing providers until the network is complete. Once in place, inter campus dialing can be routed over the ATM/SONET network and long distance evaluated for best rate options. For dialing consistency the local exchange carrier will convert the existing Centrex numbers to Direct Inward Dial numbers. This will maintain continuity within the campus for four-digit dialing, and for external callers already familiar with the existing seven-digit access.
    7. Accessing off net calling capability will be similar to the existing process dialing a leading "trunk access code" consisting of a single digit. The new system will access the appropriate facility via the Automatic Route Selection program.
  4. Wireless telephone communications will be provided through the integration with the PBX while on campus and through a cellular provider while off campus.
    1. Campuses will have internal cell telephone networks connected to the campus PBX, which will allow subscribers to forward campus extensions to the wireless network. In addition, an adjunct server connected to the PBX will route calls through an external wireless service provider when the subscriber is off campus.
  5. Wireless data, short microwave or infrared communications shall be considered for transporting data and video applications where and when appropriate and cost effective to do so.
    1.  
  6. Remote access to the network will be provided through ISDN/BRI, analog, cable TV (cable modems), satellite (DirecPC) or xDSL type network services as appropriate.
    1.  
  7. Video services will be bi-directional in design supporting video-on-demand, distance learning and video conferencing in appropriate locations and at various bandwidths as necessary.
    1.  
  8. Video infrastructure facilities will permit building locations to receive television programming, and to allow for the transmission and reception of "broadcast quality" services from designated inter- and intra-campus sites.
    1. Connectivity between buildings shall provide for the broadband distribution of multiple uncompressed television channels and data from one (1) or more cable head ends to locations throughout the campus. The broadband plant shall also support the return of multiple uncompressed television channels and data (a "two-way" system). Single mode fiber shall be the medium of choice for newly installed facilities. Campuses may opt to retain and enhance existing coaxial cable plants should they be perceived to meet their programmatic needs.
    2. The typical campus cable headend may include analog and digital satellite reception equipment (compatible with the CSUSat system and others), program recording and origination equipment, message channels, cable modems, decoders, television modulators, processors and amplifiers and other equipment sufficient to support the CATV infrastructure.
    3. The inter building plant shall also permit connection of uncompressed "broadcast quality" audio and video meeting EIA RS-250C standards between gyms, auditoria, media center(s), transmission facilities and other locations where high quality audio and video is desired for distribution or broadcast. Multi mode fiber shall be the medium of choice for new construction. Coaxial cable and twisted pair may also be used where sufficient to meet the operational requirements of the program and institution.

Intra-Building Network Infrastructure

  1. Access concentrators and/or LAN emulation will be used to connect existing intra-building networks to the intra-campus network.
    1. The access concentrator will handle layer 2 and/or layer 3 traffic forwarding and support real-time, multi-media network traffic using ATM when Quality of Service (QoS) issues are present. This concentrator should have the ability to interconnect 10/100 Mbps ethernet, gigiabit ethernet, Token Ring, FDDI and ATM LANs.
  2. ATM as well as non-ATM LAN technologies will be supported.
    1. The support technologies will be shared or switched Ethernet, Fast Ethernet, Gigabit Ethernet, Token Ring, FDDI, and ATM. Any equipment installed will allow these LAN technologies to communicate transparently.
  3. Connectivity to the desktop will be provided by UTP-5 (category 5) or fiber where necessary to meet bandwidth requirements. The infrastructure will support at a minimum the baseline of 10base-T with higher bandwidth supported where necessary.
    1. Every effort should be made to augment the existing desktop network connections with a dedicated switch environment and then utilize existing equipment when necessary. Future growth capacity, such as 10/100 switches, should be considered in new installations.
  4. Wireless data or infrared communications shall be considered for transporting data and video applications where and when appropriate and cost effective to do so.
    1.  
  5. Desktop and conference room systems requiring video capabilities will be accommodated via the intra-campus network. Similar facilities may also be used to support classrooms, laboratories and other spaces.
    1.  
  6. Video infrastructure facilities will permit classrooms, laboratories, offices and other public locations to receive off-air, satellite, and locally generated television programming. Depending on the institution, the upgrading, expansion, or implementation of a cable television RF system will be considered as a part of any intra-building design.
    1. Individual buildings shall be equipped with a fiber or coaxial riser and distribution system sufficient to connect the campus CATV system to classrooms, laboratories, conference facilities, offices, auditoria and other facilities where multiple channel, full bandwidth television is desired. UTP may also be considered within the distance and bandwidth constraints permitted by the technology for final connection to the classroom or desktop.
    2. The typical campus CATV system may include channels dedicated to off-air stations in the local area, news services (SCOLA, CNN, CSPAN), entertainment channels, teletext, televised classes, CSUSat channels, sporting events and other programs of interest to the University. A block of channels may also be reserved for occasional programs, such as one time or reoccurring satellite feeds, tape playback and other special events.
  7. Video infrastructure facilities will also allow for the transmission and reception of "broadcast quality" services to designated studios, production environments, network operation centers, microwave/satellite sites, etc.
    1. Building infrastructure shall support the interconnection of full bandwidth audio and video over fiber, coax and twisted pair in such facilities as media centers, television production suites, televised classrooms and studios, imaging laboratories, broadcast and network centers and other areas where high quality, uncompressed audio and video is required.
    2. These facilities shall also have the capability to import and export MPEG-2 CDV and electronic image files via the LAN and WAN as well as connections to the campus broadband CATV system.