Hands-on Workshop on Science DMZ and P4-DPDK
Tuesday, August 6, 2024 - Thursday, August 8, 2024
Online
Organizers
- University of South Carolina (USC)
- The Engagement and Performance Operations Center (EPOC)
- Minority Serving - Cyberinfrastructure Consortium (MS-CC)
Overview
This Mini Workshop will first discuss the challenges faced by campus networks when supporting science and engineering applications, associated to research and education activities. Then, it will cover recent advances on network technologies that can solve or mitigate those challenges, and positively impact the performance of data transfers on campus networks. Topics include ScienceDMZs, solutions with and without Science DMZs, best practices on TCP congestion control, how to monitor networks with perfSONAR, fine-grained telemetry with programmable data plane switches, and others. Attendees will be provided access to hands-on training materials running on a virtual platform.
Audience
The workshop is targeted to IT professionals such as system administrators, network engineers, and practitioners in general. The content is also suitable for IT leadership who may want to further understand best practices supporting research and education activities on campus. Additionally, systematic hands-on lab libraries will be made available to educators interested in incorporating the materials on their programs.
Outcomes
By the end of this tutorial, attendees will:
- Identify challenges faced by campus networks when supporting research and education.
- Describe network architectures, such as Science DMZ, that follow best practices.
- Deploy perfSONAR Version 5 to monitor network metrics and visualize them.
- Tune TCP parameters to achieve high-performance data transfers.
- Be familiar with new technologies such as P4 and DPDK to develop applications running at line-rate on servers and switches.
Pre-requisites
The laboratory environment consists of routers, switches, and hosts deployed in IPv4 networks. Attendees are expected to know basic networking (IPv4, local area networks, OSI model). Training activities will be conducted using NetLab. Attendees will be provided with a username and a password.
Agenda
Day 1: Tuesday, August 6
| Time (EDT) | Topic | Presenter |
|---|---|---|
| 11:00-11:05 | Welcome and Introduction | Jason Zurawski (EPOC) [Bio], Jorge Crichigno (USC) [Bio], Jennifer Kim (MS-CC) [Bio] |
| 11:05-11:20 | BGP Fundamentals [PPT, PDF] | Corey Eichelberger (TACC) [Bio] |
| 11:20-12:00 | Lab 1: Hot potato routing and BGP local preferences [PPT, PDF] | Ali AlSabeh (USC) [Bio] |
| 12:00-12:15 | perfSONAR fundamentals [PPT, PDF] | Doug Southworth (TACC) [Bio] |
| 12:15-12:20 | Demo 1: perfSONAR [Demo 1, Demo 2] | Ali Mazloum (USC) [Bio] |
| 12:20-13:00 | Lab 2: Visualizing pScheduler measurements with Grafana [PPT, PDF] | Ali Mazloum (USC) |
| 13:00-15:00 | Break | |
| 15:00-15:30 | Science DMZ fundamentals and data transfers [PPT, PDF] | George Robb (EPOC) [Bio], Ken Miller (EPOC) [Bio] |
| 15:30-15:35 | Demo 2: CUBIC vs BBR under packet losses and large RTTs [Demo] | Elie Kfoury (USC) [Bio] |
| 15:35-16:30 | Lab 3: Enabling large data transfers across a Science DMZ [PPT, PDF] | Jose Gomez (USC) [Bio] |
| 16:30-17:00 | Office hours | Survey |
| Video | ||
Day 2: Thursday, August 8
| Time (EDT) | Topic | Presenter |
|---|---|---|
| 11:00-11:05 | Introduction | Elie Kfoury (USC), Jorge Crichigno (USC), Jennifer Kim (MS-CC) |
| 11:05-11:45 | Fundamentals of P4 and DPDK [PPT, PDF] | Elie Kfoury (USC), Jorge Crichigno (USC) |
| 11:45-11:50 | Demo 3: Heavy hitter detection at 100Gbps [Demo] | Elie Kfoury (USC) |
| 11:50-12:50 | Lab 3: Introduction to P4 and DPDK [PPT, PDF] | Samia Choueiri (USC) [Bio], Elie Kfoury (USC) |
| 12:50-13:00 | Additional lab experiments on P4 DPDK | Elie Kfoury (USC), Jorge Crichigno (USC), Samia Choueiri (USC) |
| 13:00-15:00 | Break | |
| 15:00-15:35 | Portable NIC architecture [PPT, PDF] | Andy Fingerhut (Cisco) [Bio] |
| 15:35-16:20 | Lab 4: Match-action tables [PPT, PDF] | Ali Mazloum (USC) |
| 16:20-17:00 | Office hours | Survey |
| Videos [part 1, part 2] | ||
Access to Lab Platform
To access the lab platform, please use the following URL: https://netlab.cec.sc.edu/
Resources
| Item | Note |
|---|---|
| BBRv3 tests: Link | This presentation contains the latest evaluation of BBRv3 in ESnet |
| BGP VM: Link | Virtual Machine used in the BGP lab series |
| perfSONAR5 VM: Link | Virtual Machine used in the perfSONAR5 lab series |
| NTP VM: Link | Virtual Machine used in the NTP lab series |
| P4-DPDK VM: Link | Virtual Machine used in the P4-DPDK lab series |
| VM for P4 Labs: Link | VM containing lab exercises |
| Cybertraining Material: Link | List of virtual labs on P4, SDN, network tools and protocols, ... |
| P4 Campus: Link | P4 applications for campus networks |
| FABRIC: Link | A programmable research infrastructure |
| Behavioral Model version 2 (BMv2): Link | Reference P4 software switch used as a tool for developing, testing and debugging P4 data planes |
| Software-Defined Networks: A Systems Approach: Link | A book that explores the key principles of Software-Defined Networking (SDN) |
| Mininet: Link | Virtual testbed enabling the development and testing of network tools and protocols |
| Containernet: Link | Mininet fork that allows to use Docker containers as hosts in emulated networks |
| Mininet Installation: Link | A guide that describes the steps to install Mininet on Linux |
| Wireshark: Link | Packet analyzer used for network troubleshooting, analysis, protocol development, and education |
| PNA specification: Link | The webpage hosting the specification of the PNA architecture |
| P4 Zulip channel : Link | Zulip channel for P4 related questions/updates |
| p4c-dpdk backend : Link | The source code of the p4c-dpdk backend |