2nd Performance Management Workshop

Starts 8 Mar 2022, 14:00

Ends 8 Mar 2022, 17:15

(Timezone - Europe/Belgrade)

Zoom room

Virtually Hosted

Ivana Golub (PSNC), Pavle Vuletic (UoB), Tim Chown (Jisc)

The Network Technologies and Services Evolution work package of the GÉANT GN4-3 project is organising a 2nd workshop on Performance Management. The first workshop was organised in Zagreb on 4th-5th March 2020. 

The workshop will include presentations on and discussions of:

• High speed network monitoring and data transfers (100G)

• Monitoring data analytics and correlation

The workshop was recorded. Video recording is available here.

14:00 → 14:15 Welcome and introduction

Convener: Pavle Vuletic (University of Belgrade)

14:15 → 15:10 High speed network monitoring

14:15 100G tests between GEANT, SURF and RNP

Over the last three months, we have been running network performance tests involving perfSONAR hosts in Europe, Brazil and USA. We have
also compared results with tests run on a test bed with four hosts connected to a switch.

One special case of our tests involved testing the new Bela link that connects Europe (through Portugal) to Brazil at 100G. We were aiming to identify routing problems, and to obtain maximal throughput with a minimum of retransmits. We tested the effect of different congestion of algorithms, socket length and MTU.

We report sustained throughput from Netherlands to Fortaleza above 96Gbps. We present cases of limited performance between 100G hosts and try to identify the reasons for low performance.

Speaker: Raul Lopes (JISC)

RaulLopes-WP6-final-1.pptx

14:30 Data Mover Challenge (DMC) 2021 report

Speakers: Andrew Howard (Australian National University, Australia), Tim Chown (JISC)

PMW DMC tech info.pptx

14:45 Achieving 100 Gigabit Performance

The talk will present the tests and measurements made on 100 Gigabit network infrastructure using TCP/IP. It will cover three domains: between end sites in the UK and Italy, between Latin America and Europe using the EllaLink Submarine Cable, and transfers between Australia to Europe to support SKA using both a path via the US and a path on the CAE1 link.

Speaker: Richard Hughes-Jones (GEANT)

GEANT_PerfWorkshop_v3.pdf

15:00 Q&A

15:10 → 15:20 Coffee break

15:20 → 17:15 Analytics and correlation

15:20 PMP data analytics

Performance Measurement Platform explores performance of the GÉANT backbone while experiencing perfSONAR on small nodes. In our work we explore the possibilities of using machine learning algorithms on perfSONAR collected data in order to detect network anomalies.

Speaker: Ljubomir Hrboka (CARNET)

GN20220308_PMW_pmp_data_analytics.pdf

15:35 Detecting anomalous latency and jitter in Timemap

Timemap is a real-time monitoring tool to collect, visualize and analyze latency and jitter. Timemap is collecting data from the Géant backbone devices since April 2021. Recent Timemap updates introduce support for streaming ML anomaly detection. In this talk we will introduce the algorithms adopted in Timemap, the usability improvement enabled by the new feature and we will discuss some detection performance aspects.

Speaker: Fabio Farina (GARR)

Timemap_Anomaly_Detection_2ndPMW_2022_FFv1.pdf

15:50 AI/ML based path optimisation

Speakers: Nichloas Buraglio (ESnet), Scott Campbell (ESnet)

16:05 Q&A

16:15 SAND project

Speaker: Shawn McKee (University of Michigan)

GEANT-PM2-McKee-08-Jan-2022.pdf

16:30 NetSage

NetSage is an open privacy-aware network measurement, analysis, and visualization service designed to address the needs of today's international networks. Modern science is increasingly data-driven and collaborative in nature, producing petabytes of data that can be shared by tens to thousands of scientists all over the world. NetSage services provide an unprecedented combination of passive and active measurements, including SNMP data, flow data, and tstat-based traffic analysis, perfSONAR, and longitudinal network performance data visualization. Several new applications of the NetSage framework are being explored for campus use, upcoming HL-LHC data challenges, and as the basis for other monitoring platforms such as ESnet's Stardust. This talk will explain how NetSage operates, its current applications, and plans for future development.

Speaker: Doug Southworth (Indiana University)

20220308 - NetSage GEANT.pptx

16:45 Stardust

Speaker: Andrew Lake (ESNET)

20220308-Stardust GEANT Performance Mgmt Workshop.pdf

17:00 Q&A

17:10 Wrap up