14th International Conference on emerging Networking EXperiments and Technologies (CoNEXT 2018)

Metro-Haul presentation:

By Ivan González Martínez, Jorge E. López de Vergara Méndez, Javier Aracil Rico, from Naudit;

• Title: Wormhole: a novel big data platform for 100 Gbit/s network monitoring and beyond
• Abstract: Internet measurement and analysis is a never-ending challenge that increases in difficulty every year with the network evolution. This transformation affects the analysis in different ways, like changing-trends, speed increments or new protocols and ciphers. One possible solution is to use very large dedicated and expensive monitoring equipment. As an alternative, big data-based distributed architectures are being proposed for network monitoring and analysis. However, the high throughput presented in a 100 Gbit/s link overcomes state-of-the-art big data solutions, unless a huge amount of computers are used. In order to solve that issue, we have created Wormhole: a streaming engine that can surpass existing limitations by distributing the input messages/packets coherently over different off-the-shelf analysis equipment, thus reducing costs. All the non-realtime digestible data is stored on a distributed filesystem for later filtering and in-deep capture analysis. This solution creates online realtime monitoring metrics with the ability to dig deeper into issues when needed. The prototyped architecture is able to deal with 100 Gbit/s networks and enables scaling it to higher rates by just adding more computing nodes and/or by trimming encrypted packet payloads.

CoNEXT 2018 will be a major forum for presentations and discussions of novel networking technologies that will shape the future of Internetworking. The conference is single track and features a high-quality technical program with significant opportunities for individual and small-group technical and social interactions among a diverse set of participants. The CoNEXT conferences focus on stimulating exchanges between various international research communities.