GAIA-X Compatible Data Flow Monitoring in Data Exchange System
Akther, Shamshad (2022)
Akther, Shamshad
2022
Master's Programme in Computing Sciences
Informaatioteknologian ja viestinnän tiedekunta - Faculty of Information Technology and Communication Sciences
This publication is copyrighted. Only for Your own personal use. Commercial use is prohibited.
Hyväksymispäivämäärä
2022-07-26
Julkaisun pysyvä osoite on
https://urn.fi/URN:NBN:fi:tuni-202206205753
https://urn.fi/URN:NBN:fi:tuni-202206205753
Tiivistelmä
The Internet of Things (IoT) age is here, thanks to the increased availability and affordability of small computing devices like sensors. The rapid expansion of IoT devices has resulted in larger volumes of data being generated and exchanged between numerous entities. It is challenging to manage such a massive volume of data created from various sources while also controlling how the data is shared or routed. This emphasizes the need for effective data management while maintaining data sovereignty and efficient data transmission between providers and customers. To this goal, Nokia Bell Labs has developed a distributed data dissemination system based on the Publish/Subscribe messaging protocol and according to the microservice architecture. Meanwhile, GAIA-X is working on a federated data architecture that will deliver a networked data infrastructure to meet the most demanding digital sovereignty requirements while staying future-proof. This thesis is part of the Nokia Bell Labs project, the goal of the project is to find whether Nokia's data exchange system is GAIA-X compatible.
Nokia's data exchange system can currently monitor traffic between individual system components. However, for the system to be GAIA-X compatible, it must adhere to GAIA-X data exchange standards. One requirement for the data exchange system is that it has mechanisms to guarantee data sovereignty. The system must track data flow across microservices within components and identify unexpected data usage rules breaches. Hence, data usage policy violations must be noticed in both manual unauthorized system service calls and internal misbehaviour flow.
This thesis presents a monitoring approach based on a distributed tracing mechanism to implement such detection capabilities. Distributed tracing mechanism is a technique for profiling and monitoring systems, particularly those built on a microservices architecture, such as the current data exchange system. It introduces the benefits of logging and monitoring the distributed system. A proof-of-concept solution for the monitoring of the system using distributed tracing mechanism is presented and its implications on the system performance are discussed.
Nokia's data exchange system can currently monitor traffic between individual system components. However, for the system to be GAIA-X compatible, it must adhere to GAIA-X data exchange standards. One requirement for the data exchange system is that it has mechanisms to guarantee data sovereignty. The system must track data flow across microservices within components and identify unexpected data usage rules breaches. Hence, data usage policy violations must be noticed in both manual unauthorized system service calls and internal misbehaviour flow.
This thesis presents a monitoring approach based on a distributed tracing mechanism to implement such detection capabilities. Distributed tracing mechanism is a technique for profiling and monitoring systems, particularly those built on a microservices architecture, such as the current data exchange system. It introduces the benefits of logging and monitoring the distributed system. A proof-of-concept solution for the monitoring of the system using distributed tracing mechanism is presented and its implications on the system performance are discussed.