Optimizing the Efficiency of the Data Analytics Framework Using Microservice Architecture
Bin Enam, Sheikh Saimul Haque Nazeef (2020)
2020
Degree Programme in Information Technology, MSc (Tech)
Informaatioteknologian ja viestinnän tiedekunta - Faculty of Information Technology and Communication Sciences
This publication is copyrighted. You may download, display and print it for Your own personal use. Commercial use is prohibited.
Hyväksymispäivämäärä
2020-05-27
Julkaisun pysyvä osoite on
http://urn.fi/URN:NBN:fi:tuni-202005034890
http://urn.fi/URN:NBN:fi:tuni-202005034890
Tiivistelmä
This thesis describes the backend of the new data analytics framework that has been designed and developed for the new reporting feature of Cloubi. Cloubi is a web application used for creating and distributing learning materials. The reporting feature is used by the students and teachers to check the performance of the students. The new data analytics framework was developed using microservice architecture and aims to be faster in terms of fetching the students’ data compared to the previous data analytics framework developed using monolithic architecture.
The design of the previous data analytics was kept in mind while designing the new data analytics framework. The implementation included the creation of a microservice consisting of an application that is used for getting the events from Cloubi via Kafka and filling up the database used by the microservice. The application can then be used to make queries retrieving the students’ data required for the reporting feature.
After the microservice was fully functional and was interacting with Cloubi, a set of integration tests were implemented to check whether the individual modules were working as supposed to.
At the end of the thesis, a comparison was done between the previous and the new data analytics framework to prove that the new data analytics framework was better and served the goal of the thesis in optimizing the performance of the reporting feature using the new framework compared to the previous one.
The design of the previous data analytics was kept in mind while designing the new data analytics framework. The implementation included the creation of a microservice consisting of an application that is used for getting the events from Cloubi via Kafka and filling up the database used by the microservice. The application can then be used to make queries retrieving the students’ data required for the reporting feature.
After the microservice was fully functional and was interacting with Cloubi, a set of integration tests were implemented to check whether the individual modules were working as supposed to.
At the end of the thesis, a comparison was done between the previous and the new data analytics framework to prove that the new data analytics framework was better and served the goal of the thesis in optimizing the performance of the reporting feature using the new framework compared to the previous one.