A big data Product Development
Introduction
![knoldus-zillon knoldus-zillon](https://poc.nashtechglobal.vn/wp-content/uploads/elementor/thumbs/knoldus-zillon-qj0be8tcakz8r9qrlmq1y2qg6j4wfi359vuhvgio7q.png)
NashTech converted Zillion’s monolithic architecture to a microservices structure, refactoring and cleaning the code base and implementing deltas for optimised processing. This resulted in a pipeline that could handle five times the load at 1/200th of the original time.
About ZILLION
Zillion is a healthcare company having the goal of improving virtual healthcare. It provides an online interaction management platform that streamlines the entire communication process to create a better participant experience with every interaction.
Challenges
The main challenge for Zillion was to deal with the huge datasets, including the consolidated medical records and participant data from the devices they already use, from smartphones to Fitbits and more. The existing pipelines were processing and loading the whole datasets (in terabytes) each time when the pipeline ran which was taking quite a long time. The challenge was to build the pipeline to implement the deltas so that the data processing and loading occur only on the changed data (inserted/updated) instead of the whole dataset. Another challenge was to reshape the existing unstructured code base using scala best practices and converting the application to microservices-based architecture.
Solution
NashTech quickly converted the whole monolithic architecture to a microservices structure, refactored the code base to make it testable without hindering its actual logic, introduced the test cases, and cleaned the code by using the scala best practices following the Knolway (NashTech software development methodology). Further, NashTech implemented the deltas to process the changed data instead of playing with the large datasets each time, drastically reducing the processing time from hours to seconds. The end result was a pipeline that could handle 5 times the load at 1/200th of the original time.
Read more case studies
![](https://poc.nashtechglobal.vn/wp-content/uploads/2024/01/RPS-logo.png)
Modernising legacy systems and driving efficiencies through partnership with RPS Under Dev
Explore how NashTech help RPS modernise legacy systems and drive efficiencies through partnership
![](https://poc.nashtechglobal.vn/wp-content/uploads/2024/01/RPS-logo.png)
Modernising legacy systems and driving efficiencies through partnership with RPS
Explore how NashTech help RPS modernise legacy systems and drive efficiencies through partnership
![](https://poc.nashtechglobal.vn/wp-content/uploads/2023/04/confidential-logo_positive-version.webp)
Supporting digital shelf analytics and unlocking eCommerce growth
Explore how NashTech help the digital shelf analytics and unlock growth with a world leading data insights and eCommerce solutions provider.
Let's talk about your project
Our partnerships
![docker-white-png](https://poc.nashtechglobal.vn/wp-content/uploads/2023/03/docker-white.png.webp)
![ibm-white-png](https://poc.nashtechglobal.vn/wp-content/uploads/2023/03/ibm-white.png.webp)
![microsoft-logo](https://poc.nashtechglobal.vn/wp-content/uploads/2023/04/Microsoft-logo.webp)
![umbraco](https://poc.nashtechglobal.vn/wp-content/uploads/2023/03/umbraco.webp)
![confluent-white-png](https://poc.nashtechglobal.vn/wp-content/uploads/2023/03/confluent-white.png.webp)
![databricks-white-png](https://poc.nashtechglobal.vn/wp-content/uploads/2023/03/databricks-white-.png.webp)
![hashicorp-white-png](https://poc.nashtechglobal.vn/wp-content/uploads/2023/03/hashiCorp-white.png.webp)
![lightbend-white-png](https://poc.nashtechglobal.vn/wp-content/uploads/2023/03/lightbend-white.png.webp)
![microsoft-modernization](https://poc.nashtechglobal.vn/wp-content/uploads/2023/07/Microsoft-Modernization.webp)
![aws-partner](https://poc.nashtechglobal.vn/wp-content/uploads/2023/07/AWS-partner-1.webp)
![ms-solutions-partner-logo](https://poc.nashtechglobal.vn/wp-content/uploads/2023/07/MS-Solutions-partner-logo-2.webp)
![ms-data-and-ai](https://poc.nashtechglobal.vn/wp-content/uploads/2023/07/MS-Data-and-AI-1.webp)
![ms-digital-and-app-innovation](https://poc.nashtechglobal.vn/wp-content/uploads/2023/07/MS-Digital-and-App-innovation-1.webp)