Devoxx Ukraine 2019: How to build 1000 microservices with Kafka and thrive - Natan Silnitsky

Devoxx Ukraine 2020 becomes a FREE ONLINE event 6-7th of November Kyiv, Ukraine Registration: In today’s environment of globally distributed large scale web applications, reactive, event-driven design is mandatory. In this talk I will showcase how at we Implemented a reliable, scalable, event-driven, distributed Mega Microservices architecture on top of kafka but without kafka streams. We, at Wix Engineering, have built powerful soon-to-be-os libraries for data streaming and data storage using Kafka features like compacted logs and exactly once semantics. These libraries offer low latency, high throughput event processing and also high volume data-storage with very simple and easy to understand APIs that work seamlessly together with other technologies such as gRPC. I will present the challenges we faced while creating and fine-tuning such a system. An architecture that is comprised of a 1,000 micro-services that need to handle incoming traffic from multiple dat