Luxoft Tech Talk with Martin Toshev - Building highly-scalable data pipelines with Apache Spark

Many modern world software systems face the need to process increasing volumes of data in a reasonable amount of time. To achieve that one can think of different ways to build a highly-scalable data pipeline which is a non-trivial activity especially in terms of the different operations, performance through various optimizations and scalability that need to be taken into consideration during the implementation. In order to avoid that we typically fall back to a framework like Apache Spark that provides the