Microservices Logging | ELK Stack | Elastic Search | Logstash | Kibana | Simple Programming

Welcome to Simple Programming In this video, let us see how to configure and use ELK Stack in other words ElasticSearch Logstash and Kibana for application logging A major challenge in a distributed system (e.g. a system landscape of microservices) is to understand what is going on and even more importantly – what is going wrong, where and why. In this blog post we will see how we can use the ELK stack (i.e. Elasticsearch, Logstash and Kibana, ) from Elastic to aggregate log events from our microservices There are lot of tools which can do the magic if used properly used together. One such popular set of tools are Elastic Search, Logstash and Kibana ELK stack is a great open source stack for log aggregation and analytics ElasticSearch - is a NoSQL database and distributed search and analytics engine if you look at the benefits easy installation and use a powerful internal search technology (build using Apache Lucene) a restful web interface open source noSQL (schema free json documents) Logstash - is a log shipping and parsing service in other words its a transportation pipeline used to populate elastic search with data benefits open source tool collects, parse and stores logs for futiure its a log aggregator open source Kibana - a web interface that connects users wit the elasticSearchDatabase and enables visualization and search options for system operation users benefits open source data visualization you can create graphical representation with logs very easily. even beginners can execute powerful log searches easily ELK stack is getting quite popular nowadays with a very large open source community If you have to compare Splunk with ELK - actually both are very good log platforms Splunk actually edges out ELK because of the less configuration needed to configure in Splunk forwarders, when compared to Beats and Logstash in ELK The ELK Stack is popular because it fulfills a need in the log analytics space. Splunk’s enterprise software has long been the market leader, but its numerous functionalities are increasingly not worth the expensive price. ELK is a simple but robust log analysis platform that costs a fraction of the price. But cost is huge factor nowadays, and the real question you should be asking is if you need all the features of the spunk for the kind of money you are paying ? Ultimately, for ay small or medium enterprise having a low budget cost can go for ELK, and large enterprises should chooses splunk over ELK or you would like to get it done for a less cost using ELK Splunk is used by Adobe, CISCO, Symantec, Coca-cola, etc ELK is used by StackOverflow, LinkedIn, NetFlix, OpenStack, , Accenture, etc Logstash Configuration Document