Describe what happens from the moment an app logged some information until it's displayed to the user in a dashboard when the Elastic stack is used
Answer
The process may vary based on the chosen architecture and the processing you may want to apply to the logs. One possible workflow is:
- The data logged by the application is picked by filebeat and sent to logstash
- Logstash process the log based on the defined filters. Once done, the output is sent to Elasticsearch
- Elasticsearch stores the document it got and the document is indexed for quick future access
- The user creates visualizations in Kibana which based on the indexed data
- The user creates a dashboard which composed out of the visualization created in the previous step