Deploying ELK Stack with Docker for Log Management
Docker Installation of Elasticsearch
For most production environments, Elasticsearch is pre-installed on servers. If you need to set it up yourself, Docker provides the easiest method.
Pull the Docker image:
docker pull docker.elastic.co/elasticsearch/elasticsearch:7.5.2
Create and start the container:
docker run -d --name elasticsearch-node - ...
Posted on Sun, 02 Aug 2026 16:50:54 +0000 by wayz1229
MySQL to Elasticsearch Data Synchronization Using Logstash
Environment Setup
Download Logstash version matching your Elasticsearch installation (example uses 7.17.6):
Logstash: Official Download Page
MySQL Connector/J: Available from Maven repository or MySQL official site
Configure system environment variable LS_JAVA_HOME pointing to JDK 8 or 11. For Logstash 7.x, this variable is required instead o ...
Posted on Fri, 31 Jul 2026 16:06:16 +0000 by elearnindia
Building a Logging System with Docker, Elasticsearch, Logstash, and Kibana
Overview
This guide walks through setting up a centralized logging system using the ELK stack (Elasticsearch, Logstash, Kibana) with Docker Compose. The configuration collects appliaction logs, processes them via Logstash, stores them in Elasticsearch, and visualizes them in Kibana.
1. Define the docker-compose.yaml File
Create a docker-compose ...
Posted on Tue, 28 Jul 2026 16:10:51 +0000 by XiaoRulez
Configuring Logstash for Efficient Data Collection in ElasticSearch
Overview of the Elastic Stack
Effective observability relies on a cohesive data pipeline. The Elastic ecosystem comprises several components working together. ElasticSearch serves as the distributed search and analytics engine capable of storing and indexing vast amounts of data. Kibana provides a browser-based interface for visualizing stored ...
Posted on Thu, 23 Jul 2026 16:14:56 +0000 by TGWSE_GY
Building a Scalable Data Pipeline with Zookeeper, Kafka, and the ELK Stack
Setting Up a Zookeeper Ensemble
A Zookeeper cluster maintains coordination metadata for distributed systems. For production, deploy an odd number of nodes (minimum three) to achieve quorum.
Configuration Essentials
On each node, prepare the configuration file conf/zoo.cfg:
tickTime=2000
dataDir=/var/lib/zookeeper
dataLogDir=/var/log/zookeeper
c ...
Posted on Mon, 22 Jun 2026 17:18:48 +0000 by bios
Building a Scalable Log Processing Pipeline with Filebeat, Kafka, Logstash, and Elasticsearch
Distributed log processing systems are essential for modern application monitoring and analysis. A common approach involves using Filebeat for log collection, Kafka as a message buffer, Logstash for transformation, Elasticsearch for storage, and Kibana for visualization. Grafana can also integrate with Elasticsearch for real-time monitoring das ...
Posted on Fri, 15 May 2026 04:29:59 +0000 by wgh
Practical Logstash Usage Patterns for Timezone Handling, Log Parsing, and Multi-index Routing in ELK
Aligning Timestamps Across Time Zones
When shipping data from Logstash to Elasticsearch, the @timestamp field often reflects UTC time, causing mismatch with local time zones. A permanent fix involves adjusting the timestamp in the filter stage.
ruby {
code => "evt.set('local_ts', evt.get('@timestamp').time.localtime + 28800)"
}
r ...
Posted on Wed, 13 May 2026 04:44:46 +0000 by Delcypher