Building a Scalable Data Pipeline with Zookeeper, Kafka, and the ELK Stack
Setting Up a Zookeeper Ensemble
A Zookeeper cluster maintains coordination metadata for distributed systems. For production, deploy an odd number of nodes (minimum three) to achieve quorum.
Configuration Essentials
On each node, prepare the configuration file conf/zoo.cfg:
tickTime=2000
dataDir=/var/lib/zookeeper
dataLogDir=/var/log/zookeeper
c ...
Posted on Mon, 22 Jun 2026 17:18:48 +0000 by bios
Deploying Java and PHP Applications on Kubernetes with ELK and Prometheus Monitoring
Environment Preparation
1.1 Cloning GitLab Repository
mkdir /root/gitlab/
cd /root/gitlab/
git clone http://172.17.17.84:85/java/java.git
1.2 Setting Up Harbor Registry
Login and create a project named demo in Harbor.
docker login reg.ctnrs.com
# Username: admin
# Password: harbor12345
docker tag <source-image> reg.ctnrs.com/demo/java-de ...
Posted on Thu, 04 Jun 2026 19:09:24 +0000 by pplexr
Practical Logstash Usage Patterns for Timezone Handling, Log Parsing, and Multi-index Routing in ELK
Aligning Timestamps Across Time Zones
When shipping data from Logstash to Elasticsearch, the @timestamp field often reflects UTC time, causing mismatch with local time zones. A permanent fix involves adjusting the timestamp in the filter stage.
ruby {
code => "evt.set('local_ts', evt.get('@timestamp').time.localtime + 28800)"
}
r ...
Posted on Wed, 13 May 2026 04:44:46 +0000 by Delcypher