ZooKeeper+Kafka+ELK+Filebeat cluster construction to realize large batch log collection and display

The general process: After collecting the logs of the nginx server (web-filebeat) through filebeat, store them in the cache server kafka, and then logstash to the kafka server to retrieve the corresponding logs. After processing, they are written to the elasticsearch server and displayed on kibana. 1. Cluster environment preparation 4c/8G/100G 10.10.200.33 Kafka + ZooKeeper […]

Zookeeper cluster deployment

Table of Contents (1) Unzip the Zookeeper installation package 1. Go to the browserApache ZooKeeper to download the zookeeper compressed package 2. Upload the zookeeper compressed package to softwares 3. Unzip to package (2) Configure environment variables and distribute 1. Modify configuration file 2. Configure environment variables 3.?wqSave and exit 4.Use scp to copy the […]

Zookeeper cluster construction and deployment

1.Zookeeper introduction Zookeeper is a distributed coordination component developed by Yahoo based on Chubby’s ideas and later donated to Apache. It is mainly used to solve distributed data consistency problems. Distributed applications can implement functions such as data publishing/subscription, load balancing, naming service, distributed coordination/notification, cluster management, Master election, configuration management, distributed locks and distributed […]

Deploy hadoop-3.3.6, hbase-2.5.6, apache-zookeeper-3.8.1 cluster on linux

1. Introduction to hadoop Hadoop is a distributed system infrastructure developed by the Apache Foundation. Users can develop distributed programs without understanding the underlying details of distribution. Make full use of the power of clusters for high-speed computing and storage. Hadoop implements a distributed file system (Distributed File System), one of which is HDFS (Hadoop […]

If you add image uploading, movement and zooming in based on frame rich text

If you use the quill rich text plug-in according to the framework, but cannot change the size of the uploaded image, you need to download a third-party plug-in quill-image-resize-module to achieve this. 1. Add in vue.config.js module.exports = { … configureWebpack:{ … plugins:[ new webpack.ProvidePlugin({ ‘window.Quill’: ‘quill/dist/quill.js’, ‘Quill’: ‘quill/dist/quill.js’ }), ] } } 2. Download […]

Set up ELK+Filebead+zookeeper+kafka experiment

1. ELK + Filebeat + kafka + zookeeper architecture Architecture diagrams are demonstrated separately The first layer: data collection layer The data collection layer is located on the leftmost business service cluster. Filebead is installed on each business server for log collection, and then the collected original logs are sent to the kafka + zookeeper […]

Zookeeper local deployment and cluster construction

zookeeper (zookeeper) is an open source framework widely used in distributed services to provide coordination services Apache Zookeeper is understood from a design pattern perspective: it is a distributed service management framework designed based on the observer pattern. Responsible for storing and managing data that everyone cares about ,Then Accept observer registration , once the […]

Centos builds a zookeeper high-availability cluster

zookeeper-ha Host name IP address spark01 192.168.171.101 spark02 192.168.171.102 spark03 192.168.171.103 1. Upgrade kernel and software yum -y update 2. Install commonly used software yum -y install gcc gcc-c + + autoconf automake cmake make \ zlib zlib-devel openssl openssl-devel pcre-devel \ rsync openssh-server vim man zip unzip net-tools tcpdump lrzsz tar wget 3. Turn […]

The text at both ends of echarts dataZoom is not fully displayed. Set the label below the handle.

Problem: When the echarts dataZoom is as long as the chart, and when start=0 or end=100, the text at both ends is not fully displayed, as shown below Solution: You can put the text below and manually change the horizontal position when start90 <template> <div ref=”echartsBox” class=”echartsBox”></div> </template> <script lang=’ts’ setup> import * as echarts […]

Java connection to zookeeper

API ZooKeeper officially provides a Java API, which can be connected to the zookeeper service for operation through Java code. You can connect, create nodes, obtain node data, monitor node changes and other operations. Specifically, there are the following important classes: ZooKeeper: The ZooKeeper class is the core class of the Java API, used to […]