Build environment: windows10, VMware16.2.3, centOS7.9, jdk-8u162-linux-x64.tar.gz, hadoop3.1.0 Links to Hadoop for various versions of Hadoop jdk8 download link jdk 1. Basic configuration preparations 1.1 Static IP address and other configurations Note: If you are prompted for insufficient permissions, you need to use root permissions. 1.1.1 Non-clone machine configuration static IP address ####1.1.2 Configure a static […]
Tag: oop
Continuing from the previous chapter in the book, C language loop structure:
Loops can be used to execute multiple statements multiple times. The “multiple statements” here are called the loop body. In C language, three types of loops can be used, namely: while, do…while and for. In these statements, the number of times the loop body is executed repeatedly is controlled by the loop condition, which is […]
Deploy hadoop-3.3.6, hbase-2.5.6, apache-zookeeper-3.8.1 cluster on linux
1. Introduction to hadoop Hadoop is a distributed system infrastructure developed by the Apache Foundation. Users can develop distributed programs without understanding the underlying details of distribution. Make full use of the power of clusters for high-speed computing and storage. Hadoop implements a distributed file system (Distributed File System), one of which is HDFS (Hadoop […]
Deploy cluster on hadoop 3.3.6 under linux
1. Introduction to hadoop Hadoop is a distributed system infrastructuredeveloped by the Apache Foundation. Users can develop distributed programs without understanding the underlying details of distribution. Make full use of the power of clusters for high-speed computing and storage. Hadoop implements a distributed file system (Distributed File System), one of which is HDFS (Hadoop Distributed […]
The situation when the Hadoop cluster DataNode cannot be started under Linux
1. After formatting the file, restart the hadoop cluster and find that the DataNode cannot be started. Here too There is no node data, but it is empty. This graph is normal. After searching for the reason for a long time, I found that the datanode was not started. Then query the log. Found this […]
Hadoop fully distributed construction
Foreword There are always various problems encountered when configuring a Hadoop cluster. Here is a complete summary of the complete Hadoop fully distributed configuration process, hoping to help more people. Virtual machine preparation A distributed cluster requires three virtual machines. I won’t explain too much here, just clone them directly. 1. Modify the host name […]
Hadoop cluster environment setup
Hadoop environment setup write in front Statement and pitfall summary Software preparation Introduction to Hadoop Officially built Prerequisite environment preparation Install Ubuntu20.04 Server XShell remote connection Install jdk Install hadoop SSH Static IP configuration Cluster construction Cluster creation Modify hostname and IP address SSH configuration Hadoop configuration workers core-site.xml hdfs-site.xml yarn-site.xml mapred-site.xml Scripting xsync myhadoop.sh […]
STM32-HAL library 09-CAN communication (loopback mode)
1. Materials used: STM32F103C6T6 Minimum System Board STM32CUBEMX (HAL library software) MDK5 Serial debugging assistant 2. What you learned: Preliminarily learn how to use the CAN communication function of STM32. In this chapter, we mainly achieve the effect of on-board CAN communication, that is, 32 sends CAN information and then prints it out through the […]
if/switch statement and for loop while&to….while in JS
In any programming language, it is necessary to support three types of process control required to satisfy program structuring: Sequence control Branch control (conditional control) loop control Sequential control: In program flow control, the most basic thing is sequence control. The program will be executed in top-down order. if statement (commonly used statements in JS) […]
Install stand-alone version of hadoop-3.3.6 on linux
1. Download hadoop https://mirrors.tuna.tsinghua.edu.cn/apache/hadoop/core/hadoop-3.3.6/ 2. Configure environment variables 1. Configure java environment variables 2. Configure hadoop environment variables export HADOOP_HOME=/usr/local/bigdata/hadoop-3.3.6 export HBASE_HOME=/usr/local/bigdata/hbase-2.5.6 export JAVA_HOME=/usr/local/jdk-11 export CLASSPATH=.:$JAVA_HOME/lib export PATH=.:$JAVA_HOME/bin:$HBASE_HOME/bin:$HADOOP_HOME/bin:$PATH 3. Configure host 192.168.42.142 node4 3. Modify the configuration file corresponding to hadoop 3.1. Create a directory under the hadoop directory mkdir logs mkdir data mkdir -p […]