1. Introduction to hadoop Hadoop is a distributed system infrastructure developed by the Apache Foundation. Users can develop distributed programs without understanding the underlying details of distribution. Make full use of the power of clusters for high-speed computing and storage. Hadoop implements a distributed file system (Distributed File System), one of which is HDFS (Hadoop […]
Tag: ado
Deploy cluster on hadoop 3.3.6 under linux
1. Introduction to hadoop Hadoop is a distributed system infrastructuredeveloped by the Apache Foundation. Users can develop distributed programs without understanding the underlying details of distribution. Make full use of the power of clusters for high-speed computing and storage. Hadoop implements a distributed file system (Distributed File System), one of which is HDFS (Hadoop Distributed […]
The situation when the Hadoop cluster DataNode cannot be started under Linux
1. After formatting the file, restart the hadoop cluster and find that the DataNode cannot be started. Here too There is no node data, but it is empty. This graph is normal. After searching for the reason for a long time, I found that the datanode was not started. Then query the log. Found this […]
Hadoop fully distributed construction
Foreword There are always various problems encountered when configuring a Hadoop cluster. Here is a complete summary of the complete Hadoop fully distributed configuration process, hoping to help more people. Virtual machine preparation A distributed cluster requires three virtual machines. I won’t explain too much here, just clone them directly. 1. Modify the host name […]
Hadoop cluster environment setup
Hadoop environment setup write in front Statement and pitfall summary Software preparation Introduction to Hadoop Officially built Prerequisite environment preparation Install Ubuntu20.04 Server XShell remote connection Install jdk Install hadoop SSH Static IP configuration Cluster construction Cluster creation Modify hostname and IP address SSH configuration Hadoop configuration workers core-site.xml hdfs-site.xml yarn-site.xml mapred-site.xml Scripting xsync myhadoop.sh […]
Vulnerability Analysis|Adobe ColdFusion Deserialization Vulnerability (CVE-2023-29300)
1. Vulnerability description Adobe ColdFusion is a rapid application development platform from the American company Adobe. The platform includes an integrated development environment and scripting language. Adobe ColdFusion has a code issue vulnerability. This vulnerability is caused by an untrusted data deserialization vulnerability. An attacker can execute code through the vulnerability, which can cause the […]
Install stand-alone version of hadoop-3.3.6 on linux
1. Download hadoop https://mirrors.tuna.tsinghua.edu.cn/apache/hadoop/core/hadoop-3.3.6/ 2. Configure environment variables 1. Configure java environment variables 2. Configure hadoop environment variables export HADOOP_HOME=/usr/local/bigdata/hadoop-3.3.6 export HBASE_HOME=/usr/local/bigdata/hbase-2.5.6 export JAVA_HOME=/usr/local/jdk-11 export CLASSPATH=.:$JAVA_HOME/lib export PATH=.:$JAVA_HOME/bin:$HBASE_HOME/bin:$HADOOP_HOME/bin:$PATH 3. Configure host 192.168.42.142 node4 3. Modify the configuration file corresponding to hadoop 3.1. Create a directory under the hadoop directory mkdir logs mkdir data mkdir -p […]
Population mobility comprehensive data monitoring system based on Hadoop
Everyone can help like, collect, follow and comment Recommended subscription for wonderful columns: in the column below JAVA practical project Article directory JAVA practical projects 1. Project introduction 2. Development environment 3. Project display-Population flow comprehensive data monitoring system based on Hadoop 4. Code display 5. Project Summary Everyone can like, collect, follow, and leave […]
Hadoop fully distributed construction
Table of Contents Environmental preparation Install hadoop Usage example Note Unless otherwise specified, all operations in this article are performed on the root user of all nodes. The files needed in this article are placed in the /usr/local/software directory (this directory is created by yourself) Environment preparation First, the basic situation of my use of […]
The paradox of generative AI: “What it can create, it may not understand”
Click the Card below and follow the “CVer” public account AI/CV heavy-duty information, delivered as soon as possible Click to enter->[Computer Vision and Transformer] Communication Group Reprinted from: Heart of the Machine | Editor: Large Plate of Chicken, Egg Sauce Scan the QR code to join CVer Knowledge Planet, you can quickly learn the paper […]