10 ready-to-use shell script examples!

#!/bin/sh

read -p "user:" user
read -p "passd:" pass
read -p "province:" province
read -p "idcid:" idcid

mkdir -p /bigdata/sftp/province/$province/$idcid

useradd $user -d /bigdata/sftp/province/$province/$idcid

#passwd $user
echo $pass | passwd --stdin $user

chown $user /bigdata/sftp/province/$province/$idcid/ -R

chmod 750 /bigdata/sftp/province/$province/$idcid -R

echo $user>>/etc/vsftpd/chroot_list

echo $user>>/etc/vsftpd/user_list

systemctl restart vsftpd.service

Script 6: This script first customizes the province code list into multiple directory paths and loops through the customized province code list. For each province code, the script divides it into three parts: province code, operator and data reporting type. Then enter the corresponding province directory.

Execute the du -sh 2023-10-* command to query the sizes of all directories starting with 2023-10-, and output the results to a file named $province_code_file_size .txt file.

Execute a for loop, loop through all subdirectories and query the number of files in each subdirectory, and then output the results to a file named $province_code_file_count.txt.

Finally, the script will return to the upper-level directory to query the file size and number of files under the next province code. All query results will be saved in files named with province codes in the /opt/ directory.

#!/bin/bash
# @Time : 2023/10/30
# @Author : jacktian
# @Desc: This is a script suitable for a server to circularly query the file size and number of files in a specific province, a specific operator, and a specific data reporting type.
  
# Define province code list
provinces=("110000/dianxin/1024" "120000/liantong/1024" "130000/yidong/1024")
  
# Traverse the province code list
for province in "${provinces[@]}"; do
  
    # Split province codes, operators and data reporting types
    province_code=$(echo $province | cut -d'/' -f1)
    operator=$(echo $province | cut -d'/' -f2)
    category=$(echo $province | cut -d'/' -f3)
  
    # Enter the province directory
    cd /bigdata/sftp/province/$province_code/$operator/$category
  
    # Execute the du command to query the file size and output the result to the corresponding province coded txt file
    du -sh 2023-10-* >> /opt/"$province_code"_file_size.txt
  
    # Execute the for command to query the number of date files and output the results to the corresponding province code txt file
    for date in $(ls -d */ | cut -d'/' -f1);
        do
            echo $date $(ls -1 $date | wc -l) >> /opt/"$province_code"_file_count.txt
        done
  
    # Return to the upper directory
    cd..
  
done

Script 7: This script is used to query the file size and number of files in a specific province and specific data reporting type in a loop. Slightly different from script 6 above.

#!/bin/bash
# @Time : 2023/10/30
# @Author : jacktian
# @Desc: This is a script suitable for a server to query the file size and number of files in a specific province and specific data reporting type in a loop.
  
# Define province code list
provinces=("110000" "120000" "130000")
  
# Traverse the province code list
for province in "${provinces[@]}"; do
  
    # Enter the province directory
    cd /bigdata/sftp/province/$province/1024
  
    # Execute the du command to query the file size and output the result to the corresponding province coded txt file
    du -sh 2023-10-* >> /opt/"$province"_file_size.txt
  
    # Execute the for command to query the number of date files and output the results to the corresponding province code txt file
    for date in $(ls -d */ | cut -d'/' -f1);
        do
            echo $date $(ls -1 $date | wc -l) >> /opt/"$province"_file_count.txt
        done
  
    # Return to the upper directory
    cd..

done

Script 8: This script is mainly used to record the modifications of certain XML files within a specific time period and save the results in the log.

#!/bin/bash
  
# Get the current date
current_date=$(date + %Y-%m-%d)
  
# First command
directory_path="/bigdata/sftp/province/110000/yidong/1024/$current_date"
output_file="/opt/log_110000_yidong_$current_date.txt"
cd "$directory_path" & amp; & amp; ls -l *.xml | awk '{print $8,$9}' | grep -v '^$' | awk -F '[/: ]' '{hour=substr($1,1,2); if ((hour >= "00" & amp; & amp; hour < "08") || (hour >= " 10" & amp; & amp; hour < "12") || (hour >= "14" & amp; & amp; hour <= "24")) print}' >> "$output_file"
  
# The second command
directory_path="/bigdata/sftp/province/120000/dianxin/1024/$current_date"
output_file="/opt/log_120000_dianxin_$current_date.txt"
cd "$directory_path" & amp; & amp; ls -l *.xml | awk '{print $8,$9}' | grep -v '^$' | awk -F '[/: ]' '{hour=substr($1,1,2); if ((hour >= "00" & amp; & amp; hour < "08") || (hour >= " 10" & amp; & amp; hour < "12") || (hour >= "14" & amp; & amp; hour <= "24")) print}' >> "$output_file"
  
# The third command
directory_path="/bigdata/sftp/province/130000/liantong/1024/$current_date"
output_file="/opt/log_130000_liantong_$current_date.txt"
cd "$directory_path" & amp; & amp; ls -l *.xml | awk '{print $8,$9}' | grep -v '^$' | awk -F '[/: ]' '{hour=substr($1,1,2); if ((hour >= "00" & amp; & amp; hour < "08") || (hour >= " 10" & amp; & amp; hour < "12") || (hour >= "14" & amp; & amp; hour <= "24")) print}' >> "$output_file"
  
#Exit process
exit

First, use the date command to get the current date in the format: YYYY-MM-DD, and customize the current_date variable.

Then, a directory path directory_path and output file output_file were customized.

Use ls -l *.xml to list all files ending with .xml, and use awk '{print $8,$9}' Extract the modification time and size information of the file, grep -v '^$' filter out blank lines, awk -F '[/:]' '{hour=substr ($1,1,2); if ((hour >= "00" & amp; & amp; hour < "08") || (hour >= "10" & amp; & amp; hour < "12") || (hour >= "14" & amp; & amp; hour <= "24")) print}'Filter out daily Files modified during the 00:00-07:59, 10:00-11:59, 14:00-23:59 time periods, and output their modification time and size information, and append the results to the specified in the output file.

Script 9: This script is mainly used to monitor system resource usage, obtain and record disk usage, CPU idleness, memory idleness and the total number of processes, and output these print information to a log in the file.

#!/bin/bash

date=$(date + %Y-%m-%d-%H:%M:%S)

#1. Print disk usage
DISK_1=$(df -h | awk '{printf $NF} {printf "usage:"} {print $5} '| grep appslog | grep -v 'Filesystem')
DISK_2=$(df -h | awk '{printf $NF} {printf "usage:"} {print $5} '| grep bigdata | grep -v 'Filesystem')
DISK_3=$(df -h / | awk '{printf $NF} {printf "usage:"} {print $5} '| grep / | grep -v 'Filesystem')

#2. Print CPU idle status
CPU=$(top -n 1 | grep Cpu | awk 'BEGIN {printf"CPU idle usage:"} {print $8}')

#3. Print memory free status
MEMORY=$(free -h | awk 'BEGIN {printf"Memory free usage:"} NR==2 {print $4}')

#4. Print the total number of processes
JINCHENG=$(ps aux | wc -l | awk 'BEGIN {printf"Total number of processes:"} {print $1}')

echo -e "\\
 $date\\
\\
 $DISK_1\\
\\
 $DISK_3\\
\\
 $CPU\\
\\
 $MEMORY\\
\\
 $JINCHENG \\
" >> /opt/jacktian/inspection.log

exit

done

• date=$(date + %Y-%m-%d-%H:%M:%S): Get the current date and time in the format: year-month-day-hour:minute :Second
• DISK_1, DISK_2, DISK_3: This variable is used to obtain disk usage. Use the df -h command to obtain disk information, and then use awk to extract the usage and file system name. grep is used to filter out disks with specific names (such as appslog and bigdata)
• CPU: This variable obtains the idle usage of CPU. Use the top -n 1 command to obtain the system status, and then use grep and awk to extract the idle usage of CPU
• MEMORY: This variable obtains the free usage of memory. Use the free -h command to obtain memory information, and then use awk to extract the free memory usage
• JINCHENG: This variable obtains the total number of processes in the system. Use the ps aux command to obtain process information, and then use the wc -l command to count the number of lines, that is, the total number of processes
• echo -e "\\
$date\\
\\
$DISK_1\\
\\
$DISK_3\\
\\
$CPU\\
\\
$MEMORY\\
\ n $JINCHENG\\
": This part splices all the above printing information together and outputs it to the log file

Script 10: This script is mainly used to regularly cycle the access status of the FTP server, and send alarm information through the enterprise WeChat robot when there is an abnormality.

#!/bin/bash

# FTP IP list
FTP_IPS=("IP_1" "IP_2" "IP_3")

#Enterprise WeChat robot address (needs to be configured according to the actual robot address)
WEBHOOK_URL=https://qyapi.weixin.qq.com/cgi-bin/webhook/send?key=XXX

#Loop execution detection method

while :
do

       date=$(date + %Y-%m-%d-%H:%M:%S)

# Loop through the FTP IP list
for ip in "${FTP_IPS[@]}"
do
  # Connect to FTP server
  ftp -n $ip <<EOF

  # Exit FTP server
  exit

EOF

  # Check the exit status code of the previous command
  if [ $? -ne 0 ];
  then
  
  # If the exit status code is not 0, it means that the command execution failed and an abnormal alarm will be sent to the enterprise WeChat robot.
    curl --location --request POST ${WEBHOOK_URL} \
--header 'Content-Type: application/json' \
-d '{"msgtype": "markdown", "markdown": {"content": "'$date' FTP access exception: $ip"}}'
    echo "$date FTP access exception:$ip" >>/opt/ftp_check/ftp_check.log

    else
  # If the exit status code is 0, it means the command was successfully executed and no normal alarm will be sent to the enterprise WeChat robot.
    echo "$date FTP access is normal:$ip" >>/opt/ftp_check/ftp_check.log
    fi
done
exit
done

• FTP_IPS: This variable contains the IP addresses of multiple FTP servers
• WEBHOOK_URL: This variable is the address of the enterprise WeChat robot. You need to replace the XXX part with the actual enterprise WeChat robot's key
• A while loop is used to perform detection periodically. In each loop, the current date and time will be obtained and the FTP_IPS list will be traversed. For each IP address in the list, the script attempts to connect to the FTP server
• If the connection command ftp -n $ip fails, the exit status code is not: 0, which means FTP access exception. In this case, the script will send an exception alert to the enterprise WeChat robot and write relevant information to the log file
• If the connection command is executed successfully and the exit status code is: 0, it means that FTP access is normal. The script will not send alarm information, but will only record normal access information in the log.

That’s all I want to share today.

If you think this article is of some use to you, please give it a like, leave a comment or forward it so that more friends can see it, because this will be my greatest strength in continuing to output more high-quality articles. power!