Install airflow scheduling on linux system

Create airflow user groupadd airflow useradd airflow -g airflow Install python3 yum -y update yum -y install gcc — will be used later to install mysqlclient yum -y install gcc-objc gcc-objc + + libobjc — does not install and reports error gcc: error trying to exec ‘cc1plus’: execvp: No such file or directory yum -y […]

Four process scheduling algorithms for operating systems (c language)

Table of Contents FCFS SJF HPF RR FCFS FCFS (First-Come, First-Served) scheduling algorithm is the simplest process scheduling algorithm, also known as first-come, first-served algorithm. In this algorithm, processes are executed in the order in which they arrive on the ready queue, that is, processes that arrive first are executed first, and processes that arrive […]

Apache Airflow (4): Airflow scheduling shell command

Personal homepage: IT Pindao_Big data OLAP system technology stack, Apache Doris, Clickhouse technology-CSDN blog Private chat with bloggers: Join the big data technology discussion group chat to get more big data information. Blogger’s personal B stack address: Brother Bao teaches you about big data’s personal space – Brother Bao teaches you about big data personal […]

Use Docker to deploy the open source distributed task scheduling system DolphinScheduler

Blog homepage: The little sheep has insomnia. Series of columns: “C Language” strong> 《Data Structure》 《Linux》《Cpolar》 Thank you everyone for likingfavorites?comments Use Docker to deploy the open source distributed task scheduling system DolphinScheduler A few days ago, I discovered a giant artificial intelligence learning website. It is easy to understand and humorous. I couldn’t help […]

Quickly build the open source distributed task scheduling system DolphinScheduler and access it remotely

Use Docker to deploy the open source distributed task scheduling system DolphinScheduler Article directory Use Docker to deploy the open source distributed task scheduling system DolphinScheduler Preface 1. Install and deploy DolphinScheduler 1.1 Start the service 2. Log in to the DolphinScheduler interface 3. Install intranet penetration tools 4. Configure Dolphin Scheduler public network address […]

kubernetes cluster orchestration – k8s scheduling

nodename vim nodename.yaml apiVersion: v1 Kind: Pod metadata: name: nginx labels: app: nginx spec: containers: – name: nginx image: nginx nodeName: k8s2 nodeName: k8s2 #If the node pod cannot be found, pending will appear, with the highest priority. kubectl apply -f nodename.yaml kubectl get pod -o wide Recycle kubectl delete -f nodename.yaml nodeselector vim nodeselector.yaml […]

Scheduling yard algorithm (infix expression->prefix/suffix expression)

There are many and detailed reference materials on the dispatch field algorithm on the Internet; and there are other methods to deal with the problem of converting infix expressions into prefix/suffix expressions processed by the dispatch field algorithm. Those who are interested can learn about it on their own. References: Algorithm – Shunting Yard Algorithm […]

Linux implementation principle – multi-thread scheduling overhead and performance optimization in NUMA multi-core architecture

Foreword NOTE: The “thread” referred to in this article refers to the executable scheduling unit Kernel Thread. NUMA Architecture The design concept of NUMA (Non-Uniform Memory Access, non-uniform memory access) is to partition the CPU and Main Memory autonomously (Local NUMA node), and to cooperate across regions (Remote NUMA node), in this way to alleviate […]

C++ multithreading-thread scheduling API

Foreword When C++ multi-threaded programming, threads are usually created directly to start executing tasks without setting priorities. However, in some special scenarios, it may be necessary to set different priorities for incompetent thread tasks so that threads can be processed first. For high-level tasks, the pthread library provides some APIs to set the priority of […]