Problem-solving ideas: Strictly follow the requirements of the question and record the key information on the scratch paper after reading the question. The question requires screening based on three aspects: node affinity, task affinity, and task anti-affinity. Compute node affinity Compute tasks must be run on the Specified Availability Zone. Compute task affinity The computing […]
Tag: scheduler
AMD GPU kernel driver analysis (3) – gpu scheduler ring fence synchronization working model
In the AMDGPU driver implementation of Linux Kernel, dma-fence plays an important role. The Render/decoding operation of AMDGPU may involve multiple aspects referencing the buffer at the same time. Taking the rendering/video decoding scenario as an example, the application will render/decode commands After writing to the BUFFER shared with the GPU, the task needs to […]
Apache DolphinScheduler’s first scheduling off-site deployment practice at Qifu Technology
Qifu Technology (formerly 360 Digits) is an artificial intelligence-driven credit technology service platform. It is committed to empowering financial institutions to improve quality and efficiency through intelligent services, AI research and application, and security technology, and promote the high-quality development of inclusive finance. , allowing more people to enjoy safe and convenient financial technology services. […]
Process management–CFS scheduler (1)
Introduction CFS (Completely Fair Scheduler) is used for scheduling ordinary processes in Linux systems. It sets a virtual clock, vruntime, for each process in cfs_rq (cfs run queue). If a process is executed, its vruntime will continue to increase as time goes by (ticks arrive). The vruntime of processes that are not executed remains unchanged. […]
Haproxy cluster scheduler and deployment
1. Introduction to Haproxy: 1.Haproxy application analysis: LVS has a strong ability to recover in enterprises, but it has shortcomings: LVS does not support regular processing and cannot achieve dynamic and static separation. For large websites, the configuration of LVS is more complicated and the maintenance cost is relatively high. Haproxy is a proxy software […]
flask_apscheduler implements scheduled push of Feishu messages
Requirement scenario: Implement a flask service and control the starting and stopping of a scheduled task (checking hotel reservation status) through the interface. After the scheduled task is completed, the Feishu robot can push the task completion message. Display effect: Start a scheduled task Close scheduled tasks Feishu push message Code implementation: Project structure: Business […]
How to quickly extend a new task plug-in in Apache DolphinScheduler?
Author | Dai Lidong Editor | Debra Chen Apache DolphinScheduler is a modern data workflow orchestration platform with very powerful visualization capabilities. DolphinScheduler is committed to enabling data engineers, analysts, data scientists and other data workers to easily build various data workflows and make the data processing process more efficient. Simple and reliable. DolphinScheduler is […]
go-GMP and Scheduler
GPM model G goroutine to be executed, the structure is defined in runtime.g M is a thread in the operating system, which is scheduled and managed by the scheduler of the operating system. The structure is defined in runtime.m P processor is the middleware of GM. It is bound to GM through a queue. Each […]
Haproxy cluster scheduler and deployment
Table of Contents 1. Introduction to Haproxy: 1.Haproxy application analysis: 2. Features of Haproxy: 3.Haproxy’s common scheduling algorithms: 4. The difference between LVS, Nginx and HAproxy: 4.1 Comparison between Haproxy and lvs: 4.2 Comparison between Haproxy and nginx: 5. Haproxy advantages: 2. Haproxy deployment: 1. Configure the Haproxy load scheduler: 1.1 Prepare Haproxy scheduler: 1.2 […]
env->taskScheduler().doEventLoop() in live555
Live555 is a single-threaded execution. Directly executing sleep() will cause the message accepting function to not be executed and all work will stop. How to do other work while waiting Use env->taskScheduler().doEventLoop() in live555 to wait for messages. void BasicTaskScheduler0::doEventLoop(char* watchVariable) { // Repeatedly loop, handling readble sockets and timed events: while (1) { if […]