Application of stage, job, task and condition in YAML Introduction Resource preparation structural relationship Code writing (task) Define variables within task task condition gets variable value task code explanation Test task code Code writing (job) job variable definition Get job variable value job condition job code explanation Test job code Code writing (stage) stage code […]
Tag: jobs
What kind of side jobs can be done with Python? Display of recent side job demand list
Broadly divided into three types of needs: – Crawler, the most orders, not all orders need to be reversed + APP crawler – Excel automation, followed by quantity and lower technical requirements – Web development, just use Django and Flask to build a small system The following is a list of recent orders, please read […]
Kubernetes Jobs
Why we need kubernetes Jobs As you learned in the previous chapters, a Pod created via a Deployment, StatefulSet, or DaemonSet, runs continuously. When the process running in one of the Pod’s containers terminates, the Kubelet restarts the container. The Pod never stops on its own, but only when you delete the Pod object. Although […]
Practical case: Sql client uses sql to operate FlinkCDC2Hudi and supports restoring hudi jobs from savepoint
Flink supports restoring jobs from savepoint in SQL Client starting from version 1.13. Introduction to flink-savepoint Next, we build an example of mysql cdc data entering the hudi data lake through kafka from Flink SQL Client. The overall process is as follows: In the second step above, we manually stopped the Flink task of kafka→hudi, […]
What part-time jobs can you do if you learn Python?
1. What should I learn by learning Python? Here is a detailed outline for you, so you can follow it step by step~ (Guaranteed to be super detailed) From learning Python from scratch to becoming proficient, the above outline covers it all~ Learn to master good knowledge and you can find a job. If it […]
Do I need to write CUDA myself for algorithm jobs?
Click “Xiaobai Xue Vision” above and choose to add “Star” or “Pin“ Heavy stuff, delivered as soon as possible Link: https://www.zhihu.com/question/436008648 Statement: Only for academic sharing, no infringement or deletion Author: Zhihu userhttps://www.zhihu.com/question/436008648/answer/1683251210 95% of algorithm positions do not require it. True story: My colleague applied to G Company before coming to NVIDIA, but his […]
Prepare to change jobs from now on – Bit Operations
I came across this sentence again while reviewing hashMap today: The length of the bucket array inside HashMap is always an integer number of 2. The advantages of this are: first, it can be quickly addressed through bit operations such as (table.length – 1) & key.hash(), and second, When HashMap is expanded, it can ensure […]
Simple implementation of operating system scheduling algorithm in C language – large operating system jobs – FCFS, non-preemptive SJF, response ratio HRRN, time slice RR
The entire program is divided into multiple function modules to implement functions such as the number of processes, process information, various data calculations, system loops, and illegal detection. System initialization and input process Process information display and algorithm selection interface printing Core idea: ①For first-come, first-served service, just sort the respective arrival times. ②For short […]
Oracle unlocks tables, packages, users, kills sessions, and stops jobs
Oracle unlocks tables, packages, users, kills sessions, and stops jobs 1. Create package tzq_server_pkg 2. Authorize the user log that needs to be used 3. Unlock the table: Execute unlock_table(schema_name, table_name) 4. Unlock the package: Execute and save unlock_package(schema_name, pkg_name) 5. Unlock the user: Execute unlock_user(username) 6. Stop the job task: Execute and save stop_job(job_id) […]
[flink] Use flink-web-ui to submit jobs and report errors
An error occurred when submitting a job using the WebUI. Error screenshot: Bullet box information: Server Response Message: org.apache.flink.runtime.rest.handler.RestHandlerException: Could not execute application. at org.apache.flink.runtime.webmonitor.handlers.JarRunHandler.lambda$handleRequest$1(JarRunHandler.java:114) at java.util.concurrent.CompletableFuture.uniHandle(CompletableFuture.java:822) at java.util.concurrent.CompletableFuture$UniHandle.tryFire(CompletableFuture.java:797) at java.util.concurrent.CompletableFuture.postComplete(CompletableFuture.java:474) at java.util.concurrent.CompletableFuture$AsyncSupply.run(CompletableFuture.java:1595) at java.lang.Thread.run(Thread.java:748) Caused by: java.util.concurrent.CompletionException: org.apache.flink.util.FlinkRuntimeException: Could not execute application. at java.util.concurrent.CompletableFuture.encodeThrowable(CompletableFuture.java:273) at java.util.concurrent.CompletableFuture.completeThrowable(CompletableFuture.java:280) at java.util.concurrent.CompletableFuture$AsyncSupply.run(CompletableFuture.java:1592) … 1 more Caused by: org.apache.flink.util.FlinkRuntimeException: […]