Linux implementation principle – multi-thread scheduling overhead and performance optimization in NUMA multi-core architecture

Foreword NOTE: The “thread” referred to in this article refers to the executable scheduling unit Kernel Thread. NUMA Architecture The design concept of NUMA (Non-Uniform Memory Access, non-uniform memory access) is to partition the CPU and Main Memory autonomously (Local NUMA node), and to cooperate across regions (Remote NUMA node), in this way to alleviate […]

24 | See how to quickly develop big data systems from the big data performance testing tool Dew

In this issue of Spark performance optimization case analysis, through visual analysis of a large number of Spark server performance data, we discovered various performance problems of Spark in the program code and operating environment, and made corresponding optimizations to improve Spark operating efficiency. Has been greatly improved. Many students are also asking, where do […]

20 | Spark performance optimization case analysis (Part 2)

In the last issue, we talked about software performance optimization that must be conducted through performance testing and based on an understanding of software architecture and technology. Today, we use several Spark performance optimization cases to see how the performance optimization principles mentioned are implemented. If you forget the principles of performance optimization, you can […]

Escape Analysis: The secret key to unlocking performance!

High-quality blog posts: IT-BLOG-CN Interviewer pitfall: Do newly created objects in Java necessarily allocate memory on the heap? If your answer is “Yes” then you need to read this article. 1. Introduction Escape Analysis Escape Analysis: It is a very important JIT optimization technology, used to determine whether the object will be accessed outside the […]

Regarding the Youshuang Linux high-performance server programming code list 13-4 Segmentation fault (core dumped) error reporting problem

I tried various adapted or official codes, but they were all wrong. Finally, I found that the problem lies in this line of code. sub_process[pid] = user_count; This line of code assigns the pid to the array, but how big is the array? The code is as follows sub_process = new int[PROCESS_LIMIT]; You will find […]

The principle of MySQL connection 4 ways to optimize connection, performance increased by 240%

The principle of the MySQL connection 4 methods to optimize the connection, the performance is improved by 240% Foreword In the last two articles, we talked about three ways to optimize table return in MySQL: push down ICP under index conditions, multi-range read MRR and covering index. MySQL’s optimization tool Pushing down index conditions improves […]

Performance test – stress test the stored process through Jmeter!

Table of Contents 1. Stored procedure preparation: 2. Preparation of test tools: 3. Tool configuration and execution: 2. Configure the throughput controller (can be skipped): 3. Configure JDBC Request: For stored procedures: For SQL statements: 4. Other configurations such as query result tree, aggregation report, TPS, PerfMon monitoring, etc. are the same as the basic […]

Parallel Computing | Performance issues of multi-threading and multi-process processing in Python

1. What is the difference between multi-threading and multi-process in Python? Metaphor used in Linux kernel development. A process is an abstraction of a running program. A binary image, virtualized memory, various kernel resources, associated security context, etc. A thread is the unit of execution in a process. A virtualized processor, a stack, and program […]

[Tencent Cloud HAI Domain Exploration] Build a local SD text generation image application that never goes down–a rice-level high-performance application HAI deployment stable diffusion webui one-click Wenshengtu

Directory 1. High-performance application service HAI products + Stable Diffusion Webui deployment ideas 2. Start Stable Diffusion WebUI inference with one click 3. Use HAI JupyterLab connection to deploy StableDiffusion API 4. Use local IDE to realize one-click Wenshengtu on the private server Web side 5. Use Tencent Cloud Cloud Studio for rapid cloud development […]