Database|Binlog troubleshooting: drainer strikes periodically

Table of Contents 1. Background 2. Fault phenomenon 3. Analysis process 4. Solution 5. Thinking 6. Summary 1. Background Recently, users have reported that the drainer of our production environment TiDB cluster frequently fails. Failures manifest as service crashes and failure to start, or data being lost during operation, which brings great trouble to our […]

Open BinLog and connect to the virtual machine canal

Tip: After the article is written, the table of contents can be automatically generated. For how to generate it, please refer to the help document on the right. Article directory 1. What is canal? Canal working principle 2. Usage steps 1. Use docker to create a database container 2. Turn on binlog mode 3. Canal […]

Understanding MySQL logs redo, undo, binlog

Understanding MySQL log redo, undo, binlog 1. Problems solved by MySQL log files 2. redo log 2.1. Composition of redo log 2.2. Redo log flushing strategy 2.3. What problems does MySQL’s redo log solve? 3. undo log 3.1. Function of undo log 3.2. Types of undo log 3.3. Life cycle of undo log 3.4. Several […]

MySQL master-slave synchronization-binlog

MySQL master-slave synchronization-binlog Server preparation IP Node Configuration System version 191.168.117.143 master 2c2g40g centos 7.9 192.168.117.142 slave 2c2g40g centos 7.9 Environment preparation The following operations need to be performed on both machines Turn off firewall systemctl stop firewalld & amp; & amp; systemctl disable firewalld setenforce 0 & amp; & amp; sed -i ‘s/SELINUX=.*/SELINUX=disabled/g’ /etc/selinux/config […]

Binlog printing principle in gRPC

Principle of Binlog printing in gRPC gRPC supports outputting request call parameters, header and other information to a file in binary form Use The dependency of binlog is in grpc-services, so this dependency is required Specified when creating the Channel BinaryLog binaryLog = BinaryLogs.createBinaryLog(new TempFileSink(), “*”); this.channel = ManagedChannelBuilder.forAddress(host, port) .usePlaintext() .setBinaryLog(binaryLog) .build(); When creating, […]

Linked list/singly linked list O(nlogn) sorting

When writing a singly linked list, I suddenly thought, how to sort the linked list? After all, our linked list also needs its own O(nlogn) sorting method! First idea: Using quicksort, a double linked list with head and tail pointers is indeed possible, but the efficiency is not optimal, because when selecting pivot, you can […]

MySQL5.7 logical import MySQL8.0 prompts Multi-statement transaction required more than max_binlog_cache_size bytes o

Requirement: Import mysql5.7.27 database to 8.0.13 Preparation before importing MySQL8.0.13 database has been installed –1. Increase the max_binlog_cache_size value and restart the library [root@localhost ys]# grep max_binlog /data/mysql813/my8.cnf max_binlog_size = 1G #Limit the size of a single file. The default size is: 1,073,741,824, which is 1G, which is too big. max_binlog_cache_size = 1024M #The original […]

After mysql accidentally deletes or updates wrong data under Linux, recover data from binlog (6)

1. Overall idea: 1. Check the binlog status and confirm the binlog file storage location: show variables like’%log_bin%’; 2. View the status of the binlog of the current operation: show master status; 3. Flush logs refresh status and regenerate new binlog files to ensure that the original files are not modified: flush logs; 4. Search […]

.Netframe4.5.2 NLog input data to Oracle

1. Open the NuGet package manager and download the tool package (1) Download NLog and Nlog.Database packages NLog version: 5.2.4 Nlog.Database version: 5.2.4, if you want to write log data to Oracle, you must download this package (2) Download the Oracle.ManagedDataAccess package This package needs to be used to connect to the oracle database. The […]