python-MySQL driver mysql-connector

Article directory mysql-connector install driver Ubuntu22 Multiple operating systems Verify installation Database operations Create database connection Create database Open database View the data table in the database Create/delete data table Insert (batch) data into the data table Rollback operation Query all data Data sorting Limit Query/delete/update specified data mysql-connector mysql-connector is the driver officially provided […]

How to create a custom connector for Elasticsearch

Learn how to create custom connectors for Elasticsearch to simplify the data ingestion process. Author: JEDR BLASZYK Elasticsearch has a library of ingestion tools that can fetch data from multiple sources. However, sometimes your data source may not be compatible with Elastic’s existing extraction tools. In this case, you may need to create a custom […]

org.apache.catalina.connector.ClientAbortException: java.io.IOException: Connection reset by peer

//Error log org.apache.catalina.connector.ClientAbortException: java.io.IOException: Connection reset by peer at org.apache.catalina.connector.OutputBuffer.realWriteBytes(OutputBuffer.java:351) at org.apache.catalina.connector.OutputBuffer.flushByteBuffer(OutputBuffer.java:776) at org.apache.catalina.connector.OutputBuffer.append(OutputBuffer.java:681) at org.apache.catalina.connector.OutputBuffer.writeBytes(OutputBuffer.java:386) at org.apache.catalina.connector.OutputBuffer.write(OutputBuffer.java:364) at org.apache.catalina.connector.CoyoteOutputStream.write(CoyoteOutputStream.java:96) at com.fasterxml.jackson.core.json.UTF8JsonGenerator._flushBuffer(UTF8JsonGenerator.java:2159) at com.fasterxml.jackson.core.json.UTF8JsonGenerator._writeStringSegments(UTF8JsonGenerator.java:1302) at com.fasterxml.jackson.core.json.UTF8JsonGenerator.writeString(UTF8JsonGenerator.java:502) at com.fasterxml.jackson.databind.ser.std.StringSerializer.serialize(StringSerializer.java:41) at com.fasterxml.jackson.databind.ser.DefaultSerializerProvider._serialize(DefaultSerializerProvider.java:480) at com.fasterxml.jackson.databind.ser.DefaultSerializerProvider.serializeValue(DefaultSerializerProvider.java:319) at com.fasterxml.jackson.databind.ObjectWriter$Prefetch.serialize(ObjectWriter.java:1516) at com.fasterxml.jackson.databind.ObjectWriter.writeValue(ObjectWriter.java:1006) at org.springframework.http.converter.json.AbstractJackson2HttpMessageConverter.writeInternal(AbstractJackson2HttpMessageConverter.java:343) at org.springframework.http.converter.AbstractGenericHttpMessageConverter.write(AbstractGenericHttpMessageConverter.java:104) at org.springframework.web.servlet.mvc.method.annotation.AbstractMessageConverterMethodProcessor.writeWithMessageConverters(AbstractMessageConverterMethodProcessor.java:277) at org.springframework.web.servlet.mvc.method.annotation.RequestResponseBodyMethodProcessor.handleReturnValue(RequestResponseBodyMethodProcessor.java:181) at org.springframework.web.method.support.HandlerMethodReturnValueHandlerComposite.handleReturnValue(HandlerMethodReturnValueHandlerComposite.java:82) at org.springframework.web.servlet.mvc.method.annotation.ServletInvocableHandlerMethod.invokeAndHandle(ServletInvocableHandlerMethod.java:123) at org.springframework.web.servlet.mvc.method.annotation.RequestMappingHandlerAdapter.invokeHandlerMethod(RequestMappingHandlerAdapter.java:878) at org.springframework.web.servlet.mvc.method.annotation.RequestMappingHandlerAdapter.handleInternal(RequestMappingHandlerAdapter.java:792) at org.springframework.web.servlet.mvc.method.AbstractHandlerMethodAdapter.handle(AbstractHandlerMethodAdapter.java:87) at […]

SeaTunnel-JDBC Connector offline synchronization of multiple tables

1. Environmental information Database/Tools Version Apache Doris 1.2.6 MySQL 8.0.34 Apache SeaTunnel 2.3.3 2. Data table 2.1 Data source Doris data table Source table 1 CREATE TABLE IF NOT EXISTS ads.ads_device_switch_performance ( `event_time` DATETIMEV2 COMMENT ‘Business time’, `device_id` VARCHAR(32) COMMENT ‘device id’, `device_type` VARCHAR(32) COMMENT ‘device type’, `device_name` VARCHAR(128) COMMENT ‘device name’, `cpu_usage` INT COMMENT […]

Encountering org.apache.catalina.connector.ClientAbortException again: java.net.SocketException: Broken pipe (Write failed)…

On the “Payment Record” page of the Youfu merchant platform, the merchant operator clicks the “Download Settlement Voucher” button, and the system will return the receipt file of the transaction with the selected conditions to the browser page in the form of a zip package. Because the program involves complex calculations, library reading, network, and […]

A must see! S3File Sink Connector usage documentation

S3File is a Python module for managing Amazon S3 (Simple Storage Service). Currently, Apache SeaTunnel already supports S3File Sink Connector. In order to better use this Connector, it is necessary to read this usage documentation guide. Description Output data to the AWS S3 file system. Tip: If you are using Spark/Flink, you must ensure that […]

Logstash configures the mysql data source. Mysql-connector-java-8.0.13.jar does not have read permission or does not load data.

Logstash configures mysql data source, mysql-connector-java-8.0.13.jar does not have read permission [2023-09-19T11:44:11,226][ERROR][logstash.javapipeline][main][63a9fa48345e7ff6aa5948ba8c28fc5cf05d96b9dd7e1d35dd28429202350ad3] A plugin had an unrecoverable error. Will restart this plugin. Pipeline_id:main Plugin: <LogStash::Inputs::Jdbc jdbc_user=>”root”, schedule=>”0 1 * * *”, jdbc_password=><password>, statement=>”SELECT * FROM *** “, jdbc_driver_library=>”mysql-connector-java-8.0.13.jar”, jdbc_connection_string=>”jdbc:mysql://127.0.0.1:3306/***?useUnicode=true &characterEncoding =UTF-8 & serverTimezone=UTC & useSSL=false & allowMultiQueries=true”, id=>”63a9fa48345e7ff6aa5948ba8c28fc5cf05d96b9dd7e1d35dd28429202350ad3″, jdbc_driver_class=>”com. mysql.cj.jdbc.Driver” , enable_metric=>true, codec=><LogStash::Codecs::Plain id=>”plain_5b2c39bc-2e29-46d5-a23c-26a60bc31ab8″, enable_metric=>true, […]

Use the go-redis library to build a Redis connector

Usage requirements: As we all know, every company has its own tool library, which serves each project. Different projects use different redis connections, so our redis connector must be designed to be more flexible and compatible with the use of different projects. Ideas: To support cluster connections To support read and write separation It must […]

flinkCustomize flink-socket-connector

User-defined Sources & Sinks Overview The solid arrows show how objects are transformed into other objects from one stage to the next during the transformation process. Metadata Both Table API and SQL are declarative APIs. This includes table declarations. Therefore, executing a CREATE TABLE statement causes metadata in the target catalog to be updated. For […]