[ElasticSearch Series-07] ES development scenarios and index sharding settings and optimization

ElasticSearch series overall column Content Link address [1] ElasticSearch download and installation https://zhenghuisheng.blog.csdn.net/article/details/129260827 [2] ElasticSearch concepts and basic operations https://blog.csdn. net/zhenghuishengq/article/details/134121631 [3] ElasticSearch’s advanced query Query DSL https://blog.csdn.net/zhenghuishengq/article/details/134159587 [4] Aggregation query operation of ElasticSearch https://blog.csdn.net/zhenghuishengq/article/details/134159587 [5] SpringBoot integrates elasticSearch https://blog.csdn.net/zhenghuishengq/article/details/134212200 [6] The construction of Es cluster architecture and the core concepts of clusters https: //blog.csdn.net/zhenghuishengq/article/details/134258577 […]

,Multiple data sources + Mybatisplus + Sharding JDBC split tables in the same database

Horizontal table sharding is to split the data of the same table into multiple tables according to certain rules in the same database. Multiple data sources use the dynamic-datasource of mybatis-plus. The sharding-jdbc database and table sharding are used. The database connection pool management is alibaba’s druid-spring-boot-starter Tables in the same database Table of Contents […]

sharding-jdbc four sharding strategies

1. Standard sharding strategy (standard) 1. Precise sharding Configuration file spring: shardingsphere: #Enable sql display props: sql: show: true datasource: # Configure data source names: db0,db1 db0: type: com.alibaba.druid.pool.DruidDataSource driver-class-name: com.mysql.cj.jdbc.Driver url: jdbc:mysql://127.0.0.1:3306/sharding_test_0?useUnicode=true & amp;character_set_server=utf8mb4 & amp;useSSL=false & amp;useJDBCCompliantTimezoneShift=true & amp;useLegacyDatetimeCode=false & amp;serverTimezone=Asia/ Shanghai username: root password: root db1: type: com.alibaba.druid.pool.DruidDataSource driver-class-name: com.mysql.cj.jdbc.Driver url: jdbc:mysql://127.0.0.1:3306/sharding_test_1?useUnicode=true […]

Detailed restoration of one of the reasons why Elasticsearch cluster sharding appears unassigned

Personal homepage: IT Pindao_Big data OLAP system technology stack, Apache Doris, Clickhouse technology-CSDN blog Private chat with bloggers: Join the big data technology discussion group chat to get more big data information. Blogger’s personal B stack address: Brother Bao teaches you about big data’s personal space – Brother Bao teaches you about big data personal […]

dynamic-datasource+shardingsphere-jdbc realizes sub-database and sub-table

Project background On the basis of spring boot and dynamic-datasource realizing the separation of reading and writing of the database, the function of sub-database and table is added. 1. Framework version 1. Key technology stack versions <properties> <java.version>8</java.version> <snakeyaml.version>1.33</snakeyaml.version> </properties> <dependencies> <!– druid connection pool –> <dependency> <groupId>com.alibaba</groupId> <artifactId>druid-spring-boot-starter</artifactId> <version>1.2.20</version> </dependency> <!–dynamic-datasource–> <dependency> <groupId>com.baomidou</groupId> <artifactId>dynamic-datasource-spring-boot-starter</artifactId> […]

Solve the problem that sharding jdbc cannot update data in batches

Background: After integrating sharding jdbc, the following problems occur when batch modification of table data that has been divided into tables: The first modified data SQL statement was rewritten from sharding to the corresponding table name. All subsequent SQL table names were not rewritten, causing the batch modification to fail. Baidu has found relevant information. […]

Apache ShardingSphere 5.4.1 version is released, data encryption has been upgraded to provide a higher level of data protection!

Summary ShardingSphere Apache ShardingSphere ushered in the release of version 5.4.1 this week. This version lasted for more than two months and merged a total of 967 PRs from global teams and individuals. The new version has improved functionality, performance, testing, and documentation. , examples and other aspects have been greatly optimized. This update contains […]

In-depth exploration of Sharding JDBC: a powerful tool for sharding databases and tables

With the continuous development of Internet applications and the increasing number of users, traditional databases are facing huge challenges in dealing with high concurrency and large data volumes. In order to solve this problem, sharding databases and tables has become a very popular solution. The mainstream technologies for sharding databases and tables include MyCat and […]

springboot+shardingsphere realizes reading and writing separation and sub-database and table

Table of Contents 1.maven dependency 2. Configuration file 2.1mybatis-plus configuration 2.2 Data source configuration 2.3 Read-write separation configuration 2.4 Sub-database and sub-table configuration 3. Test 4.druid monitoring configuration Page configuration Monitoring configuration Startup project 5. Problems encountered Shardingsphere document address: https://shardingsphere.apache.org/document/current/cn/quick-start/ Online yml conversion tool Online yaml to properties-Online properties to yaml-ToYaml.com 1.maven dependency <!– […]

spring sharding JDBC dynamically adjusts database connection

spring sharding JDBC dynamically adjusts database connection Implemented by overriding the ShardingSphereDataSource class Code package org.apache.shardingsphere.driver.jdbc.core.datasource; import com.alibaba.druid.pool.DruidDataSource; import lombok.extern.slf4j.Slf4j; import org.apache.shardingsphere.driver.jdbc.adapter.AbstractDataSourceAdapter; import org.apache.shardingsphere.driver.jdbc.context.CachedDatabaseMetaData; import org.apache.shardingsphere.driver.jdbc.context.JDBCContext; import org.apache.shardingsphere.driver.state.DriverStateContext; import org.apache.shardingsphere.infra.config.RuleConfiguration; import org.apache.shardingsphere.infra.config.checker.RuleConfigurationCheckerFactory; import org.apache.shardingsphere.infra.config.database.DatabaseConfiguration; import org.apache.shardingsphere.infra.config.database.impl.DataSourceProvidedDatabaseConfiguration; import org.apache.shardingsphere.infra.config.mode.ModeConfiguration; import org.apache.shardingsphere.infra.config.props.ConfigurationProperties; import org.apache.shardingsphere.infra.config.scope.GlobalRuleConfiguration; import org.apache.shardingsphere.infra.datasource.props.DataSourceProperties; import org.apache.shardingsphere.infra.datasource.props.DataSourcePropertiesCreator; import org.apache.shardingsphere.infra.instance.definition.InstanceDefinition; import org.apache.shardingsphere.infra.instance.definition.InstanceType; import org.apache.shardingsphere.infra.rule.ShardingSphereRule; import org.apache.shardingsphere.infra.rule.builder.schema.DatabaseRulesBuilder; import […]