[Feature][Connector-doris] Adds case insensitivity feature

[yzeng1618]

Purpose of this pull request

#9272

This PR adds case insensitivity feature to the Doris connector. During data synchronization, especially in migration scenarios from Oracle to Doris, column name matching issues often occur because Oracle stores table and field names in uppercase by default, while Doris typically uses lowercase identifiers. By adding a case_sensitive configuration option, users can control whether column names are case-sensitive, thus resolving case difference issues during cross-database system migration.

Does this PR introduce any user-facing change?

Yes, this PR introduces a new configuration option case_sensitive that allows users to control whether the Doris connector is case-sensitive when processing column names. When set to false , the connector automatically converts column names to lowercase, achieving case-insensitive column name matching. This is particularly useful when migrating data from databases like Oracle that use uppercase identifiers by default to Doris.

How was this patch tested?

• Integration tests: Tested actual data synchronization scenarios using Oracle and Doris environments to ensure column name case differences do not affect data synchronization
• Manual testing: Verified the stability and compatibility of the feature under different configuration combinations
• Scenario testing: Mainly tested single table, multiple tables with parameter set to false, and scenarios without setting parameters, all results met the requirements

Check list

• If any new Jar binary package adding in your PR, please add License Notice according
  New License Guide
• [ x ] If necessary, please update the documentation to describe the new feature. https://github.com/apache/seatunnel/tree/dev/docs
• If you are contributing the connector code, please check that the following files are updated:
  1. Update plugin-mapping.properties and add new connector information in it
  2. Update the pom file of seatunnel-dist
  3. Add ci label in label-scope-conf
  4. Add e2e testcase in seatunnel-e2e
  5. Update connector plugin_config
• [ x ] Update the release-note.

[Copilot]

Pull Request Overview

This pull request introduces a new configuration option to control case sensitivity within the Doris connector, addressing issues in column name matching when migrating from systems like Oracle. Key changes include adding extensive tests for the case sensitivity feature, updating table/column name processing in both sink and converter components, and integrating the new configuration option via updated options and configuration classes.

Reviewed Changes

Copilot reviewed 12 out of 12 changed files in this pull request and generated 1 comment.

Show a summary per file

File	Description
DorisTypeConvertorV2Test.java, DorisTypeConvertorV1Test.java	Added tests verifying default and override behavior for case sensitivity.
DorisStreamLoad.java	Modified to optionally lowercase the table name based on the case_sensitive flag.
DorisSinkWriter.java, SeaTunnelRowSerializerFactory.java, SeaTunnelRowSerializer.java	Updated to use a new serializer factory that accepts a case sensitivity flag and processes field names accordingly.
AbstractDorisTypeConverter.java	Updated builder method to apply case sensitivity during column name construction.
DorisTableConfig.java, DorisSinkOptions.java, DorisSinkConfig.java	Introduced and integrated the new case_sensitive configuration option.

Comments suppressed due to low confidence (2)

seatunnel-connectors-v2/connector-doris/src/main/java/org/apache/seatunnel/connectors/doris/sink/writer/DorisStreamLoad.java:97

• Consider using toLowerCase(Locale.ROOT) instead of plain toLowerCase() to guarantee locale-insensitive behavior during case conversion.

this.table = dorisSinkConfig.isCaseSensitive() ? tablePath.getTableName() : tablePath.getTableName().toLowerCase();

seatunnel-connectors-v2/connector-doris/src/main/java/org/apache/seatunnel/connectors/doris/datatype/AbstractDorisTypeConverter.java:98

• Consider specifying Locale.ROOT in the toLowerCase() call to ensure consistent, locale-insensitive string conversion.

String columnName = caseSensitive ? typeDefine.getName() : typeDefine.getName().toLowerCase();

[Copilot]

Consider using toLowerCase(Locale.ROOT) here as well to avoid potential locale-related inconsistencies.

Suggested change

	processedFieldNames[i] = caseSensitive ? fieldNames[i] : fieldNames[i].toLowerCase();
	processedFieldNames[i] = caseSensitive ? fieldNames[i] : fieldNames[i].toLowerCase(Locale.ROOT);

[Hisoka-X]

Thanks @yzeng1618 ! Please update the docs.

[Hisoka-X]

Suggested change

	# If you want to convert all table and column names to lowercase
	sink {
	Doris {
	fenodes = "e2e_dorisdb:8030"
	username = root
	password = ""
	database = "Test_DB" # Will be converted to "test_db"
	table = "Test_Table" # Will be converted to "test_table"
	case_sensitive = false # Convert all names to lowercase
	sink.enable-2pc = "true"
	sink.label-prefix = "test_case_insensitive"
	doris.config = {
	format = "json"
	read_json_by_line = "true"
	}
	}
	}

Keep one demo is enough.

[yzeng1618]

It has been modified.

[Hisoka-X]

ditto.

[yzeng1618]

It has been modified.