Skip to content

Commit bc1034c

Browse files
committed
fix ci
1 parent 555ef18 commit bc1034c

File tree

4 files changed

+36
-12
lines changed

4 files changed

+36
-12
lines changed

docs/en/connector-v2/sink/Doris.md

Lines changed: 9 additions & 3 deletions
Original file line numberDiff line numberDiff line change
@@ -152,9 +152,15 @@ The supported formats include CSV and JSON
152152

153153
## Tuning Guide
154154

155-
Appropriately increasing the value of `sink.buffer-size` and `doris.batch.size` can increase the write performance. <br>
156-
In stream mode, if the `doris.batch.size` and `checkpoint.interval` are both configured with a large value, The last data to arrive may have a large delay(The delay time is the checkpoint interval). <br>
157-
This is because the total amount of data arriving at the end may not exceed the threshold specified by `doris.batch.size`. Therefore, commit can only be triggered by checkpoint before the volume of received data does not exceed this threshold. Therefore, you should select an appropriate `checkpoint.interval`.<br>
155+
Appropriately increasing the value of `sink.buffer-size` and `doris.batch.size` can increase the write performance.
156+
157+
158+
In stream mode, if the `doris.batch.size` and `checkpoint.interval` are both configured with a large value, The last data to arrive may have a large delay(The delay time is the checkpoint interval).
159+
160+
161+
This is because the total amount of data arriving at the end may not exceed the threshold specified by `doris.batch.size`. Therefore, commit can only be triggered by checkpoint before the volume of received data does not exceed this threshold. Therefore, you should select an appropriate `checkpoint.interval`.
162+
163+
158164
Otherwise if you enable the 2pc by the property `sink.enable-2pc=true`.The `sink.buffer-size` will have no effect. So only the checkpoint can trigger the commit.
159165

160166
## Task Example

docs/en/connector-v2/sink/Paimon.md

Lines changed: 9 additions & 3 deletions
Original file line numberDiff line numberDiff line change
@@ -48,9 +48,15 @@ libfb303-xxx.jar
4848
| paimon.hadoop.conf-path | String | No | - | The specified loading path for the 'core-site.xml', 'hdfs-site.xml', 'hive-site.xml' files |
4949

5050
## Changelog
51-
You must configure the `changelog-producer=input` option to enable the changelog producer mode of the paimon table. If you use the auto-create table function of paimon sink, you can configure this property in `paimon.table.write-props`.<br>
52-
The changelog producer mode of the paimon table has [four mode](https://paimon.apache.org/docs/master/primary-key-table/changelog-producer/) which is `none``input``lookup` and `full-compaction`.<br>
53-
Currently, we only support the `none` and `input` mode. The default is `none` which will not output the changelog file. The `input` mode will output the changelog file in paimon table.<br>
51+
You must configure the `changelog-producer=input` option to enable the changelog producer mode of the paimon table. If you use the auto-create table function of paimon sink, you can configure this property in `paimon.table.write-props`.
52+
53+
54+
The changelog producer mode of the paimon table has [four mode](https://paimon.apache.org/docs/master/primary-key-table/changelog-producer/) which is `none``input``lookup` and `full-compaction`.
55+
56+
57+
Currently, we only support the `none` and `input` mode. The default is `none` which will not output the changelog file. The `input` mode will output the changelog file in paimon table.
58+
59+
5460
When you use a streaming mode to read paimon table, these two mode will produce [different results](https://github.com/apache/seatunnel/blob/dev/docs/en/connector-v2/source/Paimon.md#changelog).
5561

5662
## Examples

docs/zh/connector-v2/sink/Doris.md

Lines changed: 9 additions & 3 deletions
Original file line numberDiff line numberDiff line change
@@ -149,9 +149,15 @@ CREATE TABLE IF NOT EXISTS `${database}`.`${table_name}`
149149

150150
## 调优指南
151151

152-
适当增加`sink.buffer-size``doris.batch.size`的值可以提高写性能。<br>
153-
在流模式下,如果`doris.batch.size``checkpoint.interval`都配置为较大的值,最后到达的数据可能会有较大的延迟(延迟的时间就是检查点间隔的时间)。<br>
154-
这是因为最后到达的数据总量可能不会超过doris.batch.size指定的阈值。因此,在接收到数据的数据量没有超过该阈值之前只有检查点才会触发提交操作。因此,需要选择一个合适的检查点间隔。<br>
152+
适当增加`sink.buffer-size``doris.batch.size`的值可以提高写性能。
153+
154+
155+
在流模式下,如果`doris.batch.size``checkpoint.interval`都配置为较大的值,最后到达的数据可能会有较大的延迟(延迟的时间就是检查点间隔的时间)。
156+
157+
158+
这是因为最后到达的数据总量可能不会超过doris.batch.size指定的阈值。因此,在接收到数据的数据量没有超过该阈值之前只有检查点才会触发提交操作。因此,需要选择一个合适的检查点间隔。
159+
160+
155161
此外,如果你通过`sink.enable-2pc=true`属性启用2pc。`sink.buffer-size`将会失去作用,只有检查点才能触发提交。
156162

157163
## 任务示例

docs/zh/connector-v2/sink/Paimon.md

Lines changed: 9 additions & 3 deletions
Original file line numberDiff line numberDiff line change
@@ -47,9 +47,15 @@ libfb303-xxx.jar
4747
| paimon.hadoop.conf-path | 字符串 || - | Hadoop配置文件目录,用于加载'core-site.xml', 'hdfs-site.xml', 'hive-site.xml'文件配置 |
4848

4949
## 更新日志
50-
你必须配置`changelog-producer=input`来启用paimon表的changelog产生模式。如果你使用了paimon sink的自动建表功能,你可以在`paimon.table.write-props`中指定这个属性。<br>
51-
Paimon表的changelog产生模式有[四种](https://paimon.apache.org/docs/master/primary-key-table/changelog-producer/),分别是`none``input``lookup``full-compaction`。<br>
52-
目前,我们只支持`none``input`模式。默认是`none`,这种模式将不会产生changelog文件。`input`模式将会在Paimon表下产生changelog文件。<br>
50+
你必须配置`changelog-producer=input`来启用paimon表的changelog产生模式。如果你使用了paimon sink的自动建表功能,你可以在`paimon.table.write-props`中指定这个属性。
51+
52+
53+
Paimon表的changelog产生模式有[四种](https://paimon.apache.org/docs/master/primary-key-table/changelog-producer/),分别是`none``input``lookup``full-compaction`
54+
55+
56+
目前,我们只支持`none``input`模式。默认是`none`,这种模式将不会产生changelog文件。`input`模式将会在Paimon表下产生changelog文件。
57+
58+
5359
当你使用流模式去读paimon表的数据时,这两种模式将会产生[不同的结果](https://github.com/apache/seatunnel/blob/dev/docs/en/connector-v2/source/Paimon.md#changelog)
5460

5561
## 示例

0 commit comments

Comments
 (0)