Skip to content

Conversation

@itnccuong
Copy link
Contributor

Purpose of this pull request

The sink to iceberg using Gluecatalog via Zeta is not support.

I have write a docs here, please check it out : https://itnccuong.notion.site/first-task-first-bug-first-depression-1e1f081573a480f097b2eeac27197bc6?pvs=4

Does this PR introduce any user-facing change?

I did add an example about using GlueCatalog in the connector-iceberg.
It will be more helpful for users trying to sink data to an Iceberg table(GlueCatalog) via Zeta in SeaTunnel.

How was this patch tested?

I have already built a pipeline whose sinking process was Iceberg + GlueCatalog + Zeta
I don't think E2E test cases will be possible since it would need AWS credentials and manual database creation.

Check list

Copy link
Contributor

Copilot AI left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull Request Overview

This pull request adds support for AWS Glue Data Catalog in the Apache Iceberg connector via Zeta, along with corresponding documentation updates.

  • Updated the release note to reflect the new Glue Catalog support.
  • Corrected the warehouse URL format in the Iceberg sink configuration and added a new Glue Catalog configuration example in the documentation.

Reviewed Changes

Copilot reviewed 2 out of 3 changed files in this pull request and generated no comments.

File Description
release-note.md Added a new release note entry for Glue Catalog support.
docs/en/connector-v2/sink/Iceberg.md Adjusted warehouse URL formatting and added a Glue Catalog config example.
Files not reviewed (1)
  • seatunnel-connectors-v2/connector-iceberg/pom.xml: Language not supported

Copy link
Member

@Hisoka-X Hisoka-X left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks @itnccuong ! Could you add a screenshot of your successful test?

@Hisoka-X Hisoka-X changed the title Feature/glue catalog support [Feature][Connector-V2] Iceberg add glue catalog support Apr 29, 2025
@Hisoka-X
Copy link
Member

Also please follow the guide to open github action on your fork repository :) https://github.com/apache/seatunnel/pull/9247/checks?check_run_id=41318097636

@itnccuong itnccuong closed this May 1, 2025
@itnccuong itnccuong reopened this May 1, 2025
@itnccuong
Copy link
Contributor Author

Hi @Hisoka-X , I have screenshot my 2 successful-run example here : https://itnccuong.notion.site/Pull-Request-9247-1e6f081573a480fda022e56476ef43e5?pvs=4

And also the Workflow have successfully run.

@itnccuong itnccuong closed this May 5, 2025
@itnccuong itnccuong reopened this May 5, 2025
@duongphannamhung
Copy link

duongphannamhung commented May 5, 2025

looking for this enhancement, too

@Hisoka-X
Copy link
Member

Hisoka-X commented May 6, 2025

Also please follow the guide to open github action on your fork repository :) https://github.com/apache/seatunnel/pull/9247/checks?check_run_id=41318097636

@itnccuong

Hisoka-X
Hisoka-X previously approved these changes May 12, 2025
corgy-w
corgy-w previously approved these changes May 13, 2025
@corgy-w
Copy link
Contributor

corgy-w commented May 13, 2025

hi @itnccuong Conflict needs to be resolved first .

# Conflicts:
#	release-note.md
@Hisoka-X Hisoka-X dismissed stale reviews from corgy-w and themself via 15c4b1d May 15, 2025 12:44
Hisoka-X
Hisoka-X previously approved these changes May 15, 2025
@hailin0
Copy link
Member

hailin0 commented May 15, 2025

image

@corgy-w corgy-w merged commit ecff2e8 into apache:dev May 17, 2025
5 checks passed
@rogerpanlego
Copy link

iceberg on Glue catalog as the source using the streaming mode cannot work.
java.lang.IllegalMonitorStateException
at org.apache.seatunnel.connectors.seatunnel.iceberg.source.enumerator.IcebergStreamSplitEnumerator.run(IcebergStreamSplitEnumerator.java:97)

@Hisoka-X
Copy link
Member

Hi @rogerpanlego . Please create an issue for this.

iceberg on Glue catalog as the source using the streaming mode cannot work. java.lang.IllegalMonitorStateException at org.apache.seatunnel.connectors.seatunnel.iceberg.source.enumerator.IcebergStreamSplitEnumerator.run(IcebergStreamSplitEnumerator.java:97)

dybyte pushed a commit to dybyte/seatunnel that referenced this pull request Jul 23, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

7 participants