-
Notifications
You must be signed in to change notification settings - Fork 2.1k
[Feature][Connector-V2] Iceberg add glue catalog support #9247
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Conversation
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Pull Request Overview
This pull request adds support for AWS Glue Data Catalog in the Apache Iceberg connector via Zeta, along with corresponding documentation updates.
- Updated the release note to reflect the new Glue Catalog support.
- Corrected the warehouse URL format in the Iceberg sink configuration and added a new Glue Catalog configuration example in the documentation.
Reviewed Changes
Copilot reviewed 2 out of 3 changed files in this pull request and generated no comments.
| File | Description |
|---|---|
| release-note.md | Added a new release note entry for Glue Catalog support. |
| docs/en/connector-v2/sink/Iceberg.md | Adjusted warehouse URL formatting and added a Glue Catalog config example. |
Files not reviewed (1)
- seatunnel-connectors-v2/connector-iceberg/pom.xml: Language not supported
Hisoka-X
left a comment
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Thanks @itnccuong ! Could you add a screenshot of your successful test?
|
Also please follow the guide to open github action on your fork repository :) https://github.com/apache/seatunnel/pull/9247/checks?check_run_id=41318097636 |
|
Hi @Hisoka-X , I have screenshot my 2 successful-run example here : https://itnccuong.notion.site/Pull-Request-9247-1e6f081573a480fda022e56476ef43e5?pvs=4 And also the Workflow have successfully run. |
|
looking for this enhancement, too |
|
|
hi @itnccuong Conflict needs to be resolved first . |
# Conflicts: # release-note.md
|
iceberg on Glue catalog as the source using the streaming mode cannot work. |
|
Hi @rogerpanlego . Please create an issue for this.
|

Purpose of this pull request
The sink to iceberg using Gluecatalog via Zeta is not support.
I have write a docs here, please check it out : https://itnccuong.notion.site/first-task-first-bug-first-depression-1e1f081573a480f097b2eeac27197bc6?pvs=4
Does this PR introduce any user-facing change?
I did add an example about using GlueCatalog in the connector-iceberg.
It will be more helpful for users trying to sink data to an Iceberg table(GlueCatalog) via Zeta in SeaTunnel.
How was this patch tested?
I have already built a pipeline whose sinking process was Iceberg + GlueCatalog + Zeta
I don't think E2E test cases will be possible since it would need AWS credentials and manual database creation.
Check list
New License Guide
release-note.