apache/seatunnel

[Feature][Connector-V2][CDC] Expose structured source identifiers as metadata fields about 2 hours ago

help wanted good first issue

9.5K

SeaTunnel is a multimodal, high-performance, distributed, massive data integration tool.

Java

#apache#batch#cdc#change-data-capture#data-ingestion#data-integration#elt#embeddings#high-performance#llm#multimodal#offline#real-time#streaming

[Feature][Connector-V2][PostgreSQL-CDC] Add committed-offset and snapshot-only startup modes about 3 hours ago

help wanted feature

apache/seatunnel

9.5K

SeaTunnel is a multimodal, high-performance, distributed, massive data integration tool.

Java

#apache#batch#cdc#change-data-capture#data-ingestion#data-integration#elt#embeddings#high-performance#llm#multimodal#offline#real-time#streaming

[Docs] Document DolphinScheduler integration with Docker Compose deployments about 3 hours ago

document good first issue

apache/seatunnel

9.5K

SeaTunnel is a multimodal, high-performance, distributed, massive data integration tool.

Java

#apache#batch#cdc#change-data-capture#data-ingestion#data-integration#elt#embeddings#high-performance#llm#multimodal#offline#real-time#streaming

[Bug] SftpFile REST submit may block for a long time before returning `jobId` when source directory contains many files 1 day ago

bug help wanted

apache/seatunnel

9.5K

SeaTunnel is a multimodal, high-performance, distributed, massive data integration tool.

Java

#apache#batch#cdc#change-data-capture#data-ingestion#data-integration#elt#embeddings#high-performance#llm#multimodal#offline#real-time#streaming

[Bug] [spark-3-starter] Failed to read config file while starting with cluster mode 1 day ago

bug help wanted

apache/seatunnel

9.5K

SeaTunnel is a multimodal, high-performance, distributed, massive data integration tool.

Java

#apache#batch#cdc#change-data-capture#data-ingestion#data-integration#elt#embeddings#high-performance#llm#multimodal#offline#real-time#streaming

[Feature][CDC] Add a unified CDC lag observability view across connectors 1 day ago

help wanted feature cdc design api metrics Zeta UI connectors-v2

apache/seatunnel

9.5K

SeaTunnel is a multimodal, high-performance, distributed, massive data integration tool.

Java

#apache#batch#cdc#change-data-capture#data-ingestion#data-integration#elt#embeddings#high-performance#llm#multimodal#offline#real-time#streaming

[Feature][CI&CD] Add upgrade-compatibility CI for cross-version restore 2 days ago

help wanted feature

apache/seatunnel

9.5K

SeaTunnel is a multimodal, high-performance, distributed, massive data integration tool.

Java

#apache#batch#cdc#change-data-capture#data-ingestion#data-integration#elt#embeddings#high-performance#llm#multimodal#offline#real-time#streaming

[Docs] Add Zeta slow-operation troubleshooting cookbook 2 days ago

help wanted document good first issue

apache/seatunnel

9.5K

SeaTunnel is a multimodal, high-performance, distributed, massive data integration tool.

Java

#apache#batch#cdc#change-data-capture#data-ingestion#data-integration#elt#embeddings#high-performance#llm#multimodal#offline#real-time#streaming

[Feature][Zeta] Add a runtime execution graph view for live pipeline diagnosis 2 days ago

help wanted feature Zeta design metrics Zeta UI

apache/seatunnel

9.5K

SeaTunnel is a multimodal, high-performance, distributed, massive data integration tool.

Java

#apache#batch#cdc#change-data-capture#data-ingestion#data-integration#elt#embeddings#high-performance#llm#multimodal#offline#real-time#streaming

[Feature][Zeta] Add a dedicated backpressure diagnostics view for running jobs 2 days ago

help wanted feature Zeta design metrics Zeta UI

apache/seatunnel

9.5K

SeaTunnel is a multimodal, high-performance, distributed, massive data integration tool.

Java

#apache#batch#cdc#change-data-capture#data-ingestion#data-integration#elt#embeddings#high-performance#llm#multimodal#offline#real-time#streaming

[Feature][Zeta] Add a checkpoint timeline with phase-level progress and failure breakdown 2 days ago

help wanted feature Zeta design checkpoint Zeta UI

apache/seatunnel

9.5K

SeaTunnel is a multimodal, high-performance, distributed, massive data integration tool.

Java

#apache#batch#cdc#change-data-capture#data-ingestion#data-integration#elt#embeddings#high-performance#llm#multimodal#offline#real-time#streaming

[Feature][CDC][DDL] Add a schema evolution timeline and decision log 2 days ago

help wanted feature cdc design api Zeta UI ddl connectors-v2

apache/seatunnel

9.5K

SeaTunnel is a multimodal, high-performance, distributed, massive data integration tool.

Java

#apache#batch#cdc#change-data-capture#data-ingestion#data-integration#elt#embeddings#high-performance#llm#multimodal#offline#real-time#streaming

[Feature][CI&CD] Extend upgrade compatibility coverage beyond the initial cross-version restore workflow 2 days ago

help wanted CI&CD feature design e2e

apache/seatunnel

9.5K

SeaTunnel is a multimodal, high-performance, distributed, massive data integration tool.

Java

#apache#batch#cdc#change-data-capture#data-ingestion#data-integration#elt#embeddings#high-performance#llm#multimodal#offline#real-time#streaming

[Feature][Connector-V2][CDC] Add configurable schema change behavior policies 3 days ago

help wanted

apache/seatunnel

9.5K

SeaTunnel is a multimodal, high-performance, distributed, massive data integration tool.

Java

#apache#batch#cdc#change-data-capture#data-ingestion#data-integration#elt#embeddings#high-performance#llm#multimodal#offline#real-time#streaming

[Docs] Improve JDBC docs for mixing primary key placeholders with static keys 3 days ago

help wanted document good first issue

apache/seatunnel

9.5K

SeaTunnel is a multimodal, high-performance, distributed, massive data integration tool.

Java

#apache#batch#cdc#change-data-capture#data-ingestion#data-integration#elt#embeddings#high-performance#llm#multimodal#offline#real-time#streaming

[Bug] [MySQL CDC] alter table change column error 3 days ago

bug help wanted

apache/seatunnel

9.5K

SeaTunnel is a multimodal, high-performance, distributed, massive data integration tool.

Java

#apache#batch#cdc#change-data-capture#data-ingestion#data-integration#elt#embeddings#high-performance#llm#multimodal#offline#real-time#streaming

[Feature] [Connector] Support Python-based Custom Data Sources As source for SeaTunnel 4 days ago

help wanted good first issue

apache/seatunnel

9.5K

SeaTunnel is a multimodal, high-performance, distributed, massive data integration tool.

Java

#apache#batch#cdc#change-data-capture#data-ingestion#data-integration#elt#embeddings#high-performance#llm#multimodal#offline#real-time#streaming

[Feature][Connector-V2] Support write data into DeepLake dataset 4 days ago

help wanted feature

apache/seatunnel

9.5K

SeaTunnel is a multimodal, high-performance, distributed, massive data integration tool.

Java

#apache#batch#cdc#change-data-capture#data-ingestion#data-integration#elt#embeddings#high-performance#llm#multimodal#offline#real-time#streaming

[Feature] Support SeaTunnel on Spark 3.5.8 4 days ago

help wanted feature

apache/seatunnel

9.5K

SeaTunnel is a multimodal, high-performance, distributed, massive data integration tool.

Java

#apache#batch#cdc#change-data-capture#data-ingestion#data-integration#elt#embeddings#high-performance#llm#multimodal#offline#real-time#streaming

[Bug] [connector-kafka] Unable to parse Avro-formatted Kafka data 4 days ago

bug help wanted

apache/seatunnel

9.5K

SeaTunnel is a multimodal, high-performance, distributed, massive data integration tool.

Java

#apache#batch#cdc#change-data-capture#data-ingestion#data-integration#elt#embeddings#high-performance#llm#multimodal#offline#real-time#streaming

[Umbrella][Improve] Migrate Connector/Transform Validation to Declarative OptionRule — Claim & Tracking 5 days ago

help wanted good first issue First-time contributor

apache/seatunnel

9.5K

SeaTunnel is a multimodal, high-performance, distributed, massive data integration tool.

Java

#apache#batch#cdc#change-data-capture#data-ingestion#data-integration#elt#embeddings#high-performance#llm#multimodal#offline#real-time#streaming

[Docs] Document S3File credential provider support for container environments 6 days ago

help wanted document good first issue

apache/seatunnel

9.5K

SeaTunnel is a multimodal, high-performance, distributed, massive data integration tool.

Java

#apache#batch#cdc#change-data-capture#data-ingestion#data-integration#elt#embeddings#high-performance#llm#multimodal#offline#real-time#streaming

[Docs] Add transform recipes for nested JSON splitting and vector conversion 6 days ago

help wanted document good first issue

apache/seatunnel

9.5K

SeaTunnel is a multimodal, high-performance, distributed, massive data integration tool.

Java

#apache#batch#cdc#change-data-capture#data-ingestion#data-integration#elt#embeddings#high-performance#llm#multimodal#offline#real-time#streaming

[Feature][Transform-V2] Support GET_JSON_OBJECT in SQL transform 6 days ago

help wanted feature

apache/seatunnel

9.5K

SeaTunnel is a multimodal, high-performance, distributed, massive data integration tool.

Java

#apache#batch#cdc#change-data-capture#data-ingestion#data-integration#elt#embeddings#high-performance#llm#multimodal#offline#real-time#streaming

[Bug] [connector-jdbc] DM compatible data type NVARCHAR2 9 days ago

bug help wanted good first issue

apache/seatunnel

9.5K

SeaTunnel is a multimodal, high-performance, distributed, massive data integration tool.

Java

#apache#batch#cdc#change-data-capture#data-ingestion#data-integration#elt#embeddings#high-performance#llm#multimodal#offline#real-time#streaming

[Feature][Connector] Add connectors for these datasources 9 days ago

help wanted good first issue feature

apache/seatunnel

9.5K

SeaTunnel is a multimodal, high-performance, distributed, massive data integration tool.

Java

#apache#batch#cdc#change-data-capture#data-ingestion#data-integration#elt#embeddings#high-performance#llm#multimodal#offline#real-time#streaming

[Bug] [MongoDB-CDC] Bug DataException: operationType is not a valid field name 10 days ago

bug help wanted

apache/seatunnel

9.5K

SeaTunnel is a multimodal, high-performance, distributed, massive data integration tool.

Java

#apache#batch#cdc#change-data-capture#data-ingestion#data-integration#elt#embeddings#high-performance#llm#multimodal#offline#real-time#streaming

[Bug] [hudi sink] hudi sink java client not support struct field type where is null 11 days ago

bug help wanted

apache/seatunnel

9.5K

SeaTunnel is a multimodal, high-performance, distributed, massive data integration tool.

Java

#apache#batch#cdc#change-data-capture#data-ingestion#data-integration#elt#embeddings#high-performance#llm#multimodal#offline#real-time#streaming

[Feature][Connector-V2][MySQL-CDC] Add snapshot-only startup mode 11 days ago

help wanted good first issue feature

apache/seatunnel

9.5K

SeaTunnel is a multimodal, high-performance, distributed, massive data integration tool.

Java

#apache#batch#cdc#change-data-capture#data-ingestion#data-integration#elt#embeddings#high-performance#llm#multimodal#offline#real-time#streaming

[Feature][Connector-V2][Oracle-CDC] Add SCN-based specific-offset startup 13 days ago

help wanted feature

apache/seatunnel

9.5K

SeaTunnel is a multimodal, high-performance, distributed, massive data integration tool.

Java

#apache#batch#cdc#change-data-capture#data-ingestion#data-integration#elt#embeddings#high-performance#llm#multimodal#offline#real-time#streaming

[Umbrella][Feature][Connector] Support New Connectors — Claim & Tracking 14 days ago

help wanted good first issue First-time contributor

apache/seatunnel

9.5K

SeaTunnel is a multimodal, high-performance, distributed, massive data integration tool.

Java

#apache#batch#cdc#change-data-capture#data-ingestion#data-integration#elt#embeddings#high-performance#llm#multimodal#offline#real-time#streaming

[bug][connector-cdc-mongodb] Fails to Connect to MongoDB Atlas Due to Hardcoded URI Scheme "mongodb://" 16 days ago

bug help wanted

apache/seatunnel

9.5K

SeaTunnel is a multimodal, high-performance, distributed, massive data integration tool.

Java

#apache#batch#cdc#change-data-capture#data-ingestion#data-integration#elt#embeddings#high-performance#llm#multimodal#offline#real-time#streaming

[Feature][Connector-V2][MySQL-CDC] Extend specific-offset startup with GTID-set and skip controls 17 days ago

help wanted

apache/seatunnel

9.5K

SeaTunnel is a multimodal, high-performance, distributed, massive data integration tool.

Java

#apache#batch#cdc#change-data-capture#data-ingestion#data-integration#elt#embeddings#high-performance#llm#multimodal#offline#real-time#streaming

[Feature][Connector-V2][CDC] Add OceanBase CDC source connector 20 days ago

help wanted feature

apache/seatunnel

9.5K

SeaTunnel is a multimodal, high-performance, distributed, massive data integration tool.

Java

#apache#batch#cdc#change-data-capture#data-ingestion#data-integration#elt#embeddings#high-performance#llm#multimodal#offline#real-time#streaming

[Feature] Add NebulaGraph Connector 20 days ago

help wanted good first issue

apache/seatunnel

9.5K

SeaTunnel is a multimodal, high-performance, distributed, massive data integration tool.

Java

#apache#batch#cdc#change-data-capture#data-ingestion#data-integration#elt#embeddings#high-performance#llm#multimodal#offline#real-time#streaming

seatunnel-transforms-v2 compiled with Scala 2.13 incompatible with Spark Scala 2.12 21 days ago

bug help wanted

apache/seatunnel

9.5K

SeaTunnel is a multimodal, high-performance, distributed, massive data integration tool.

Java

#apache#batch#cdc#change-data-capture#data-ingestion#data-integration#elt#embeddings#high-performance#llm#multimodal#offline#real-time#streaming

[Feature][Connector-V2][CDC] Add include/exclude filtering for schema change event types 21 days ago

help wanted good first issue

apache/seatunnel

9.5K

SeaTunnel is a multimodal, high-performance, distributed, massive data integration tool.

Java

#apache#batch#cdc#change-data-capture#data-ingestion#data-integration#elt#embeddings#high-performance#llm#multimodal#offline#real-time#streaming

[Bug] Oracle-CDC fails to obtain schema for the third table in Oracle 19c CDB/PDB multi-table CDC job 22 days ago

bug help wanted

apache/seatunnel

9.5K

SeaTunnel is a multimodal, high-performance, distributed, massive data integration tool.

Java

#apache#batch#cdc#change-data-capture#data-ingestion#data-integration#elt#embeddings#high-performance#llm#multimodal#offline#real-time#streaming

Who is Using SeaTunnel? 22 days ago

help wanted

apache/seatunnel

9.5K

SeaTunnel is a multimodal, high-performance, distributed, massive data integration tool.

Java

#apache#batch#cdc#change-data-capture#data-ingestion#data-integration#elt#embeddings#high-performance#llm#multimodal#offline#real-time#streaming

[Feature][Connector-V2][CDC] Pass sink-specific table options into auto-created target tables 22 days ago

help wanted

apache/seatunnel

9.5K

SeaTunnel is a multimodal, high-performance, distributed, massive data integration tool.

Java

#apache#batch#cdc#change-data-capture#data-ingestion#data-integration#elt#embeddings#high-performance#llm#multimodal#offline#real-time#streaming

[Bug] [Connector-V2] [connector-hive] stream was closed when writing data to Hive 22 days ago

bug help wanted

apache/seatunnel

9.5K

SeaTunnel is a multimodal, high-performance, distributed, massive data integration tool.

Java

#apache#batch#cdc#change-data-capture#data-ingestion#data-integration#elt#embeddings#high-performance#llm#multimodal#offline#real-time#streaming

[Umbrella][RAG] Define and implement production-grade Knowledge Sync for SeaTunnel 23 days ago

help wanted feature design

apache/seatunnel

9.5K

SeaTunnel is a multimodal, high-performance, distributed, massive data integration tool.

Java

#apache#batch#cdc#change-data-capture#data-ingestion#data-integration#elt#embeddings#high-performance#llm#multimodal#offline#real-time#streaming

Optimize Sink Connection Creation When Writing Multiple Sharded MySQL Tables to a Single Paimon Table (Stuck on 200+ Sinks) 24 days ago

help wanted feature

apache/seatunnel

9.5K

SeaTunnel is a multimodal, high-performance, distributed, massive data integration tool.

Java

#apache#batch#cdc#change-data-capture#data-ingestion#data-integration#elt#embeddings#high-performance#llm#multimodal#offline#real-time#streaming

[Feature][connector] http connector cursor type pageing not check the number of returned items is less than batchSize？ 25 days ago

bug help wanted

apache/seatunnel

9.5K

SeaTunnel is a multimodal, high-performance, distributed, massive data integration tool.

Java

#apache#batch#cdc#change-data-capture#data-ingestion#data-integration#elt#embeddings#high-performance#llm#multimodal#offline#real-time#streaming

[Feature][Connector-V2][CDC] Add Vitess CDC source connector 25 days ago

help wanted

apache/seatunnel

9.5K

SeaTunnel is a multimodal, high-performance, distributed, massive data integration tool.

Java

#apache#batch#cdc#change-data-capture#data-ingestion#data-integration#elt#embeddings#high-performance#llm#multimodal#offline#real-time#streaming

[Bug] [Connector-V2] [TiDB-CDC] resolvedTs keeps advancing but row change events are silently missed 25 days ago

bug help wanted

apache/seatunnel

9.5K

SeaTunnel is a multimodal, high-performance, distributed, massive data integration tool.

Java

#apache#batch#cdc#change-data-capture#data-ingestion#data-integration#elt#embeddings#high-performance#llm#multimodal#offline#real-time#streaming

[Bug] [SFTP] SFTP connector miss fs.sftp.keyfile option 26 days ago

bug help wanted

apache/seatunnel

9.5K

SeaTunnel is a multimodal, high-performance, distributed, massive data integration tool.

Java

#apache#batch#cdc#change-data-capture#data-ingestion#data-integration#elt#embeddings#high-performance#llm#multimodal#offline#real-time#streaming

[Feature][Transform-V2][CDC] Add configurable rule evaluation mode for multi-table transform matching 26 days ago

help wanted good first issue

apache/seatunnel

9.5K

SeaTunnel is a multimodal, high-performance, distributed, massive data integration tool.

Java

#apache#batch#cdc#change-data-capture#data-ingestion#data-integration#elt#embeddings#high-performance#llm#multimodal#offline#real-time#streaming

[Bug] [oss-sink] parquet_avro_write_timestamp_as_int96 An error occurs when the name of the datetime-type field is in uppercase 27 days ago

bug help wanted

apache/seatunnel

9.5K

SeaTunnel is a multimodal, high-performance, distributed, massive data integration tool.

Java

#apache#batch#cdc#change-data-capture#data-ingestion#data-integration#elt#embeddings#high-performance#llm#multimodal#offline#real-time#streaming

[Bug] [Doris Sink] In Zeta mode, MySQL CDC cannot automatically create tables in Doris. The Doris version is 3.0+ and there is an error. 28 days ago

bug help wanted needs-info

apache/seatunnel

9.5K

SeaTunnel is a multimodal, high-performance, distributed, massive data integration tool.

Java

#apache#batch#cdc#change-data-capture#data-ingestion#data-integration#elt#embeddings#high-performance#llm#multimodal#offline#real-time#streaming

[Feature][Connector-v2][MySQL] Support dynamic discovery of new tables for regex-based multi-table sync 28 days ago

help wanted good first issue

apache/seatunnel

9.5K

SeaTunnel is a multimodal, high-performance, distributed, massive data integration tool.

Java

#apache#batch#cdc#change-data-capture#data-ingestion#data-integration#elt#embeddings#high-performance#llm#multimodal#offline#real-time#streaming

[Bug][Spark][CDC] Coordinated source path does not support SourceEvent for CDC sources 28 days ago

bug help wanted

apache/seatunnel

9.5K

SeaTunnel is a multimodal, high-performance, distributed, massive data integration tool.

Java

#apache#batch#cdc#change-data-capture#data-ingestion#data-integration#elt#embeddings#high-performance#llm#multimodal#offline#real-time#streaming

[Bug] [Connector-V2][Postgres-CDC] Scanning unwanted database and tables which are not mentioned in Source 28 days ago

bug help wanted

apache/seatunnel

9.5K

SeaTunnel is a multimodal, high-performance, distributed, massive data integration tool.

Java

#apache#batch#cdc#change-data-capture#data-ingestion#data-integration#elt#embeddings#high-performance#llm#multimodal#offline#real-time#streaming

[Feature][CDC][DDL] Support comment-related schema change events for CDC schema evolution 28 days ago

help wanted discussion feature cdc api ddl

apache/seatunnel

9.5K

SeaTunnel is a multimodal, high-performance, distributed, massive data integration tool.

Java

#apache#batch#cdc#change-data-capture#data-ingestion#data-integration#elt#embeddings#high-performance#llm#multimodal#offline#real-time#streaming

[Feature][Connector-V2][MongoDB-CDC] Add latest-offset startup mode without initial snapshot 28 days ago

help wanted good first issue

apache/seatunnel

9.5K

SeaTunnel is a multimodal, high-performance, distributed, massive data integration tool.

Java

#apache#batch#cdc#change-data-capture#data-ingestion#data-integration#elt#embeddings#high-performance#llm#multimodal#offline#real-time#streaming

[Feature][Sqlserver-CDC] Add multi-table e2e testcase 28 days ago

help wanted good first issue e2e

apache/seatunnel

9.5K

SeaTunnel is a multimodal, high-performance, distributed, massive data integration tool.

Java

#apache#batch#cdc#change-data-capture#data-ingestion#data-integration#elt#embeddings#high-performance#llm#multimodal#offline#real-time#streaming

[Feature][Transform-V2][CDC] Add optional soft-delete conversion for delete events 28 days ago

help wanted

apache/seatunnel

9.5K

SeaTunnel is a multimodal, high-performance, distributed, massive data integration tool.

Java

#apache#batch#cdc#change-data-capture#data-ingestion#data-integration#elt#embeddings#high-performance#llm#multimodal#offline#real-time#streaming

[Feature][Connector] Add Shopify Source Connector 28 days ago

help wanted good first issue feature connectors-v2

apache/seatunnel

9.5K

SeaTunnel is a multimodal, high-performance, distributed, massive data integration tool.

Java

#apache#batch#cdc#change-data-capture#data-ingestion#data-integration#elt#embeddings#high-performance#llm#multimodal#offline#real-time#streaming

[Umbrella][Feature][Connector] Need help for supporting multi-table source feature 29 days ago

help wanted good first issue feature

apache/seatunnel

9.5K

SeaTunnel is a multimodal, high-performance, distributed, massive data integration tool.

Java

#apache#batch#cdc#change-data-capture#data-ingestion#data-integration#elt#embeddings#high-performance#llm#multimodal#offline#real-time#streaming

[Bug][CDC][Postgres] Postgres-CDC fails with UnsupportedOperationException: Unsupported type TIMESTAMP_TZ for TIMESTAMP WITH TIME ZONE columns about 1 month ago

bug help wanted

apache/seatunnel

9.5K

SeaTunnel is a multimodal, high-performance, distributed, massive data integration tool.

Java

#apache#batch#cdc#change-data-capture#data-ingestion#data-integration#elt#embeddings#high-performance#llm#multimodal#offline#real-time#streaming

[Bug] [Module Name] TiDB-CDC cdc event lose data about 1 month ago

bug help wanted

apache/seatunnel

9.5K

SeaTunnel is a multimodal, high-performance, distributed, massive data integration tool.

Java

#apache#batch#cdc#change-data-capture#data-ingestion#data-integration#elt#embeddings#high-performance#llm#multimodal#offline#real-time#streaming

[Bug] [Zeta] Batch job occasionally hangs in RUNNING forever under high-frequency job submission about 1 month ago

bug help wanted

apache/seatunnel

9.5K

SeaTunnel is a multimodal, high-performance, distributed, massive data integration tool.

Java

#apache#batch#cdc#change-data-capture#data-ingestion#data-integration#elt#embeddings#high-performance#llm#multimodal#offline#real-time#streaming

MongoDB connector closeCurrentSplit() masks real errors with NullPointerException about 1 month ago

bug help wanted

apache/seatunnel

9.5K

SeaTunnel is a multimodal, high-performance, distributed, massive data integration tool.

Java

#apache#batch#cdc#change-data-capture#data-ingestion#data-integration#elt#embeddings#high-performance#llm#multimodal#offline#real-time#streaming

[Umbrella][Feature][Connector] Implement multi-table sink support for connectors about 1 month ago

help wanted good first issue feature

apache/seatunnel

9.5K

SeaTunnel is a multimodal, high-performance, distributed, massive data integration tool.

Java

#apache#batch#cdc#change-data-capture#data-ingestion#data-integration#elt#embeddings#high-performance#llm#multimodal#offline#real-time#streaming

The submitted tasks remain in PENDING status about 1 month ago

bug help wanted

apache/seatunnel

9.5K

SeaTunnel is a multimodal, high-performance, distributed, massive data integration tool.

Java

#apache#batch#cdc#change-data-capture#data-ingestion#data-integration#elt#embeddings#high-performance#llm#multimodal#offline#real-time#streaming

[Bug] [MySQL CDC] MySQL cdc start by time，TIMESTAMP startup mode cannot recover from checkpoints. about 1 month ago

bug help wanted

apache/seatunnel

9.5K

SeaTunnel is a multimodal, high-performance, distributed, massive data integration tool.

Java

#apache#batch#cdc#change-data-capture#data-ingestion#data-integration#elt#embeddings#high-performance#llm#multimodal#offline#real-time#streaming

[Feature][Zeta] Support resuming a force-stopped streaming job from the latest successful checkpoint about 1 month ago

help wanted feature

apache/seatunnel

9.5K

SeaTunnel is a multimodal, high-performance, distributed, massive data integration tool.

Java

#apache#batch#cdc#change-data-capture#data-ingestion#data-integration#elt#embeddings#high-performance#llm#multimodal#offline#real-time#streaming

[Bug] [UI] The task home page does not display the rate indicators, but they are clearly shown. about 1 month ago

bug help wanted good first issue

apache/seatunnel

9.5K

SeaTunnel is a multimodal, high-performance, distributed, massive data integration tool.

Java

#apache#batch#cdc#change-data-capture#data-ingestion#data-integration#elt#embeddings#high-performance#llm#multimodal#offline#real-time#streaming

[Umbrella][Docs] P0 Documentation Optimization — Tracking about 1 month ago

help wanted

apache/seatunnel

9.5K

SeaTunnel is a multimodal, high-performance, distributed, massive data integration tool.

Java

#apache#batch#cdc#change-data-capture#data-ingestion#data-integration#elt#embeddings#high-performance#llm#multimodal#offline#real-time#streaming

[Improve][Zeta] Add observability for engine state stores (IMap / StateStore) about 1 month ago

help wanted improve Zeta monitor metrics

apache/seatunnel

9.5K

SeaTunnel is a multimodal, high-performance, distributed, massive data integration tool.

Java

#apache#batch#cdc#change-data-capture#data-ingestion#data-integration#elt#embeddings#high-performance#llm#multimodal#offline#real-time#streaming

PR-I: Add dedicated knowledge sources about 1 month ago

help wanted feature

apache/seatunnel

9.5K

SeaTunnel is a multimodal, high-performance, distributed, massive data integration tool.

Java

#apache#batch#cdc#change-data-capture#data-ingestion#data-integration#elt#embeddings#high-performance#llm#multimodal#offline#real-time#streaming

Inquiry about Http-related issues about 1 month ago

help wanted feature

apache/seatunnel

9.5K

SeaTunnel is a multimodal, high-performance, distributed, massive data integration tool.

Java

#apache#batch#cdc#change-data-capture#data-ingestion#data-integration#elt#embeddings#high-performance#llm#multimodal#offline#real-time#streaming

[Docs] Improve Kubernetes documentation with managed platform deployment guides about 2 months ago

help wanted good first issue

apache/seatunnel

9.5K

SeaTunnel is a multimodal, high-performance, distributed, massive data integration tool.

Java

#apache#batch#cdc#change-data-capture#data-ingestion#data-integration#elt#embeddings#high-performance#llm#multimodal#offline#real-time#streaming

[Feature][Ecosystem] Support airflow integration about 2 months ago

help wanted ecosystem

apache/seatunnel

9.5K

SeaTunnel is a multimodal, high-performance, distributed, massive data integration tool.

Java

#apache#batch#cdc#change-data-capture#data-ingestion#data-integration#elt#embeddings#high-performance#llm#multimodal#offline#real-time#streaming

[Feature][Connector] Add Salesforce Source Connector about 2 months ago

help wanted good first issue

apache/seatunnel

9.5K

SeaTunnel is a multimodal, high-performance, distributed, massive data integration tool.

Java

#apache#batch#cdc#change-data-capture#data-ingestion#data-integration#elt#embeddings#high-performance#llm#multimodal#offline#real-time#streaming

[STIP-24][Feature][Zeta] Support lightweight edge collector clients for remote data collection about 2 months ago

help wanted discussion feature design

apache/seatunnel

9.5K

SeaTunnel is a multimodal, high-performance, distributed, massive data integration tool.

Java

#apache#batch#cdc#change-data-capture#data-ingestion#data-integration#elt#embeddings#high-performance#llm#multimodal#offline#real-time#streaming

[Feature][Seatunnel] Introduce support for key vaults such as Azure KeyVault in configs about 2 months ago

help wanted feature

apache/seatunnel

9.5K

SeaTunnel is a multimodal, high-performance, distributed, massive data integration tool.

Java

#apache#batch#cdc#change-data-capture#data-ingestion#data-integration#elt#embeddings#high-performance#llm#multimodal#offline#real-time#streaming

[Feature][Connector] Add Google Bigtable Connector 2 months ago

help wanted good first issue feature

apache/seatunnel

9.5K

SeaTunnel is a multimodal, high-performance, distributed, massive data integration tool.

Java

#apache#batch#cdc#change-data-capture#data-ingestion#data-integration#elt#embeddings#high-performance#llm#multimodal#offline#real-time#streaming

[Feature][Connector-V2][File] Add bitwise reading functionality for file types such as FTP, SFTP, HDFS, and local files 2 months ago

help wanted feature connectors-v2 file needs-info

apache/seatunnel

9.5K

SeaTunnel is a multimodal, high-performance, distributed, massive data integration tool.

Java

#apache#batch#cdc#change-data-capture#data-ingestion#data-integration#elt#embeddings#high-performance#llm#multimodal#offline#real-time#streaming

[Feature][MySQL-CDC] Support truncate table ddl 2 months ago

help wanted feature ddl

apache/seatunnel

9.5K

SeaTunnel is a multimodal, high-performance, distributed, massive data integration tool.

Java

#apache#batch#cdc#change-data-capture#data-ingestion#data-integration#elt#embeddings#high-performance#llm#multimodal#offline#real-time#streaming

[Feature][Connector-V2] Support Doris sink direct BE stream load mode in addition to FE redirect mode 2 months ago

help wanted feature

apache/seatunnel

9.5K

SeaTunnel is a multimodal, high-performance, distributed, massive data integration tool.

Java

#apache#batch#cdc#change-data-capture#data-ingestion#data-integration#elt#embeddings#high-performance#llm#multimodal#offline#real-time#streaming

[Feature][syslog-connector] can seatunnel support a syslog-connector 2 months ago

help wanted feature

apache/seatunnel

9.5K

SeaTunnel is a multimodal, high-performance, distributed, massive data integration tool.

Java

#apache#batch#cdc#change-data-capture#data-ingestion#data-integration#elt#embeddings#high-performance#llm#multimodal#offline#real-time#streaming

[Feature][Connector-V2] Support filesystem Azure Blob FileSystem(ABFS) 2 months ago

help wanted feature needs-info

apache/seatunnel

9.5K

SeaTunnel is a multimodal, high-performance, distributed, massive data integration tool.

Java

#apache#batch#cdc#change-data-capture#data-ingestion#data-integration#elt#embeddings#high-performance#llm#multimodal#offline#real-time#streaming

[Bug] [connector-cdc-sqlserver] SqlServer-CDC出现SSL认证问题 2 months ago

bug help wanted

apache/seatunnel

9.5K

SeaTunnel is a multimodal, high-performance, distributed, massive data integration tool.

Java

#apache#batch#cdc#change-data-capture#data-ingestion#data-integration#elt#embeddings#high-performance#llm#multimodal#offline#real-time#streaming

[Bug][Connector-V2][MySQL-CDC] BinlogOffset.compareTo ignores restartSkipRows when GTID sets are equal 3 months ago

bug help wanted cdc connectors-v2

apache/seatunnel

9.5K

SeaTunnel is a multimodal, high-performance, distributed, massive data integration tool.

Java

#apache#batch#cdc#change-data-capture#data-ingestion#data-integration#elt#embeddings#high-performance#llm#multimodal#offline#real-time#streaming

[Discuss] Discuss adding VARIANT SqlType for semi-structured data 3 months ago

help wanted discussion feature

apache/seatunnel

9.5K

SeaTunnel is a multimodal, high-performance, distributed, massive data integration tool.

Java

#apache#batch#cdc#change-data-capture#data-ingestion#data-integration#elt#embeddings#high-performance#llm#multimodal#offline#real-time#streaming

[Feature][Connector-V2][PostgreSQL-CDC] Support schema evolution 3 months ago

help wanted feature cdc ddl connectors-v2

apache/seatunnel

9.5K

SeaTunnel is a multimodal, high-performance, distributed, massive data integration tool.

Java

#apache#batch#cdc#change-data-capture#data-ingestion#data-integration#elt#embeddings#high-performance#llm#multimodal#offline#real-time#streaming

[Improve][E2E] Make SeaTunnelContainer reusable across test classes to speed up E2E tests 3 months ago

help wanted improve Test

apache/seatunnel

9.5K

SeaTunnel is a multimodal, high-performance, distributed, massive data integration tool.

Java

#apache#batch#cdc#change-data-capture#data-ingestion#data-integration#elt#embeddings#high-performance#llm#multimodal#offline#real-time#streaming

[Feature][CDC] Support db2 cdc connector source 3 months ago

help wanted

apache/seatunnel

9.5K

SeaTunnel is a multimodal, high-performance, distributed, massive data integration tool.

Java

#apache#batch#cdc#change-data-capture#data-ingestion#data-integration#elt#embeddings#high-performance#llm#multimodal#offline#real-time#streaming

[Bug] [Doris Connector] DorisSinkWriter lacks circuit breaker, causing cascading OOM when Doris BE is unavailable 3 months ago

help wanted

apache/seatunnel

9.5K

SeaTunnel is a multimodal, high-performance, distributed, massive data integration tool.

Java

#apache#batch#cdc#change-data-capture#data-ingestion#data-integration#elt#embeddings#high-performance#llm#multimodal#offline#real-time#streaming

[Bug] [Postgres-CDC] Failed to synchronize partitioned tables to MySQL using Postgres-CDC 3 months ago

bug help wanted good first issue

apache/seatunnel

9.5K

SeaTunnel is a multimodal, high-performance, distributed, massive data integration tool.

Java

#apache#batch#cdc#change-data-capture#data-ingestion#data-integration#elt#embeddings#high-performance#llm#multimodal#offline#real-time#streaming

[Discussion][Zeta] Reduce historical job runtime info stored in IMap / StateStore with differentiated retention 3 months ago

help wanted discussion improve Zeta

apache/seatunnel

9.5K

SeaTunnel is a multimodal, high-performance, distributed, massive data integration tool.

Java

#apache#batch#cdc#change-data-capture#data-ingestion#data-integration#elt#embeddings#high-performance#llm#multimodal#offline#real-time#streaming

[Bug] [Zeta] the ClientJobProxy.waitForJobCompleteV2()method returns immediately with a non-final job status instead of waiting for the job to complete 3 months ago

bug help wanted

apache/seatunnel

9.5K

SeaTunnel is a multimodal, high-performance, distributed, massive data integration tool.

Java

#apache#batch#cdc#change-data-capture#data-ingestion#data-integration#elt#embeddings#high-performance#llm#multimodal#offline#real-time#streaming

[Feature][Connector-v2] Support fluss source & sink 3 months ago

help wanted feature

apache/seatunnel

9.5K

SeaTunnel is a multimodal, high-performance, distributed, massive data integration tool.

Java

#apache#batch#cdc#change-data-capture#data-ingestion#data-integration#elt#embeddings#high-performance#llm#multimodal#offline#real-time#streaming

[Feature][Zeta] Implement proper dry-run mode with progressive validation layers 3 months ago

help wanted good first issue feature

apache/seatunnel

9.5K

SeaTunnel is a multimodal, high-performance, distributed, massive data integration tool.

Java

#apache#batch#cdc#change-data-capture#data-ingestion#data-integration#elt#embeddings#high-performance#llm#multimodal#offline#real-time#streaming

[Docs][Core] Add Javadoc to CheckpointCoordinator (checkpoint state machine) 3 months ago

help wanted

apache/seatunnel

9.5K

SeaTunnel is a multimodal, high-performance, distributed, massive data integration tool.

Java

#apache#batch#cdc#change-data-capture#data-ingestion#data-integration#elt#embeddings#high-performance#llm#multimodal#offline#real-time#streaming

[Feature][CDC/JDBC] Add option to disable sampling-based sharding 3 months ago

help wanted good first issue

apache/seatunnel

9.5K

SeaTunnel is a multimodal, high-performance, distributed, massive data integration tool.

Java

#apache#batch#cdc#change-data-capture#data-ingestion#data-integration#elt#embeddings#high-performance#llm#multimodal#offline#real-time#streaming

[Feature][Connector-V2] Support write data into lance dataset 3 months ago

help wanted feature

apache/seatunnel

9.5K

SeaTunnel is a multimodal, high-performance, distributed, massive data integration tool.

Java

#apache#batch#cdc#change-data-capture#data-ingestion#data-integration#elt#embeddings#high-performance#llm#multimodal#offline#real-time#streaming

[Umbrella] unified parameter class and refactor connector creation logic 3 months ago

help wanted good first issue

apache/seatunnel

9.5K

SeaTunnel is a multimodal, high-performance, distributed, massive data integration tool.

Java

#apache#batch#cdc#change-data-capture#data-ingestion#data-integration#elt#embeddings#high-performance#llm#multimodal#offline#real-time#streaming

[Demos-Collection] Collecting Use Case Demos for Apache SeaTunnel 3 months ago

help wanted good first issue FAQ

apache/seatunnel

9.5K

SeaTunnel is a multimodal, high-performance, distributed, massive data integration tool.

Java

#apache#batch#cdc#change-data-capture#data-ingestion#data-integration#elt#embeddings#high-performance#llm#multimodal#offline#real-time#streaming

Open Issues Need Help