diff --git a/CHANGELOG.md b/CHANGELOG.md deleted file mode 100644 index 1ba1aa44..00000000 --- a/CHANGELOG.md +++ /dev/null @@ -1,36 +0,0 @@ -# Change log - -All notable changes are documented in this file. Release numbers follow [Semantic Versioning](http://semver.org) - -## 0.2.0.Beta - -January 8th 2022 - -### New features since 0.1.0.Alpha - -* Enable automatic field addition to support schema - evolution [#74](https://github.com/memiiso/debezium-server-iceberg/pull/74) -* Support writing partitioned iceberg tables [#71](https://github.com/memiiso/debezium-server-iceberg/pull/71) -* Add support for array data type [#63](https://github.com/memiiso/debezium-server-iceberg/pull/63) -* Improving documentation [#61](https://github.com/memiiso/debezium-server-iceberg/pull/61) -* Update distribution to include oracle and db2 - connectors [#60](https://github.com/memiiso/debezium-server-iceberg/pull/60) -* add Dockerfile and release image to github container - registry [#53](https://github.com/memiiso/debezium-server-iceberg/pull/53) -* Support all iceberg file formats parquet,orc,avro [#46](https://github.com/memiiso/debezium-server-iceberg/pull/46) -* Support nested data types [#41](https://github.com/memiiso/debezium-server-iceberg/pull/41) -* Add batch size wait to optimize batch size by monitoring debezium queue - size [#16](https://github.com/memiiso/debezium-server-iceberg/pull/16) - -## 0.1.0.Alpha - -April 23 2021 - -### New features - -* Implement `upsert` mode to consume deduplicated events to destination table in addition to append - mode [#8](https://github.com/memiiso/debezium-server-iceberg/pull/8) -* Add dynamic wait feature to optimize batch size and commit - interval [#6](https://github.com/memiiso/debezium-server-iceberg/pull/6) -* Partition `debezium_events` table by destination and event_sink - hour [#5](https://github.com/memiiso/debezium-server-iceberg/pull/5) \ No newline at end of file diff --git a/CONTRIBUTING.md b/CONTRIBUTING.md index e4c793c1..b7aa480c 100644 --- a/CONTRIBUTING.md +++ b/CONTRIBUTING.md @@ -1,8 +1,10 @@ # Contributing -Debezium Iceberg consumer is a very young project and looking for new maintainers. There are definitively many small/big improvements to do, including documentation, adding new features to submitting bug reports. +Debezium Iceberg consumer is a very young project and looking for new maintainers. There are definitively many small/big +improvements to do, including documentation, adding new features to submitting bug reports. Please feel free to send pull request, report bugs or open feature request. ## License + By contributing, you agree that your contributions will be licensed under Apache 2.0 License. diff --git a/README.md b/README.md index 8cba26b0..bea3c5bb 100644 --- a/README.md +++ b/README.md @@ -18,7 +18,7 @@ For a full understanding of current limitations and recommended solutions, pleas # Installation - Requirements: - - JDK 11 + - JDK 21 - Maven ### Building from source code 1. Clone the repository @@ -43,7 +43,8 @@ bash run.sh It's possible to use python to run,operate debezium server -This project provides Python scripts to automate the startup, shutdown, and configuration of Debezium Server. By leveraging Python, you can manage Debezium Server. +For convenience this project additionally provides Python scripts to automate the startup, shutdown, and configuration of Debezium Server. +Using Python, you can do various Debezium Server operation and take programmatic, dynamic, debezium configuration. example: ```commandline @@ -64,9 +65,18 @@ d.run(*java_args) ``` ```python +import os from debezium import DebeziumRunAsyn java_args = [] +# using python we can dynamically influence debezium +# by chaning its config within python +if my_custom_condition_check is True: + # Option 1: set config using java arg + java_args.append("-Dsnapshot.mode=always") + # Option 2: set config using ENV variable + os.environ["SNAPSHOT_MODE"] = "always" + java_args.append("-Dquarkus.log.file.enable=true") java_args.append("-Dquarkus.log.file.path=/logs/dbz_logfile.log") d = DebeziumRunAsyn(debezium_dir="/dbz/server/dir", java_home='/java/home/dir', java_args=java_args)