v0.9.1

Changelog

• db24b6a: Add more example pipelines (#1447) (@hariso)
• 300a7d8: Docker image: bump Alpine image to 3.19 (#1445) (@hariso)
• 76897a6: Expose register processor plugin (#1441) (@lovromazgon)
• 51ba7a7: Make installing of tools more stable (#1423) (@lovromazgon)
• 32ebab3: Make sure plugins with non-semantic version are registered as latest (#1439) (@lovromazgon)
• c9d70b0: Remove obsolete page about processors (#1416) (@hariso)
• c7e2813: Small fixes in processor docs (#1417) (@lovromazgon)
• 61c8af3: Update links about referencing fields in processors (#1424) (@hariso)
• 8193c56: Upgrade Kafka connector to v0.7.2 (#1448) (@hariso)
• 647e462: add support for converting []byte to string (#1463) (@lovromazgon)
• 81009b5: chore: remove unused (#1429) (@raulb)
• e7e3983: chore: update specs (#1428) (@raulb)
• f60cbcb: mention standalone processors in the readme (#1451) (@maha-hajja)
• aa2f838: remove redundant actions (#1430) (@lovromazgon)
• 1ac0964: upgrade processor sdk and postgres (#1464) (@lovromazgon)

Docker images

To pull the image, you can execute the following command:

docker pull ghcr.io/conduitio/conduit:v0.9.1

v0.9.0

This release contains a major overhaul of Conduit processors. Builtin processors have been rewritten from scratch and now provide more powerful ways to transform the data and can target any field in the record. Additionally, we have added the ability to write standalone WASM processors, which allows you to manipulate records in your language of choice while keeping the processor as performant as a built-in processor. Check out the processor SDK for information about building your custom processor.

Changelog

• 2b08f0d: Replace deprecated goreleaser argument (#1415) (@hariso)
• 00dbcba: [Feature] Better processors (#1378) (@lovromazgon)

Docker images

To pull the image, you can execute the following command:

docker pull ghcr.io/conduitio/conduit:v0.9.0

v0.8.1

Changelog

• e36be0f: Better processors design document (#1279) (@lovromazgon)
• 96481ff: Block profile (#1301) (@lovromazgon)
• d2dbf4a: Bump s3 connector to v0.5.1 (#1315) (@lyuboxa)
• abaaf49: Convert provision config pipelines into model yaml (#1278) (@lyuboxa)
• f95c941: Improve builtin plugin sandbox (#1380) (@lovromazgon)
• afc939c: Increase length limit for ID and Name for pipeline (128) and connector (256) (#1331) (@lovromazgon)
• 92142fd: Take golangci-lint version from go.mod (#1300) (@lovromazgon)
• cf84e59: Update Dockerfile to remove health check (#1335) (@lyuboxa)
• 76e801e: Update connector list to point to conduit.io (#1334) (@lovromazgon)
• 6a3fe41: Use OpenCDC proto from conduit-commons (#1330) (@lovromazgon)
• b65713a: Use goccy/go-json instead of encoding/json (#1383) (@hariso)
• 01fafc5: Validate connector name and pipeline description through API (#1242) (@AdamHaffar)
• bda52d4: add periods as allowed ids + fix http log (#1307) (@maha-hajja)
• 2c3dfaf: conditional processor execution (#1349) (@maha-hajja)
• e06af99: downgrade container policy action to v2.1.2 (#1293) (@lovromazgon)
• 442f8ee: execute processor condition template (#1352) (@maha-hajja)
• dccde3f: fix: OpenCDC unwrap (#1343) (@samirketema)
• deb2907: fix: ellipsis connector text (#1394) (@jmar910)
• f3fbcc7: fix: opencdc unwrap (#1355) (@raulb)
• f71d078: fix: unwrap openCDC records on create and update (#1362) (@raulb)
• c149030: refactor: opencdc test examples (#1363) (@raulb)
• 2e2fde6: upgrade kafka connector to v0.7.1 (#1341) (@samirketema)

Docker images

To pull the image, you can execute the following command:

docker pull ghcr.io/conduitio/conduit:v0.8.1

v0.8.0

Changelog

• 4bae904: Programmatic way of knowing that Conduit has been initialized (#1224) (@hariso)
• 0b3dd54: Escape analysis (#1245) (@nassor)
• c40884a: Pipeline created from API gets overwritten by config file with duplicate ID (#1229) (@AdamHaffar)
• 784f05f: Remove Assert Package 1/3 (#1177) (@AdamHaffar)
• 8e1cdf7: Remove Assert Package 3/3 (#1205) (@AdamHaffar)
• be519c6: [Perf] Inspector refactoring and optimization (#1248) (@lovromazgon)
• ce7bb3a: add flags for profiling, hide them in help (#1246) (@lovromazgon)
• 9fd97f9: add json tags to v2 provisioning model (#1212) (@lovromazgon)
• bbdb074: clone record without reflection (#1247) (@lovromazgon)
• 3145202: encode connectors in persister only on flush (#1249) (@lovromazgon)
• dca7d58: expose delete method in provisioning service (#1230) (@lovromazgon)
• 0a5225d: fix make target install-tools (#1185) (@lovromazgon)
• 3111797: optimize fanin and fanout nodes to use less reflection (#1250) (@lovromazgon)
• db5f1e1: update http processor request (#1201) (@maha-hajja)

Docker images

To pull the image, you can execute the following command:

docker pull ghcr.io/conduitio/conduit:v0.8.0

v0.7.2

Changelog

• 7cf9c3b: Add a check in service.go to avoid panic when 2 connector ID's are the same (#1134) (@AdamHaffar)
• f9896cb: Add make lint (#1128) (@hariso)
• 5d87fc4: Make config more flexible (#1171) (@lovromazgon)
• 99d32f0: Refactor entrypoint, parse config from env vars and file (#1131) (@lovromazgon)
• 75726c7: Refactor logger to use zerolog ctx attached to event (#1169) (@lovromazgon)
• f1fd7ea: Replace github.com/golang/mock with go.uber.org/mock (#1168) (@lovromazgon)
• 99c9593: Use zip for windows releases (#1129) (@lyuboxa)
• 427db69: bump golangci-lint to v1.53.3 (#1152) (@maha-hajja)
• 0029b39: clean up DLQ connectors on connectors service init (#1144) (@lovromazgon)
• 58aac9a: fix issue #453 add nil checkers for endpoints (#1173) (@AdamHaffar)

Docker images

To pull the image, you can execute the following command:

docker pull ghcr.io/conduitio/conduit:v0.7.2

v0.7.1

Changelog

• 6ee5a82: Bump built-in connectors (#1122) (@hariso)

Docker images

To pull the image, you can execute the following command:

docker pull ghcr.io/conduitio/conduit:v0.7.1

v0.7.0

Changelog

• b86eb01: Enable nodejs in js processor (#1094) (@lovromazgon)
• 12ec39c: Fix CI badge in readme (#1000) (@lovromazgon)
• d036f1f: SR: Encoder and decoder (#1096) (@lovromazgon)
• 5367324: SR: Extract Avro schema with reflection (#1051) (@lovromazgon)
• be8d2dd: SR: Fake schema registry for tests (#1083) (@lovromazgon)
• e634ec8: SR: Implement cached schema registry client (#1049) (@lovromazgon)
• 00b362f: SR: Processor encodewithschema (#1098) (@lovromazgon)
• a1d1f41: Scripts for bumping versions (#995) (@hariso)
• 1cf327c: Use Debian Bullseye in Dockerfile (#1108) (@hariso)
• fdb0b0e: build(actions): match node version for ember (#1066) (@jmar910)
• d7f9224: build(ui): update mx-ui-components version (#1064) (@jmar910)
• 3cd2c30: build(ui): upgrade ember-modifier to 4.1.0 (#1065) (@jmar910)
• d824b53: build(ui): upgrade ember-sortable to latest (#1067) (@jmar910)
• 096656f: deps(ember): upgrade to latest LTS (4.8.x) (#1011) (@jayjayjpg)
• beef45c: doc: add mongodb connector (#1075) (@raulb)
• 9531dad: doc: fix typo (#1030) (@raulb)
• 46e56a5: doc: update GitHub links to show only remaining (#1008) (@raulb)
• 07ce9bd: docs(connectors): add section about adding built-in connectors (#1021) (@jayjayjpg)
• d8a0f6a: don't ignore .git folder (#1035) (@lovromazgon)
• 323cd0f: don't trigger lifecycle events for DLQ connectors (#1025) (@lovromazgon)
• 13221ad: implement processor decodewithschema (#1097) (@lovromazgon)
• be9ebe9: remove .dockerignore (#1036) (@lovromazgon)
• b26d260: return context when new transaction returns error (#1033) (@lovromazgon)
• cf6b879: update badger to v4.1.0 (#1001) (@lovromazgon)
• 45540f1: update pgx to v5.3.1 (#1002) (@lovromazgon)

Docker images

To pull the image, you can execute the following command:

docker pull ghcr.io/conduitio/conduit:v0.7.0

v0.6.2

Changelog

• b15da1e: Bump Kafka connector to v0.5.1 (@hariso)

Docker images

To pull the image, you can execute the following command:

docker pull ghcr.io/conduitio/conduit:v0.6.2

v0.6.1

Changelog

• a3c4edf: Exit Conduit if pipeline config file fails to be provisioned (#964) (@hariso)

Docker images

To pull the image, you can execute the following command:

docker pull ghcr.io/conduitio/conduit:v0.6.1

v0.6.0

Changelog

• 17cf478: Add CI action for generated code (#951) (@hariso)
• 0f2ead2: Stream Inspector: Add metrics (#971) (@hariso)
• 57de7b0: Stream Inspector: Close inspector when connector/processor is deleted (#882) (@hariso)
• 8648a6e: Close WebSocket connections when shutting down (#899) (@hariso)
• 01366a7: Design: Connector Lifecycle Methods (#916) (@lovromazgon)
• 588098b: Fix latest version for built-in plugins, bump built-in connectors (#996) (@lovromazgon)
• 3ca8c7b: Glob patterns exclude double digits in tags (#953) (@hariso)
• cd45646: Housekeeping: Markdownlint (#905) (@lovromazgon)
• 00ccd81: Lifecycle Events (#954) (@lovromazgon)
• 551eccc: Make graceful stop more graceful (#883) (@lovromazgon)
• 6b46e8b: Parallel processor JavaScript (#869) (@lovromazgon)
• e0e600c: Parallel processors (#744) (@lovromazgon)
• 82f7c66: Pipeline configuration v2 (#955) (@lovromazgon)
• 166dfe9: Trigger Lifecycle Events (#963) (@lovromazgon)
• 9541533: Update docs for built-in processors, improve filterfield processor (#992) (@hariso)
• ede3570: Update entities when provisioning config files (#968) (@lovromazgon)
• 6bb1be9: Update example in proto/README (#946) (@hariso)
• 7aa77fd: Upgrade Kafka connector to 0.4.1 (#923) (@hariso)
• 073647c: Upgrade golangci-lint to 1.52.2 (#975) (@hariso)
• bfea935: Use Buf remote plugins (#927) (@hariso)
• 7a8181b: create both deb and rpm files when releasing (#901) (@maha-hajja)
• 4ab4a85: installation guide (homebrew, deb, rpm) (#988) (@maha-hajja)
• bf4c1f5: keep alive tomb when starting pipeline (#911) (@lovromazgon)
• fbea7b4: parsejson processor fix (#970) (@maha-hajja)
• e5db0ce: upgrade golangci-lint to v1.51.2 (#921) (@maha-hajja)

Docker images

To pull the image, you can execute the following command:

docker pull ghcr.io/conduitio/conduit:v0.6.0