v0.12.3

Changelog

• 5c42c30: Add more unit tests (#1970) (@hariso)
• 3ffaa18: Conduit release template: add command for re-generating processor docs (#1965) (@hariso)
• 95ab7da: Fix GH action for running unit tests (#1992) (@hariso)
• 43fe0a1: Fix: filtered records holding up pipeline with destination batching (#1987) (@hariso)
• 1378b8a: [automated] Update Buf dependencies (#1969) (@github-actions[bot])
• f751508: [automated] Update Buf dependencies (#1982) (@github-actions[bot])
• 3100bc4: fix: ensure deprecated flags are correctly hidden (#1974) (@raulb)
• ed6ea11: rely on conduit.io/docs (#1972) (@raulb)

Release Artifacts

OSX Darwin

• 📦 conduit_0.12.3_Darwin_arm64.tar.gz
• 📦 conduit_0.12.3_Darwin_x86_64.tar.gz

Linux

• 📦 conduit_0.12.3_Linux_arm64.deb
• 📦 conduit_0.12.3_Linux_arm64.rpm
• 📦 conduit_0.12.3_Linux_arm64.tar.gz
• 📦 conduit_0.12.3_Linux_i386.deb
• 📦 conduit_0.12.3_Linux_i386.rpm
• 📦 conduit_0.12.3_Linux_i386.tar.gz
• 📦 conduit_0.12.3_Linux_x86_64.deb
• 📦 conduit_0.12.3_Linux_x86_64.rpm
• 📦 conduit_0.12.3_Linux_x86_64.tar.gz

Windows

• 📦 conduit_0.12.3_Windows_arm64.zip
• 📦 conduit_0.12.3_Windows_x86_64.zip

Docker images

To pull the image, you can execute the following command:

docker pull conduit.docker.scarf.sh/conduitio/conduit:v0.12.3

v0.12.2

Changelog

• b1dc373: Add installation script (#1921) (@hariso)
• 977b037: Allow a connector's or processor's plugin name to be updated (#1938) (@hariso)
• a60c36a: Basic conduit init and conduit pipelines init commands (#1927) (@hariso)
• 7028b67: Configure SonarCloud (#1944) (@hariso)
• 9a216a4: Exclude generated code from SonarCloud scans (#1945) (@hariso)
• 4d8d53f: Fix formatting in CLI design doc (#1934) (@hariso)
• 55ebed9: Load configs and directories from the working directory (#1952) (@hariso)
• 58284dc: Pipeline architecture v2 (preview) (#1913) (@lovromazgon)
• 1989bb4: Update Buf dependencies (#1933) (@github-actions[bot])
• dba04d5: adds a mutex to ctx cancel (#1909) (@raulb)
• 322c078: allow multiple acks to be returned from connector (#1912) (@lovromazgon)
• 1a558d1: chore: remove automatic npm updates (#1916) (@raulb)
• 4b66347: chore: remove codeowners (#1917) (@raulb)
• 0c74ada: doc: Add GitHub issue template for releasing Conduit (#1947) (@raulb)
• 3610610: doc: add cli design document for 0.13 (#1931) (@raulb)
• 5f5d4c9: doc: add links to the release issue template (#1954) (@raulb)
• 9faa30f: doc: update links (#1923) (@raulb)
• f1d2e43: fix: conduit release issue template (#1948) (@raulb)
• 048a99c: fix: link and tweak issue template title (#1949) (@raulb)
• 2a742ba: fix: processor links (#1928) (@raulb)
• 552a613: update pipeline_recovering metric on recovery (#1932) (@lovromazgon)

Release Artifacts

OSX Darwin

• 📦 conduit_0.12.2_Darwin_arm64.tar.gz
• 📦 conduit_0.12.2_Darwin_x86_64.tar.gz

Linux

• 📦 conduit_0.12.2_Linux_arm64.deb
• 📦 conduit_0.12.2_Linux_arm64.rpm
• 📦 conduit_0.12.2_Linux_arm64.tar.gz
• 📦 conduit_0.12.2_Linux_i386.deb
• 📦 conduit_0.12.2_Linux_i386.rpm
• 📦 conduit_0.12.2_Linux_i386.tar.gz
• 📦 conduit_0.12.2_Linux_x86_64.deb
• 📦 conduit_0.12.2_Linux_x86_64.rpm
• 📦 conduit_0.12.2_Linux_x86_64.tar.gz

Windows

• 📦 conduit_0.12.2_Windows_arm64.zip
• 📦 conduit_0.12.2_Windows_x86_64.zip

Docker images

To pull the image, you can execute the following command:

docker pull conduit.docker.scarf.sh/conduitio/conduit:v0.12.2

v0.12.1

Changelog

• 3df0511: Update version in README.md (#1904) (@hariso)
• 0c3d647: add conduit release view pixel to the release template (#1906) (@maha-hajja)

Release Artifacts

OSX Darwin

• 📦 conduit_0.12.1_Darwin_arm64.tar.gz
• 📦 conduit_0.12.1_Darwin_x86_64.tar.gz

Linux

• 📦 conduit_0.12.1_Linux_arm64.deb
• 📦 conduit_0.12.1_Linux_arm64.rpm
• 📦 conduit_0.12.1_Linux_arm64.tar.gz
• 📦 conduit_0.12.1_Linux_i386.deb
• 📦 conduit_0.12.1_Linux_i386.rpm
• 📦 conduit_0.12.1_Linux_i386.tar.gz
• 📦 conduit_0.12.1_Linux_x86_64.deb
• 📦 conduit_0.12.1_Linux_x86_64.rpm
• 📦 conduit_0.12.1_Linux_x86_64.tar.gz

Windows

• 📦 conduit_0.12.1_Windows_arm64.zip
• 📦 conduit_0.12.1_Windows_x86_64.zip

Docker images

To pull the image, you can execute the following command:

docker pull conduit.docker.scarf.sh/conduitio/conduit:v0.12.1

v0.12.0

Changelog

• 0e3280d: [Recovery] Make backoff parameters globally configurable (#1818) (@hariso)
• 6b2381e: Add 'recovering' status (#1797) (@hariso)
• 6b3a2ad: Adds: Recovery not triggered - user force-stopped pipeline. (#1877) (@hariso)
• c9bb34f: Correct comment in dependabot config (#1763) (@hariso)
• 468f998: Fix Go version (#1841) (@hariso)
• 579a71b: Fix scripts/get-compare-link.sh (#1890) (@hariso)
• 28cdc80: Guidelines for writing a connector (#1802) (@hariso)
• 38ca22d: Handle concurrent access to a pipeline's status field (#1794) (@hariso)
• 35343c5: Make logger configurable (#1829) (@lovromazgon)
• 2be6a5e: Makefile: mark targets as .PHONY (#1785) (@hariso)
• fe22032: Register prometheus metrics only once (#1842) (@lovromazgon)
• d4e6177: Regularly check for updates in Buf dependencies (#1772) (@hariso)
• 292193e: Track recovery attempts using leaky bucket (#1881) (@lovromazgon)
• 515adc6: Typo and some doc enhacements (#1889) (@FarukhS52)
• 891178b: Update Buf actions (#1739) (@hariso)
• d439290: [Design] Recover from pipeline errors (#1765) (@lovromazgon)
• c284938: [Recovery] Metrics (#1828) (@hariso)
• 7e52888: [automated] Update Buf dependencies (#1824) (@github-actions[bot])
• bab1afb: chore: remove docker warnings (#1816) (@raulb)
• 54bf050: chore: update constructor name (#1817) (@raulb)
• b429365: do not use a sandbox for Run (#1886) (@lovromazgon)
• af47e0f: don't enrich id if it's not provided (#1845) (@lovromazgon)
• 7edb34d: feat: add fatal errors (#1811) (@raulb)
• d7417fd: feat: restart pipeline with recovery (#1853) (@raulb)
• 8f2d5d1: fix: go (#1848) (@raulb)
• 0072ae1: refactor: Add Lifecycle service (#1835) (@raulb)
• 7e7bb8b: small adjustments to fatal errors (#1830) (@lovromazgon)

Release Artifacts

OSX Darwin

• 📦 conduit_0.12.0_Darwin_arm64.tar.gz
• 📦 conduit_0.12.0_Darwin_x86_64.tar.gz

Linux

• 📦 conduit_0.12.0_Linux_arm64.deb
• 📦 conduit_0.12.0_Linux_arm64.rpm
• 📦 conduit_0.12.0_Linux_arm64.tar.gz
• 📦 conduit_0.12.0_Linux_i386.deb
• 📦 conduit_0.12.0_Linux_i386.rpm
• 📦 conduit_0.12.0_Linux_i386.tar.gz
• 📦 conduit_0.12.0_Linux_x86_64.deb
• 📦 conduit_0.12.0_Linux_x86_64.rpm
• 📦 conduit_0.12.0_Linux_x86_64.tar.gz

Windows

• 📦 conduit_0.12.0_Windows_arm64.zip
• 📦 conduit_0.12.0_Windows_x86_64.zip

Docker images

To pull the image, you can execute the following command:

docker pull conduit.docker.scarf.sh/conduitio/conduit:v0.12.0

v0.11.1

Changelog

• 8670c8a: commit provisioning transaction before starting pipeline (#1759) (@lovromazgon)

Release Artifacts

OSX Darwin

• 📦 conduit_0.11.1_Darwin_arm64.tar.gz
• 📦 conduit_0.11.1_Darwin_x86_64.tar.gz

Linux

• 📦 conduit_0.11.1_Linux_arm64.deb
• 📦 conduit_0.11.1_Linux_arm64.rpm
• 📦 conduit_0.11.1_Linux_arm64.tar.gz
• 📦 conduit_0.11.1_Linux_i386.deb
• 📦 conduit_0.11.1_Linux_i386.rpm
• 📦 conduit_0.11.1_Linux_i386.tar.gz
• 📦 conduit_0.11.1_Linux_x86_64.deb
• 📦 conduit_0.11.1_Linux_x86_64.rpm
• 📦 conduit_0.11.1_Linux_x86_64.tar.gz

Windows

• 📦 conduit_0.11.1_Windows_arm64.zip
• 📦 conduit_0.11.1_Windows_x86_64.zip

Docker images

To pull the image, you can execute the following command:

docker pull conduit.docker.scarf.sh/conduitio/conduit:v0.11.1

v0.11.0

Schema Support:

• Introduced comprehensive schema support, allowing schemas to be attached to records.
• Integrated a built-in schema registry, with the option to use an external schema registry.
• Enhanced standalone connectors to retain type information.

Connector Improvements:

• Introduced middleware for automatic schema handling in built-in connectors and processors.
• Postgres Connector:
  • Added support for incremental snapshots in logical replication mode.
  • Improved management of logical replication slots.

Processor Improvements:

• error
  • Introduced an error processor to send records to DLQ or fail the pipeline based on conditions.
• webhook.http
  • Added the ability to specify headers in the webhook.http processor.
• field.convert
  • Extended to support conversion to Go time.Time objects, handling unix nano timestamps and RFC3339 formatted dates.
• avro.encode and avro.decode
  • Updated to use Conduit’s built-in schema registry.

Internal Improvements:

• Fixed bug causing a panic when trying to run a partial pipeline.

Changelog

• ab0ecac: Mention storage options in README (#1730) (@hariso)
• 428e651: Database implementation for SQLite3 (#1682) (@lyuboxa)
• bf9b0c7: Include conduit-schema-registry in release instructions (#1713) (@hariso)
• 840a650: More info about Postgres connection string (#1726) (@hariso)
• 7339241: Replace panic with error message when not declaring a source node in .yml config (#1695) (@AdamHaffar)
• 1397d5d: Replace pkg/foundation/database with commons, use schema registry with DB (#1720) (@hariso)
• 930afae: Schema support (#1702) (@lovromazgon)
• 3a9d244: Tests and examples for converting time using field.convert (#1745) (@lovromazgon)
• 5c956e1: Update SDK, protocol, Kafka connector (#1731) (@hariso)
• 7601e06: Update dependencies for v0.11.0 (#1756) (@lovromazgon)
• f53d710: Update linter config (#1675) (@hariso)
• d6e83ce: Update processor SDK, add middleware (#1742) (@lovromazgon)
• 06bd6e5: Use connector protocol v2 (#1622) (@lovromazgon)
• 0d5929d: Use gofumpt (#1741) (@hariso)
• d370cd5: Use interpreter runtime in wasm tests (#1746) (@lovromazgon)
• 306defe: Wrap builtin processors in middleware in examples (#1748) (@lovromazgon)
• 76c25f1: [Schemas] Handle name conflicts (#1718) (@hariso)
• 203aeb7: [Schemas] Limit schema service usage to connectors (#1701) (@hariso)
• 817d52c: [Schemas] Use configured schema service in Avro processors (#1743) (@hariso)
• a9812b7: add getSchema and createSchema for wasm processors (#1683) (@maha-hajja)
• 76151f4: change keep-n-most-recent to cut-off (required parameter) (#1689) (@lovromazgon)
• 6b9dfa2: doc: update releases template (#1749) (@raulb)
• fd9f261: don't release win/i386 (#1703) (@lovromazgon)
• 7bb8cd8: enable container-retention-policy action (#1693) (@lovromazgon)
• a8d76dc: feat: sets environment variable based on log level (#1740) (@raulb)
• 2da3a0b: refactor: architecture documentation (#1732) (@raulb)
• b6fa5be: support empty .payload.After / .payload.Before in avro.decode (#1678) (@samirketema)
• fab3ab9: update swagger ui (#1711) (@lovromazgon)

Release Artifacts

OSX Darwin

• 📦 conduit_0.11.0_Darwin_arm64.tar.gz
• 📦 conduit_0.11.0_Darwin_x86_64.tar.gz

Linux

• 📦 conduit_0.11.0_Linux_arm64.deb
• 📦 conduit_0.11.0_Linux_arm64.rpm
• 📦 conduit_0.11.0_Linux_arm64.tar.gz
• 📦 conduit_0.11.0_Linux_i386.deb
• 📦 conduit_0.11.0_Linux_i386.rpm
• 📦 conduit_0.11.0_Linux_i386.tar.gz
• 📦 conduit_0.11.0_Linux_x86_64.deb
• 📦 conduit_0.11.0_Linux_x86_64.rpm
• 📦 conduit_0.11.0_Linux_x86_64.tar.gz

Windows

• 📦 conduit_0.11.0_Windows_arm64.zip
• 📦 conduit_0.11.0_Windows_x86_64.zip

Docker images

To pull the image, you can execute the following command:

docker pull conduit.docker.scarf.sh/conduitio/conduit:v0.11.0

v0.10.3

Changelog

• 873fb5c: Configure dependabot for Docker (#1658) (@hariso)
• b90bec7: Upgrade pg connector to v0.7.5 (#1677) (@lyuboxa)
• ad87154: Upgrade test Docker images (#1671) (@hariso)

Release Artifacts

OSX Darwin

• 📦 conduit_0.10.3_Darwin_arm64.tar.gz
• 📦 conduit_0.10.3_Darwin_x86_64.tar.gz

Linux

• 📦 conduit_0.10.3_Linux_arm64.deb
• 📦 conduit_0.10.3_Linux_arm64.rpm
• 📦 conduit_0.10.3_Linux_arm64.tar.gz
• 📦 conduit_0.10.3_Linux_i386.deb
• 📦 conduit_0.10.3_Linux_i386.rpm
• 📦 conduit_0.10.3_Linux_i386.tar.gz
• 📦 conduit_0.10.3_Linux_x86_64.deb
• 📦 conduit_0.10.3_Linux_x86_64.rpm
• 📦 conduit_0.10.3_Linux_x86_64.tar.gz

Windows

• 📦 conduit_0.10.3_Windows_arm64.zip
• 📦 conduit_0.10.3_Windows_i386.zip
• 📦 conduit_0.10.3_Windows_x86_64.zip

Docker images

To pull the image, you can execute the following command:

docker pull conduit.docker.scarf.sh/conduitio/conduit:v0.10.3

v0.10.2

Changelog

• 4d286f4: Add handling for time.Time in avro encode processor (#1650) (@samirketema)
• 8304d42: Upgrade postgres connector to v0.7.4 (#1661) (@lyuboxa)
• 019ec4c: manually set current tag in release action (#1637) (@lovromazgon)

Release Artifacts

OSX Darwin

• 📦 conduit_0.10.2_Darwin_arm64.tar.gz
• 📦 conduit_0.10.2_Darwin_x86_64.tar.gz

Linux

• 📦 conduit_0.10.2_Linux_arm64.deb
• 📦 conduit_0.10.2_Linux_arm64.rpm
• 📦 conduit_0.10.2_Linux_arm64.tar.gz
• 📦 conduit_0.10.2_Linux_i386.deb
• 📦 conduit_0.10.2_Linux_i386.rpm
• 📦 conduit_0.10.2_Linux_i386.tar.gz
• 📦 conduit_0.10.2_Linux_x86_64.deb
• 📦 conduit_0.10.2_Linux_x86_64.rpm
• 📦 conduit_0.10.2_Linux_x86_64.tar.gz

Windows

• 📦 conduit_0.10.2_Windows_arm64.zip
• 📦 conduit_0.10.2_Windows_i386.zip
• 📦 conduit_0.10.2_Windows_x86_64.zip

Docker images

To pull the image, you can execute the following command:

docker pull conduit.docker.scarf.sh/conduitio/conduit:v0.10.2

v0.10.1

Changelog

• 252efd7: --- (#1606) (@dependabot[bot])
• 8893784: --- (#1607) (@dependabot[bot])
• ad6d01c: --- (#1609) (@dependabot[bot])
• 4f94cd4: --- (#1610) (@dependabot[bot])
• a79386e: Error processor (#1598) (@lovromazgon)
• b6f3b46: Schema support (design doc) (#1532) (@hariso)
• 7ad8e66: Update release procedure (#1514) (@hariso)
• 4641fb4: Webhook processor fixes (#1597) (@lovromazgon)
• 734fa82: add headers to http processor (#1552) (@maha-hajja)
• 07be204: automate scarf package links in conduit releases body (#1538) (@maha-hajja)
• 5d51602: chore: update conduit-connector-postgres (#1615) (@raulb)
• 00e1ec0: fix: when settings is nil (#1545) (@raulb)
• 3af1dba: populate settings map if nil (#1517) (@lovromazgon)
• 504ebbc: release v0.10.1 (@lovromazgon)
• 4cb3847: update nightly releases and docs' docker image to point to our scarf package (#1534) (@maha-hajja)

Release Artifacts

OSX Darwin

• 📦 conduit_0.10.1_Darwin_arm64.tar.gz
• 📦 conduit_0.10.1_Darwin_x86_64.tar.gz

Linux

• 📦 conduit_0.10.1_Linux_arm64.deb
• 📦 conduit_0.10.1_Linux_arm64.rpm
• 📦 conduit_0.10.1_Linux_arm64.tar.gz
• 📦 conduit_0.10.1_Linux_i386.deb
• 📦 conduit_0.10.1_Linux_i386.rpm
• 📦 conduit_0.10.1_Linux_i386.tar.gz
• 📦 conduit_0.10.1_Linux_x86_64.deb
• 📦 conduit_0.10.1_Linux_x86_64.rpm
• 📦 conduit_0.10.1_Linux_x86_64.tar.gz

Windows

• 📦 conduit_0.10.1_Windows_arm64.zip
• 📦 conduit_0.10.1_Windows_i386.zip
• 📦 conduit_0.10.1_Windows_x86_64.zip

Docker images

To pull the image, you can execute the following command:

docker pull conduit.docker.scarf.sh/conduitio/conduit:v0.10.1

v0.10.0

What's new?

This release focuses on improving connector functionality regarding multiple collections and record routing. You can read more about this on our documentation page.

It also improves the webhook.http processor to allow the usage of record data in the URL. More information can be found here.

Changelog

• 55926a2: Mutliple collections design document (#1465) (@lovromazgon)
• 9ea03b5: Upgrade builtin connectors, SDK and commons (#1515) (@lovromazgon)
• cef8ae4: Upgrade go version to 1.22.2 (#1485) (@lovromazgon)
• 4de440b: add dynamic url to HTTP processor + fix RawData bug (#1498) (@maha-hajja)
• a0c743c: add scarf pixel (#1506) (@maha-hajja)
• 15da724: chore: add scarf (#1507) (@maha-hajja)
• b208a0f: chore: upgrade ui dependencies (#1470) (@raulb)
• 98ad6b3: feature(ui): update to ember 5.7 and latest dependencies (#1483) (@raulb)
• e2cd585: http processor: replace space with + (#1499) (@maha-hajja)
• af6a8b7: upgrade Go version in docker image to 1.22 (#1490) (@lovromazgon)
• 21b2f7c: upgrade Go version to 1.22 (again) (#1501) (@lovromazgon)

Release Artifacts

OSX Darwin

• 📦 conduit_0.10.0_Darwin_arm64.tar.gz
• 📦 conduit_0.10.0_Darwin_x86_64.tar.gz

Linux

• 📦 conduit_0.10.0_Linux_arm64.deb
• 📦 conduit_0.10.0_Linux_arm64.rpm
• 📦 conduit_0.10.0_Linux_arm64.tar.gz
• 📦 conduit_0.10.0_Linux_i386.deb
• 📦 conduit_0.10.0_Linux_i386.rpm
• 📦 conduit_0.10.0_Linux_i386.tar.gz
• 📦 conduit_0.10.0_Linux_x86_64.deb
• 📦 conduit_0.10.0_Linux_x86_64.rpm
• 📦 conduit_0.10.0_Linux_x86_64.tar.gz

Windows

• 📦 conduit_0.10.0_Windows_arm64.zip
• 📦 conduit_0.10.0_Windows_i386.zip
• 📦 conduit_0.10.0_Windows_x86_64.zip

Docker images

To pull the image, you can execute the following command:

docker pull conduit.docker.scarf.sh/conduitio/conduit:v0.10.0