0.13.1

Changelog

• Fix for blocked thread in Kafka sink (#129)

0.13.0

Changelog

• Reduce default maxRecordSize of Pubsub sink to 9 MB (#126)
• Bump sbt-ci-release to 1.11.1 (#127)
• Add new method isHealthy to sinks (#124)
• Define sink factory types for easier imports in apps (#125)
• Pubsub Source/Sink to work with emulator for local developent (#123)
• Factory classes to create sources/streams sharing underlying resources (#122)
• Pubsub sink elimate Publisher wrapper (#121)
• Kafka sink to use single-threaded executor for blocking operations (#120)
• Sink configs should allow for optional sinks (#115)
• Remove dependency on snowplow scala tracker (#114)
• Add NSQ module (#119)

Version 0.12.0

Changelog

• Add group.instance.id to kafka consumer config (#116)
• Return error from 'resolveTypes' when schemas have clashing column names (#117)

Version 0.11.0

Changelog

• Debounce how often we checkpoint progress (#109)
• Prefetch from pubsub source when parallelPullCount is 1 (#110)
• Bump dependencies (#112)

Version 0.10.0

Changelog

• Remove prefetch from pubsub source (#107)
• Ensure first window is always small (#106)
• Sources should report stream latency of stuck events (#105)
• Enable fairness on Kinesis Source's SynchronousQueue (#105)
• PubSub Source using Unary Pull (#101)
• Kinesis source improve management of shard ends (#102)
• Kinesis checkpointer should retry on dynamodb provisioned throughput exception (#103)
• Kafka Sink rewrite without fs2-kafka (#100)

Version 0.9.0

Changelog

• Kinesis source improvements for larger deployments (#99)
• Preserve original field order when merging schemas (#98)

Version 0.8.1

Changelog

• Fix for _schema_version overriding non-object entity data (#97)

Version 0.8.0

CHANGELOG

• Bump dependencies to latest versions (#96)
• Fix TypedTabledEntity build (#94)
• Install sbt in github actions (#95)
• Change default webhook heartbeat period to 5 minutes (#93)
• Pubsub source open more transport channels (#92)
• Remove temporary Iglu registry used for heartbeat tests (#90)
• Bump schema-ddl to 0.25.0 (#89)
• Http4s Client with configuration appropriate for common-streams apps (#87)
• Resolve schemas in parallel (#85)
• Re-implement Kinesis source without fs2-kinesis (#84)
• Refactor application health monitoring (#82)
• Bump iglu-scala-client to 3.2.0 (#83)
• Webhook for sending alert messages (#81)

0.7.0

Changelog

• Kinesis source must report its latency when KCL is not healthy (#77)
• PubSub source scale the parallel pull count with number of cores (#78)
• Fix randomly adjusted first window size (#79)
• Eagerness of windows should be configurable (#76)

0.6.0

Changelog

• Omit parquet field for a schema with no nested fields (#74)
• Disable testcontainers/ryuk in CI (#69)
• Manually fetch Localstack container image before running Kinesis specs (#69)
• Manually fetch container image before running StatsD spec (#69)