Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Revisit log messages and levels to enhance observability #1534

Open
2 tasks
yhl25 opened this issue Mar 3, 2024 · 0 comments
Open
2 tasks

Revisit log messages and levels to enhance observability #1534

yhl25 opened this issue Mar 3, 2024 · 0 comments
Labels
enhancement New feature or request opex Operational Excellence to make it easy to run in production and debug

Comments

@yhl25
Copy link
Contributor

yhl25 commented Mar 3, 2024 •
edited by vigith
Loading

  • Our system overly relies on the "Skip watermark publishing" log for data processing validation. If the watermark is disabled it's very difficult to validate.

  • The abundant debug logs currently in place make debugging a challenging task due to the quantity.

  • Our logging system doesn't support finer-grained logging levels such as trace and verbose.

Tasks
Preview Give feedback
  1. Replace zap with zerolog for logging #1495
    opex
  2. independently configurable logging for different modules #326
    enhancement opex
@yhl25 yhl25 added the enhancement New feature or request label Mar 3, 2024
@vigith vigith added the opex Operational Excellence to make it easy to run in production and debug label Mar 20, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
enhancement New feature or request opex Operational Excellence to make it easy to run in production and debug
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
2 participants
@vigith @yhl25