Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Missing value imputation #36

Closed
chris-1187 opened this issue Nov 6, 2024 · 0 comments · Fixed by #50
Closed

Missing value imputation #36

chris-1187 opened this issue Nov 6, 2024 · 0 comments · Fixed by #50
Assignees
Labels
component Related to a RTDIP component

Comments

@chris-1187
Copy link

User Story

  1. As a RTDIP user
  2. I want my time series data to be consistent in the pattern I expect and not incomplete
  3. So that my BI functions and planned doings on this data later is enhanced by the provision of a curve of continuous data points

Additional context

  • This component should work with time series data with a fixed pattern
  • It should use imputeFD or MICE, which are common ML algorithms / methods (based on which is more relevant to the usecase)
  • This can be done by integrating Apache SystemDS through its python bindings, which is a perfect fit because it runs on top of Spark and is optimized for single node processing

Acceptance Criteria

  • A new component is implemented
  • Component input
    • live data (adjusted and filled with missing data points as NaN value)
    • the name of column with the value data that should be imputed
  • Component output
    • the same dataframe of live data with imputed values for continuous data points

Definition of Done

  • Test cases have been created and are runnin successfully
  • Documentation for the new component was added
  • Github Actions are running without errors
@chris-1187 chris-1187 added the component Related to a RTDIP component label Nov 6, 2024
@chris-1187 chris-1187 self-assigned this Nov 6, 2024
@chris-1187 chris-1187 linked a pull request Nov 18, 2024 that will close this issue
@github-project-automation github-project-automation bot moved this from Awaiting Review to Feature Archive in amos2024ws01-feature-board Nov 19, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
component Related to a RTDIP component
Projects
Status: Feature Archive
Development

Successfully merging a pull request may close this issue.

1 participant