Skip to content

[PAI Submitter] Add PAI submitter #1321

Open
@typhoonzero

Description

@typhoonzero

PAI is a machine learning platform on aliyun: https://help.aliyun.com/product/30347.html

We need to support submit jobs as PAI Tensorflow jobs:

  • Connect to DB Proxy Alisa . @weiguoz @shendiaomo
  • Use dataset to read from MaxCompute data, create temp maxcompute table in one couler step @typhoonzero
  • save model to OSS without credentials
  • Distributed training support @typhoonzero
  • Support submiting PAI couler program and PAI single submit
  • Support custom models (and model zoo) @typhoonzero
  • Enable CI @shendiaomo @weiguoz
  • Support Analyze/GBDT, on spark or local @Yancey1989 @shendiaomo

Metadata

Metadata

Labels

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions