diff --git a/README-ZH.md b/README-ZH.md index 60434446bf..e1c0ef0472 100644 --- a/README-ZH.md +++ b/README-ZH.md @@ -7,33 +7,33 @@ ## 引言 -DataSphere Studio（简称 DSS）是微众银行自研的数据应用开发管理集成框架。 +        DataSphere Studio（简称 DSS）是微众银行自研的数据应用开发管理集成框架。 -基于插拔式的集成框架设计，及计算中间件 [**Linkis**](https://github.com/WeBankFinTech/Linkis) ，可轻松接入上层各种数据应用系统，让数据开发变得简洁又易用。 +        基于插拔式的集成框架设计，及计算中间件 [**Linkis**](https://github.com/WeBankFinTech/Linkis) ，可轻松接入上层各种数据应用系统，让数据开发变得简洁又易用。 -在统一的 UI 下，DataSphere Studio 以工作流式的图形化拖拽开发体验，将满足从数据交换、脱敏清洗、分析挖掘、质量检测、可视化展现、定时调度到数据输出应用等，数据应用开发全流程场景需求。 +        在统一的 UI 下，DataSphere Studio 以工作流式的图形化拖拽开发体验，将满足从数据交换、脱敏清洗、分析挖掘、质量检测、可视化展现、定时调度到数据输出应用等，数据应用开发全流程场景需求。 -**DSS 通过插拔式的集成框架设计，让用户可以根据需要，简单快速替换 DSS 已集成的各种功能组件，或新增功能组件。** +        **DSS 通过插拔式的集成框架设计，让用户可以根据需要，简单快速替换 DSS 已集成的各种功能组件，或新增功能组件。** -借助于 [**Linkis**](https://github.com/WeBankFinTech/Linkis) 计算中间件的连接、复用与简化能力，DSS 天生便具备了金融级高并发、高可用、多租户隔离和资源管控等执行与调度能力。 +        借助于 [**Linkis**](https://github.com/WeBankFinTech/Linkis) 计算中间件的连接、复用与简化能力，DSS 天生便具备了金融级高并发、高可用、多租户隔离和资源管控等执行与调度能力。 ## 界面预览 -请您耐心等待，加载 gif 需要一些时间。 +        请您耐心等待，加载 gif 需要一些时间。 ![DSS-V1.0 GIF](images/en_US/readme/DSS_gif.gif) ## 核心特点 -DSS 主要特点： +        DSS 主要特点： ### 一、一站式、全流程的应用开发管理界面 -       DSS 集成度极高，目前已集成的系统有： +        DSS 集成度极高，目前已集成的系统有：        1、数据开发IDE工具——[Scriptis](https://github.com/WeBankFinTech/Scriptis) -        2、数据可视化工具——[Visualis](https://github.com/WeBankFinTech/Visualis)（基于宜信[Davinci](https://github.com/edp963/davinci) 二次开发） +        2、数据可视化工具——[Visualis](https://github.com/WeBankFinTech/Visualis)（基于宜信 [Davinci](https://github.com/edp963/davinci) 二次开发）        3、数据质量管理工具——[Qualitis](https://github.com/WeBankFinTech/Qualitis) @@ -61,7 +61,7 @@ DSS 主要特点：        AppConn ——应用连接器，定义了一套统一的前后台接入协议，总共分为三级规范，可让外部数据应用系统快速简单地接入，成为 DSS 数据应用开发中的一环。 -        AppConn 的三级规范即：一级SSO规范，二级组织结构规范，三级开发流程规范； +        AppConn 的三级规范即：一级 SSO 规范，二级组织结构规范，三级开发流程规范；        DSS 通过串联多个 AppConn，编排成一条支持实时执行和定时调度的工作流，用户只需简单拖拽即可完成数据应用的全流程开发。 @@ -85,7 +85,7 @@ DSS 主要特点： | [**Prophecis**](https://github.com/WeBankFinTech/Prophecis) | 一站式机器学习平台，集成多种开源机器学习框架。Prophecis 的 MLFlow 通过 AppConn 可以接入到 DSS 工作流中。 | 不支持 | >=1.0.2 | **即将发布集成版本** | | [**Streamis**](https://github.com/WeBankFinTech/Streamis) | 流式应用开发管理工具。支持发布 Flink Jar 和 Flink SQL ，提供流式应用的开发调试和生产管理能力，如：启停、状态监控、checkpoint 等。 | 不支持 | >=1.0.1 | **即将发版** | | [**Exchangis**](https://github.com/WeBankFinTech/Exchangis) | 支持对结构化及无结构化的异构数据源之间的数据传输的数据交换平台，即将发布的 Exchangis1.0，将与 DSS 工作流打通 | 不支持 | >=1.0.1 | **筹备中** | -| [**Visualis**](https://github.com/WeBankFinTech/Visualis) | 基于宜信开源项目 Davinci 二次开发的数据可视化BI工具，为用户在数据安全方面提供金融级数据可视化能力。 | >=0.5.0 | >=1.0.2 | **待发布** | +| [**Visualis**](https://github.com/WeBankFinTech/Visualis) | 基于宜信开源项目 Davinci 二次开发的数据可视化 BI 工具，为用户在数据安全方面提供金融级数据可视化能力。 | >=0.5.0 | >=1.0.2 | **待发布** | | [**Qualitis**](https://github.com/WeBankFinTech/Qualitis) | 数据质量校验工具，提供数据完整性、正确性等数据校验能力 | >=0.5.0 | >=1.0.1 | **待发布** | | [**DataApiService**](https://github.com/WeBankFinTech/DataSphereStudio-Doc/blob/main/zh_CN/%E4%BD%BF%E7%94%A8%E6%96%87%E6%A1%A3/DataApiService%E4%BD%BF%E7%94%A8%E6%96%87%E6%A1%A3.md) | 数据API服务。可快速将SQL脚本发布为一个 Restful 接口，对外提供 Rest 访问能力。 | 不支持 | >=1.0.0 | 已发布 | | [**Scriptis**](https://github.com/WeBankFinTech/Scriptis) | 支持在线写 SQL、Pyspark、HiveQL 等脚本，提交给[Linkis](https://github.com/WeBankFinTech/Linkis)执行的数据分析 Web 工具。 | >=0.5.0 | >=1.0.0 | 已发布 | @@ -99,11 +99,11 @@ DSS 主要特点：        由于 DataSphereStudio 支持执行脚本风险较高，WeDataSphere Demo 环境的隔离没有做完，考虑到大家都在咨询 Demo 环境，决定向社区先定向发放邀请码，接受企业和组织的试用申请。 -       如果您想试用 Demo 环境，请加入DataSphere Studio社区用户群（**加群方式请翻到本文档末尾处**），联系 **WeDataSphere入群机器人** 获取邀请码。 +       如果您想试用 Demo 环境，请加入DataSphere Studio社区用户群（**加群方式请翻到本文档末尾处**），联系 **WeDataSphere 入群机器人** 获取邀请码。 -       DataSphereStudio Demo环境用户注册页面：[点我进入](https://www.ozone.space/wds/dss/#/register) +       DataSphereStudio Demo 环境用户注册页面：[点我进入](https://www.ozone.space/wds/dss/#/register) -       DataSphereStudio Demo环境登录页面：[点我进入](https://www.ozone.space/wds/dss/#/login) +       DataSphereStudio Demo 环境登录页面：[点我进入](https://www.ozone.space/wds/dss/#/login) ## 下载 @@ -112,19 +112,19 @@ DSS 主要特点： ## 编译和安装部署 -请参照 [编译指引](https://github.com/WeBankFinTech/DataSphereStudio-Doc/blob/main/zh_CN/%E5%BC%80%E5%8F%91%E6%96%87%E6%A1%A3/DSS%E7%BC%96%E8%AF%91%E6%96%87%E6%A1%A3.md) 来编译 DSS 源码。 +        请参照 [编译指引](https://github.com/WeBankFinTech/DataSphereStudio-Doc/blob/main/zh_CN/%E5%BC%80%E5%8F%91%E6%96%87%E6%A1%A3/DSS%E7%BC%96%E8%AF%91%E6%96%87%E6%A1%A3.md) 来编译 DSS 源码。 -请参考 [安装部署文档](https://github.com/WeBankFinTech/DataSphereStudio-Doc/blob/main/zh_CN/%E5%AE%89%E8%A3%85%E9%83%A8%E7%BD%B2/DSS%E5%8D%95%E6%9C%BA%E9%83%A8%E7%BD%B2%E6%96%87%E6%A1%A3.md) 来部署 DSS。 +        请参考 [安装部署文档](https://github.com/WeBankFinTech/DataSphereStudio-Doc/blob/main/zh_CN/%E5%AE%89%E8%A3%85%E9%83%A8%E7%BD%B2/DSS%E5%8D%95%E6%9C%BA%E9%83%A8%E7%BD%B2%E6%96%87%E6%A1%A3.md) 来部署 DSS。 ## 示例和使用指引 -请到 [用户使用文档](https://github.com/WeBankFinTech/DataSphereStudio-Doc/blob/main/zh_CN/%E4%BD%BF%E7%94%A8%E6%96%87%E6%A1%A3/DSS%E7%94%A8%E6%88%B7%E6%89%8B%E5%86%8C.md) ，了解如何快速使用DSS。 +        请到 [用户使用文档](https://github.com/WeBankFinTech/DataSphereStudio-Doc/blob/main/zh_CN/%E4%BD%BF%E7%94%A8%E6%96%87%E6%A1%A3/DSS%E7%94%A8%E6%88%B7%E6%89%8B%E5%86%8C.md) ，了解如何快速使用DSS。 ## 文档 -DSS1.0的完整文档列表，请参见 [DSS-Doc](https://github.com/WeBankFinTech/DataSphereStudio-Doc/tree/main/zh_CN) +        DSS1.0 的完整文档列表，请参见 [DSS-Doc](https://github.com/WeBankFinTech/DataSphereStudio-Doc/tree/main/zh_CN) -以下为 DSS 相关 AppConn 插件的安装指南： +        以下为 DSS 相关 AppConn 插件的安装指南： - [DSS的Visualis AppConn插件安装指南](https://github.com/WeBankFinTech/DataSphereStudio-Doc/blob/main/zh_CN/%E5%AE%89%E8%A3%85%E9%83%A8%E7%BD%B2/VisualisAppConn%E6%8F%92%E4%BB%B6%E5%AE%89%E8%A3%85%E6%96%87%E6%A1%A3.md) @@ -155,22 +155,22 @@ DSS1.0的完整文档列表，请参见 [DSS-Doc](https://github.com/WeBankFinTe ## 贡献 -我们非常欢迎和期待更多的贡献者参与共建 DSS, 不论是代码、文档，或是其他能够帮助到社区的贡献形式。 +        我们非常欢迎和期待更多的贡献者参与共建 DSS, 不论是代码、文档，或是其他能够帮助到社区的贡献形式。 ## 联系我们 -对 DSS 的任何问题和建议，敬请提交 issue，以便跟踪处理和经验沉淀共享。 +        对 DSS 的任何问题和建议，敬请提交 issue，以便跟踪处理和经验沉淀共享。 -您也可以扫描下面的二维码，加入我们的 微信/QQ群，以获得更快速的响应。 +        您也可以扫描下面的二维码，加入我们的 微信/QQ群，以获得更快速的响应。 ![交流](images/zh_CN/readme/communication.png) ## 谁在使用 DSS -我们创建了 [Who is using DSS](https://github.com/WeBankFinTech/DataSphereStudio/issues/1) issue 以便用户反馈和记录谁在使用 DSS，欢迎您注册登记. +        我们创建了 [Who is using DSS](https://github.com/WeBankFinTech/DataSphereStudio/issues/1) issue 以便用户反馈和记录谁在使用 DSS，欢迎您注册登记. -DSS 自2019年开源发布以来，累计已有700多家试验企业和1000+沙盒试验用户，涉及金融、电信、制造、互联网等多个行业。 +        DSS 自2019年开源发布以来，累计已有700多家试验企业和1000+沙盒试验用户，涉及金融、电信、制造、互联网等多个行业。 ## License -DSS is under the Apache 2.0 license. See the [License](LICENSE) file for details. +        DSS is under the Apache 2.0 license. See the [License](LICENSE) file for details. diff --git a/README.md b/README.md index f37d3639da..258d49a9de 100644 --- a/README.md +++ b/README.md @@ -7,17 +7,17 @@ English | [中文](README-ZH.md) ## Introduction -DataSphere Studio (DSS for short) is WeDataSphere, a big data platform of WeBank, a self-developed one-stop data application development management portal. +        DataSphere Studio (DSS for short) is WeDataSphere, a one-stop data application development management portal developed by WeBank. -Based on [Linkis](https://github.com/WeBankFinTech/Linkis) computation middleware, DSS can easily integrate upper-level data application systems, making data application development simple and easy to use. +        With the pluggable integrated framework design and the Linkis, a computing middleware, DSS can easily integrate various upper-layer data application systems, making data development simple and easy to use. -DataSphere Studio is positioned as a data application development portal, and the closed loop covers the entire process of data application development. With a unified UI, the workflow-like graphical drag-and-drop development experience meets the entire lifecycle of data application development from data import, desensitization cleaning, data analysis, data mining, quality inspection, visualization, scheduling to data output applications, etc. +        DataSphere Studio is positioned as a data application development portal, and the closed loop covers the entire process of data application development. With a unified UI, the workflow-like graphical drag-and-drop development experience meets the entire lifecycle of data application development from data import, desensitization cleaning, data analysis, data mining, quality inspection, visualization, scheduling to data output applications, etc. -With the connection, reusability, and simplification capabilities of Linkis, DSS is born with financial-grade capabilities of high concurrency, high availability, multi-tenant isolation, and resource management. +        With the connection, reusability, and simplification capabilities of Linkis, DSS is born with financial-grade capabilities of high concurrency, high availability, multi-tenant isolation, and resource management. ## UI preview -Please be patient, it will take some time to load gif. +        Please be patient, it will take some time to load gif. ![DSS-V1.0 GIF](images/en_US/readme/DSS_gif.gif) @@ -25,100 +25,114 @@ Please be patient, it will take some time to load gif. ### 1. One-stop, full-process application development management UI -       DSS is highly integrated. Currently integrated systems include: - -        a. [Scriptis](https://github.com/WeBankFinTech/Scriptis) - Data Development IDE Tool. - -        b. [Visualis](https://github.com/WeBankFinTech/Visualis) - Data Visualization Tool(Based on the open source project [Davinci](https://github.com/edp963/davinci) contributed by CreditEase) - -        c. [Qualitis](https://github.com/WeBankFinTech/Qualitis) - Data Quality Management Tool - -        d. [Schedulis](https://github.com/WeBankFinTech/Schedulis) - Batch workflow job scheduler - -        f. [Exchangis](https://github.com/WeBankFinTech/Exchangis) - Data Exchange Tool - +        DSS is highly integrated. Currently integrated systems include: + +        1. Data Development IDE Tool - [Scriptis](https://github.com/WeBankFinTech/Scriptis) + +        2. Data Visualization Tool - [Visualis](https://github.com/WeBankFinTech/Visualis) (Based on the open source project [Davinci](https://github.com/edp963/davinci ) contributed by CreditEase) + +        3. Data Quality Management Tool - [Qualitis](https://github.com/WeBankFinTech/Qualitis) + +        4. Workflow scheduling tool - [Schedulis](https://github.com/WeBankFinTech/Schedulis) + +        5. Data Exchange Tool - [Exchangis](https://github.com/WeBankFinTech/Exchangis) (**The upcoming Exchangis1.0 will be integrated with the DSS workflow**) + +        6. Data Api Service - [DataApiService](https://github.com/WeBankFinTech/DataSphereStudio-Doc/blob/main/zh_CN/%E4%BD%BF%E7%94%A8%E6%96%87%E6%A1%A3/DataApiService%E4%BD%BF%E7%94%A8%E6%96%87%E6%A1%A3.md) + +        7. Streaming Application Development Management Tool - [Streamis](https://github.com/WeBankFinTech/Streamis) + +        8. One-stop machine Learning Platform - [Prophecis](https://github.com/WeBankFinTech/Prophecis) (**Integrated version will be released soon**) + +        9. Workflow Task Scheduling Tool - DolphinScheduler (**In Code Merging**) + +        10. Data Model Center - DataModelCenter (**In development**) + +        **With a pluggable framework architecture, DSS is designed to allow users to quickly integrate new data application tools, or replace various tools that DSS has integrated**. For example, replace Scriptis with Zeppelin, and replace Schedulis with DolphinScheduler... + ![DSS one-stop video](images/en_US/readme/onestop.gif) ### 2. AppConn, based on Linkis，defines a unique design concept -        AppConn——application connector, defining unified front-end and back-end - integration specifications, can quickly and easily integrate with external data application systems, - making them as part of DSS data application development. +        AppConn is the core concept that enables DSS to easily and quickly integrate various upper-layer web systems. + +        AppConn, an application connector, defines a set of unified front-end and back-end three-level integration protocols, allowing external data application systems to easily and quickly becoming a part of DSS data application development. + +        The three-level specifications of AppConn are: the first-level SSO specification, the second-level organizational structure specification, and the third-level development process specification.        DSS arranges multiple AppConns in series to form a workflow that supports real-time execution and scheduled execution. Users can complete the entire process development of data applications with simple drag and drop operations. -        Since AppConn is integrated with Linkis, the external data application system shares the capabilities of resource management, concurrent limiting, and high performance. AppConn also allows sharable context across system level and completely gets away from application silos. +        Since AppConn is integrated with Linkis, the external data application system shares the capabilities of resource management, concurrent limiting, and high performance. AppConn also allows sharable context across system level and thus makes external data application completely gets away from application silos. -### 3. Project, as the management unit +### 3. Workspace, as the management unit -        With Project as the management unit, DSS organizes and manages the business applications of each data application system, and defines a set of common standards for collaborative development of projects across data application systems. +        With Workspace as the management unit, it organizes and manages business applications of various data application systems, defines a set of common standards for collaborative development of workspaces across data application systems, and provides user role management capabilities. ### 4. Integrated data application components -       a. Schedulis AppConn —— Batch workflow job scheduler - -         Many data applications developed by users usually require periodic scheduling capability. - -         At present, the open source scheduling system in the community is pretty unfriendly to integrate with other data application systems. - -         DSS implements Schedulis AppConn, which allows users to publish DSS workflows to Azkaban for regular scheduling. - -         DSS also defines standard and generic workflow parsing and publishing specifications for scheduling systems, allowing other scheduling systems to easily achieve low-cost integration with DSS. - -![Azkaban](images/en_US/readme/Azkaban_AppJoint.gif) - -       b. Scriptis AppConn —— Data Development IDE Tool - -         What is [Scriptis](https://github.com/WeBankFinTech/Scriptis)? - -         Scriptis is for interactive data analysis with script development(SQL, Pyspark, HiveQL), task submission(Spark, Hive), UDF, function, resource management and intelligent diagnosis. - -         Scriptis AppConn integrates the data development capabilities of Scriptis to DSS, and allows various script types of Scriptis to serve as nodes in the DSS workflow to participate in the application development process. - -         Currently supports HiveSQL, SparkSQL, Pyspark, Scala and other script node types. - -![Scriptis](images/en_US/readme/Scriptis_AppJoint.gif) - -       c. Visualis AppConn —— Data Visualization Tool - -         What is [Visualis](https://github.com/WeBankFinTech/Visualis)? - -         Visualis is a BI tool for data visualization. It provides financial-grade data visualization capabilities on the basis of data security and permissions, based on the open source project Davinci contributed by CreditEase. - -         Visualis AppConn integrates data visualization capabilities to DSS, and allows displays and dashboards, as nodes of DSS workflows, to be associated with upstream data market. - -![Visualis](images/en_US/readme/Visualis_AppJoint.gif) - -       d. Qualitis AppConn —— Data quality management Tool - -         Qualitis AppConn integrates data quality verification capabilities for DSS, allows Qualitis as a node in DSS workflow - -![Qualitis](images/en_US/readme/Qualitis_AppJoint.gif) - -       e. Data Sender——Sender AppConn - -         Sender AppConn provides data delivery capability for DSS. Currently it supports the SendEmail node type, and the result sets of all other nodes can be sent via email. - -         For example, the SendEmail node can directly send the screen shot of a display as an email. - -       f. Signal AppConn —— Signal Nodes - -         Signal AppConn is used to strengthen the correlation between business and process while keeping them decoupled. - -         DataChecker Node：Checks whether a table or partition exists. - -         EventSender Node: Messaging nodes across workflows and projects. - -         EventReceiver: Receive nodes for messages across workflows and projects. - -       g. Function node - -         Empty nodes, sub workflow nodes. - -## Compared with similar systems - -       DSS is an open source project leading the direction of data application development and management. - The open source community currently does not have similar products. +        DSS has integrated a variety of upper-layer data application systems by implementing multiple AppConns, which can basically meet the data development needs of users. + +        **If desired, new data application systems can also be easily integrated to replace or enrich DSS's data application development process.** [Click me to learn how to quickly integrate new application systems](https://github.com/WeBankFinTech/DataSphereStudio-Doc/blob/main/zh_CN/%E5%BC%80%E5%8F%91%E6%96%87%E6%A1%A3/%E7%AC%AC%E4%B8%89%E6%96%B9%E7%B3%BB%E7%BB%9F%E6%8E%A5%E5%85%A5DSS%E5%BC%80%E5%8F%91%E6%8C%87%E5%8D%97.md) + +| Component | Description | DSS0.X Version Requirements | DSS1.0 Version Requirements | Version Planning | +| --------------- | -------------------------------------------------------------------- | --------- | ---------- | ------ | +| **DolphinScheduler** | Apache DolphinScheduler, a distributed and scalable visual workflow task scheduling platform, supports one-click publishing of DSS workflows to DolphinScheduler. | Not supported | Planned in 1.1.0 | **Code merging** | +| **DataModelCenter** | It mainly provides the capabilities of data warehouse planning, data model development and data asset management. Data warehouse planning includes subject domains, data warehouse layers, modifiers, etc.; data model development includes indicators, dimensions, metrics, wizard-based table building, etc.; data assets are connected to Apache Atlas to provide data lineage capabilities. | Not supported | Planning in 1.2.0 | **Community joint construction, expected after the Spring Festival** | +| **UserManager** | Automatically initialize all user environments necessary for a new DSS user, including: creating Linux users, various user paths, directory authorization, etc. | >=0.9.1 | >=1.0.2 | **Code merging** | +| [**Prophecis**](https://github.com/WeBankFinTech/Prophecis) | A one-stop machine learning platform that integrates multiple open source machine learning frameworks. Prophecis' MLFlow can be connected to DSS workflow through AppConn. | Not supported | >=1.0.2 | **Combination version coming soon** | +| [**Streamis**](https://github.com/WeBankFinTech/Streamis) | Streaming application development management tool. It supports the release of Flink Jar and Flink SQL, and provides the development, debugging and production management capabilities of streaming applications, such as: start-stop, status monitoring, checkpoint, etc. | Not supported | >=1.0.1 | **Coming soon** | +| [**Exchangis**](https://github.com/WeBankFinTech/Exchangis) | A data exchange platform that supports data transmission between structured and unstructured heterogeneous data sources, the upcoming Exchangis1. 0, will be connected with DSS workflow | not supported | >=1.0.1 | **In preparation** | +| [**Visualis**](https://github.com/WeBankFinTech/Visualis) | A data visualization BI tool based on the second development of Davinci, an open source project of CreditEase, provides users with financial-level data visualization capabilities in terms of data security. | >=0.5.0 | >=1.0.2 | **To be released** | +| [**Qualitis**](https://github.com/WeBankFinTech/Qualitis) | Data quality verification tool, providing data verification capabilities such as data integrity and correctness | >=0.5.0 | >=1.0 .1 | **To be published** | +| [**DataApiService**](https://github.com/WeBankFinTech/DataSphereStudio-Doc/blob/main/zh_CN/%E4%BD%BF%E7%94%A8%E6%96%87%E6%A1%A3/DataApiService%E4%BD%BF%E7%94%A8%E6%96%87%E6%A1%A3.md) | Data API service. The SQL script can be quickly published as a Restful interface, providing Rest access capability to the outside world. | Not supported | >=1.0.0 | Released | +| [**Scriptis**](https://github.com/WeBankFinTech/Scriptis) | Support online script writing such as SQL, Pyspark, HiveQL, etc., submit to [Linkis](https://github.com/WeBankFinTech/Linkis ) to perform data analysis web tools. | >=0.5.0 | >=1.0.0 | Released | +| [**Schedulis**](https://github.com/WeBankFinTech/Schedulis) | Workflow task scheduling system based on Azkaban secondary development, with financial-grade features such as high performance, high availability and multi-tenant resource isolation. | >=0.5.0 | >=1.0.0 | Released | +| **EventCheck** | Provides cross-business, cross-engineering, and cross-workflow signaling capabilities. | >=0.5.0 | >=1.0.0 | Released | +| **SendEmail** | Provides the ability to send data, all the result sets of other workflow nodes can be sent by email | >=0.5.0 | >=1.0.0 | Released | +| **Airflow** | Supports publishing DSS workflows to Airflow for scheduling. | >=0.9.1, not yet merged | Not supported | **To be planned** | + + +## Demo Trial environment + +        The function of DataSphere Studio supporting script execution has high security risks, and the isolation of the WeDataSphere Demo environment has not been completed. Considering that many users are inquiring about the Demo environment, we decided to first issue invitation codes to the community and accept trial applications from enterprises and organizations. + +       If you want to try out the Demo environment, please join the DataSphere Studio community user group (**Please refer to the end of the document**), and contact **WeDataSphere Group Robot** to get an invitation code. + +       DataSphereStudio Demo environment user registration page: [click me to enter](https://www.ozone.space/wds/dss/#/register) + +       DataSphereStudio Demo environment login page: [click me to enter](https://www.ozone.space/wds/dss/#/login) + +## Download + +        Please go to the [DSS Releases Page](https://github.com/WeBankFinTech/DataSphereStudio/releases) to download a compiled version or a source code package of DSS. + +## Compile and deploy + +        Please follow [Compile Guide]((https://github.com/WeBankFinTech/DataSphereStudio-Doc/blob/main/zh_CN/%E5%BC%80%E5%8F%91%E6%96%87%E6%A1%A3/DSS%E7%BC%96%E8%AF%91%E6%96%87%E6%A1%A3.md)) to compile DSS from source code. + +        Please refer to [Deployment Documents](https://github.com/WeBankFinTech/DataSphereStudio-Doc/blob/main/zh_CN/%E5%AE%89%E8%A3%85%E9%83%A8%E7%BD%B2/DSS%E5%8D%95%E6%9C%BA%E9%83%A8%E7%BD%B2%E6%96%87%E6%A1%A3.md) to do the deployment. + +## Examples and Guidance + +        You can find examples and guidance for how to use DSS in [User Manual](https://github.com/WeBankFinTech/DataSphereStudio-Doc/blob/main/zh_CN/%E4%BD%BF%E7%94%A8%E6%96%87%E6%A1%A3/DSS%E7%94%A8%E6%88%B7%E6%89%8B%E5%86%8C.md). + + +## Documents + +        For a complete list of documents for DSS1.0, see [DSS-Doc](https://github.com/WeBankFinTech/DataSphereStudio-Doc) + +        The following is the installation guide for DSS-related AppConn plugins: + +- [Visualis AppConn Plugin Installation Guide](https://github.com/WeBankFinTech/DataSphereStudio-Doc/blob/main/zh_CN/%E5%AE%89%E8%A3%85%E9%83%A8%E7%BD%B2/VisualisAppConn%E6%8F%92%E4%BB%B6%E5%AE%89%E8%A3%85%E6%96%87%E6%A1%A3.md) + +- [Schedulis AppConn Plugin Installation Guide](https://github.com/WeBankFinTech/DataSphereStudio-Doc/blob/main/zh_CN/%E5%AE%89%E8%A3%85%E9%83%A8%E7%BD%B2/SchedulisAppConn%E6%8F%92%E4%BB%B6%E5%AE%89%E8%A3%85%E6%96%87%E6%A1%A3.md) + +- [Qualitis AppConn Plugin Installation Guide](https://github.com/WeBankFinTech/DataSphereStudio-Doc/blob/main/zh_CN/%E5%AE%89%E8%A3%85%E9%83%A8%E7%BD%B2/QualitisAppConn%E6%8F%92%E4%BB%B6%E5%AE%89%E8%A3%85%E6%96%87%E6%A1%A3.md) + +- [Exchangis AppConn Plugin Installation Guide](https://github.com/WeBankFinTech/DataSphereStudio-Doc/blob/main/zh_CN/%E5%AE%89%E8%A3%85%E9%83%A8%E7%BD%B2/ExchangisAppConn%E6%8F%92%E4%BB%B6%E5%AE%89%E8%A3%85%E6%96%87%E6%A1%A3.md) + +## Architecture + +![DSS Architecture](images/en_US/readme/architecture.png) ## Usage Scenarios @@ -132,27 +146,26 @@ Please be patient, it will take some time to load gif.       4. Scenarios in which users have the capabilities of big data foundation platform and comprehensive data application tools. but lacks unified and standardized specifications, while a part of these tools have been integrated. +## Contributing -## Quick start - -Click to [Quick start](docs/en_US/ch2/DSS%20Quick%20Installation%20Guide.md) +        Contributions are always welcomed, we need more contributors to build DSS together. either code, or doc, or other supports that could help the community. -## Architecture +        For code and documentation contributions, please follow the contribution guide. -![DSS Architecture](images/en_US/readme/architecture.png) +## Communication -## Documents +        For any questions or suggestions, please kindly submit an issue. -[Compiled documentation](https://github.com/WeBankFinTech/DataSphereStudio/blob/master/docs/en_US/ch1/DataSphereStudio_Compile_Manual.md) +        You can scan the QR code below to join our WeChat and QQ group to get more immediate response. -[User manual](https://github.com/WeBankFinTech/DataSphereStudio/blob/master/docs/en_US/ch3/DataSphereStudio_quick_start.md) +![communication](images/en_US/readme/communication.png) -[Quick integration with DSS for external systems](docs/en_US/ch4/The%20Guide%20for%20Third-party%20Systems%20accessing%20DSS.md) +## Who is using DSS -## Communication +        We opened an issue for users to feedback and record who is using DSS. -![communication](images/en_US/readme/communication.png) +        Since the first release of DSS in 2019, it has accumulated more than 700 trial companies and 1000+ sandbox trial users, which involving diverse industries, from finance, banking, tele-communication, to manufactory, internet companies and so on. ## License -DSS is under the Apache 2.0 license. See the [License](LICENSE) file for details. +        DSS is under the Apache 2.0 license. See the [License](LICENSE) file for details. diff --git a/images/zh_CN/readme/DSS-V1.0.mp4 b/images/zh_CN/readme/DSS-V1.0.mp4 deleted file mode 100644 index 3d8c5efd23..0000000000 Binary files a/images/zh_CN/readme/DSS-V1.0.mp4 and /dev/null differ