Skip to content

0.9.0
Compare
Choose a tag to compare
@Adamyuanyuan Adamyuanyuan released this 13 Jul 13:39
· 3514 commits to master since this release
0.9.0
b7ed704
This commit was created on GitHub.com and signed with GitHub’s verified signature. The key has expired.
GPG key ID: 4AEE18F83AFDEB23
Expired
Learn about vigilant mode.

0.9.0 is an important version led by ChinaTelecom Ctyun Big Data Platform Team with the help of WeBank.
This is the next release based on DataSphere Studio 0.8.0 line. This version aims to build a one-stop big data application development and management platform by introducing the concepts of "DSS Integration Standard" and "Workspace", which greatly enhances the user's big data development experience.
DSS Integration Standard (DSS Integration Standard): It is the unified access specification of the application system composed of SecurityService from the AppJoint specification of DSS, so that enterprises can connect related big data products to DSS very easily One-stop big data application system portal display and management capabilities (DSS application access specifications will continue to be supplemented and improved in subsequent versions of DSS).
Workspace specification: enables different types of data applications (such as workflow offline applications, real-time applications, data API services, etc.) to be organized and managed from a unified perspective, enhancing application organization and management capabilities.
It contains 23 bug fixes, improvements and enhancements.

Enhancement

  • [DSS-149] DSS Homepage optimization, mainly includes management items for operation and workspace creation, as well as cases and introductions.
  • [DSS-150] DSS Workspace Homepage optimization. After the administrator creates a space for the corresponding role (for example, developer), this page is the first page after login. Includes entries for common applications, administrator functions, and various types of applications.
  • [DSS-151] Common function configuration optimization of the workspace. The roles provided in the workspace can be freely configured and add common function entries that can be added and deleted.
  • [DSS-152] Optimize DSS front-end joint adjustment configuration. After adding this configuration, you can modify the back-end gateway addresses in different environments of the agent as needed, such as production and testing, to quickly locate the problem.

Bug Fix

  • [DSS-120] add use cases such as HQL， PySpark, Spark SQL for new users, so that new users can test and use.
  • [DSS-176] footer-channel in iframe not work.
  • [DSS-185] 0.8.0-scriptis cannot show the execution result of python scripts.
  • [DSS-193] Replace DWS with DSS.

Credits

The release of DataSphere Studio 0.9.0 is inseparable from the contributors of the WeDataSphere community. They selflessly contribute their codes and actively carry out technical exchanges with community partners. With their help, DataSphere Studio 0.9.0 can be successfully released. Thank you all Contributors to the community! Rank in no particular order:
det101: contributed front-end codes for workspace homepage, optimized local debugging configuration of front-end, and solved the bug that footer-channel in iframe didn't work.
yuchenyao: contributed front-end codes for DSS homepage, and optimized the process of creating project and workflow.
schumiyi: contributed back-end codes for DSS homepage and workspace homepage.
ryanqin01: contributed database related codes。
AdamWang: contributed back-end codes for workspace homepage, and reconstructed part of remaining problems.

Upgrade Wizard

Due to the addition of the concept of user workspace (Workspace) in this version of DSS-0.9.0, if you are upgrading from DSS0.7 or DSS0.8 to DSS0.9.0, after completing the platform deployment, you need to make some adjustments to the database tables , Please visit: DSS 0.9.0 Upgrade Guide

Cloud Resource

  1. DSS one-click installation package
    URL: https://pan.baidu.com/s/1unf0FqO6GrvUzYjnHOBWug Password:nnx9
  2. DSS + Linkis + Qualitis + Visualis + Azkaban one-click installation package
    URL：https://osp-1257653870.cos.ap-guangzhou.myqcloud.com/WeDatasphere/DataSphereStudio/0.9.0/dss_linkis.zip
  3. dss-web one-click installation package
    URL: https://pan.baidu.com/s/1nS4iVildF4oXFdd1CPh3AA Password: 56nh
  4. linkis-jobType（Azkaban）
    URL：https://pan.baidu.com/s/1hkCaVFoIWJH5atedSqhd8Q Password：09pz

0.9.0是在微众银行的倾力帮助下，由天翼云大数据平台团队主导完成的一个重要版本。
这是基于DataSphere Studio 0.8.0的下一个发行版本。该版本旨在通过引入“DSS应用接入规范”，“工作空间”等概念，构建一站式大数据应用开发与管理平台，极大提升了用户的大数据开发体验。
DSS应用接入规范（DSS Integration Standard）： 是从DSS的AppJoint规范中，抽出SecurityService组成的应用系统统一接入规范，使企业可以非常简单地将相关大数据产品接入到DSS之中，快速具备一站式的大数据应用系统门户展示和管理能力（DSS应用接入规范将会在DSS的后续版本之中继续补充完善）。
工作空间规范：使不同类型的数据应用（如：工作流离线应用、实时应用、数据API服务等）能够以统一的视角进行组织管理，提升应用的组织和管理能力。
本次版本包含了23个Bug修复，改进和增强。

特性增强

  • [DSS-149] DSS首页优化，主要包括运营入口和工作空间创建管理入口，也包括案例和入门。
  • [DSS-150] DSS工作空间首页优化，管理员创建空间分配给对应的角色之后，如开发者，那么该页面就是登陆之后的首页。
  • [DSS-151] 工作空间常用功能配置，提供给工作空间的角色自由配置增加常用的功能入口，可以增加和删除
  • [DSS-152] dss前端联调配置优化，增加该配置之后，可以根据需要修改代理不同环境的后端gateway地址，如生产和测试，快速定位问题。

Bug修复

  • [DSS-120] 为新用户使用增加包括HQL、PySpark、Spark SQL等用户用例，方便新用户测试试用。
  • [DSS-176] 列表浮动块在iframe下面拖动存在问题。
  • [DSS-185] 0.8.0-scriptis执行python脚本无法显示结果。
  • [DSS-193] 历史遗留问题重构，将DWS替换为DSS。

新贡献者

DataSphere Studio 0.9.0的发布，离不开WeDataSphere社区的贡献者，他们无私地贡献自己的代码，积极地与社区伙伴进行技术交流，有了他们的助力，DataSphere Studio 0.9.0才能顺利地发布，在此感谢各位社区的贡献者! 排名不分先后:
luxl ：贡献工作空间功能的前端代码，优化前端本地调试配置，修复任务管理器入口在iframe下拖动不正常的问题
yuchenyao：贡献了首页的前端代码，优化了创建工程及工作流的流程。
schumiyi: 贡献了首页和用户工作空间相关后端代码。
ryanqin01: 贡献了数据库相关代码。
AdamWang：贡献了用户工作空间相关后端代码，以及部分历史代码遗留问题重构。

升级向导

由于本次DSS-0.9.0版本新增了用户工作空间（workspace）概念，如果您是从 DSS0.7 或 DSS0.8 升级到 DSS0.9.0，在完成平台部署后，需对数据库表做一些调整，具体请访问： DSS 0.9.0 升级指南

云资源

  1. dss一键安装包
    链接:https://pan.baidu.com/s/1unf0FqO6GrvUzYjnHOBWug 提取码:nnx9
  2. DSS + Linkis + Qualitis + Visualis + Azkaban一键安装包
    链接：https://osp-1257653870.cos.ap-guangzhou.myqcloud.com/WeDatasphere/DataSphereStudio/0.9.0/dss_linkis.zip
  3. dss 前端安装包
    链接: https://pan.baidu.com/s/1nS4iVildF4oXFdd1CPh3AA 提取码: 56nh
  4. linkis-JobType（Azkaban）
    链接：https://pan.baidu.com/s/1hkCaVFoIWJH5atedSqhd8Q 提取码：09pz
Assets 2
Loading