Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

建议“数据管道添加“,支持批量修改StarRocks目标表名称,设置目标表属性,新增目标表字段。 #410

Closed
baopuzi opened this issue Jan 23, 2025 · 2 comments
Labels
enhancement New feature or request
Milestone

Comments

@baopuzi
Copy link

baopuzi commented Jan 23, 2025

应用场景:MySQL同步数据到StarRocks,StarRocks分层构建数仓(ods/dwd/dws……,类似Hive)。

建议:
1.在数据管道添加-第四步表映射,可以批量修改目标表名称(加前缀/后缀/同时加前后缀),如批量给目标表加前缀“ods_erp_”。
2.支持批量配置StarRocks建表属性,常见如BUCKETS、replication_num,以及可选配置其他属性等。
3.支持目标表批量新增字段ETL_TIME,取服务器日期时间。

@baisui1981
Copy link
Member

baisui1981 commented Jan 24, 2025

感谢提供的建议,针对您提到的三点:

  1. 之前有同学也提过批量加前缀的需求,
  2. 已经在4.0.1 版本中加上
  3. 已经在4.0.1 版本中实现,届时通过添加Transformer功能,有一个sys_time的虚拟字段可供使用

以上三点会在4.1.0 版本中提供,请关注TIS版本发布

Image

@baisui1981 baisui1981 added the enhancement New feature or request label Jan 24, 2025
@baisui1981 baisui1981 added this to the v4.1.0 milestone Jan 24, 2025
@baopuzi
Copy link
Author

baopuzi commented Jan 25, 2025

感谢,膜拜大佬~

@baopuzi baopuzi closed this as completed Jan 25, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
None yet
Development

No branches or pull requests

2 participants