Skip to content

Commit

Permalink
Merge pull request #2 from programer-0/main
Browse files Browse the repository at this point in the history
Modify the Concept document
  • Loading branch information
yuanxiaodong authored Dec 6, 2021
2 parents afcd5e3 + af5d5ef commit 047144d
Show file tree
Hide file tree
Showing 4 changed files with 2 additions and 9 deletions.
2 changes: 2 additions & 0 deletions README.md
Original file line number Diff line number Diff line change
Expand Up @@ -217,3 +217,5 @@ conf目录下有俩个有来个重要的配置,一个是```log4j.xml```, 主
# out.mock.sls.accessId=
# out.mock.sls.group=
```

如果您希望更详细的了解Rsqldb的相关内容, 请点击[这里](docs/SUMMARY.md)
9 changes: 0 additions & 9 deletions docs/stream_concept/README.md
Original file line number Diff line number Diff line change
Expand Up @@ -21,15 +21,6 @@ RocketMQ-Streams聚焦大数据量->高过滤->轻窗口计算的场景,核心
- 专门针对过滤做了优化,包括前置过滤指纹,同源规则自动归并,hyperscan加速,表达式指纹等
- 计算资源比flink降低(65%-95%),专有云部分规则的测试结果。
- 最好效果,一个超大规则,flink消耗3000 CU,消耗264.25 CU

Flink任务(SQL直接跑在flink上)

![img_2.png](img_2.png)

Dipper任务(Dipper支持和flink融合,也可以跑在flink上,SQL->Dipper任务->Dipper发布成flinkUDF->发布成flink任务)

![img_3.png](img_3.png)

- **维表 JOIN(千万数据量维表支持)**
我们为维表 JOIN 做了高压缩的内存设计,无java头部和对齐的开销,内存存储接近原始数据大小,千万维表加载到内存,不超过2G内存,纯内存操作,性能最大化,同时对于Mysql提供了多线程并发加载,提高加载维表的速度。
- **双流 JOIN**
Expand Down
Binary file removed docs/stream_concept/img_3.png
Binary file not shown.
Binary file removed docs/stream_concept/img_4.png
Binary file not shown.

0 comments on commit 047144d

Please sign in to comment.