how to integrate hbase with summingbird?

[leesf]

Do anyone knows how to use hbase in summingbird programs? Looking for help

[pankajroark]

Summingbird can integrate with any data store exposed as a Storehaus store, which is basically a trait used to represent a Key Value store. Looks like such stores for HBase already exist at storehaus-hbase/src/main/scala/com/twitter/storehaus/hbase in this repo. You should be able to use any of those stores with sumByKey operation in Summingbird.

[leesf]

The offline store of summingbird should be in form of Readable[K, (BatchId, V)], but i can not find proper store in HBase. I am new and looking for your help, thanks a lot.

[johnynek]

here is one of the hbase stores:

https://github.com/twitter/storehaus/blob/develop/storehaus-hbase/src/main/scala/com/twitter/storehaus/hbase/HBaseStore.scala

There are some more:

https://github.com/twitter/storehaus/tree/develop/storehaus-hbase/src/main/scala/com/twitter/storehaus/hbase

these are for online.

For offline, you need to implement a service:
https://github.com/twitter/summingbird/tree/develop/summingbird-scalding/src/main/scala/com/twitter/summingbird/scalding/service

Here is the simplest one:
https://github.com/twitter/summingbird/blob/develop/summingbird-scalding/src/main/scala/com/twitter/summingbird/scalding/service/UniqueKeyedService.scala#L71

we don't use hbase at stripe (or at Twitter much) but here is scalding support for hbase (as an example project):
https://github.com/kianwilcox/hbase-scalding

unfortunately, hbase is something you are going to have to do a bit of work on (gluing the existing pieces together).