Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Change FutureCollector signature to fix https://github.com/twitter/st… #293

Merged
merged 4 commits into from
Jun 13, 2016

Conversation

pankajroark
Copy link
Contributor

Fix for #292 by changing signature of FutureCollector.

Please note the change in MergeableStoreViaGetPut to use the supplied future collector instead of the implicit one.

@@ -19,24 +19,24 @@ package com.twitter.storehaus
import com.twitter.util.Future

/** A type to represent how Seq of futures are collected into a future of Seq[T] */
trait FutureCollector[-T] extends java.io.Serializable {
def apply[T1<:T](in: Seq[Future[T1]]): Future[Seq[T1]]
trait FutureCollector extends java.io.Serializable { self =>
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

do we need the self? I dont see how?

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

My bad. I was trying something else earlier and forgot to remove the self. Removed.

@johnynek
Copy link
Collaborator

HBase store is failing in these.

Could it be related?

@pankajroark
Copy link
Contributor Author

pankajroark commented May 31, 2016

I re-ran the tests and this time only the MutableTTLCacheProperties failed and only for scala 2.11.7. I think the HBase test is also flaky.
https://travis-ci.org/twitter/storehaus

@johnynek
Copy link
Collaborator

johnynek commented Jun 1, 2016

can you comment out this flakey test and add an issue to fix it?

…ffort. As it was before it would have thrown an exception on keys filtered by bestEffort collector.
@pankajroark
Copy link
Contributor Author

Commented out the flaky tests: HBaseStringStoreProperties and MutableTTLCacheProperties. There was already an issue for MutableTTLCacheProperties #291. Created one for HBaseStringStoreProperties #294

@johnynek
Copy link
Collaborator

johnynek commented Jun 1, 2016

merge when green. Added a few more issues: #296 #295

@isnotinvain
Copy link
Contributor

I'm not that familiar with this, but LGTM. Is there any extra testing we can / should do on our side to validate this?

@johnynek
Copy link
Collaborator

johnynek commented Jun 1, 2016

Well, @pankajroark is on your side right? :)

@pankajroark
Copy link
Contributor Author

FYI: Change in FutureCollector signature requires changes in some exposed APIs in summingbird (and thus some user code as well). I suppose I'll need to make a release of storehaus and then create the PR in summingbird with the code changes and version upgrade of storehaus.
For further testing I'm planning to run E2E tests on our side.

@johnynek
Copy link
Collaborator

johnynek commented Jun 3, 2016

👍

@isnotinvain
Copy link
Contributor

@johnynek that was a question for @pankajroark :)

@pankajroark
Copy link
Contributor Author

I ran e2e tests on our end and they look good. Merging this now.

@pankajroark pankajroark merged commit b3d6d08 into develop Jun 13, 2016
@johnynek johnynek deleted the fix_mergeable_store_future_collector branch June 13, 2016 17:30
@johnynek
Copy link
Collaborator

👍 good work.

@@ -67,3 +71,4 @@ with DefaultHBaseCluster[Store[String, String]] {
val store=HBaseStringStore(quorumNames, table, columnFamily, column, createTable,pool,conf,4)
store.convert[Long,Long](_.toString)
}
*/
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

oops, I didn't see this. I'm fixing those in #300

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants