Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Expected DAG Generation #151

Merged
merged 70 commits into from
Mar 15, 2021
Merged

Expected DAG Generation #151

merged 70 commits into from
Mar 15, 2021

Conversation

andrewlawhh
Copy link
Collaborator

Generate expected DAG from executedPlan value in a dataframe.

  • Generate DAG of spark operators
  • Convert DAG of spark operators to DAG of ecalls.

Andrew Law and others added 30 commits October 1, 2020 18:14
Support for multiple branched CaseWhen
f17d8a8
@eric-feng-2011
Interval (mc2-project#116)
366e92c 
* add date_add, interval sql still running into issues

* Add Interval SQL support

* uncomment out the other tests

* resolve comments

* change interval equality

Co-authored-by: Eric Feng <[email protected]>
@chester-leung
Remove partition ID argument from enclaves
c7fcd98
@chester-leung
Fix comments
93dbf5e
@chester-leung
updates
f357ab2
@chester-leung
Merge serialization of ecall string as int
bb4018a
@chester-leung
Modifications to integrate crumb, log-mac, and all-outputs_mac, wip
56ace17
@chester-leung
Store log mac after each output buffer, add all-outputs-mac to each e…
21bbbfb 
…ncryptedblocks wip
@chester-leung
Add all_outputs_mac to all EncryptedBlocks once all log_macs have bee…
549566f 
…n generated
@chester-leung
Almost builds
55ee664
@chester-leung
cpp builds
057caec
@chester-leung
Use ubyte for all_outputs_mac
db54c44
@chester-leung
use Mac for all_outputs_mac
e77f1eb
@chester-leung
Hopefully this works for flatbuffers all_outputs_mac mutation, cpp bu…
736b8f6 
…ilds
merge
cbb2373
Merge branch 'comp-integrity' of https://github.com/mc2-project/opaque …
0351b5d 
…into comp-integrity
@chester-leung
Scala builds now too, running into error with union
3002bd3
@chester-leung
Stuff builds, error with all outputs mac serialization. this commit u…
dc54741 
…ses all_outputs_mac as Mac table
@chester-leung
Fixed bug, basic encryption / show works
5be9b7c
@chester-leung
All single partition tests pass, multiple partiton passes until tpch-9
86fab02
@chester-leung
All tests pass except tpch-9 and skew join
8b1a1d1
@chester-leung
comment tpch back in
18f45d6
Merge branch 'crumb-path' of http://github.com/chester-leung/opaque i…
123fa1f 
…nto comp-integrity
Check same number of ecalls per partition - exception for scanCollect…
bfc06ba 
…LastPrimary(?)
First attempt at constructing executed DAG
c818a41
Fix typos
39a4945
Rework graph
c970965
Add log macs to graph nodes
43ccd2e
Construct expected DAG and refactor JobNode.
69fc49e 
Refactor construction of executed DAG.
Implement 'paths to sink' for a DAG
35691ff
Andrew Law and others added 9 commits February 3, 2021 16:23
Update pathsEqual to be less conservative
2685530
Remove print statements from unit tests
7efb677
@octaviansima
Removed calls to toSet in TPC-H tests (mc2-project#140)
0519def 
* removed calls to toSet

* added calls to toSet back where queries are unordered
@wzheng
Documentation update (mc2-project#148)
0d69b7b
@octaviansima
Cluster Remote Attestation Fix (mc2-project#146)
0f877d4 
The existing code only had RA working when run locally. This PR adds a sleep for 5 seconds to make sure that all executors are spun up successfully before attestation begins.

Closes mc2-project#147
@octaviansima
upgrade to 3.0.1 (mc2-project#144)
c215a99
@wzheng
Update two TPC-H queries (mc2-project#149)
8bd1e09 
Tests for TPC-H 12 and 19 pass.
@octaviansima @wzheng
TPC-H 20 Fix (mc2-project#142)
823d95d 
* string to stringtype error

* tpch 20 passes

* cleanup

* implemented changes

* decimal.tofloat

Co-authored-by: Wenting Zheng <[email protected]>
Add expected operator DAG generation from executedPlan string
fbe324c
@andrewlawhh andrewlawhh merged commit 5dc5561 into mc2-project:comp-integrity Mar 15, 2021
andrewlawhh added a commit that referenced this pull request Mar 15, 2021
@andrewlawhh
Revert "Expected DAG Generation (#151)"
89ab178 
This reverts commit 5dc5561.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@chester-leung chester-leung Awaiting requested review from chester-leung

Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
6 participants
@andrewlawhh @eric-feng-2011 @chester-leung @wzheng @octaviansima @Chenyu-Shi