Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

build(deps-dev): bump junit from 4.12 to 4.13.1 in /hadoop-project #293

Open
wants to merge 714 commits into
base: calvin
Choose a base branch
from
Open
Changes from 1 commit
Commits
Show all changes
714 commits
Select commit Hold shift + click to select a range
46a1300
Merge pull request #161 from DSL-UMD/distributed
gangliao Sep 5, 2019
0733115
disable CacheRegistry and BlockPoolRegistry
gangliao Sep 5, 2019
729898e
TinyDataNode connected to namenode directly
gangliao Sep 6, 2019
09c6f45
Merge pull request #163 from DSL-UMD/distributed
gangliao Sep 6, 2019
344848c
test voltdb's zk
gangliao Sep 8, 2019
adfcd7d
Merge pull request #165 from DSL-UMD/distributed
gangliao Sep 8, 2019
25cc1ec
Using VoltDB's zookeeper to store mount table
gangliao Sep 9, 2019
61d048d
Merge pull request #166 from DSL-UMD/distributed
gangliao Sep 9, 2019
d4a621d
optimize routing algorithm
gangliao Sep 10, 2019
2802496
Merge pull request #169 from DSL-UMD/distributed
gangliao Sep 10, 2019
ed2a4c9
fix compile error
gangliao Sep 11, 2019
d1293b0
typo
gangliao Sep 11, 2019
93074c7
Merge pull request #170 from DSL-UMD/distributed
gangliao Sep 11, 2019
b87b416
compile on Red Hat Enterprise Linux
gangliao Sep 13, 2019
9617b45
Merge pull request #171 from DSL-UMD/distributed
gangliao Sep 13, 2019
4e850c4
change name
gangliao Sep 13, 2019
868e9cd
Delete getName.java
gangliao Sep 13, 2019
143814d
get dependencies back
gangliao Sep 13, 2019
2e97b5d
ignore bench for now
gangliao Sep 15, 2019
f0b0b11
Merge pull request #172 from DSL-UMD/distributed
gangliao Sep 15, 2019
9f5dfbf
fix nullpointer
gangliao Sep 18, 2019
5842b08
Merge pull request #173 from DSL-UMD/distributed
gangliao Sep 18, 2019
a9e60a0
delay buffer logging
gangliao Sep 18, 2019
f9cd135
Merge pull request #174 from DSL-UMD/distributed
gangliao Sep 18, 2019
ad608bb
Add OBJECT_CACHE_SIZE env
gangliao Sep 18, 2019
b79409e
Merge pull request #175 from DSL-UMD/distributed
gangliao Sep 18, 2019
e340069
add bench script
gangliao Sep 18, 2019
2503c3f
Merge pull request #176 from DSL-UMD/distributed
gangliao Sep 18, 2019
57e2056
Optimize delete op
gangliao Sep 18, 2019
ca43aab
Merge pull request #177 from DSL-UMD/distributed
gangliao Sep 18, 2019
9b8f476
Optimize delete recursively
gangliao Sep 21, 2019
64084bd
ignore bench result for now
gangliao Sep 21, 2019
dce051d
Merge pull request #178 from DSL-UMD/distributed
gangliao Sep 21, 2019
a708b6a
revert back to avoid sync delete
gangliao Sep 21, 2019
a747d96
Merge pull request #179 from DSL-UMD/distributed
gangliao Sep 21, 2019
3fb374a
Optimize Cache Miss
gangliao Sep 22, 2019
e990cb6
Merge pull request #180 from DSL-UMD/distributed
gangliao Sep 22, 2019
a5f800c
fix compile error
gangliao Sep 23, 2019
f698975
Merge pull request #181 from DSL-UMD/distributed
gangliao Sep 23, 2019
17754fc
[FIX] symbol: variable DFSUtil
gangliao Sep 23, 2019
a01c4ef
Merge pull request #182 from DSL-UMD/distributed
gangliao Sep 23, 2019
efd6017
[FIX] root dir
gangliao Sep 23, 2019
514bc25
Merge pull request #183 from DSL-UMD/distributed
gangliao Sep 23, 2019
fd6d2de
typo
gangliao Sep 23, 2019
3e7261b
Merge pull request #184 from DSL-UMD/distributed
gangliao Sep 23, 2019
94a13d6
typo
gangliao Sep 23, 2019
ddf7b35
Merge pull request #185 from DSL-UMD/distributed
gangliao Sep 23, 2019
96756c2
[FIX] An edge case
gangliao Sep 23, 2019
57c272b
Merge pull request #186 from DSL-UMD/distributed
gangliao Sep 23, 2019
3611f92
[FIX] reloading from db to cache
gangliao Sep 23, 2019
83eb471
Merge pull request #187 from DSL-UMD/distributed
gangliao Sep 23, 2019
1ec5cd4
async update inode
gangliao Sep 23, 2019
8ad41d7
Merge pull request #188 from DSL-UMD/distributed
gangliao Sep 23, 2019
5960cfd
[ENH] Avoid cache flooding when do open benchmark
gangliao Sep 24, 2019
50b39c5
Merge pull request #189 from DSL-UMD/distributed
gangliao Sep 24, 2019
e2db39d
[FIX] load entries failed if Node doesn't exist
gangliao Sep 25, 2019
2c515ea
Merge pull request #190 from DSL-UMD/distributed
gangliao Sep 25, 2019
017130e
[FIX] creatingParentsIfNeeded isn't in VoltDB's ZK
gangliao Sep 25, 2019
739cba3
Merge pull request #191 from DSL-UMD/distributed
gangliao Sep 25, 2019
76e1943
[ENH] refine mount table output
gangliao Sep 25, 2019
14271c1
Merge pull request #193 from DSL-UMD/distributed
gangliao Sep 25, 2019
65bccb4
[ENH] refine mount's output
gangliao Sep 25, 2019
0247ff1
Merge pull request #194 from DSL-UMD/distributed
gangliao Sep 25, 2019
5eb670a
[ENH] add batch sync buffer to db and set 5s timer
gangliao Sep 26, 2019
bc65a55
[ENH] use scheduleWithFixedDelay
gangliao Sep 26, 2019
07106d3
[ENH] add final
gangliao Sep 26, 2019
b866bf6
Merge pull request #196 from DSL-UMD/distributed
gangliao Sep 26, 2019
91160e2
add env variable: UPDATE_DB_TIME_DELAY
gangliao Sep 26, 2019
288d38d
Merge pull request #197 from DSL-UMD/distributed
gangliao Sep 26, 2019
03d5119
change time scheduler to MILLISECONDS
gangliao Sep 26, 2019
dc747d8
Merge pull request #198 from DSL-UMD/distributed
gangliao Sep 26, 2019
5fe2925
change to MICROSECONDS
gangliao Sep 26, 2019
3a49c18
Merge pull request #199 from DSL-UMD/distributed
gangliao Sep 26, 2019
371dcb9
[FIX] typo
gangliao Sep 27, 2019
9e35c19
Merge pull request #200 from DSL-UMD/distributed
gangliao Sep 27, 2019
37c61fa
[FIX] async update is too fast, switch to sync call
gangliao Sep 27, 2019
2093508
Merge pull request #201 from DSL-UMD/distributed
gangliao Sep 27, 2019
13cf25f
[ENH] VoltDB Synchronous Command Logging
gangliao Sep 27, 2019
47e96f6
Merge pull request #202 from DSL-UMD/distributed
gangliao Sep 27, 2019
4a0c233
[FIX] test sync command logging in VoltDB
gangliao Sep 28, 2019
9d0d181
Merge pull request #203 from DSL-UMD/distributed
gangliao Sep 28, 2019
4da8cd9
[FIX] awaitility schedule conflicts
gangliao Sep 28, 2019
92f5eb7
update
gangliao Sep 28, 2019
1129490
Merge pull request #204 from DSL-UMD/distributed
gangliao Sep 28, 2019
60289a1
[FIX] clean await import
gangliao Sep 28, 2019
d59d1fa
Merge pull request #205 from DSL-UMD/distributed
gangliao Sep 28, 2019
92ec393
Update test.sh
gangliao Sep 30, 2019
2690db4
Update test.sh
gangliao Sep 30, 2019
3f66bf2
Update test.sh
gangliao Sep 30, 2019
e8ff189
[ENH] AWS EC2 instance need to specify VoltDB's IP
gangliao Sep 30, 2019
7bc554d
Merge pull request #206 from DSL-UMD/distributed
gangliao Sep 30, 2019
4ef8f76
Delete Update
gangliao Oct 1, 2019
3203677
[ENH] add BatchRemoveINodes
gangliao Oct 1, 2019
29b12e6
[ENH] Partitioning Tables
gangliao Oct 1, 2019
77d5af4
Merge pull request #207 from DSL-UMD/distributed
gangliao Oct 1, 2019
8e884c8
Update Readme.md
gangliao Oct 1, 2019
3b22d9a
[FIX] Partition column is not nullable.
gangliao Oct 1, 2019
9f0a3b5
Merge pull request #208 from DSL-UMD/distributed
gangliao Oct 1, 2019
f60c1f2
[FIX] The PRIMARY KEY on the partitioned table INODES does not includ…
gangliao Oct 1, 2019
92797bc
Merge pull request #209 from DSL-UMD/distributed
gangliao Oct 1, 2019
0c387a7
[ENH] multiple-partition constraint
gangliao Oct 1, 2019
74771cf
Merge pull request #210 from DSL-UMD/distributed
gangliao Oct 1, 2019
560513e
update
gangliao Oct 1, 2019
e279dcd
Merge pull request #211 from DSL-UMD/distributed
gangliao Oct 1, 2019
58c54df
update
gangliao Oct 1, 2019
fbdc9af
Merge pull request #212 from DSL-UMD/distributed
gangliao Oct 1, 2019
841af8d
update
gangliao Oct 1, 2019
e260548
Merge pull request #213 from DSL-UMD/distributed
gangliao Oct 1, 2019
4559e32
[FIX] java.lang.NullPointerException
gangliao Oct 1, 2019
8ad6c07
Merge pull request #214 from DSL-UMD/distributed
gangliao Oct 1, 2019
7d7d936
update
gangliao Oct 1, 2019
5dd7505
Merge pull request #215 from DSL-UMD/distributed
gangliao Oct 1, 2019
34bee15
[ENH] Sync delete
gangliao Oct 1, 2019
c03a4f2
Merge pull request #216 from DSL-UMD/distributed
gangliao Oct 1, 2019
a0dbf1a
[FIX] remove itself
gangliao Oct 1, 2019
a3f128e
Merge pull request #217 from DSL-UMD/distributed
gangliao Oct 1, 2019
de2f595
[FIX] typo
gangliao Oct 1, 2019
d3a405e
Merge pull request #218 from DSL-UMD/distributed
gangliao Oct 1, 2019
da91aad
[FIX] volt stored procedure param error
gangliao Oct 1, 2019
e81d089
Merge pull request #219 from DSL-UMD/distributed
gangliao Oct 1, 2019
480860f
[AWS] support the public/private ip
gangliao Oct 1, 2019
ea267fd
Merge pull request #220 from DSL-UMD/distributed
gangliao Oct 1, 2019
f60363e
[ENH] for multi namenode test
gangliao Oct 8, 2019
9d8d345
Merge pull request #222 from DSL-UMD/distributed
gangliao Oct 8, 2019
2dd81df
simplify multinamenodes open ops
gangliao Oct 8, 2019
08d6266
Merge pull request #223 from DSL-UMD/distributed
gangliao Oct 8, 2019
4679029
update
gangliao Oct 8, 2019
530a4a2
Merge pull request #224 from DSL-UMD/distributed
gangliao Oct 8, 2019
3f77162
more easier to test delete
gangliao Oct 9, 2019
0a7ca69
Merge pull request #225 from DSL-UMD/distributed
gangliao Oct 9, 2019
a83a3ec
NN_BECHMARK route
gangliao Oct 10, 2019
bca7ed3
Merge pull request #226 from DSL-UMD/distributed
gangliao Oct 10, 2019
a9bdd8b
typo
gangliao Oct 10, 2019
1bf2412
Merge pull request #227 from DSL-UMD/distributed
gangliao Oct 10, 2019
e50ad32
mount table resolve is not a bottleneck
gangliao Oct 10, 2019
aa9136c
Merge pull request #228 from DSL-UMD/distributed
gangliao Oct 10, 2019
441565f
Optimize remove child
gangliao Oct 11, 2019
503571d
Merge pull request #229 from DSL-UMD/distributed
gangliao Oct 11, 2019
1d43488
update batch remove
gangliao Oct 11, 2019
35db17a
Merge pull request #230 from DSL-UMD/distributed
gangliao Oct 11, 2019
e6cb7a6
add some bench scripts
gangliao Jan 15, 2020
7b7917d
Merge pull request #237 from DSLAM-UMD/distributed
gangliao Jan 15, 2020
68816fd
change editlog format in memory
gangliao Jan 31, 2020
eccd988
add log for create files
gangliao Jan 31, 2020
39bef97
add logs to syncDB
gangliao Feb 1, 2020
1ba0d87
support both async and sync logging
gangliao Feb 1, 2020
10a8920
fix: compilation error
gangliao Feb 2, 2020
1b8bdde
fix: import more package
gangliao Feb 2, 2020
357253a
fix: setInodeId for different op
gangliao Feb 2, 2020
ddca5d2
typo
gangliao Feb 2, 2020
987727e
voltdb sync and asyn log
gangliao Feb 3, 2020
881e1d1
fix: possible lossy conversion from long to int
gangliao Feb 3, 2020
67fccf3
fix: parse log error
gangliao Feb 3, 2020
ff58082
feat: add mkdirOp logs
gangliao Feb 4, 2020
2ca7048
Merge pull request #240 from DSLAM-UMD/synclog
gangliao Feb 4, 2020
9ec79fb
fix: api argument changes
gangliao Feb 4, 2020
ea7a8ee
Merge pull request #242 from DSLAM-UMD/synclog
gangliao Feb 4, 2020
0f8e0f9
fix: mkdirop logs
gangliao Feb 4, 2020
bf5d469
fix: typo
gangliao Feb 4, 2020
5c41b5a
fix: write inodeid
gangliao Feb 4, 2020
057dc50
Merge pull request #243 from DSLAM-UMD/synclog
gangliao Feb 4, 2020
320e34b
fix: log root dir
gangliao Feb 4, 2020
091f7ca
fix: editLog initializes after createRoot()
gangliao Feb 4, 2020
d6af300
Merge pull request #244 from DSLAM-UMD/synclog
gangliao Feb 4, 2020
218e1bd
fix: variable results is already defined
gangliao Feb 5, 2020
a4b74c9
Feat: separate medata flush ans logging
gangliao Feb 10, 2020
aec052c
fix: comments
gangliao Feb 10, 2020
55bae70
Merge pull request #245 from DSLAM-UMD/synclog
gangliao Feb 10, 2020
880b2df
add root's parent in cache
gangliao Feb 11, 2020
777ca8c
fix: recursive op
gangliao Feb 11, 2020
205dc72
Merge pull request #247 from DSLAM-UMD/synclog
gangliao Feb 11, 2020
e2518d2
feat: add namenode uuid to update remove op
gangliao Feb 20, 2020
3cd3cee
fix: optimize getId() in NameNode
gangliao Feb 20, 2020
832717e
feat: add local sync log
gangliao Feb 20, 2020
9264875
feat: serialize inode to stream for RPC remote log
gangliao Feb 20, 2020
dd4c6ef
feat: add editlog rpc interface
gangliao Feb 20, 2020
d4beca7
feat: remote editlog rpc impl
gangliao Feb 21, 2020
281f44e
feat: get mount point from zookeeper
gangliao Feb 21, 2020
6cedd34
fix compilation error
gangliao Feb 22, 2020
f0cd614
fix: add dependency hadoop-hdfs-nnproxy to hdfs
gangliao Feb 22, 2020
8da361a
move nnproxy into hdfs-project to avoid cycle depdency
gangliao Feb 22, 2020
a2a8bd1
fix: rename bench
gangliao Feb 23, 2020
3719c02
fix: setId()
gangliao Feb 23, 2020
0619a56
fix: dst name
gangliao Feb 23, 2020
b61fed4
Merge branch 'synclog' of https://github.com/DSLAM-UMD/FileScale into…
gangliao Feb 23, 2020
d193d05
fix: ignore path (null)
gangliao Feb 23, 2020
18c0afe
fix: disable checkArgument in logOpenFile
gangliao Feb 23, 2020
479732e
fix: setClient Name and Machine only if uc is active
gangliao Feb 23, 2020
0fc61e8
fix: add conditions
gangliao Feb 23, 2020
2d72b7f
fix: avoid log null attribute
gangliao Feb 23, 2020
6433da7
fix: set hashcode value to positive
gangliao Feb 23, 2020
24598bd
Merge pull request #248 from DSLAM-UMD/synclog
gangliao Feb 23, 2020
0d13790
opt: optimize local and remote logging for rename operations
gangliao Feb 23, 2020
a0312fc
fix typo
gangliao Feb 23, 2020
a7f4bf5
Merge pull request #250 from DSLAM-UMD/synclog
gangliao Feb 23, 2020
7606a24
add hopsfs create
gangliao Mar 13, 2020
5a449f9
Merge pull request #252 from DSLAM-UMD/synclog
gangliao Mar 13, 2020
4ef238b
add hopsfs scripts
gangliao Mar 15, 2020
6823c6a
Merge pull request #253 from DSLAM-UMD/synclog
gangliao Mar 15, 2020
60ffb10
enable logging other types of ops.
gangliao Mar 21, 2020
59249c6
Merge pull request #254 from DSLAM-UMD/synclog
gangliao Mar 21, 2020
79fc77d
enable other ops log
gangliao Mar 22, 2020
f56fc3a
fix: miss xAttrs variables
gangliao Mar 22, 2020
a99215c
Merge pull request #255 from DSLAM-UMD/synclog
gangliao Mar 22, 2020
ba046d9
resolving path optimization: cuckoo filter in inode directory (#259)
gangliao May 28, 2020
4e3cf59
fix: add guava version (#261)
gangliao May 29, 2020
2a3fb3b
FIX: reload inode and its fake filter
gangliao Jun 1, 2020
c99eff4
bench: intra- and inter-data center rename ops
gangliao Jun 8, 2020
479edd7
Update Readme.md
gangliao Jun 9, 2020
b4fb8be
Update Readme.md
gangliao Jun 9, 2020
4d559f2
bench: intra- and inter-data center rename ops (#263)
gangliao Jun 9, 2020
e573546
Merge branch 'calvin' of https://github.com/DSL-UMD/hadoop into calvin
gangliao Jun 10, 2020
edc6b4b
update the rest of inodes to db
gangliao Jun 10, 2020
35abec1
optimize mount manager
gangliao Jun 10, 2020
32b0b01
optimize mount manager (#266)
gangliao Jun 10, 2020
bed83a6
Merge branch 'calvin' of https://github.com/DSL-UMD/hadoop into calvin
gangliao Jun 10, 2020
e4dd3f9
fix: remote renmae logging failure (#267) (#268)
gangliao Jun 10, 2020
5a3b1b0
remote rename failure: NullPointerException (#269) (#270)
gangliao Jun 10, 2020
bca16ef
fix typo
gangliao Jun 11, 2020
3b47186
Merge branch 'calvin' of https://github.com/DSL-UMD/hadoop into calvin
gangliao Jun 11, 2020
8365790
fix: NoSuchMethodError: org.apache.hadoop.hdfs.db.DatabaseINode.setPa…
gangliao Jun 11, 2020
f921c61
CONSTRAINT VIOLATION: update to a partitioning column (#272)
gangliao Jun 11, 2020
c99c69b
fix: SetParents failures (#273)
gangliao Jun 11, 2020
3d19979
fix: remote rename files (#274)
gangliao Jun 11, 2020
d29a077
feat: scale-out namenodes for nnbench (#276)
gangliao Jun 15, 2020
d7b1185
fix: install mount table before starting its manager
gangliao Jun 16, 2020
3d7d31a
feat: distinct filenames from different clients
gangliao Jun 16, 2020
ed137d4
feat: distinct filenames from different clients (#278)
gangliao Jun 17, 2020
f57d335
feat: distinct filenames from different clients (#279)
gangliao Jul 15, 2020
af69c7c
fix conflict
gangliao Jul 15, 2020
536844d
feat: optimize rename operation among namenodes (sharing data nodes) …
gangliao Jul 16, 2020
46d9a2e
Update Readme.md
gangliao Jul 24, 2020
1943fa8
feat: single-key cache (#281)
gangliao Aug 10, 2020
256dea1
fix: change filter's false positive rate to 0.001
gangliao Aug 14, 2020
7a59415
feat: pre-allocate filters for directory (#283)
gangliao Aug 16, 2020
55f1f48
fix: optimize local rename op (#282)
gangliao Aug 16, 2020
96548b4
fix typo (#284)
gangliao Aug 16, 2020
39d24b7
fix: typo
gangliao Aug 16, 2020
eafce3b
Merge branch 'calvin' of https://github.com/DSLAM-UMD/FileScale into …
gangliao Aug 16, 2020
b000c81
fix: remove unnecessary uc
gangliao Aug 19, 2020
a6ea37c
fix: revert iip optimization
gangliao Aug 21, 2020
8ca20e3
opt: remove local rename logs
gangliao Aug 21, 2020
c5e5ce3
feat: remove filter (#285)
gangliao Aug 26, 2020
8c624dd
feat: repartition mount table with consistency
gangliao Sep 2, 2020
ccd0dc9
fix: update moveCache only when repartition happen
gangliao Sep 2, 2020
1c2e665
feat: support mount table repartition (with consistency)
gangliao Sep 3, 2020
1405ea8
feat: support mount table repartition (with consistency) (#288)
gangliao Sep 3, 2020
72460e4
fix: if else
gangliao Sep 3, 2020
4425c57
Merge branch 'calvin' of https://github.com/DSL-UMD/hadoop into calvin
gangliao Sep 3, 2020
bde1b17
build(deps-dev): bump junit from 4.12 to 4.13.1 in /hadoop-project
dependabot[bot] Oct 13, 2020
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Prev Previous commit
Next Next commit
Update test.sh
  • Loading branch information
gangliao authored Sep 30, 2019
commit 2690db40e5f3c36cbd5124333a98a2b00ec1c54d
2 changes: 1 addition & 1 deletion test.sh
Original file line number Diff line number Diff line change
@@ -16,5 +16,5 @@ rm -rf ~/hadoop/data/*
rm -rf ~/hadoop/name/*
rm -rf ~/hadoop/tmp/*
rm -rf logs/*
./bin/hdfs namenode -format
./bin/hdfs namenode -format -force
./sbin/start-dfs.sh