Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

sync #12

Merged
merged 37 commits into from
Feb 9, 2022
Merged

sync #12

merged 37 commits into from
Feb 9, 2022

Conversation

GuoPhilipse
Copy link
Owner

sync

liubingxing and others added 30 commits January 19, 2022 17:59
@liubingxing
HDFS-16423. Balancer should not get blocks on stale storages (#3883)
db2c320 
Reviewed-by: litao <[email protected]>
Signed-off-by: Takanobu Asanuma <[email protected]>
@anmolanmol1234
HADOOP-18084. ABFS: Add testfilePath while verifying test contents ar…
7c97c0f 
…e read correctly (#3903)


Contributed by: Anmol Asrani
@dependabot
YARN-11065. Bump follow-redirects from 1.13.3 to 1.14.7 in hadoop-yar…
dae33cf 
…n-ui (#3890)

Bumps [follow-redirects](https://github.com/follow-redirects/follow-redirects) from 1.13.3 to 1.14.7.
- [Release notes](https://github.com/follow-redirects/follow-redirects/releases)
- [Commits](follow-redirects/follow-redirects@v1.13.3...v1.14.7)

---
updated-dependencies:
- dependency-name: follow-redirects
  dependency-type: indirect
...

Signed-off-by: dependabot[bot] <[email protected]>

Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Signed-off-by: Akira Ajisaka <[email protected]>
@tomscut
HDFS-16402. Improve HeartbeatManager logic to avoid incorrect stats. (#…
15b820c 
…3839). Contributed by tomscut.

Reviewed-by: He Xiaoqiao <[email protected]>
@cndaimin
HDFS-16430. Add validation to maximum blocks in EC group when adding …
5ef335d 
…an EC policy (#3899). Contributed by daimin.

Reviewed-by: tomscut <[email protected]>
Signed-off-by: Ayush Saxena <[email protected]>
@zhongjun2 @aajisaka
HADOOP-17593. hadoop-huaweicloud and hadoop-cloud-storage to remove l…
795a5ef 
…og4j as transitive dependency

Signed-off-by: Akira Ajisaka <[email protected]>
@steveloughran
HADOOP-18094. Disable S3A auditing by default.
b795f6f 
See HADOOP-18091. S3A auditing leaks memory through ThreadLocal references

* Adds a new option fs.s3a.audit.enabled to controls whether or not auditing
is enabled. This is false by default.

* When false, the S3A auditing manager is NoopAuditManagerS3A,
which was formerly only used for unit tests and
during filsystem initialization.

* When true, ActiveAuditManagerS3A is used for managing auditing,
allowing auditing events to be reported.

* updates documentation and tests.

This patch does not fix the underlying leak. When auditing is enabled,
long-lived threads will retain references to the audit managers
of S3A filesystem instances which have already been closed.

Contributed by Steve Loughran.
@afchung
YARN-11015. Decouple queue capacity with ability to run OPPORTUNISTIC…
3ed3c74 
… container (#3779)
@cndaimin
HDFS-16403. Improve FUSE IO performance by supporting FUSE parameter …
d699389 
…max_background (#3842)

Reviewed-by: Istvan Fajth <[email protected]>
Reviewed-by: Wei-Chiu Chuang <[email protected]>
@ThinkerLei
HDFS-16428. Source path with storagePolicy cause wrong typeConsumed w…
43153e8 
…hile rename (#3898). Contributed by lei w.

Signed-off-by: Ayush Saxena <[email protected]>
Signed-off-by: He Xiaoqiao <[email protected]>
@bbeaudreault
HDFS-16262. Async refresh of cached locations in DFSInputStream (#3527)
94b884a
@jianghuazhu
HDFS-16401.Remove the worthless DatasetVolumeChecker#numAsyncDatasetC…
8c7c49d 
…hecks. (#3838)
@xinglin
HADOOP-18093. Better exception handling for testFileStatusOnMountLink…
0d17b62 
…() in ViewFsBaseTest.java (#3918). Contributed by Xing Lin.

Signed-off-by: Ayush Saxena <[email protected]>
@minni31
YARN-11034. Add enhanced headroom in AllocateResponse (#3766)
4b26635
@virajjasani
HADOOP-18089. Test coverage for Async profiler servlets (#3913)
4faac58 
Reviewed-by: Akira Ajisaka <[email protected]>
Reviewed-by: Wei-Chiu Chuang <[email protected]>
@tomscut
HDFS-16398. Reconfig block report parameters for datanode (#3831)
c2ff390
@tomscut
HDFS-16427. Add debug log for BlockManager#chooseExcessRedundancyStri…
6136d63 
…ped (#3888)
@MingXiangLi
HDFS-16429. Add DataSetLockManager to manage fine-grain locks for FsD…
e17c96a 
…ataSetImpl. (#3900). Contributed by limingxiang.

Signed-off-by: He Xiaoqiao <[email protected]>
@jojochuang
YARN-11068. Exclude transitive log4j2 dependency coming from solr 8. (#…
1c01944 
…3936)

Signed-off-by: Akira Ajisaka <[email protected]>
@aajisaka
Revert "YARN-11068. Exclude transitive log4j2 dependency coming from …
02f6bad 
…solr 8. (#3936)"

This reverts commit 1c01944.
@aajisaka
YARN-10561. Upgrade node.js to 12.22.1 and yarn to 1.22.5 in YARN app…
9cb535c 
…lication catalog webapp (#2591)

Reviewed-by: Masatake Iwasaki <[email protected]>
@secfree
HDFS-16169. Fix TestBlockTokenWithDFSStriped#testEnd2End failure (#3850)
39cad5f 
Reviewed-by: Fei Hui <[email protected]>
Reviewed-by: litao <[email protected]>
Signed-off-by: Akira Ajisaka <[email protected]>
@tomscut
HDFS-16444. Show start time of JournalNode on Web (#3943)
bd50b91
@KevinWikant
HDFS-16443. Fix edge case where DatanodeAdminDefaultMonitor doubly en…
089e06d 
…queues a DatanodeDescriptor on exception (#3942)

Signed-off-by: Akira Ajisaka <[email protected]>
@minni31
YARN-11026. Make default AppPlacementAllocator configurable in AppSch… (
e8f767f 
#3741)

* YARN-11026. Make default AppPlacementAllocator configurable in AppSchedulingInfo
Co-authored-by: Minni Mittal <[email protected]>
@ayushtkn
Revert "HADOOP-18024. SocketChannel is not closed when IOException ha…
aeae571 
…ppens in Server$Listener.doAccept (#3719)"

This reverts commit 6ed0158.

Breaks TestIPC#testIOEOnListenerAccept
@minni31
YARN-10822. Containers going from New to Scheduled transition for kil… (
87abc43 
#3632)
@minni31
YARN-10459. containerLaunchedOnNode method not need to hold scheduler… (
ec2fd01 
#3195)
@GauthamBanasandra
HDFS-16445. Make HDFS count, mkdir, rm cross platform (#3945)
ed44662
@tomscut
HDFS-16435. Remove no need TODO comment for ObserverReadProxyProvider (…
b5b07af 
…#3912). Contributed by tomscut.

Reviewed-by: Chao Sun <[email protected]>
Signed-off-by: Ayush Saxena <[email protected]>
aswinshakil and others added 7 commits February 3, 2022 15:50
@aswinshakil
HADOOP-18101. Bump aliyun-sdk-oss to 3.13.2 and jdom2 to 2.0.6.1 (#3951)
41c86b6
@abhishekdas99 @omalley
HADOOP-18100: Change scope of inner classes in InodeTree to make them…
3684c7f 
… accessible outside package

Fixes #3950

Signed-off-by: Owen O'Malley <[email protected]>
@bogthe
HADOOP-18085. S3 SDK Upgrade causes AccessPoint ARN endpoint mistrans…
5e7ce26 
…lation (#3902)


Part of HADOOP-17198. Support S3 Access Points.

HADOOP-18068. "upgrade AWS SDK to 1.12.132" broke the access point endpoint
translation.

Correct endpoints should start with "s3-accesspoint.", after SDK upgrade they start with
"s3.accesspoint-" which messes up tests + region detection by the SDK.

Contributed by Bogdan Stolojan
@singer-bin
HDFS-16437 ReverseXML processor doesn't accept XML files without the … (
125e3b6 
#3926)
@virajjasani
HADOOP-18098. Basic verification for the release candidate vote (#3944)
b39b334
@yulongz
HDFS-16411 RBF: RouterId is NULL when disable RourterRpcServer (#3878)
3e7a7c3
@secfree
HDFS-16406. ReadsFromLocalClient counts short-circuit reads (#3847)
bf0cefb
@GuoPhilipse GuoPhilipse merged commit 99a3513 into GuoPhilipse:trunk Feb 9, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers
No reviews
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.