Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

YARN-8234. Improve RM system metrics publisher's performance by pushi… #3793

Merged
merged 34 commits into from
Dec 23, 2021
Merged
Changes from 1 commit
Commits
Show all changes
34 commits
Select commit Hold shift + click to select a range
27643d5
YARN-8234. Improve RM system metrics publisher's performance by pushi…
ashutoshcipher Dec 13, 2021
ab2553d
HADOOP-18040. Use maven.test.failure.ignore instead of ignoreTestFail…
aajisaka Dec 9, 2021
056450e
YARN-10982. Replace all occurences of queuePath with the new QueuePat…
szilard-nemeth Dec 9, 2021
6d6da57
HADOOP-17982. OpensslCipher initialization error should log a WARN me…
jojochuang Dec 10, 2021
b60de17
YARN-11033. isAbsoluteResource is not correct for dynamically created…
szilard-nemeth Dec 10, 2021
f5d7192
HADOOP-18042. Fix jetty version in LICENSE-binary (#3783)
luoyuan3471 Dec 13, 2021
08041e4
HADOOP-18039. Upgrade hbase2 version and fix TestTimelineWriterHBaseD…
virajjasani Dec 13, 2021
b86083b
HADOOP-18043. Use mina-core 2.0.22 to fix LDAP unit test failures (#3…
aajisaka Dec 13, 2021
5084d03
YARN-11024. Create an AbstractLeafQueue to store the common LeafQueue…
szilard-nemeth Dec 13, 2021
290a685
YARN-10907. Minimize usages of AbstractCSQueue#csContext. Contributed…
szilard-nemeth Dec 13, 2021
6832024
HDFS-16327. Make DFS_NAMENODE_MAX_SLOWPEER_COLLECT_NODES_KEY reconfig…
tomscut Dec 14, 2021
69eb1f4
HDFS-16373. Fix MiniDFSCluster restart in case of multiple namenodes.…
ayushtkn Dec 14, 2021
e26c044
HDFS-16014: Fix an issue in checking native pmdk lib by 'hadoop check…
PHILO-HE Dec 14, 2021
acb9f40
YARN-10929. Do not use a separate config in legacy CS AQC. Contribute…
szilard-nemeth Dec 14, 2021
b504bec
Clean up checkstyle warnings from YARN-11024/10907/10929. Contributed…
szilard-nemeth Dec 14, 2021
84da38b
HDFS-16378. Add datanode address to BlockReportLeaseManager logs (#37…
tomscut Dec 15, 2021
2d1142a
YARN-11045. ATSv2 storage monitor fails to read from hbase cluster (#…
virajjasani Dec 15, 2021
8a1e4cf
YARN-11044. Fix TestApplicationLimits.testLimitsComputation() ineffec…
szilard-nemeth Dec 15, 2021
2d2345a
HDFS-16375. The FBR lease ID should be exposed to the log (#3769)
tomscut Dec 16, 2021
19e0c0c
HDFS-16384. Upgrade Netty to 4.1.72.Final (#3798)
tamaashu Dec 16, 2021
b107c21
HDFS-16377. Should CheckNotNull before access FsDatasetSpi (#3784)
tomscut Dec 16, 2021
4ecd77a
Revert "HDFS-16384. Upgrade Netty to 4.1.72.Final (#3798)"
jojochuang Dec 16, 2021
ec06898
YARN-11048. Add tests that shows how to delete config values with Mut…
szilard-nemeth Dec 16, 2021
9d7c3c4
YARN-10963. Split TestCapacityScheduler by test categories. Contribut…
szilard-nemeth Dec 16, 2021
4d54a0e
YARN-10951. CapacityScheduler: Move all fields and initializer code t…
szilard-nemeth Dec 16, 2021
a8635b8
YARN-10427. Duplicate Job IDs in SLS output (#3809). Contributed by S…
szilard-nemeth Dec 16, 2021
057297b
HDFS-16352. return the real datanode numBlocks in #getDatanodeStorage…
liubingxing Dec 17, 2021
cd37788
HADOOP-13500. Synchronizing iteration of Configuration properties obj…
dbadaya1 Dec 17, 2021
8c306b5
YARN-11050 (#3805)
szilard-nemeth Dec 18, 2021
1a16522
HADOOP-16908. Prune Jackson 1 from the codebase and restrict it's usa…
virajjasani Dec 20, 2021
ebd3bcb
YARN-11047. ResourceManager and NodeManager unable to connect to Hbas…
virajjasani Dec 20, 2021
b4c7e1b
HDFS-16168. Fix TestHDFSFileSystemContract.testAppend timeout (#3815)
secfree Dec 20, 2021
6a0de4f
HDFS-16386. Reduce DataNode load when FsDatasetAsyncDiskService is wo…
jianghuazhu Dec 20, 2021
c7ba4e4
Merge branch 'apache:trunk' into YARN-8234
ashutoshcipher Dec 22, 2021
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Prev Previous commit
Next Next commit
YARN-10427. Duplicate Job IDs in SLS output (#3809). Contributed by S…
…zilard Nemeth
szilard-nemeth authored and ashutoshcipher committed Dec 22, 2021
commit a8635b87540854def598f7c1d9ab7400dc499f49
Original file line number Diff line number Diff line change
@@ -75,6 +75,7 @@
@Private
@Unstable
public abstract class AMSimulator extends TaskRunner.Task {
private static final long FINISH_TIME_NOT_INITIALIZED = Long.MIN_VALUE;
// resource manager
protected ResourceManager rm;
// main
@@ -102,7 +103,7 @@ public abstract class AMSimulator extends TaskRunner.Task {
protected long traceStartTimeMS;
protected long traceFinishTimeMS;
protected long simulateStartTimeMS;
protected long simulateFinishTimeMS;
protected long simulateFinishTimeMS = FINISH_TIME_NOT_INITIALIZED;
// whether tracked in Metrics
protected boolean isTracked;
// progress
@@ -226,6 +227,16 @@ public void middleStep() throws Exception {

@Override
public void lastStep() throws Exception {
if (simulateFinishTimeMS != FINISH_TIME_NOT_INITIALIZED) {
// The finish time is already recorded.
// Different value from zero means lastStep was called before.
// We want to prevent lastStep to be called more than once.
// See YARN-10427 for more details.
LOG.warn("Method AMSimulator#lastStep was already called. " +
"Skipping execution of method for application: {}", appId);
return;
}

LOG.info("Application {} is shutting down.", appId);
// unregister tracking
if (isTracked) {