[Processor] Simplify some logic to reduce unnecessary duplicated work.

[Processor] Simplify some logic to reduce unnecessary duplicated work. #3053