Using both gradient clipping and learning rate warmup, should gradients be clipped during the warmup, or only once the warmup phase has completed?

Question

I'm training a network using both learning rate warmup and an adaptive gradient clipping method outlined here. Is there a general consensus or anything in the literature relating to whether gradients should be clipped during the warmup phase or only after the warmup phase has completed.