Not freezing the pretrained layers will destroy the information they contain during future training rounds.
The result of not freezing the pretrained layers will be to destroy the information they contain during future training rounds.
seeSee this guidTransfer learning and fine-tuning guide from tensorflowTensorFlow.