zlacker

It is called fine-tuning or transfer learning, and you usually train the last layer.

Here is an example for keras (a popular ML framework). https://keras.io/guides/transfer_learning/