If I'm running a Keras model on some Nvidia GPUs which are connected via NVLink, how can I monitor the usage of the NVLink connections?
I want to be sure the NVLink connections are being used and see at what rate.
Data Science Stack Exchange is a question and answer site for Data science professionals, Machine Learning specialists, and those interested in learning more about the field. It only takes a minute to sign up.Sign up to join this community
This command shows various information about nvlink including usage. If nvlink connections are utilized, usage should go up during training.
nvidia-smi nvlink -h
Shows available performance counters on present cards.
"NVLink Usage Counters" section in this tutorial shows how to see if data is being transferred across nvlink.