How to managing software (versions) on nodes in a cluster?

pvd

Hello Linux Experts,
We run a small Debian Linux cluster with slurm.
We mount, from the head node, the user home dir with software to the work nodes for calculations, this works all fine.
Now we want to go to the next level, the use of environment-modules. I have read into it and it is in big lines clear how modules work.

It is logic to me to NOT install all the calculation software (samtools, anaconda, etc) with different versions on all the nodes. So, install the needed software on the head node and mount that drive to the working nodes and tell with modules where the software is.

Question:
How do I install and maintain Debian packages and libraries in for example /opt/usr/local/ on the head node and mount that to the work nodes?