In many tensorflow tutorials (example) "towers" are mentioned without a definition. What is meant by that?
According to tensorflow documentation about CNN,
The first abstraction we require is a function for computing inference and gradients for a single model replica. In the code we term this abstraction a "tower".
To get the relevant context and more, check this.
