There are certain benefits of writing the complete application in C++ rather than implementing only small part of the algorithm where this is "really needed".
Most important, mixing two languages adds complexity to the project, also using up your time. You need to write and maintain bindings. Your build scripts become more complex. Your debugging ...
There is not any CAP by any Framework Or technology.
This is how components will be impacted -
This will be directly impacted by the total count and size of each image
This is dependent on your layer's depth, batch size, Kernel count and size of the individual image. Please check SE/Internet on "RAM needed during CNN learning"
Theoretically speaking, there is no limit on how many data points you can use to train any neural network. This is true because neural networks that can be trained incrementally and do not need to "see" the entire dataset.
Obviously, it helps if your machine is able to store at least a single image and the network in memory.
To train on a large number of ...