Profile timing for minibatch federated learning

[RomainGoussault]

Increasing the number of minibatch seems to increase the time to do a federated run.
This might be due to the process of:

• creating the model
• setting the weights
• compiling the model

[RomainGoussault]

This can help: https://blog.tensorflow.org/2020/04/introducing-new-tensorflow-profiler.html?m=1

[RomainGoussault]

_make_train_function should be investigated

[bowni]

@RomainGoussault do you think it would be interesting to profile again as you did above?

[RomainGoussault]

Yes it would be interesting to use the tensorflow profiler : https://blog.tensorflow.org/2020/04/introducing-new-tensorflow-profiler.html?m=1