I', looking to write a custom distribution strategy for tensorflow.
Currently there are several types strategies available (MirroredStrategy, TPUStrategy, ...), but i would like to implement a new way of distributing training across several machines.
I looked through the documentation and didn't find any tutorial or guide on how to implement a custom strategy
Is there already a predefined way to do this?