While the most widely-used activation functions are predefined, it'd be better to have some sort of registry so that the serde deserialization works with custom activations.
It would also be good to note that there should be a separate flag or something for those activation functions which do not want to be randomly mutated to/fro.
While the most widely-used activation functions are predefined, it'd be better to have some sort of registry so that the
serdedeserialization works with custom activations.It would also be good to note that there should be a separate flag or something for those activation functions which do not want to be randomly mutated to/fro.