Hello, when running the train. x program, there will be an error: invalid function type in ` change_activation': swish

[guchen147]

The compiler used is: mpi/openmpi/4.1.1-gcc7.3.0
The compilation method is:
cd lib
make
cd ../src
make -f makefiles/Makefile.gfortran_mpi
Generate train. x program
The software version is 2.0.4
My in file is as follows

Error screenshot:

[alexurba]

As the error message implies, swish is not a valid activation function in ænet. It is not implemented. However, I believe there is support for the very similar GELU function (https://arxiv.org/abs/1606.08415).

[guchen147]

Okay, thank you. I'll give it a try