Hey. Yes of course you can, but you'll have to recalculate the backward pass, and it's going to be more complicated. What if you want to change activation ? You'll have to do this over again. The advantage of separating layers like this is that the code becomes very modular and split in shorter pieces :)