I think the following sentence:
In other words, it only passes values 0 or greater to the next layer in the network
should be updated as below:
In other words, it only passes values greater than 0 to the next layer in the network
Because the test is:
if x > 0: return x
Thanks for flagging, this has been fixed!