Here are the steps to resolve the network issue:
1. Create a new internal network (e.g. 192.168.0.0/24)
2. Create a new router
3. Add the PublicNetwork as the gateway for the router
4. Add the internal network as an interface to the router
This will allow instances on the internal network to get floating IPs from the PublicNetwork via the router. The original error indicates direct access to the external network is forbidden, so routing traffic through an internal network and router is required.