In a home network with multiple devices, each device should be assigned its own IP address to avoid troubleshooting issues and prevent address conflicts. The process for assigning an IP address on a Windows computer involves opening the network connection properties, selecting Internet Protocol Version 4, and entering the IP address, subnet mask, default gateway, and DNS server addresses. This allows each device on the network to be uniquely identified and managed.