To configure an SA-MP server, edit the values in the server.cfg file such as the hostname, port, max players, and game mode settings. The file specifies options like enabling LAN mode, announcing the server, and setting the rcon password. Properly configuring these values is necessary to launch the samp-server process and have an operational multiplayer server.