Certain folder names like "CON", "PRN", and "COM1" cannot be created in Windows as they are reserved words from the underlying DOS operating system. However, it is possible to create folders with these names using DOS commands like "mkdir" in the Command Prompt by specifying the full directory path starting with "\\.\". These reserved folder names can then be removed using the "rmdir" command.