This document presents a novel fuzzy rule-based system to assess groundwater potability in South India. Groundwater samples were collected from 24 districts in Karnataka and analyzed for 8 water quality parameters. A fuzzy logic approach was used to convert parameter concentrations into fuzzy membership values. Analytic hierarchy process was applied to assign weights to parameters. Rules were generated to classify water samples into one of four potability categories. The system found that 51.78% of samples from the 24 districts were not suitable for consumption based on their salt contents. A knowledge base and inference engine were developed as the main components of the fuzzy rule-based system.