Deuteronomy 12.3

3. Overthrow their altars, and break down their statues, burn their groves with fire, and break their idols in pieces: destroy their names out of those places.