As a symbol, the goat represents masculinity, abundant vitality, creative energy. In Christianity the goat is a symbol for lust, the sinner.
In astrology, the goat is the symbol of Capricorn.
In the Toth-Tarot, the goat is the XV-card of the major Arcana, i.e. The Devil. The goat in these circumstances is the merry goat, Pan, Lust for Life and Humor.