Goliath was a Philistine, not a Greek. Philistines were Semitic peoples and, at the time of the original story, probably would have followed the Canaanite religion that Yahweh was still a pantheon member of.

Bonus Fun Fact: Philistine is the etymological origin of Palestine.