Interestingly enough, the Puritans did in fact build their "city on a hill."  It was in the area now known as Boston, Mass.  The Puritans fled England to avoid persecution from the state run Anglican Church. The Puritans likened themselves to the Jews fleeing Egypt with Moses. 

The Puritans required that you have to be a white male member of their church (Freemen) before you could vote or hold office.  They were known to disagree vehemently with the Quakers and hung Quaker Mary Dyer who had been banned from the city several times for proselytizing. They also banned the celebration of Christmas in Boston from 1659 to 1681.