Why Do some people want Freedom From Religon, When the Frist Amendment says nothing of the sort?

Weren't the first Americans coming here to escape the religion being forced upon the by King George and the Church of England? America: Built on freedom to practice your religion and not having other religions forced upon you.