To stop using the word "free" now would be a mistake; we need more, not less, talk about freedom.
If those using the term "open source" draw more users into our community, that is a contribution, but the rest of us will have to work even harder to bring the issue of freedom to those users' attention. We have to say, "It's free software and it gives you freedom!"