I use namecheap for our website's domain - I pay a bit more than most, but it's once of those novelty domains and people comment on it all the time, so it's been worth it
For hosting I use NearlyFreeSpeech. It's kind of unique in that it provides a "pay as you go" scheme - you top it up with some cash and it only charges you for the bandwidth, storage and services that you use. It's been great value in the past, but I feel that as our website is growing and getting more visitors, it might lose its advantages - the costs keep growing with every month. But we'll see.