Brian,
that doesn't seem to work, I even removed the quick search from the homepage, but even not logged in (i.e. a non member) I can just add search.php to the address bar and still search and view profiles. What's wrong with the membership levels?
Did you clear your cache?
I have also found that with one browser - chrome - my changes to membership level do not save correctly so I use safari or firefox for those changes (pain in the butt) but other functions work fine in chrome. I don't know about other people's experiences, but I have found that certain admin functions work better in one browser over another.
Try switching browsers and make sure you clear your cache and see if that does it.
-Brian