One browses magazines and the Internet, or one can browse through them. Any dictionary will say as much.
On the same token one can browse through a shop.
However, an N-gram proves that you will more often browse in a shop rather than simply browse a shop. Why is that? Is there a change in meaning? After all, whether it's a magazine, the Internet or a shop, I'm still glancing at stuff (whether reading or looking at images/objects).