Some of them have collision, some don't. Most obvious that comes to mind is the stemmed bush in the desert, running into it brings you to a complete stop and throws you, can't be harvested.
There also seems to be random non-collision rocks (Big ones) I've found. Please go over them for consistency!