My geologist coworker said that agate isn't really a mineral either, mostly because it gets used too broadly and doesn't have one singular chemical composition.
Then again, I'm just an organic chemist, and classifying minerals seems suspiciously like biology to me...