I agree the way you’re using it doesn’t sound negative. But I don’t think that’s a representative use of this term. Take a look at the top few entries on urban dictionary, they don’t seem very judgement free to me…
https://www.urbandictionary.com/define.php?term=Normie
The point of this post is that even if you don’t mean it in the way that urban dictionary describes it, that’s how some people will interpret it.
After all, why shouldn’t we ask our bosses if we can go play?