Rude to v/s rude with

Completely out of the blue, a question popped up in my mind "rude with v/s rude to"

I'd go with 'rude to' anyday; however, 'rude with' doesn't seem wrong to me.

You're being rude to me.

Why were you being rude to him v/s why were you being rude with him? To me, option 1 is preferable.

I behaved rudely with you is preferrable to I behaved rudely to you, as the second one doesn't sound right.

Don't be rude with me v/s don't be rude to me ; both seem ok.