Neighbor told us to leave

I was walking Hoshi before I left for work. Hoshi was doing #2 on my neighbor’s grass. The neighbor opened his window and said, “Excuse me! What are you doing!?” I held up my grocery bag and said, “I’ll pick it up.” I said it as friendly as I could. He said, “Never mind. Get going. ” Well, I picked it up and left. We’ve lived here 13 years and this was our 1st encounter. I think he moved in his parents’ house during that time.