One minute is within reason...
I make sure that I can hear the lifters have quietened down so that I know oil is getting to where it's needed, but once that's accomplished, it's time to go.
However, I wasn't questioning one minute, I was questioning 5+ minutes.
As for the neighbour comment, I'm a victim of this.... a neighbour has an extremely loud (hunk of crap) car that they like to leave idling for up to half an hour at a time.