Do most dogs treat people based on their physical apparence?

I think the dog treated you differently not due to your appearence but due to your behaviour and mannerisms. The dog could probably sense you were confident and unfraid and therefore did not bother you. Whereas the older woman could have been afraid of the dog and the dog could have sensed this. Dogs are very perceptive about how we feel and can sense fear. Perhaps they can even smell fear?