Would a home buyer without a buyer's agent, be upset if I have a selling agent?

I've got a house for sale by owner, but will use an agent to make sure things are done properly. Someone has looked at the house and did not tell me they were without a buyers agent and I did not tell them I have a selling agent to help me. Since the seller usually pays all commissions, would my lookers be intimidated or turned off when they find out I have an agent?