Lady problems down there. Help!?

I have had this problems since puberty maybe. Way before I was sexually active. Often there will be bumps down there, on the otter part of the vagina, the vulva. The bumps often when squeezed have white puss, just like pimples and then also clear puss if i continue to squeeze. I also mess with it, which i shouldn't, but typically there is a hair once i get through the squeezing and picking. It seems as if after that, much of the bump goes away. These bumps can last awhile, not just a few days. I have yet to see a gyno, scared to do that but plan on it very soon. Would appreciate help, this has been bugging me for years now and I cant seem to find many people who have experienced the same thing. If you have any suggestions please tell me. Thanks