Yes. Virgin vinyl is better. Recycled vinyl was often made from records they didn't even bother taking the labels off of. You could SEE little pieces of label embedded in the vinyl. It absolutely made a difference to the sound and added a lot of hissing and clicks that are absent from virgin vinyl.
And I'll add, the more records were recycled, the more paper was introduced. Some records skipped and got stuck on the very first playing. 45's were the worst of it. This also made the vinyl brittle.