First of all, duplicated the original layer and started using mostly the spot healing brush tool, but also the healing brush and the patch tool. I removed all of the wrinkles and the end result was quite rough. So I lowered the opacity to 43% and duplicated the background layer again.
