Ok, I took a closer look today and did pinpoint that it indeed is the belt tensioner. It is a little loose and i can see it move on its own.
On Napa's website, they have 2 different parts, 1 has a 90mm diameter pulley, and 1 a 76 mm pulley.
Is there an easy way to tell which I would need...