I had a similar problem with a leaking gasket and a bad O2 sensor on my old 2003 Liberty 3.7l. It turned out that the oil was dripping down directly onto the O2 sensor, and that caused it to go bad.
However, by the time it went bad, I had already replaced the gasket, so the source of the oil was...