Jane says he finds Partridge 'Irksome'. This is Jane using his using his amazing intuition. His deceased psychologist made a similar comment about Red John. Think about that.

There are at least three scenes in this series where the screen shot shows Jane and Partridge in a standoff, sizing each other up. NO other suspect on the list of seven has been given this full screen treatment. It's not an accident.