No, each person is accountable to God for his/her thoughts regarding the word of God. (HB 4:12) BTW, you DO know what the H in IMHO means?
However, although Paul said his freedom should not be judged by another man's conscience, he still made an effort not to act in ways that might tempt...