Can we ever say that our attachments are holding us when actually we are always responsible?

Won’t such an idea lead to our claiming that we can’t be blamed ? (This question is based on the Gita-daily article: are our attachments holding us or are we holding our attachments?)