whereas, to say "I couldn't care less" means that you care SO LITTLE about that thing or person that you couldn't possibly go any lower. Ie, you have already hit rock bottom in the caring stakes.