It was a simple, common question. We have all asked it at some point or another in our lives. Answered positively, it can fuel a disappointment or feed an ego. Answered to the negative, it can face regret or relief. Thus is the wily nature of the question.
In giving an answer to the question, I would be transferring the burden from one to many. We have so much care in our lives as it is; there is no need to add to the load. And when it comes to certain aspects of my life, I would rather prevent the boat from rocking. It is a flaw of mine. I know that is not necessarily a valid reason. I know it is a crappy copout of an excuse. For better or worse, however, it is my gut reaction and the course I have taken.
Though I suppose that if the question were formed differently or if I were pressed to answer, I would yield.
But if we were being completely honest with ourselves, the question would not have been asked in the first place ... because you already know the answer.