Except that despite the dictionary definition agnostic is used to describe people who don't believe in god but refuse to be atheists, because that is the practical use of the word.
More importantly, however, what form does this "holding out" take? Do you live your life in accordance with religious observance or don't you? There's no fence sitting option, you have to choose one or the other.