Former presidential candidate Mike Huckabee on Tuesday threatened to leave the Republican Party over its reluctance to speak out against gay marriage.

Huckabee made his remarks during an appearance on the American Family Association's (AFA) Today's Issues program.

Huckabee said he was livid at the GOP's muted response to the Supreme Court's decision not to hear appeals in cases challenging bans in five states. The decision makes it almost certain marriage equality will become the law in 11 more states.

“I am utterly exasperated with Republicans and the so-called leadership of the Republicans who have abdicated on this issue,” he said.

By not taking strong stands on social issues such as marriage and abortion, Huckabee “guaranteed” the GOP is “going to lose every election in the future” and “lose guys like me and a whole bunch of still God-fearing, Bible-believing people.”

“I'm gone,” he warned. “I'll become an independent. I'll start finding people that have guts to stand. I'm tired of this.”