In an interesting segment on Fox News this Tuesday, host Bill O’Reilly criticized opponents of same sex marriage, saying that their argument was weak and that it relies entirely on religious dogma.

During the segment, the conservative Fox News host discussed two cases before the Supreme Court regarding same sex marriage with his guest, Fox News anchor and lawyer Megyn Kelly.

O’Reilly seemed to break with many contributors on his conservative network and remarked that public policy should not be based on religion. Kelly then bolstered his comments by saying that arguments against same sex marriage did not hold up when the element of religion was removed.

“I agree with you 100 percent, the compelling argument is on the side of homosexuals,” O’Reilly said. “That’s where the compelling argument is. We’re Americans, we just want to be treated like everybody else. That’s a compelling argument, and to deny that you’ve got to have a very strong argument on the other side. And the other side hasn’t been able to do anything but thump the Bible.”

“I support civil unions, I always have,” he added. “The gay marriage thing, I don’t feel that strongly about it one way or the other. I think the states should do it.”

Watch the segment in the video below.