Dennis Hastert may still be Speaker of the House, after the Washington Times and other conservatives called on him to resign last week. But his job is not exactly secure, either.

Republican candidates are canceling appearances with Hastert. Other Republicans are contradicting his timeline of what happened when. And the influential conservative editorial page of the Union Leader newspaper in Manchester, New Hampshire, long a presidential kingmaker, declared on Sunday that Denny should go.

“This is not the first time Hastert has reacted to scandal by attempting to shift blame instead of addressing the real problem,” the Union Leader writes. “If he remains in power, it will not be the last.

Hastert’s obsession with maintaining power has corrupted his judgment and he can no longer be trusted to put the interests of the country above the interests of his party. Republicans must insist that he resign.”