(CNN) -- House Speaker John Boehner on Thursday stood by his argument that President Barack Obama doesn't give a "damn" about unemployed, middle class Americans, saying Obama has been more focused on his role as candidate than president.
"The president checked out last Labor Day. And he's been on the campaign trail nonstop ever since," Boehner said on CNN's "The Situation Room with Wolf Blitzer."
Boehner told reporters on Capitol Hill the day prior that the president was attempting to divert attention from the economy in order to win re-election and "doesn't give a damn about the middle class Americans who are out there looking for work."
In a sit-down interview on Thursday, Boehner defended his comments and blasted the president's re-election campaign over its recent tactics.
"When you look at some of the nonsense that's gone on in the campaign here over the last couple of weeks, you begin to scratch your head," he said. "Somebody has got to speak English. And I'm not afraid to do it."
The Obama team has been spearheading a round of calls for Romney to release more tax returns than the two years' worth of information he has already made public. They argue the documents would answer questions about his offshore accounts and overseas investments.
Despite pressure from Democrats--and some Republicans-Romney has said the release of his tax returns will be sufficient with his 2010 return and his completed 2011 return to come out in October at the extended filing deadline.
Boehner, however, said he won't be joining the few from his party who are urging Romney to put forward more documents.
"I think it's a sideshow. He released his returns from 2010. He's going to release his returns from 2011. I think that's more than enough," the speaker said.
Answering questions about the increasing attention over Romney's running mate pick, Boehner said he has not been in contact with Romney about the presumptive GOP nominee's decision.
"He's got to keep this in a very closed circle. And I don't expect to be consulted. I don't need to be consulted," he said, adding that he generally doesn't "spend a lot of time talking" to Romney in the first place.
The speaker has faced criticism for his less-than-glowing praise for Romney since he became the presumptive GOP nominee. Boehner said last month that the "American people probably aren't going to fall in love" with Romney.
Defending his comments, Boehner said Thursday that he is, in fact, enthusiastic about the former Massachusetts governor but views the election more as a referendum on what he called Obama's "failed economic policies" than a choice between Romney and the incumbent.
"As a result, the American people, I think, will vote with their wallets," he said. "And I think Mitt Romney is going to win this election."
In the wide-ranging interview, Boehner also indicated he would stand firm in his commitment against passing the president's proposal to end the Bush-era tax cuts for households making more than $250,000 a year.
Both parties agree the tax breaks should be renewed for the 98% of those who fall under the threshold. With that in mind, the president has argued Congress should go ahead and pass the extension for that 98%, then debate about the remaining two percent later on.
Boehner, however, said the top two percent includes many small business owners, and argued it would be a "monumental mistake" for the still struggling economy to project a tax hike on those who fall in the bracket.
"What I'm trying to do is to protect all Americans and keep our focus on what the American people want us focused on, and that's the economy and jobs," the speaker said. "And if we're serious about getting the economy going and creating jobs, we need to extend all the current tax rates."
Pressed on whether he would be willing to pass a bill for the 98% now, then later work on a deal for the remainder, Boehner said: "It would be the wrong thing for the country to do."
The House speaker also commented on recent calls from Republican Rep. Michele Bachmann of Minnesota--and four other GOP members of Congress--for investigations of Islamic extremist infiltration in the federal government. They particularly target Huma Abedin, deputy chief of staff to Secretary of State Hillary Clinton, saying she has family members tied to the "Muslim Brotherhood."
Boehner reiterated his defense of Abedin and said she has "sterling character." Describing the accusations as "dangerous," Boehner said he has not yet talked to Bachmann but added someone should "put out the facts."
"Frankly, there are enough legitimate issues that we need to work with here in town, here in Washington, that I just am very concerned about the direction that this thing takes," he said.
™ & © 2012 Cable News Network, Inc., a Time Warner Company. All rights reserved.