Buffett faces friendly fire on 'Buffett Rule'

Warren Buffett

At annual meeting, some shareholders wish Buffett would put a sock in it on taxes.

Omaha (Fortune) -- Warren Buffett says the 'Buffett Rule' has been "butchered a bit." But that hasn't stopped some shareholders from criticizing him for getting involved in the nation's debate over taxes and what the richest Americans should pay in the first place.

On Saturday, Buffett fielded dozens of questions from the crowd of shareholders and journalists who packed CenturyLink Center for Berkshire Hathaway's (BRKA) annual meeting. A number of the questions were on his proposal that the U.S. should institute a rule that would guarantee the richest Americans pay higher rates than average tax payers. At one point in the meeting, a shareholder was greeted with applause when he said that Buffett's outspoken position on taxes was hurting the company's stock. "My 84-year-old father won't invest in Berkshire because of your stance on taxes," said the shareholder.

MORE: Millionaires effective tax rates top most

Even Charlie Munger, Buffett's long-time partner in running Berkshire Hathaway, seemed to somewhat disagree with Buffett on taxes, even though Munger says he is "100%" behind the Buffett Rule. Still, Munger says the focus should not just be on taxes, but how government spends its money as well. "We need more sacrifice and we need more sensible ways of spending money," says Munger.

At a dinner on Friday night, money manager Mario Gabelli, who has attended Berkshire's annual meetings for the past decade, told a crowd of attendees that he thought Buffett made a mistake by getting too political, though he seemed to be in the minority. "It's BS," said Gabelli. He asked the room to raise their hands if they had wished Buffett hadn't proposed the tax rule. Only a few hands went up. "It's the elephant in the room and we should talk about it," said Gabelli. "It's a negative on the stock."

A feisty Buffett on Saturday responded that he has a right, like every citizen, to free speech and that he didn't give that up when he became the CEO of a public company. "Sounds like your father should buy stock in Fox," says Buffett. "When I and Charlie took this job we weren't required to put our citizenship in a blind trust."

MORE: What exactly is the Buffett Rule?

Buffett says it's fair to disagree with him, but that he doesn't think that should change anyone's choice to buy or not buy Berkshire's stock. He says he didn't know the political stances of many of the CEOs of the companies that he and Berkshire invests in and didn't care. Though presumably the reason Buffett doesn't know their political stances is because those CEOs have chosen not to be as vocal about them as Buffett has recently.

Buffett said his proposal has been butchered by others, but he didn't really say how. "It would affect very few people, and raise a significant amount of cash," says Buffett.

Buffett said about a third of the 400 richest people in America pay a 15% tax rate or less. He said rates used to be much higher for the top earning Americans and that we should restore that. What's more, Buffett said despite recently getting voted down in the Senate, he was optimistic that some form of the rule he has proposed would be adopted. "Not dead," says Buffett, "People are bothered by inequality. Something will happen."

Buffett said he doesn't use offshore accounts or other tax strategies. Yet, every year, Buffett says, he compares his tax rate to others in his office, and he routinely pays the lowest rate. "They all are in the 30s, and I am in the range of 17%," says Buffett. "It's time we look at that."

That comment got applause from the Buffett faithful as well.

Posted in: Berkshire Hathaway, Warren Buffett

• 5 things learned at Berkshire's Annual Meeting

  Buffett likes newspapers, hates paying dividends.

  Omaha (FORTUNE) -- At Berkshire Hathaway's (BRKA) annual meeting on Saturday, Warren Buffett fielded questions from shareholders, journalists and analysts. The questioning started at 9:30 and is expected to last until 3:30. In all he said he would take a total of 54 questions. At mid-day, the questions have ranged from simple ones about his health ("I feel terrific.") to more technical ones about how MORE

  Stephen Gandel, senior editor - May 5, 2012 2:21 PM ET
  Posted in: Berkshire Hathaway, Warren Buffett

• The only analyst who doesn't like Buffett's Berkshire

  Analyst, shunned from annual meeting, says S&P 500 is a better bet.

  Omaha, Neb. (FORTUNE) -- This weekend, at Berkshire Hathaway's annual meeting, tens of thousands of Warren Buffett faithful have descended on Omaha, the hometown of Buffett and his company. Before sunrise, investors lined up to get good seats in the Centurylink Center, which is filled with Berkshire shareholders.

  Like in past years, Buffett will hold an all-day meeting in the MORE

  Stephen Gandel, senior editor - May 5, 2012 10:32 AM ET
  Posted in: Berkshire Hathaway, Warren Buffett

• At Buffett-fest, investors upbeat about economy, hate Facebook

  Despite optimism, investors are looking for Buffett to lay out a better vision of what his company might look like when he is gone.

  Omaha, Neb. (FORTUNE) -- The economy is improving. Berkshire Hathaway's  (BRKA) stock is undervalued. And Facebook is a crapshoot. That was the general feeling at a gathering of investors on the eve of Berkshire Hathaway's annual meeting.

  Tens of thousands of investors pour into this city each year MORE

  Stephen Gandel, senior editor - May 5, 2012 1:02 AM ET
  Posted in: Berkshire Hathaway, mario gabelli, Warren Buffett

• After Buffett's rule: What the billionaire means to Berkshire

  Investors say the 'Buffett premium' has shrunk.

  FORTUNE -- Warren Buffett, it appears, is worth less than he used to be.

  Shares of Buffett's Berkshire Hathaway (BRKA) fell slightly, down about 1%, on Wednesday, a day after the company's legendary CEO announced he has Stage 1 prostate cancer. Buffett said his condition is "not remotely life-threatening" and would barely slow him down. (He won't be able to travel, while getting radiation treatment, MORE

  Stephen Gandel, senior editor - Apr 18, 2012 4:01 PM ET
  Posted in: Berkshire Hathaway, investing, Warren Buffett

• Fidelity gets its own Buffett Day

  At the Berkshire Hathaway shareholder meeting last year, Fidelity investment pros gamed the system and threw an outsized number of questions at Warren Buffett. Instead of getting even, Buffett invited them to Omaha for their own private party.

  By Carol Loomis, senior editor-at-large

  FORTUNE -- Thousands of business students, from scores of American colleges and from countries like Brazil, China, India, and Israel, have experienced the thrill of a Buffett Day in MORE

  Mar 23, 2012 5:00 AM ET
  Posted in: Berkshire Hathaway, Macro, Warren Buffett

• Buffett gains ground in hedge fund bet

  Four years into a 10-year wager that the S&P 500 index will return more than a selection of hedge funds, Warren Buffett has almost caught up with his competition.

  By Carol Loomis, senior editor-at-large

  FORTUNE -- Results are in for 2011, the fourth year of the 10-year wager that is sometimes called, rather loosely, The Million-Dollar Buffett Bet. In this competition about investment performance, Warren Buffett is contending that an S&P 500 index fund MORE

  Mar 21, 2012 8:30 AM ET
  Posted in: Berkshire Hathaway, Hedge Funds, Macro, Warren Buffett

• Buffett on housing: Was "dead wrong," but still believes

  Warren Buffett says "hormones" will save the housing market. But this time he's not saying exactly when.

  FORTUNE -- In his annual letter to Berkshire Hathaway (BRKA) shareholders, which was released on Saturday, Buffett says he still believes a real estate recovery is on the horizon. Yet, the Oracle of Omaha admits that on housing his crystal ball has been cloudy. Last year, Buffett said the real estate market would recover MORE

  Stephen Gandel, senior editor - Feb 25, 2012 8:00 AM ET
  Posted in: Berkshire Hathaway, real estate, Warren Buffett

• Don't believe every "Buffett buys..." headline

  Warren Buffett still does most of the portfolio management at Berkshire Hathaway, but the press often mistakes his investments with those of his managers, Todd Combs and Ted Weschler.

  By Carol Loomis, senior editor-at-large

  FORTUNE -- Because the press and stock-market pundits like headlines that begin "Buffett Buys…," big-type assertions of that precise kind often appear. But such headlines are all too often wrong, for the simple reason that other people besides MORE

  Feb 25, 2012 8:00 AM ET
  Posted in: Berkshire Hathaway, Warren Buffett

• Geico's profits plunged in 2011

  Troubles at auto insurer Geico could signify a larger shift going on at Buffett's Berkshire.

  FORTUNE -- Fifteen minutes may save you money, but Geico is not benefiting Warren Buffett as much as it used to.

  Profits at the auto insurance company, which is owned by Buffett's Berkshire Hathaway (BRKA), plunged 48% to $587 million in 2011. It was the first time since 2003 that Geico earned so little. The disappointing results MORE

  Stephen Gandel, senior editor - Feb 25, 2012 8:00 AM ET
  Posted in: Berkshire Hathaway, Geico, Warren Buffett