The answer varies depending on which stores and what locations, but many (though not all) CVS stores, as well as other drugstores like Walgreens and Duane Read stores, do sell postage stamps. Many grocery stores and some convenience stores sell stamps as well. At many Walgreens stores, cashiers usually have books of stamps for sale at the cash register; all you have to do is ask.
Some stores that do not have stamps at the counter or customer service desk often have stamp vending machines in the store. This is common in some (but not all) Wal-Mart and 7-11 stores.
Some of the stores mentioned above, however, do not sell stamps at all, so you may want to contact your local store before visiting to confirm.
Be forewarned, however, that most stores that sell stamps only sell them in books of 20, so if you only want one or two or a few stamps, you may have no choice but to the visit the counter at your local post office, as even the US Postal Service no longer has stamp vending machines in many of its locations.
In October 2012, which is National Stamp Collecting Month in the U.S., the United States Postal Service has issued the Earthscapes Forever series of stamps, featuring landscape views from high altitudes over the planet, or from space, of such views as Mount St. Helens in Washington state and Monument Valley in Utah. The stamps were available from the USPS beginning October 1st.
The USPS issued Forever stamps commemorating the Major League Baseball All-Stars in July 2012.