One thing I've learned my last year on food stamps, and trying to eat delicious food, is that many ethnic markets are extremely affordable and take food stamps. For instance, my local Chinese and Indian stores offer spices, of a better quality than say the ones at Big Lots, the dollar stores, etc for chump change. My fiance drinks a lot of espresso and we buy 1 lb bricks of it for like $2-3 bucks at the Mexican stores.
You have to be adventurous and broad-minded, as sometimes you might have a language barrier, but trust me, besides the bargains you can find some pretty cool stuff.