Maybe it's just me, but I feel like the 'good stuff' is all moving out of the convention center. True Dungeon was first, then last year NASCRAG and Mayfair games... And this year I'm seeing more of the LARPs and other RPGs moving to Lucas Oil. I definitely have a lot of events there (if I get the items on my wishlist) and plan to be in Lucas Oil every day.
Perhaps it's just perspective, but this 'too far' thing really gets to me. Do you want all of GenCon to be confined to one room? One floor? Would that be the ideal con for you? It's a big con and getting bigger. As it does, it will spread out. The Lucas Oil space is huge, connected to the convention center and much quieter. I've been very pleased with the events I have enjoyed there over the past 2 years. I go to many cons each year and most of them have far more walking involved, with offsites and panels in neighboring hotels. The walking is an important part of my day and is expected. Given the junk I eat and the long periods of sitting at cons, the walking is a nice way to get my blood flowing and perk myself up between events. As big as it is, and with so much down there, more people will be going to Lucas Oil every year, and I look forward to it.