A place to stay is what's going to really soak you in NYC. When I visit and am spending my own money, I've enjoyed the character of the Chelsea Hotel. It's not fancy, but interesting - and right down in the middle of most of it.
Chelsea Hotel (New York City, NY) - Hotel Reviews - TripAdvisor