The expectations won't be the same as say at a big school though. A .500 record and possibly winning the southern conference tourney is what matters to most VMI alums. There is no reason Danny Earl cannot get that done.
VMI is a tough place to recruit to though. Four years of living in a barracks with no tv, no air conditioning in your room, etc. It is a very spartan life and extremely demanding. It is certainly not for everyone. Combine the military life with the academics and it is very challenging.