It's very important to store wine bottles horizontally or angularly, since the cork is an elastic substance and will dry out over time unless kept in contact with the liquid. If stored upright, you will risk excess evaporation through the dry cork’s porous fibres. Moreover, you may also find that the cork will split when you attempt to remove it years down the road.