SPHERE is the VLT second generation planet hunter instrument. Installed since may 2014 on UT3, the system has been commissionned and verified for more than one year now and routinely delivers unprecedented images of star surroundings, exoplanets and dust disks. The exceptionnal performance required for this kind of observation makes the appointment: a repeatable Strehl Ratio of 90% in H band, a rough contrast level of 10-5@0.5 arcsec, and reaches 10-6 at the same separation after differential imaging (SDI, ADI). The instrument also presents high contrast levels in the visible and an unprecedented 17mas diffraction-limited resolution at 0.65 microns wavelength. SAXO is the SPHERE XAO system, allowing the system to reach its final detectivity. Its high performance and therefore highly sensitive capacities turns a new eye on telescope environement. Even if XAO performance are reached as expected, some unexpected limitations are here described and a first work around is proposed and discussed. Spatial limitation: wave-front aberrations have been identified, deviating from kolmogorov statistics, and therefore not easily seen and compensated for by the XAO system. The impact of this limitations results in a degraded performance in some particular low wind conditions. Solutions are developped and tested on sky to propose a new operation procedure reducing this limitation. Temporal limitation: high amplitude vibrations on the low order modes have been issued, due to telescope environment and XAO behaviour. Again, a solution is developped and an assessment of its performance is dressed. The potential application of these solutions to E-ELT is proposed.