Robert Downey walks out when asked about past