Sycamore 'too busy' for Labour conference