Why might Sir Andrew not be able to attend Marguerite's water-party?

Sir Andrew may have to pass on the party because he might possible need to leave London.

“I am not sure, Lady Blakeney,” he replied evasively. “I may have to leave London to-morrow.”