Here's a simple and polite response:
"I have a few things planned for today. I need to [mention one or two activities you have planned, such as 'go to work,' 'meet a friend,' 'run errands,' 'exercise,' etc.]. How about you? Do you have any plans for today?"