Just answer the phone and say no.. You're not obligated to work when you're not scheduled so you shouldn't feel bad if you don't want to work on your day off. Giving an answer, instead of ignoring it, allows HR to move onto the next person quicker without having to wait for a responses from a couple people.