Parents' vs. parent's

Normally you would say "I visited my parents' house the other day", but is it possible to say "I visited my parent's house the other day" if you are referring to only one of your parents?