No, it sounds like he's been following her around town. It almost sounds like a stalker. Or perhaps a private detective trying to collect evidence.
Another way to use "follow" relates to a performer, say a singer or an actress. If you have noticed her performances, kept an eye open for a new album or movie, you can say you have been following her career or, more simply, following her.