You wait for them to pass, and, as they're passing, you can smell the smell of fish. Then suddenly it hits you -- they weren't talking about robbing people! They were fishermen!
Before you fully register the thought, you're on your feet and chasing after the men, trying to get their attention.
It is all to no avail, for they continue on their merry way, leaving you on the side of the road, dejected.