I always operated under the assumption that when one holes out a chip or other shot off the green, one should remove the ball, leaving the flagstick in. Or, alternately, carefully remove the flag, leaving the ball in the hole. If one removes the flag and the ball comes out, the ball is not considered holed.
The other day another player in my group holed a chip. A different player, without asking the player who just holed the chip, yanked out the flagstick and the ball popped out. Everyone proceeded without comment.
Does the fact that the player and/or his caddy did not remove the flag make the ball popping out irrelevant. Or is the ball not considered holed out?