There are other ways to annoy people other than PKing. Blocking them in somewhere with a wall of bodies, for example. Or setting traps, or pushing boulders there that are too heavy for newbies to push... depends on the game, but you get the idea.