Record the users click points while ignoring all scrolling and then provide two UI buttons for Next and Prev to navigate to those lines/files where the user previously was.

Providing keyboard shortcuts would be a plus.
Ignoring interactions with other file types (.dmf, dmm, ico, etc) seems like a good idea.

ts