In 2015, after several false starts, I wrote a series of ruby scripts that ran as a cron job fetching sitemaps throughout the federation looking for recent activity and cataloging what I found.
I tested authoring with the Graph Plugin by writing explanations of both scrape and search. I found the result to be better than nothing but not easy to consult when returning to the ramble of scripts and files which is federation search.
Here I return to a careful reading of the scrips with improved graph authoring tools for another go.