• yeehaw@lemmy.ca
    link
    fedilink
    arrow-up
    5
    ·
    1 year ago

    How does that work, does it go out and start indexing the internet for you?

        • whaleross@lemmy.world
          link
          fedilink
          arrow-up
          3
          ·
          1 year ago

          There is probably a neat wget oneliner that could crawl everything on the open web. The real challenge is how to index all the information. That might be a neat Perl oneliner.