A Simple Web Crawler in Perl

What's a web crawler? A web crawler is "a internet bot that systematically browses the World Wide Web, typically for the purpose of web indexing".

Well, I got bored one night and decided to write one in Perl.

Here's the result:

Github

If you want to use it, you have the following options:

Q: Want to ask something about the crawler? Leave a comment!

No comments :

Post a Comment