What's a web crawler? A web crawler is
"a internet bot that systematically browses the World Wide Web, typically for the purpose of web indexing".
Well, I got bored one night and decided to write one in Perl.
Here's the result:
If you want to use it, you have the following options:
Q: Want to ask something about the crawler? Leave a comment!
No comments :
Post a Comment