HOME       >>       Programming

Perl For Automated Web Form Search


Hi all,I'd like to write a script to automate a search in order to collect data from an online database. The database is an archive of newspaper articles. The search is for certain words/text. It is searchable via a form only. The rub is that only a small portion (a month) at a time is searchable. I need to search every day for 50 years or so. Manually, this would take a considerable amount of time.I'm thinking of using perl or ruby or something similar. I am an absolute beginner with scripting and haven't done much formal learning in the subject since a pascal course many years ago in college. Of course I could just pay someone to do it, but i'd like to learn some basic scripting as I can envisage needing to do similar things quite regularly in the future.Is this feasible? Any ideas on the most efficient way to go about it? What do i need to learn in order to have a go at it? Any thoughts, tips, pointers would be greatly appreciated. Cheers


Well, I guess PERL would be the best choice for such searches, RegEx is a quite powerfull tool... You can connect to MySQL databases from PERL, so that shouldn't be a problem either... You should concentrate on connecting to databases (MySQL, PostgreSQL, and others) in PERL, and also Regular Expressions... RegEx will be your best friend in searches for news articles...


Xisto.com offers Free Web Hosting to its Members for their participation in this Community. We moderate all content posted here but we cannot warrant full correctness of all content. While using this site, you agree to have read and accepted our terms of use, cookie and privacy policy. Copyright 2001-2019 by Xisto Corporation. All Rights Reserved.