Hi, I'm George, a skilled web crawler expert with 5+ years of experience in Python and Robot Framework. I've successfully completed several web scraping projects and I'm confident I'm the perfect fit for your Web Scraping Robot Framework Developer role.
As requested, I'll automate the web scraping process using a cron job and implement IP rotation proxy to prevent site blocking. I'll also extract specified metadata and documents, store them in a database, and organize them in a local folder, while also picking up incremental data from the last run.
My ideal skills and experience, including proficiency in Python and extensive work in web scraping and Robot Framework, make me well-suited for this project. I'm also familiar with cron jobs, IP rotation proxies, and managing databases. Adding to that, I've worked extensively with PDF files, Word documents, and HTML data extraction.
Questions:
1. Have you considered using a custom web scraping tool for this project?
2. Can you share the targeted websites for a closer look at the scope?
3. Are there any specific metadata or documents you want to extract?
4. Do you have any preferred timeline for project completion?
Looking forward to discussing further and creating value through our collaboration! Thank you.