I need robust web crawlers to scrape data from several websites (For e.g using scrapy and pushing it in mongoDB)

Nice to meet you on freelancer. My name is Da Zhang. I am an experienced data scraper from China. I always do web scraping projects (more than 200+ scraping projects done on freelancer and upwork). Below is my personal information. * I live in Beijing, China. Timezone is UTC+8. * I am good at reading and writing English. * I am full time freelancer. I cna start immediately. Below are some sample code I created with scrapy. #1> - [login to view URL]!AiiBtT-1najcg7saj2pMhRWFgaHHlw?e=csuWBf - You see, I created tens scrapy scraper in past 1 ~ 2 months. I use Ubuntu 16.04 OS #2> - [login to view URL]!AiiBtT-1najcg7psFWsgIqEQ_CXWSw?e=M99IqE - source code of a scrapy spider. - [login to view URL]!AiiBtT-1najcg7pwqyLTt_lMQAp_kA?e=N3P0zI - data scraped by the spider. #3> - [login to view URL]!AiiBtT-1najcg7tLCcdNBD9wx88Miw?e=VHagvu - another source code created with scrapy, also used headless chromedriver. You see I can do this type work, correct? Could I know more about your project? * Could you please provide me the URLs need to scrape? * I see you want to run the scraper every 3 minutes, so now I have a question, how many data you want to scrape? * Would you provide the IP service URL, so I can call it in the code? I see you said, there are several different websites, we can start with one website. So let's make the first milestone 50 EUR. I can start immediately. Looking forward to hearing from you. Thank you very much.

I have a huge web scraping experience with Scrapy (see my reviews) that's why I'm sure that you'll be impressed with my work. I can provide you robust crawlers for your needs but I need to know your target websites and sample output you need first. Thanks. Roman

Hi. I did read the project description and have a few questions. 1. Do you need the script as well or data only? 2. What is the format of the output data? CSV is OK? We can do other formats as well. 3. Which fields do you want to extract from the website? 4. How many results/urls are there? 5. What is the website? Let's get in touch and we can provide a sample. Thx, waiting for these details and hope to collaborate.

‌Hi, I have gone through your requirement to scrape lots of websites. I am EXPERT in building scraping tools /scripts. Hence, I can SURELY work on your project. I am having 4 YEARS of EXPERIENCE in developing PHP-PYTHON (Scrapy, Selenium) based web scraper as well as WINDOWS BASED web scraping software through which I have crawled many sites such as Craigslist, Amazon, Yelp and many others. I have also worked on complex site to bypass CAPTCHA with the use of PROXY IP bouncing techniques.. Let's work together :) Have a great day! I am glad to see your WORK HISTORY and positive reviews of other freelancers. I am really excited to work with you and would love to have a long-term business association for any of your data related tasks

Hello sir, Please take a look at my reviews and portfolio. I have completed web/data scraping jobs many times. I am interested in your project as well. I would like to discuss the details via pm. I look forward to hearing from you soon. Best Regards,

hi there i can make this scrapper in c# .net with option to insert record in mango db. kindly initiate chat lets discuss more thankyou

Hey there, I have read your project web crawlers. I will create your robust web crawler so that you can run it as many times as you want to. Crawler will scrap all the information that you need from all the required websites. I will also take care of IP so that crawler does not get blacklisted. I have good experience working with web crawlers using scrapy and you will be highly satisfied with my work. You will be provided with high quality script that will not break at any cause and also will not get tracked. Please contact me for further details. Thank you, Ijlal

Hi, have experience to scrapy data from different sites. Can help you to resolve this task, write me

Have written several scrappers in scrapy and request/beautifull soup . Would be glad to work for you.

I scraping700 global real estate sites in my old job. if you want i can show them as reference i suggest you choose me