large scrape 275 million records from 3 different websites -- 2

Hello, How are you ? Can you provide me all the details about the three websites from where i have to scrape the data. and you just only need data ? not the code ? as you said you need that in sql file. Thanks

Hello sir, I have 5+ member team i am done many big data entry project with good result so pls give me one Chane then i am want start this work right now and give you good result. sir you can see my good feedback with last project Regards

Greetings of the day!! Hope that you are doing well. Glad to have information for the project from you. I have gone through your requirements and understood that you want an experienced Python developer. I have experience of Python for 5+ years and did many projects successfully. Will be requiring more details from you for knowing more about the project. Areas of expertise: PHP, Python, Web Scraping, MySQL, Data Mining Let's connect and discuss further. Waiting for a favorable feedback from you. Warm Regards, Virang Patel.

Hi, I'm experienced bot developer and I can do it on time. The bid price is just a rough estimation, I would first need to see the websites. Regards, Borna Croatia

Hi Andrew, I will build a Node js web scraper to scrape data from 3 websites. I will save the data in a remote MySQL database and send you the MySQL dump after scraping the data. In order to scrape millions of records per day we need an efficient web scraper(which I will build), a server with good amount of RAM and reliable proxy servers. Let's say we complete this in 2 months, then the costs for server and the proxies amount to 50 - 70 USD on an average. You don't have to worry anything about the server and the proxies. I will setup the server, install required software on the server, design and build the application, test the application, deploy the application on server, scrape the data and send you the data in 30 days. I will automate the process of scraping in such a way that the application runs 24*7 to scrape the data. Even if the scraper terminates for any reason, the application gets triggered automatically to scrape the data from where it got terminated. Less number of reviews and more amount earned with only a handful of projects will give you an idea of my capabilities. I worked mostly on high budget long term projects. Please contact me to know more about my proposal. Let's discuss your requirements and then get started. Looking forward to hearing from you soon. Thank you.

Hi Hiring Manager I am Web Scraping - Data Mining, Java / Python Developer. - web scraping, data mining, data extraction, data transformation, - writing scripts and utilities, - image / file downloading. - scraping info from websites into SQL-like DB or any other format (txt, CSV, EXCEL, JSON etc). - file transformation. Web scraping technologies: - Selenium Webdriver - create autotest, scraping information from different websites - Scrapy - a gathering of information variety of websites like amazon, airbnb, etc (python) - Xpath - analysis and using XPath to navigate in an XML document - beautiful soup + requests - collecting information from the given websites. Skillset: - Java – advances (new tools implementation, web applications creation, bug fixing, code review) - JavaScript – basic (new script creation, support existing solution). - Groovy – basic (creation simple CRUD web application using Grails Framework). - Python (knowledge: PyGame, Django, scrapy, beautiful soup) - Spring (Core, MVC, Security, JPA) – new application creation, support existing web applications. - Oracle SQL – creating new scripts, support and tuning existing scripts. - HTML + CSS – simple page creation / support existing Thanks

Hi, Andrew. I am a web scrapping expert. I saw your project and I think budget and deadline is not enough In my opinion, If you don't have more budget and deadline, you will not find exact developer If you can discuss budget and deadline with me, please contact me Thank you

I have scrapped a large amount of scraping already I have my own proxies and own servers I am professional Python web scraper I can complete your web scraping requirement on time with good quality results using Python scripting I start script right away and deliver within your timeline I use Python BeautifulSoup4, Selenium and scrapy Libraries to accomplish and achieve this I am confident that i can deliver best service for you if i am awarded Thanks in advance!

Hello I am web scraper expert using php I will scrap large number of data plz start chat with me for further discussion Thanks Jaffer I.

Hi. I am a freelancer working in 24/7 service. I have much experience of +6 years in Scraping field, I can do your job with Python. I will produce the output in any format you desire. I think this project is for me and I can finish it for a short time with a quality result. you can also see my profile reviews as my only goal is the client satisfaction, Please don't hesitate to contact me about any question, Kindly initiate chat and let's have a talk. we can start immediately Best Regards.

Hello there I hope you will be fine and I am very glad to see your project of Data scraping. Here I am a full time freelancer and yes I have done this type of projects. Here I have a skill of multi threading scraping by which I can scrap data on multiple windows. and for this computers are required more advance,, so i also have that type of computer. I provide you my best services on cheapest price. Hope to hear from you soon. Take good care of your self. Thank you!

Hello Employer, let me put you to ease. I've developed a multi threaded API to scrap huge amount of data from websites. I've experience of designing a software which can perform parallel scrapping of website pages and cut the time into half or even more less. As your target is to grab 270million records, The software needs to be fully automated and faster. By hiring me, you'll get experience freelancer who has his own API developed to scrap in parallel. You can view my profile and check my work with Joseph B for reference. I developed him the software for scraping Malacards If you'd like to know more about it, I'm happy to share to assure you of my work. Let's talk and send me the sites you want to scrap. I'll let you know how my expertise can speed up this process and maximum accuracy and quality possible. I've added the Milestones description as well, if you have any other way to take this project further let me know.

Dear Client Warm Greetings, I have been Python Developer for 3+ years and have experience of Building Management, Distributed, Database Applications. with Machine Learning, Ensemble Learning, Deep Learning implementations . Expertise in Classification, Regression Clustering, Detection, CNN, ANN using Neural Networks, Random Forest, Gradient Boosting, Logistic Regression, K-Means and several other Algorithms. Hands on implementation with libraries like Tensorflow, Keras, Pandas, OpenCV, Flask etc. I'm available for a discussion from 8:00 AM to 10:00 PM IST (GMT+5:30). However, you can let me know the time that works best for you so that I can plan accordingly. Looking forward to work with you. Rajat

Hello, Share with me those 3 websites. I will check those and inform you of any better solution. I have a rich experience with web scraping. Thanks.

Hello I'm expert in scraping, i have scraped a lot of data to mysql database before. Can we discuss, and i can start immediately? Thank you!

Hi I am skilled and experienced in web scraping. Please share complete details on the task. I can get all the required data with perfect accuracy. Thanks and Regards Mohit

Hello!, I’ve carefully checked your requirements and really interested in this job. I’m awesome creative designer working at small-scale to large scale designs as a lead designer with U.S. and European teams. I have read all your requirements. We have rich experience in Data Mining, MySQL, Python, Web Scraping and PHP. For more information about me, please refer to my portfolios. Please contact me to discuss more regarding this project. Thanks & regards

Hey there, i am a developer from the Australia with over 9 years experience in web development. Upon reading your project description this seems like a task which i can start on right now and will not take long to complete. I have a few questions for yourself before i get started then i can begin. I will describe and explain the whole process and keep you updated along the whole way. I have experience in various languages PHP, HTML, C#, C++, Python, Javascript and jQuery. I also have heavy experience in scraping projects scraping sites such as linkedIn, google and facebook. Furthermore, experience in mobile app development and cross system applications developing on both MacOS and Windows. I can fulfil all your requirements to the fullest standard in a low and affordable price. Contact me right away so we can discuss and I can get started. Thank you

Hi, I am ready to start your project now. I am professional web Scraper can scrape Website easily. Please share complete details about project. Please tell me Which types of website you need to scrape and in which format? Waiting for your reply. Thanks Majid

hi, i am expert in selenium and chrome driver , i can write a script to scrap records and save in excel sheet or database. have a look at my portfolio for web scrapper script. please award me this project, Regards, Nooruddin