Find Jobs
Hire Freelancers

Create a Fast Web Crawler to Extract Google SERP Data

$250-750 USD

Zaprt
Objavljeno pred približno 4 leti

$250-750 USD

Plačilo ob dostavi
Hi, I need someone to develop me a fast and powerful web crawler to extract data from Google SERP. Important key features; 1. Must have a user interface protected by user and password where I can manage my campaigns. 2. Must have rotating proxies support 3. Multi threading support I want a dashboard, where I can create/edit/delete my campaigns. For every campaign, I will set a google query (ie: intitle:"fashion" "blog") and decide how many results I want to extract. When I will click on the "Start Crawler" button, I want to see the results in real time.. so If I decided to crawl the first 100 000 results for this query, if the crawler have extracted 1000 results, it should show 1000 results extracted out of 100 000. Once the extraction is completed, I want to receive an email that notify me that the campaign has finished. Once the process is completed, I want to have 3 options; 1. Remove duplicated domains (Remove all entries that is for the same domain) ie: [login to view URL] [login to view URL] [login to view URL] Should keep just first entry so "[login to view URL]" and delete all the other entries. 2. Update metrics (This will use the SEMrush API to update the keywords / organic traffic for every extracted domains) 3. Export the data in Excel format. (Columns; Full URL / SEMrush Keywords / SEMrush Organic Traffic)
ID projekta: 23957254

Več o projektu

15 ponudb
Projekt na daljavo
Aktivno pred 4 leti

Želite zaslužiti?

Prednosti oddajanja ponudb na Freelancerju

Nastavite svoj proračun in časovni okvir
Prejmite plačilo za svoje delo
Povzetek predloga
Registracija in oddajanje ponudb sta brezplačna
15 freelancerjev je oddalo ponudbo s povprečno vrednostjo $596 USD za to delo
Avatar uporabnika
Hey there, I have 4 years of working experience in web technologies and I have a strong working knowledge of every possible framework which is in the market. In terms of client-end I know: Javascript, PHP, Python, Software Architecture, Web Scraping Also I have done tons of work on freelancing career. I am waiting anxiously for a positive response from your side. And I have read your requirements as well. Thanks and regards, Awais
$1.250 USD v 29 dneh
4,9 (110 ocen)
8,3
8,3
Avatar uporabnika
Hi there,I am Web Scraping expert from Bosnia & Herzegovina,Europe. I have carefully gone through with your requirements and I would like to help you with this project ! I can start immediately and finish it within the agreed deadline. Check out my profile and former clients feedback - that'll let you know everything about me. Please feel free to initiate the chat so that we can discuss further details. Thank you for taking the time to read my proposal.I am looking forward to hearing from you. Best regards, Miljan
$500 USD v 7 dneh
4,9 (180 ocen)
8,0
8,0
Avatar uporabnika
Hi. I did read the project description and have a few questions. 1. Do you need the script as well or data only? 2. What is the format of the output data? CSV is OK? We can do other formats as well. 3. Which fields do you want to extract from the website? 4. How many results/urls are there? Let's get in touch and we can provide a sample. Thx, waiting for these details and hope to collaborate.
$500 USD v 4 dneh
5,0 (151 ocen)
7,7
7,7
Avatar uporabnika
Hi there, Being an expert in Python and matlab programming I can do this project for you. please leave a message on my chat so we can discuss the budget and deadline of the project. Also, have a look at my profile for my reviews and portfolios. Thanks Note: This is not an automated bid and i'm ready to discuss your project right now. .. .
$750 USD v 3 dneh
5,0 (32 ocen)
7,0
7,0
Avatar uporabnika
Hi there, Greeting!! I have more than 10 years of experience in Web & App development and multiple technologies. I am committed to providing you high quality services. My goal is to satisfy clients by providing high quality professional services. I have gone through your requirements and am ready to complete your job. I have developed a number of projects in the following skills set. Our expertise: PHP, CorePHP, MVC(Model/View/Controller),Vue.js, Laravel, Codeigniter, Nodejs, Angularjs, Reactjs, Restful APIs, Data Scraping, MySQL, MongoDB, JQuery, HTML5, CSS3, WordPress, BootStrap, UnityGames Development ( Android and Iphone), 3D work, Android and IOS Mobile Apps. Our Services: - Website Design and Development - Mobile Games Development(Android and iOS) - Mobile application Development (Android and iOS) - Graphic Designing - 3D Modeling More work and client Reference can be provided on demand! Waiting to hear back from you. Stepinnsolution
$750 USD v 7 dneh
4,9 (48 ocen)
6,7
6,7
Avatar uporabnika
hello sir , I am a full time freelancer and have 10 years of experience in web and window development in asp.net c#, javascript,sql server . and Android mobile development i can do work as per your requirement . I can quickly understand the details and idea of your project so I think my technology is suitable for your project. please inbox me so that we can talk. Thanks Sanjay
$500 USD v 7 dneh
4,9 (9 ocen)
5,4
5,4
Avatar uporabnika
Hello I'm familiar Page Scrapping with Phantom JS and php script. I have some examples. I read your description and i can start right now. Please discuss details on chat, Thanks
$700 USD v 7 dneh
4,9 (11 ocen)
5,6
5,6
Avatar uporabnika
Hello Dear, Yes, I can work for you as per your project description with amazing exploration and experimental research abilities of mine organization is perfect for that you may require. My work fulfills as well as keep you returning consistently. It is because of the importance behind this field that I am confident & serious when taking these types of projects. Let me introduce with professionalism and skill that exists to supply the best. Regards, https://www.freelancer.com/u/Servicehour24 Servicehour24
$600 USD v 10 dneh
5,0 (8 ocen)
4,3
4,3
Avatar uporabnika
Hello, I checked out your requirements.I have 5+ years of working experience and Expertise in IOS , Android , Web Development, PHP, JavaScript, NodeJS, HTML,C++ ,Wordpress, CSS, RestAPI, Third-Party integration. I am available to start quick work on your app & assure you to provide highly perform-able with in given time. Hope to see you soon.
$500 USD v 7 dneh
5,0 (2 ocen)
3,0
3,0
Avatar uporabnika
Hi there! I have read your description carefully and I am confident I can full fill your requirement. I provide my skills in hopes of working with you. I am a web scraper and have 7+years of ample experienced in web scraping. I can extract data on any website using python and PHP script(beautiful soup, selenium, scrapy, phantomJS) I can save data scraped into xlsx, CSV, MySQL and etc using CSV module and xlsxwriter please feel free to contact me if you want. I look forward to working back with you. Best Regards.
$500 USD v 7 dneh
5,0 (3 ocen)
2,5
2,5
Avatar uporabnika
Dear Sir. Glad to meet you. I'm Web developer specializing in web scraping crawling and indexing web pages. Skills: python, scrapy, selenium, requests, beautifulsoup, mechanize, lxml, urllib2, automation, bots, spiders I worked with 50+ differenct individuals/startups/companies and helped them archive their goals. Here¡¯s what you will get by working with me: * Working only on projects that I can deliver 100% * Ridiculous quality of work * Smart suggestions on increasing results/revenue and decreasing costs * Responsibility for tasks/project I work on * Reliability * Short response time * Good sense of humor ;) Hope I could awake you interest in me. Thank you for your attention.
$500 USD v 7 dneh
0,0 (0 ocen)
0,0
0,0
Avatar uporabnika
Hi I have read your post content carefully and can develop your python project as my experience. That's why I have rich experience with Python. I am a new freelancer on freelancer.com, but I can provide you robust and cleanest code. Please contact me, so we can discuss how to work to fully meet your needs. Regards
$500 USD v 7 dneh
0,0 (0 ocen)
0,0
0,0
Avatar uporabnika
Nice to meet you Hi I am automation expert If there is any website you need to scrape data from (no matter the format, what blocking tools there are). I can deliver the data. If you do the same thing on the internet day after day and are just tired of it, then I will free you of your pain. When we talk I will be focused primarily on your needs. That means that I will: 1) Help you to determine your exact goals, the scope of the project and clarify exact details 2) Save you money by adding in suggestions for improving the value of the work I deliver to you 3) Deliver a step by step proposal for how I will solve your problems 4) Deliver the solution, in whatever time frame you need it. I am good at javascript,php,python,software-architecture,web-scraping Thank you
$637 USD v 9 dneh
0,0 (0 ocen)
0,0
0,0

O stranki

Zastava CANADA
Sabrevois, Canada
5,0
44
Član(ica) od maj 23, 2014

Verifikacija stranke

Hvala! Po e-pošti smo vam poslali povezavo za prevzem brezplačnega dobropisa.
Pri pošiljanju vašega e-sporočila je šlo nekaj narobe. Poskusite znova.
Registrirani uporabniki Skupaj objavljenih del
Freelancer ® is a registered Trademark of Freelancer Technology Pty Limited (ACN 142 189 759)
Copyright © 2024 Freelancer Technology Pty Limited (ACN 142 189 759)
Nalaganje predogleda
Geolociranje je bilo dovoljeno.
Vaša prijavna seja je potekla, zato ste bili odjavljeni. Prosimo, da se znova prijavite.