Find Jobs
Hire Freelancers

Scrape newest real estate listings with Ruby and Active Admin as CRUD -- 2

$250-750 USD

Zaprt
Objavljeno pred približno 4 leti

$250-750 USD

Plačilo ob dostavi
We want to scrape real estate listings of 3 different websites. More websites will be added later. Ideally we can add more websites by configuration (ideally we can configure the regex for each variable). We will provide a briefing with all values marked on the respective listings pages. The goal for the tool is to scrape the newest listings so we can check them and if needed, post them on our own platform (of course with a reference to the source) instead of copy-paste them by hand. The scraper should have the following behavior: - 1st we scrape the index/result pages to find newly added listings - 2nd we visit and scrape individual listings The scraper should not scrape more than 5 listings per hour per website to prevent unnecessary load and the scraper from being banned. Scraper has to be developed in Ruby (or RoR) and we will use Active Admin as CRUD for the data management. Database will be PostgreSQL. You should also be able to set this up on Amazon AWS (EC2/RDS/S3). We might also integrate the tool you develop into an existing setup. In addition you know about using proxies and can implement that. Finally, please add the result of 6+5=? to your bid, so we know you're not a bid bot.
ID projekta: 24081228

Več o projektu

19 ponudb
Projekt na daljavo
Aktivno pred 4 leti

Želite zaslužiti?

Prednosti oddajanja ponudb na Freelancerju

Nastavite svoj proračun in časovni okvir
Prejmite plačilo za svoje delo
Povzetek predloga
Registracija in oddajanje ponudb sta brezplačna
19 freelancerjev je oddalo ponudbo s povprečno vrednostjo $588 USD za to delo
Avatar uporabnika
result = 11 Hi, my name is Selim. I am from UK. I read your "Scrape newest real estate listings with Ruby and Active Admin as CRUD --2" project descriptions carefully before bidding. I checked your requirements as well... I got what you need and ready to go ahead as soon as we can clarify further project details. I am 5-star web scraping expert here at freelancer.com. Pls check my profile and feedbacks first to have some idea about the quality of my previous businesses. I had many similar web scraping tasks, including extraction of large product data from various ecommerce websites, all achieved with 5/5 rating. Kindly get back to me if you wish to proceed with a top-rated and reliable partner here...pls note that I only deliver best quality at a reasonable price, and I am open for longterm partnerships, if you wish too... I bid my best for you to start business, and I am ready to prepare a sample task for you to check & validate, once you give me a reply... Kind Regards, Selim
$550 USD v 7 dneh
5,0 (303 ocen)
8,2
8,2
Avatar uporabnika
11 Hi there,I am Web Scraping expert from Bosnia & Herzegovina,Europe. What are the URLs of those 3 websites ? Please feel free to initiate the chat so that we can discuss further details. Thank you for taking the time to read my proposal.I am looking forward to hearing from you. Best regards, Miljan
$650 USD v 14 dneh
4,9 (169 ocen)
8,0
8,0
Avatar uporabnika
You can bank on me for the expertise in scrapers and crawlers I have. Having delivered many such similar projects in the past, I look forward to discuss and start the project inline to your requirements
$500 USD v 7 dneh
4,9 (66 ocen)
6,7
6,7
Avatar uporabnika
6+5=11 I have done this before for an Australian client, this is not very trivial and if you are not careful your IP would eventually get banned from their servers
$2.000 USD v 30 dneh
4,9 (27 ocen)
6,3
6,3
Avatar uporabnika
6+5=11 Hi, i'm good at web scraping . Last year, i created private ruby gem for scraping specific site. Experienced on ActiveAdmin Gem , Postgresql database. Also I can deploy it on EC2 . Thanks, Mezbah Alam
$500 USD v 7 dneh
5,0 (57 ocen)
6,4
6,4
Avatar uporabnika
Dear Client , Hope you are doing well, I have reviewed the job post and would like to join you as a fullstack ROR developer. I am full time and immediately available for this job (40 hrs in a week ) and having excellence communication skill, request you to please share some more details to get start the job. I am working in Ruby on Rails from last 10 years, I have done too many projects with different technologies as well as different types of servers, like Ubuntu, Centos, etc. And have full command on Server side configurations along with multiple databases. Like Mongo, Postgresql, mysql, redis, etc. As I have great expertise in : ----Core - Ruby and Ruby on Rails , react , react native ----Front end - JavaScript, Angular.js, React JS, Backbone.js, HTML, HTML5, Bootstrap, CSS3, ----Test Driven Development - RSpec, Capybara, Shoulda, FactoryGirl, Selenium, Poltergeist stack. ----Database - MySQL, PostgreSQL ----Middleware - Redis/Resque, Memcached, Sidekiq, Delayed_job ----Methodologies - Scrum/Agile, TDD, BDD, pair-programming ----Cloud server - EC-2, Digital Ocean, Heroku, Linod, Azure ----API Integration - Facebook, Twitter, Google, LinkedIn, Twilio, Sendgrid and other, Payment API. So please give me opportunity to proof you my skills. I hope you and i will go for longer relationship. Thanks.
$250 USD v 5 dneh
4,9 (56 ocen)
6,4
6,4
Avatar uporabnika
Hi, I will build the scraper in Java(although Ruby is not a problem. I have expertise building scrapers in Java). I will set up cron jobs on EC2 instance to trigger the "NEW LISTINGS" scraper each day and "INDIVIDUAL LISTINGS" scraper each day that scrapes only five listings per hour per website. I will automate the entire process. I have expertise in automating such tasks. Please contact me to discuss more about my proposal. Looking forward to hearing from you soon. Thank you.
$500 USD v 6 dneh
5,0 (12 ocen)
6,0
6,0
Avatar uporabnika
Hi, I can Scrape newest real estate listings with Ruby and Active Admin as CRUD for you on time and within your budget. Website design and development work portfolio: https://www.freelancer.com/u/webdroid Skills and expertise: HTML5 , CSS3, JAVASCRIPT,Jquery ,Bootstrap,ajax,PHP ,Mysql ,Laravel ,Codignator,ecommerce ,UI UX, API integration, payment module integration,Web scrapping. Let's connect in chat
$450 USD v 5 dneh
4,9 (5 ocen)
5,2
5,2
Avatar uporabnika
11 Hello there, Hope you are doing fine. I am a full-stack web developer with more than 6 years of experience in web scrapping Ruby and PostgreSQL. I can develop a perfect tool for you that will scrape the data from 3 websites listings. It will scrape the newest listings as per your requirements. And the scraper will not scrape more than 5 listings per hour per website. I understand your requirements and can do this job perfectly for you. Share that 3 websites and more details about it. Let's discuss it over chat. Waiting for your response
$250 USD v 2 dneh
5,0 (1 ocena)
4,4
4,4
Avatar uporabnika
Nice to meet you I am an Amazon Cloud Architect for the web infrastructure serving 90 million page impressions and 12 TB Internet traffic per month. The AWS services I use are EC2, ELB, MySQL RDS, VPC, CloudFront, ElastiCache, CloudWatch, CloudFormation, OpsWorks, ElasticBeanstalk, CodeDeploy, S3, SES, SQS and SNS. I have 20 years of Linux SysAdmin experience. I currently use Apache, Nginx, Ldirectord, MySQL, Perl, PHP, Memcached, Sphinx, Bind, Typo3, WordPress, Send-mail, Postfix, NFS, Samba, Snort, Vsftpd, aide, Nagios, Cacti, Puppet and a bunch of other traditional Linux software. I am good at amazon-web-services,postgresql,ruby,ruby-on-rails,web-scraping If you’re looking for a developer that’s truly an expert, driven by passion, not afraid to take on a challenge, and will be there with you every step of the way then look no further as I’m your guy.
$637 USD v 9 dneh
4,8 (5 ocen)
3,8
3,8
Avatar uporabnika
I have gone through the above-mentioned details very well. I have got plenty of experience in ruby on rails, web scraping, amazon web services, postgresql, ruby kinds of works and I can assure you that I can reach your satisfaction level by providing you best results with ruby on rails, web scraping, amazon web services, postgresql, ruby Looking for a positive response Thanks
$456 USD v 7 dneh
5,0 (1 ocena)
3,2
3,2
Avatar uporabnika
11 Hi, I can do that and have rich experience to scrape data from websites. Please contact me via private chat. Regards, Fan
$500 USD v 7 dneh
5,0 (1 ocena)
1,4
1,4
Avatar uporabnika
Hello there, How are you doing? Just saw your project posted. I read the brief details and I felt I could help you with it. Lets start the chat and discuss it in detail. Please check my porfolio: My Portfolio: https://www.freelancer.com/u/AITSoft Availability timings: 8am-8pm EST Regards, Shamshad
$750 USD v 22 dneh
0,0 (0 ocen)
0,0
0,0

O stranki

Zastava SWITZERLAND
Zollikon, Switzerland
5,0
29
Plačilna metoda je verificirana
Član(ica) od sep. 2, 2009

Verifikacija stranke

Hvala! Po e-pošti smo vam poslali povezavo za prevzem brezplačnega dobropisa.
Pri pošiljanju vašega e-sporočila je šlo nekaj narobe. Poskusite znova.
Registrirani uporabniki Skupaj objavljenih del
Freelancer ® is a registered Trademark of Freelancer Technology Pty Limited (ACN 142 189 759)
Copyright © 2024 Freelancer Technology Pty Limited (ACN 142 189 759)
Nalaganje predogleda
Geolociranje je bilo dovoljeno.
Vaša prijavna seja je potekla, zato ste bili odjavljeni. Prosimo, da se znova prijavite.