Code a webcrawler wich crawls the web for specified keywords and build excerpts

Končano Objavljeno pred 2 letoma/leti Plačilo ob prevzemu
Končano Plačilo ob prevzemu

We need a webcrawler, wich crawls the whole german languaged based web, to find specified keywords and extract then excerpts from pages. A bit like Google or Bing, but of course with specified keywords.

The goal is to find business signals about new buildings or relocations of companies so that we can offer our products there. Companies post messages about it on their own websites or on social media platforms.

We want to set various keywords after crawling to find these messages. For example, these are the words "neubau" which means new building, "baut neu" wich means build new and "errichtet" wich meens build.

Since we then also receive messages that, for example, ships are being newly built, we need exclusion keywords in the next step. So we would define "ship" as an exclusion, and these excerpts then do not need to be displayed. For example, another exclusion keyword would be "warehouse" because these companies do not need our products. We need to be able to conveniently add both included and excluded keywords at any time from the backend of the homepage.

Duplicate excerpts should be filtered out. Similar entries should be grouped together if possible. An excerpt should show (as shown in the example) about 50-100 words around the keyword found, so that we can assess whether this message fits our intent or not.

A database should be created, with a web page view for the results. On the left, the company with address, phone, etc. (see example) on the right side the different business signals found for this company. In different tables in the database to implement rights and access management later. The admin zone for regulating this and the keywords should already be created. The website can run on our IIS for the time being, but should go online later. If necessary we want to market the software for other customers (with other keywords) later on. There should already be a login for our employees. And it should also be possible to export the data so that we can transfer it to our CRM system.

We can send you two screenshots to describe the searched output. If you understand german language it is simpler for you to interpret the samples. Please request the samples before submitting a price.

Podatkovno rudarjenje Obdelava podatkov Python Data Scraping Pridobivanje spletnih informacij

ID projekta: #29730296

Več o projektu

8 predlogov Oddaljen projekt Aktiven pred 2 letoma/leti

Dodeljeno:

(37 mnenj)
6.1

8 freelancerjev ponuja v povprečju za €191 na tem delu

imtyzooel71n

Hi, I am Python script developer with 10 years of experience. I can build a script/bot for you by python with instructions very short time. Can we discuss please? Thanks.

€175 EUR v 3 dneh
(93 ocen)
6.3
salmanullahbaig

Hi, can you please share the sample? I have experience in python data scraping using request, selenium and many other ways. Would like to discuss more in detail. Thanks

€175 EUR v 7 dneh
(6 ocen)
4.5
merinsinha

I can do it. Hi i am an Senior Python web crawling , web scraping Expert. As 9+ years experiences in these field. I can give good quality work. I have read the guidelines of your work.I believe that i can provide you Več

€200 EUR v 5 dneh
(38 ocen)
4.7
asciencioalex

I am an highly experienced freelancer. I am offering services in Web Applications, Machine Learning, Deep Leaning, Arduino programming , Raspberry pi Android app development, Data Science, Natural Language Processing, Več

€175 EUR v 5 dneh
(2 ocen)
0.3
AlikAgaian

Dear Client. I have read the description carefully. I fully understand what you want and it is doable for me. I am ready now for you. Let's chat so that we can discuss details. Thank you.

€175 EUR v 7 dneh
(0 ocen)
0.0
Parvez74

Hello, I have gone through your project description and understood what has to be done in this task and can give you a complete assurance that I can do the job. I have sound experience in performing such kind of work Več

€175 EUR v 7 dneh
(0 ocen)
0.0