Find Jobs
Hire Freelancers

Pyspark Data engineer for a test project in Spark

₹600-1500 INR

Zaprt
Objavljeno pred skoraj 3 leti

₹600-1500 INR

Plačilo ob dostavi
Looking for a pySpark developer to help with a pyspark application for demonstration purpose. The goal is to read 3 small json files each less than 1 mb into a single data frame. Do preprocessing and then fetch some metrics based on regular expression search. ETL task is easy and I am able to achieve it. However the end goal is written below that is also the acceptability criteria for this project. The developer should be able to write code with following points in mind: Well structured, object-oriented and maintainable code. Unit tests for the different components. Documentation, comments and Proper exception handling. Solution is deployable and we can run it (locally and on a cluster) Config management. (separate folders and files like [login to view URL], [login to view URL] etc. rather than one python script). Logging and alerting. Data quality checks (like input/output dataset validation).
ID projekta: 29872024

Več o projektu

1 ponudba
Projekt na daljavo
Aktivno pred 3 leti

Želite zaslužiti?

Prednosti oddajanja ponudb na Freelancerju

Nastavite svoj proračun in časovni okvir
Prejmite plačilo za svoje delo
Povzetek predloga
Registracija in oddajanje ponudb sta brezplačna
1 freelancer je oddal ponudbo s povprečno vrednostjo ₹1.050 INR za to delo
Avatar uporabnika
Hi, I am working in MNC as Data Engineer and currently working on Big Data Fields using PySpark and Hadoop Frameworks. Having more than 4 years of experience in Big Data Field in production and certified pyspark developer as well as certified Hadoop developer. Requesting you to please share the details. Thanks Rahul.
₹1.050 INR v 7 dneh
4,4 (4 ocen)
2,2
2,2

O stranki

Zastava INDIA
Pune, India
0,0
0
Član(ica) od jul. 8, 2019

Verifikacija stranke

Hvala! Po e-pošti smo vam poslali povezavo za prevzem brezplačnega dobropisa.
Pri pošiljanju vašega e-sporočila je šlo nekaj narobe. Poskusite znova.
Registrirani uporabniki Skupaj objavljenih del
Freelancer ® is a registered Trademark of Freelancer Technology Pty Limited (ACN 142 189 759)
Copyright © 2024 Freelancer Technology Pty Limited (ACN 142 189 759)
Nalaganje predogleda
Geolociranje je bilo dovoljeno.
Vaša prijavna seja je potekla, zato ste bili odjavljeni. Prosimo, da se znova prijavite.