Find Jobs
Hire Freelancers

Data Engineeering

$250-750 USD

Chiuso
Pubblicato quasi 3 anni fa

$250-750 USD

Pagato al completamento
I need an expert in Pyspark. who can read the data from kafka topic and write it to hive tables applying required transformations.
Rif. progetto: 30461593

Info sul progetto

18 proposte
Progetto a distanza
Attivo 3 anni fa

Hai voglia di guadagnare un po'?

I vantaggi delle offerte su Freelancer

Imposta il tuo budget e le scadenze
Fatti pagare per il lavoro svolto
Delinea la tua proposta
La registrazione e le offerte sui lavori sono gratuite
18 freelance hanno fatto un'offerta media di $541 USD
Avatar dell'utente
Hi, I saw that you need help with Python, PySpark, Apache Hadoop and Spark. I have 9 years of experience working on these frameworks. I believe I can help you with it. I would request you to have a look at my portfolio, customer feedbacks from my profile. If you find me worthy of doing your job. Please start the chat and lets discuss it. Regards Awais
$750 USD in 11 giorni
5,0 (7 valutazioni)
6,4
6,4
Avatar dell'utente
Hi there, I'm bidding on your project "Data Engineeering" Being an expert in Python and matlab programming I can do this project for you. please leave a message on my chat so we can discuss the budget and deadline of the project. Also, have a look at my profile for my reviews and portfolios. Thanks Note: This is not an automated bid and i'm ready to discuss your project right now. .. .
$750 USD in 5 giorni
5,0 (11 valutazioni)
6,1
6,1
Avatar dell'utente
Hi there,I'm biddin on your project "Data Engineeering" I have read your project description and i'm an expert in Python and machine learning therefore i can do this project for you perfectly.I still have a few questions. please leave a message on my chat so we can discuss the budget and deadline of the project. Thanks. .. .
$750 USD in 3 giorni
4,8 (21 valutazioni)
6,2
6,2
Avatar dell'utente
Hello, I am very good at python data engineering. Please check my profile I hope to discuss more. Thank you. nemanja
$500 USD in 7 giorni
5,0 (19 valutazioni)
6,1
6,1
Avatar dell'utente
Hello! I am a python pyspark expert who has 10 years of experience and certifications. I would like to help you. Please let me know your choice.
$500 USD in 7 giorni
4,8 (14 valutazioni)
6,0
6,0
Avatar dell'utente
I read your project description carefully. I am bidding on your project because I am very much familiar with Data Engineering and tools like Kafka, Hadoop ECO system, Pyspark and Azkaban. I am an experienced Data Scientist and Machine Learning Engineer. Data Visualization, NLP, Deep learning, Artificial intelligence, machine learning, Data structures, and algorithms are my major fields. I finished specializations on Data Science, Machine learning, Deep neural Network, Convolution NN, Recurrent NN, Tuning Hyper Parameter .this project will well fit for me. I have won the 2nd runners up award in Sri Lanka Biggest Data Science Competition. I am very fluent with python and did a lot of data science and ml project. So I am familiar with these related libraries such as matplotlib, seaborn, pandas, numpy, sikit-learn, Keras, TensorFlow, spark etc .
$300 USD in 6 giorni
5,0 (74 valutazioni)
5,6
5,6
Avatar dell'utente
Hello, ‌Hope you doing well. We are a team of software developers. Delivered more than 100 projects based on ML, AI, application development, website and similar projects. Kindly message me in chat so that we can discuss about the project. ‌Regards Anchal
$500 USD in 15 giorni
4,9 (23 valutazioni)
5,1
5,1
Avatar dell'utente
hi, I recently completed a pyspark data pipeline project where data pulled from kafka producer, did training and prediction and written to elasticsearch and sent to kafka consumer topic using pyspark. You can see the review from my client. I did the complete ML model training and stream processing for prediction. Also I did it using latest version of Spark i.e. 3.1.1. I can do the same for hive table sink. I have five years of experience in building production data pipeline and ML/AI systems. Can we discuss in detail. Thank you.
$280 USD in 2 giorni
5,0 (10 valutazioni)
4,6
4,6
Avatar dell'utente
Hi, I am an experienced Data Engineer with a solid background in Spark. I have worked on many Big Data projects with Spark, Scala, Python, Cassandra, Kafka, Snowflake,... Let's have a call for more details about the project. Regards
$500 USD in 3 giorni
4,8 (3 valutazioni)
4,5
4,5
Avatar dell'utente
Hi Greetings! I have worked on similar projects working on streaming data using kafka clusters and big data applications using hadoop and spark. Used several datrabases including sql and nosql . Please inform further deails
$500 USD in 10 giorni
4,8 (9 valutazioni)
4,6
4,6
Avatar dell'utente
Hello This is Ajay singodia having expertise in python and experienced in MNCs as well worked with great teams now in my team we are 3 peoples. Thanks
$658 USD in 7 giorni
0,0 (0 valutazioni)
0,0
0,0
Avatar dell'utente
HI I have 1.5 years of experience in developing PySpark applications and I have 5 years of experience in developing Spark applications. If you elaborate your requirements I will be able to help you .If interested please ping me. Below approach can be used for solving your issue First need to read the data from corresponding Kafka topic into an RDD and then after doing the transformations using data frame operations we can load data into hive tables. The tables needs to be portioned based in the access pattern .
$500 USD in 7 giorni
0,0 (0 valutazioni)
0,0
0,0
Avatar dell'utente
I have excellent skills in pyspark, kafka, python, ETL/ELT, DWH, bigdata, etc. With over 15+ years of exp in s/w development and over 10+ exp in data engineering. Provided a chance I should able to deliver the project with full enthusiasm. Hope to connect with you soon.
$800 USD in 7 giorni
0,0 (0 valutazioni)
0,0
0,0
Avatar dell'utente
I have worked in python pyspark and hive query language. Worked in extracting data from json to pyspark dataframes and loading them into hive database.
$500 USD in 7 giorni
0,0 (0 valutazioni)
0,0
0,0
Avatar dell'utente
Hi, I am a data engineer with 7 years of experience in ETL related projects. Let me know if I can help you with project. Also we can discuss the requirement over short meeting if you really interested. Thanks, Bala
$700 USD in 7 giorni
0,0 (0 valutazioni)
0,0
0,0
Avatar dell'utente
Hi, I have been working on pyspark since 5 years now. I have recently developed Kafka- PySpark streaming application for my MNC client. I have dealt with variety of data sources having structued or unstructured format. Besides everything, I love churning data and absolutely love solving challenges the raw data can throw at you. Please let me know if we can complete this together. Best Regards, Sandy
$250 USD in 3 giorni
0,0 (0 valutazioni)
0,0
0,0

Info sul cliente

Bandiera: UNITED STATES
Overland Park, United States
0,0
0
Membro dal ott 24, 2020

Verifica del cliente

Grazie! Ti abbiamo inviato tramite email il link per richiedere il tuo bonus gratuito.
Non è stato possibile inviarti l'email. Riprova per piacere.
di utenti registrati di lavori pubblicati
Freelancer ® is a registered Trademark of Freelancer Technology Pty Limited (ACN 142 189 759)
Copyright © 2024 Freelancer Technology Pty Limited (ACN 142 189 759)
Caricamento anteprima
Autorizzazione per la geolocalizzazione concessa.
La tua sessione è scaduta ed è stato effettuato il log out. Accedi nuovamente per piacere.