Modifications on a Postgresql database using Scala and Spark

$10-30 USD

Completato

Pubblicato

quasi 6 anni fa

$10-30 USD

Pagato al completamento

The project is about making modifications on a table on a postgresql database using Scala and Spark. The following functions are required: 1- Connect to a Postgresql database. 2- Update a column based on the existence of certain words on another column and write the new table on the database. 3- Filter non-relevant tweets: define the filtering criteria (removing retweets, remove spams : tweets containing squads, removing tweets containing only urls or mentions, etc. 4- call a function that compute a score for each tweet : score = number of suicide, depression terms. 5- integrate these steps as a generic function, try to use something scalable, so that we can modify the criteria easily without touching the whole pipeline.

PostgreSQL

Scala

Spark

Rif. progetto: 16936018

Info sul progetto

5 proposte

Progetto a distanza

Attivo 6 anni fa

Hai voglia di guadagnare un po'?

Indirizzo Email

I vantaggi delle offerte su Freelancer

Imposta il tuo budget e le scadenze

Fatti pagare per il lavoro svolto

Delinea la tua proposta

La registrazione e le offerte sui lavori sono gratuite

Assegnato a:

@pradeepred

Have 10 years of IT experience with more than 4.5 years of experience in hadoop technologies like hive,pig,spark,sqoop,map reduce and [login to view URL] have very good experience in Java,scala,Python and shell scripting. Worked in more than 7 real time hadoop [login to view URL] of 7,3 are in spark First 7 years I have worked in various relational databases like MySQL,SQL server,oracle and db2. Also worked in SSIS and knowledge about dataware housing concepts

$50 USD in 1 giorno

0,0

(0 valutazioni)

0,0

5 freelance hanno fatto un'offerta media di $61 USD

@ahmsak

Hello Sir, I am a computer science tutor, I teach (among others) Scala, Spark and Advanced Algorithms. I have done many projects like this, and I'm one of the top Scala developers, and you can check by clicking on my profile picture. Please contact me for more details when possible. I look forward to work for you, Sir. Best Regards.

$100 USD in 1 giorno

5,0

(8 valutazioni)

4,2

@sandeepfreax

Hi I am interested in this job. I believe that the skills and experiences I have gained at this position make me an ideal candidate for this position. I have extensive experience in implementing Spark-core, Spark-sql and Spark-Streaming. I have developed strong programming and debugging skills. I have completed dozens of PoC for my customers and received praise for the before time completion and that in Scala, Java and Python. Beside Apache Spark, I have also gained extensive experience in Jenkins and Automated / Unit Testing. My experience has afforded me the opportunity to become familiar with the some of the best used architectures in the programming. In particular, through my work I have become heavily involved in writing the good applications and debugging the high severity issues. It has also helped me in designing the best application model. I am always eager to learn about new emerging technologies in the world of programming and Devops Integration. I would love to bring the passion for programming and sharing the good practices with your application. I am confident that my experience in the Big Data and my programming skills in Scala / Java / Python will qualify me for consideration. If you would like, I can discuss my experience with you. I look forward to meeting with you and discussing my qualifications in more detail. PS : I am certified Spark, Scala and Java Developer. Beside that I held many certificates in different domains from BigData Univesity.

$55 USD in 2 giorni