Find Jobs
Hire Freelancers

Big data Engineer

$25-50 USD / hour

Closed
Posted almost 6 years ago

$25-50 USD / hour

• Build data pipelines and ETL using heterogeneous sources to Hadoop using Kafka, Flume, Sqoop, Spark Streaming etc. • Experience in batch (Spark. Scala) or real-time data streaming (Kafka) • Knowledge of design strategies for developing scalable, resilient, always-on data lake
Project ID: 17127074

About the project

36 proposals
Remote project
Active 6 yrs ago

Looking to make some money?

Benefits of bidding on Freelancer

Set your budget and timeframe
Get paid for your work
Outline your proposal
It's free to sign up and bid on jobs
36 freelancers are bidding on average $37 USD/hour for this job
User Avatar
Hello, I have gone through the project details specified , but need to clear some points. So please click Chat button to initiate chat and send a text message when you are available to discuss. For Now I am placing a placeholder bid as the bid amount field is compulsory to submit this proposal. Thanks & Regards Hire Tech Experts
$42 USD in 10 days
5.0 (4 reviews)
5.9
5.9
User Avatar
We are Ukrainian software development company that employs several passionate engineers. Our main direction is the engineering, development and implementation of custom software with a deep scientific focus that requires strong skills in mathematics, physics and other exact and natural scientific disciplines. Technical leadership of the company is held by two keen scientists with Ph.D. degrees in physics, mathematics and technical sciences. During the last 5 years we have been involved in several projects related to cloud computations, math libraries, machine learning, parallel computing, CAD/CAE, engineering drawing, production costing, computer vision, remote device control, brain physics modeling, natural language processing, satellite imaginary and others. We would be happy to take care of your bold and complicated project!
$27 USD in 40 days
5.0 (1 review)
5.2
5.2
User Avatar
Hi, I am working in Bigdata/hadooptechnologies including Spark, Kafka, Cassandra, ELK stack NLTK using Java, Scala and Python. Can we discuss details on the requirement? Thanks and Regards!
$45 USD in 40 days
5.0 (44 reviews)
5.4
5.4
User Avatar
Hi, My name is Xiong Jie Zhao. I am a newbie in this freelancer, but I have a lot of experiences with Java EE and Hadoop development. I have some experiences with Amabari for data scraping using nutch based on hadoop. Let me know what kind of your project is. Let's discuss more detail. Regards.
$35 USD in 40 days
4.9 (12 reviews)
4.3
4.3
User Avatar
Hi, I have 7 years of experience and working on hadoop, spark, nosql, java, cloud... Done end to end data warehouse management projects on aws cloud with hadoop, hive, spark and presodb. Worked on multiple etl project like Kafka, nifi, flume, mapreduce, spark with XML/JSON., Cassandra, mongodb, hbase, redis, oracle, sap hana, ASE.... Many more. Let's discuss the required things in detail. I am committed to work done and strong in issue resolving as well. Thanks
$25 USD in 30 days
5.0 (6 reviews)
4.0
4.0
User Avatar
Hi, I have more than 4+ years of experience in big data technologies like hadoop, HDFS, Hive, spark, Kafka,scala MapReduce etc. I have worked on AWS/Azure Services. I know how to configure the EMR Cluster. Deplyments of MapReduce , Scala code on aws and Azure. contact me for more details
$41 USD in 40 days
4.7 (5 reviews)
3.9
3.9
User Avatar
Hi, I have experience working with Hadoop and Spark. I can work on this project. PS: hourly rate is negotiable. Thanks, Pranay
$27 USD in 40 days
5.0 (5 reviews)
2.6
2.6
User Avatar
Hi, I have a throughout knowledge of Spark and Scala. For my daily work I'm using these and other hadoop technologies since 2015. Your project cannot be a problem for me, just choose me, and let's start to discuss the details and your needs. Bests, Janos
$41 USD in 40 days
5.0 (1 review)
1.0
1.0
User Avatar
Hi there, We are a team based in Argentina with strong experience in software and mobile development. We are able to do your project starting ASAP. Do not hesitate to contact me if you are interested. You will not regret, Thank you very much, Best regards, Jorge.
$40 USD in 40 days
0.0 (0 reviews)
0.0
0.0
User Avatar
Hi, I am a software professional with around 12 years experience in software development and test automation. I am specialised in below skills -Excel macro development -Development of Software Test Automation Framework and Test Script -Creation of Robotic Process Automation bot -Manual and Automation Testing Specialised in below tools -EXCEL Macro/VBA -HP UFT/QTP -TestComplete -Selenium, Cucumber -JAVA,SCALA -AutomationAnywhere, WorkFusion Domains -Healthcare -Investment Bank -Retail -Forex Specialised in below methodologies -Agile -Iterative -Waterfall I have worked with clients like NHS, United Health, BT, O2, Thales, Citigroup services in our career.
$38 USD in 40 days
0.0 (0 reviews)
0.0
0.0
User Avatar
I have built the big data ecosystem of the company from scratch. During this period, I've built the hadoop cluster and then upgraded it into HA mode; I've built kafka open platform which can maintenance cluster visualized and use it with ACL and visual monitoring; I've writen many mapreducer task for data etl and analysis; I've writen many spark and storm programs for real time calculation; I've built nginx-kafka-hdfs system which transfer data by flume for log collection. Can we have a further talk about the project.
$41 USD in 40 days
0.0 (0 reviews)
0.0
0.0
User Avatar
we have the expertise and domain knowledge of 10 years combined to deliver the project .we can quickly get you on onboard and provide the right time to time insights of the project. we have buiuld humongous pipelines using Storm, Mapreduce , Spark, Kafka, Hbase . And also have provided patches in Hbase, Storm for better performance.
$44 USD in 40 days
0.0 (0 reviews)
0.0
0.0
User Avatar
Hi, Currently i am working for E-Commerce Project as Big Data Developer. We working on Spark Streaming and Kafka, MongoDB.
$27 USD in 40 days
0.0 (0 reviews)
0.0
0.0
User Avatar
Our clients include: Citi Bank US, SBI (the Largest bank in India). We have a team of 6 Data Scientists, 15 Developers, 4 Project Analyzers. Shouldn't be a big challange to handle your project. Thanks & Regards, Dipankar
$55 USD in 40 days
0.0 (0 reviews)
0.0
0.0
User Avatar
Data Engineer professional, working for a fortune 500 client, experienced in end-to-end project life cycle. Handled projects from scratch to deployment phase which included ingestion, ETL and ELT, Data Validation, Visualisation and building recommendation systems using On-Prem as well as Cloud based environments. Also enthusiastic about exploring and taming new technologies and trends with basic focus on Machine Learning, Big Data and Cloud.
$41 USD in 40 days
0.0 (0 reviews)
0.0
0.0
User Avatar
Well, if you expect this as your induction question, then the answer would be to highlight your strengths that you could bring to the table which will be: your functional or domain skills that you have gained over the period, the process skills to show your discipline, the interpersonal skills that keep your team momentum going and the technical skills that you could contribute to the project success.
$41 USD in 40 days
0.0 (0 reviews)
0.0
0.0
User Avatar
Hello, I am currently working as a data engineer. I have experience in spark(python/scala), kafka, nifi, etc. since a year. I can get this work done easily and within time.
$44 USD in 20 days
0.0 (0 reviews)
0.0
0.0
User Avatar
I have 9 years of Experience in ETL and more than 5 years of experience in Bigdata tech. My strength is , understand the project quickly and give smart and simple solution to solve the problem. I can guarantee, you will definitely impress with my work style.
$25 USD in 40 days
0.0 (0 reviews)
0.0
0.0
User Avatar
Hi, I am not sure if you will be considering my application at all as this is the first time I am applying for a project on freelancer and do not have anything against my name to showcase my potential. However I would like to take this opportunity to tell you that I am really very good at apache spark and overall big data barring real time process to be honest. And would put my 100 per cent to get your work done. Best Regards Rupesh
$25 USD in 40 days
0.0 (0 reviews)
0.0
0.0
User Avatar
Have already implemented a similar project for a leading Brand Experience company in the USA using Hadoop, Java, Scala & Spark. Solution implemented: ➢ Source System - (Data which is in any format or any system). File, SQL Data, URL. ➢ Staging System - (Convert data based on Staging System) Capturing Insert, delete and update ➢ Destination DB System – All the source system will be converted into a single destination using ETL (Extract, Transform, Load) ➢ Source System (Raw Data)  Staging System  Destination Db (Transformed Data). ➢ Tools used to perform this ETL so that all the data are sorted in once single destination (SQL database). ➢ Cloud-based data integration service that allows you to create data-driven workflows in the cloud for orchestrating and automating data movement and data transformation. ➢ Able to monitor when how many data are processed from source to destination. Ability to track and get notification if the data process is stopped in between. ➢ Advantage is viewing reporting in Mobile Application without using any third party. ➢ Make data-driven decisions, from anywhere o Keep on top of your data no matter where you are. o With touch-enabled native apps for Windows, iOS, and Android, you can access all your data wherever you go.
$38 USD in 40 days
0.0 (0 reviews)
0.0
0.0

About the client

Flag of UNITED STATES
United States
0.0
0
Member since Jun 7, 2018

Client Verification

Thanks! We’ve emailed you a link to claim your free credit.
Something went wrong while sending your email. Please try again.
Registered Users Total Jobs Posted
Freelancer ® is a registered Trademark of Freelancer Technology Pty Limited (ACN 142 189 759)
Copyright © 2024 Freelancer Technology Pty Limited (ACN 142 189 759)
Loading preview
Permission granted for Geolocation.
Your login session has expired and you have been logged out. Please log in again.