Find Jobs
Hire Freelancers

100 gb data processing

₹1500-12500 INR

Closed
Posted over 2 years ago

₹1500-12500 INR

Paid on delivery
I have un-managed data 5 text and 4 csv file, each file length is 1gb+ and some has 10gb or 20gb data. i want to combine all the data with matching row and column and store in single file like sql/nosql and then some data sorting or suggest any easy way to do so(that i can access easy big data in few minutes or do search operations).
Project ID: 31907228

About the project

11 proposals
Remote project
Active 2 yrs ago

Looking to make some money?

Benefits of bidding on Freelancer

Set your budget and timeframe
Get paid for your work
Outline your proposal
It's free to sign up and bid on jobs
11 freelancers are bidding on average ₹8,506 INR for this job
User Avatar
Hi In my current Profession , I have experience in sql server versions 2000-2019,postgressql,mysql I perfom the DBA and Developer duties in high traffic OLTP environment -Python programing -Data Scraping using python -Data warehousing on sql,mysql and postgres database (Star Schemas) and Business Intelligence systems development -Data extractions using Talend Open Studio,Python -Data Intergration using WSO2 ,Talend Open Studio -Database development in (Mysql,Postgres and SQl) -Database Backups and Restores -I have rich experienced in Database Administration, Excel, -Data visualisation using Power BI,BIRT ,Jasper ,excel and python -SQL server installations I can assure that if you work with me once, you will always work with me on these kind of projects and I can deliver quality and superior work at a price we are both comfortable with and within the agreed timeline. Kindly consider my bid.I will do whatever it takes to complete this project and earn a 5 star rating from you as well Kind Regards Takudzwa
₹4,000 INR in 7 days
5.0 (16 reviews)
4.2
4.2
User Avatar
You can use elasticsearch to search huge data. Contact me for further deliberations.................................................. Regards Ginu
₹9,800 INR in 7 days
5.0 (14 reviews)
4.1
4.1
User Avatar
Good Day I can do this job. Few days ago I finished one project with 17.5Gb file Total was 38 000 000 rows So I'm experienced in like this jobs. I have a 15+ year experience Excel VBA, Visual Basic and Quick Basic application. Hope you will be satisfied with result Thanks
₹8,500 INR in 7 days
5.0 (7 reviews)
3.2
3.2
User Avatar
Hello, sir, I would like to propose the following solution. I am a software developer and one of my specialties is C# and .NET Framework, a programming language and a framework for Windows application development. I can create a simple Windows application for you, which will extract data from your files, both, text (I assume these are Word documents?) and csv and input them into an SQL database. The application will have a user interface that will enable you to search through the data with a few simple clicks and search features. You can tell me in what way you would like the data to be presented in the interface. My proposal would be that you send me a small sample of each of the files that you have. Just create one text file and one csv file and copy a small sample of the data the way it is originally written on both files. I will create an application and use those files as a reference to how it will be done with the original ones. I hope we can work together on the solution. Thank you, Denis
₹10,000 INR in 7 days
5.0 (2 reviews)
2.6
2.6
User Avatar
I am an experienced data Engineer and can do the data handling of this type using big data tools like pyspark and hadoop, it is easy to do so. I Have Already Done This Type of Projet data was in TBs . . MESSAGE MEFOR FURTHER DISCUSSION...
₹6,667 INR in 5 days
0.0 (0 reviews)
0.0
0.0
User Avatar
Dear sir, Have a good day, I have seen the details of your project and I understand what you need. I can create an application software for you and I will use a backhand MySQL database file to save your records. Records can be stored as long as there is free space on the drive of this database. Best regards, Kaucher
₹5,000 INR in 2 days
0.0 (0 reviews)
0.0
0.0
User Avatar
I will use BigQuery and compile your documents all in your data lake. You can use SQL to query and make joins and aggregations as you like and train machine learning models using sql with your data.
₹8,000 INR in 7 days
0.0 (0 reviews)
0.0
0.0
User Avatar
I have very good experience in healthcare industry ,more patients population and claims. These are historical data processing faster. Having 10 + years on Mssql,data analytical, automation for data processing, performance tuning expert skills technical. Having Leadership quality and project foundation skills.
₹12,000 INR in 7 days
0.0 (0 reviews)
0.0
0.0
User Avatar
I have an experience on the work being posted. I believe in doing work with finesse and will be there to assist you whenever needed.
₹7,800 INR in 7 days
0.0 (0 reviews)
0.0
0.0

About the client

Flag of INDIA
Abohar, India
5.0
1
Payment method verified
Member since Feb 16, 2021

Client Verification

Thanks! We’ve emailed you a link to claim your free credit.
Something went wrong while sending your email. Please try again.
Registered Users Total Jobs Posted
Freelancer ® is a registered Trademark of Freelancer Technology Pty Limited (ACN 142 189 759)
Copyright © 2024 Freelancer Technology Pty Limited (ACN 142 189 759)
Loading preview
Permission granted for Geolocation.
Your login session has expired and you have been logged out. Please log in again.