Find Jobs
Hire Freelancers

Data Preparation Preprocessing(Data Mining) -- 2

$30-250 AUD

Closed
Posted about 4 years ago

$30-250 AUD

Paid on delivery
This project is about preprocessing and preparing data for future analysis. Details are below. In this project, some steps will be done using Weka, and the others will be done using Java. The project will use a modified (red) wine dataset from UCI(search it on google to see the data), although the developed project should be able to work on any dataset involving numerical attributes plus a class attribute (which is the last attribute of the file). The modification is done by mapping tuples whose quality is <=5 to class 0 and mapping other tuples to class 1. All non-class attributes are numerical. The input file is a csv file. We will call the attributes as A1, A2, …, A11, in the left-to-right order given in the input file. There are two tasks: Task 1. Discretize all attributes as follows: Use the entropy based method to split each attribute into 2 intervals; in case Weka does not produce a split for a given attribute, use the equal-density method to split the attribute into 4 intervals. The resulting bins will be stored in a csv file called Bins.csv. This file contains rows of the form for each attribute Ai with 2 bins Ai, splitValue, countC0Bin1, countC1Bin1, countC0Bin2, countC1Bin2 This file contains a row with 12 fields (3 split values + 8 counts), for each attribute with 4 bins. Task 2: Map the dataset into the itemized form using the bins produced in Task 1. This step will produce two files, namely [login to view URL] and ItemizedData.csv. The contents of these two files should follow the format given on [login to view URL] file attached. There are two possible ways to do the project: 1) Using Weka and Java, providing a Java program producing all results specified above. 2) Using Java only, providing a Java program producing all results specified above. For option 1, you should submit your Java program, and a jar file called P1.jar. The Java program should work assuming that Weka is installed on the machine. [login to view URL] when run should take the name of the dataset file as a parameter. You should assume that the input dataset is the same folder where the jar file is run. For option 2, you should submit your Java program, and a jar file called P1.jar. [login to view URL] when run should take the name of the dataset file and a minIG value as parameters. The program will use information gain (IG) to split an attribute if the IG is >= minIG, and use equal-frequency Only the requested results are required.
Project ID: 23962307

About the project

4 proposals
Remote project
Active 4 yrs ago

Looking to make some money?

Benefits of bidding on Freelancer

Set your budget and timeframe
Get paid for your work
Outline your proposal
It's free to sign up and bid on jobs
4 freelancers are bidding on average $145 AUD for this job
User Avatar
Hi, I have 4+ years of experience in Hadoop technologies like HDFS, MapReduce, Spark, Hive etc as well as data mining techniques. I can complete your project Please contact me...
$200 AUD in 7 days
4.7 (11 reviews)
4.3
4.3
User Avatar
Having 8.7+ Yrs. of experience in ears of Extensive Software Development Life Cycle experience. • Worked on View, Procedures, Function, Triggers, Indexes, Partitioning. • Good in SQL Queries. • Experience in data extraction, transmission and loading. • Experience in SSIS Package • Good explore in Data warehousing concept and Data Modeling. • Good knowledge on Dimensional data model, Star schema, snowflake schema. • Working experience in Retail. • Experience in Python. • Good Knowledge in AWS Redshift. • Experience in Hive, Sqoop • Good knowledge in Cloud (Aws/Azure) • Expertise in debugging the code. • Good knowledge in UNIX commands.
$140 AUD in 7 days
0.0 (0 reviews)
0.0
0.0
User Avatar
HI! I AM DEV AND I AM INTERESTED IN YOUR WORK BECAUSE I'VE ALREADY DONE SOMETHING LIKE THAT BEFORE. SO, I THINK I CAN DO THIS JOB EASILY...
$100 AUD in 7 days
0.0 (0 reviews)
0.0
0.0

About the client

Flag of INDIA
faridabad, India
4.9
37
Payment method verified
Member since Mar 9, 2017

Client Verification

Thanks! We’ve emailed you a link to claim your free credit.
Something went wrong while sending your email. Please try again.
Registered Users Total Jobs Posted
Freelancer ® is a registered Trademark of Freelancer Technology Pty Limited (ACN 142 189 759)
Copyright © 2024 Freelancer Technology Pty Limited (ACN 142 189 759)
Loading preview
Permission granted for Geolocation.
Your login session has expired and you have been logged out. Please log in again.