YOUTUBE CRAWLER

Completed Posted Apr 29, 2015 Paid on delivery
Completed Paid on delivery

Objective: GET or UPDATE link, image, description and publish date infos of a specific youtube channel

Work Flow:

1 - I should insert the url video page of a especific Youtbe Channel (don't need a interface, I can change it directly into the script - just need inform where)

(example: [url removed, login to view])

2 - I should insert the folder name (where the image will be save)(again -> don't need a interface, I can change it directly into the script - just need inform where)(example: tastemade)

3 - Than the crawler must be ready to check each video using the Name (example: 24 Austin Restaurants in 24 Hours | Day of Gluttony Ep. 7) and the VIDEO URL (example: [url removed, login to view]) of ALL VIDEOS related in this Youtube Channel Name (CAUTION: this app must read ALL VIDEOS of this channel inclued the old videos that you need click on "load more" button to see them)

-> 3.1 - if this video is new :)

3.1.1 - the crawler must get this Name of this Video (example: 24 Austin Restaurants in 24 Hours | Day of Gluttony Ep. 7)

3.1.2 - Get the image (from this channel page, exmaple: [url removed, login to view] - NOT the image from video page)

* this image must be renamed with the url video name (example: [url removed, login to view] - not use complete url!)

* this image must be save in the correct directory (defined in step 2)

3.1.3 - Open this video page (example: [url removed, login to view]) and:

3.1.3.1 - get the publish date

3.1.3.2 - get the description

-> 3.2 - if this video exist :(

3.2.1 - open this video page (example: [url removed, login to view]) and:

3.2.1.1 - check the description

3.2.1.1.1 - if it is different -> UPDATE

3.2.1.1.2 - if it is equal -> DIMISS

IMPORTANT:

1 - The code must be done in PHP/CURL/PERL

2 - I'm using mysql database and I will send the database

3 - All fields (link, image, description and publish date) must be INSERT/UPDATE in my database

4 - This crawler must generate a LOG FILE (preference text file)

- The name of this file could be the CHANNEL NAME + DATE (example: tastemade_29-04-2015 or something like that)

- This log should inform exactly what was read and in inform what was INSERT/UPDATE

5 - The publish date must be insert like "DATE" not "DATETIME" into mysql database

Data Entry MySQL Perl PHP Web Scraping

Project ID: #7578591

About the project

6 proposals Remote project Active May 7, 2015

Awarded to:

mmadi

Hi, Iam interested in your project and I will be happy to do that for you. I have rich experince in scrapping, curl, regular expressions, Dom and Selenium RC. examples of scrapping work: [login to view URL] travel search eng More

$85 USD in 2 days
(36 Reviews)
6.2

6 freelancers are bidding on average $189 for this job

hossionsumon

Dear sir, Experts and top data entry service provider here ready to start work now .My success always measure with client's satisfaction. So, i always try to do the best. Please let me know if you have any questions. More

$210 USD in 7 days
(295 Reviews)
7.3
mantislin

Hi sir, I am scraping expert, I have did too many similar projects, please check my feedback then you will know. Can you tell me more details? then I will provide demo data for you. Thanks, Kimi

$210 USD in 5 days
(237 Reviews)
7.2
rsdsoftsl

Hello. I specialize in data scraping and crawling. You may check my feedbacks to be sure. So I ready to develo PHP crawler (based on CURL) which process urls of specific youtube channels (you may set channel name i More

$166 USD in 2 days
(297 Reviews)
7.5
desplash

Hi, i can help you with that, i went over the descriptions, and can deliver a php/curl/mysql script within 1 day, please contact me for more info

$250 USD in 1 day
(15 Reviews)
4.8
projexan

Please find below my short experience summary. * Have worked earlier for scarping video information from Youtube using Perl ( CPAN Packages ) * Several years experience developing Text Mining and Information Extrac More

$190 USD in 5 days
(0 Reviews)
0.0