YOUTUBE CRAWLER
$30-250 USD
Paid on delivery
Objective: GET or UPDATE link, image, description and publish date infos of a specific youtube channel
Work Flow:
1 - I should insert the url video page of a especific Youtbe Channel (don't need a interface, I can change it directly into the script - just need inform where)
(example: [url removed, login to view])
2 - I should insert the folder name (where the image will be save)(again -> don't need a interface, I can change it directly into the script - just need inform where)(example: tastemade)
3 - Than the crawler must be ready to check each video using the Name (example: 24 Austin Restaurants in 24 Hours | Day of Gluttony Ep. 7) and the VIDEO URL (example: [url removed, login to view]) of ALL VIDEOS related in this Youtube Channel Name (CAUTION: this app must read ALL VIDEOS of this channel inclued the old videos that you need click on "load more" button to see them)
-> 3.1 - if this video is new :)
3.1.1 - the crawler must get this Name of this Video (example: 24 Austin Restaurants in 24 Hours | Day of Gluttony Ep. 7)
3.1.2 - Get the image (from this channel page, exmaple: [url removed, login to view] - NOT the image from video page)
* this image must be renamed with the url video name (example: [url removed, login to view] - not use complete url!)
* this image must be save in the correct directory (defined in step 2)
3.1.3 - Open this video page (example: [url removed, login to view]) and:
3.1.3.1 - get the publish date
3.1.3.2 - get the description
-> 3.2 - if this video exist :(
3.2.1 - open this video page (example: [url removed, login to view]) and:
3.2.1.1 - check the description
3.2.1.1.1 - if it is different -> UPDATE
3.2.1.1.2 - if it is equal -> DIMISS
IMPORTANT:
1 - The code must be done in PHP/CURL/PERL
2 - I'm using mysql database and I will send the database
3 - All fields (link, image, description and publish date) must be INSERT/UPDATE in my database
4 - This crawler must generate a LOG FILE (preference text file)
- The name of this file could be the CHANNEL NAME + DATE (example: tastemade_29-04-2015 or something like that)
- This log should inform exactly what was read and in inform what was INSERT/UPDATE
5 - The publish date must be insert like "DATE" not "DATETIME" into mysql database
Project ID: #7578591
About the project
6 freelancers are bidding on average $189 for this job
Dear sir, Experts and top data entry service provider here ready to start work now .My success always measure with client's satisfaction. So, i always try to do the best. Please let me know if you have any questions. More
Hi sir, I am scraping expert, I have did too many similar projects, please check my feedback then you will know. Can you tell me more details? then I will provide demo data for you. Thanks, Kimi
Hi, i can help you with that, i went over the descriptions, and can deliver a php/curl/mysql script within 1 day, please contact me for more info