Scrape my website (and sub domains) for youtube embeds (With Python and BS4)

Hello, Chrilles. I think i solve your problem. I wrote script as you need on Python using bs4. There were some troubles with access to your site using 'requests'. It was forbidden. So i decided to use 'Selenium Webdriver', which is much slower, but it's emulate real browser. I checked about 300 internal links to test my script and found only 6 videos. But it's already night, so i can do all job tomorrow if you want. Please contact me and i'll show how it works or make any changes if you need. I'll be in touch about 14:00 - 15:00 (UTC+2, Kharkiv, Ukraine) Regards, Pavlo P.S. I think i know how to force 'requests' work. I will try it tomorrow. P.S.S. Already did. 1768 internal pages. 37 youtube ids.

Hi, I am an experienced Python developer who specialises in web scraping. I can create a script to scrape all youtube embeds from the website and its subdomains. Just send me url for the site and I can start. Kind Regards

Hello sir, I am interedted in your project. I would like to discuss details via pm. Yours sincerely,

I can do this job within a short time (hours) as I did the same task (scraping) many times before as a web dev for +6 years..Please give me the chance to handle your project and I promise I will not let you down! Just give it a try and you will not regret it!

I'm sorry to say, but as far as I can tell, this isn't a 30 dollar job. If you give me more details we can discuss the price. I have done a couple of projects with Python and BeautifulSoup, the most recent one where I had to scrape tweets from twitter.

I've not only used Beautiful Soup for several projects before, but I've also configured API's for cryptocurrency, Computer Vision for the Physical Therapists (in C++ as well), and powerful websites and pipelines with a Flask backend - all centrally in Python.

Hi, I have worked on this kind of project for an advertisement company. I can do your project in a day.

A proposal has not yet been provided

The tag of the youtube video was easy to find. Then after the html is downloaded as a dict then all we have to do is to extract the tag value from the scraped data and save in the required format.

hey Chrillis, what you've asked for, is what my current project is about. I am currently scraping shoes from Adidas, Nike, etc. When I started with this project I have found a Python Library which is combining HTTP requests with scraping the site itself (it uses bs4 too). It is a new, unknown Library which makes it much much much easier for you to scrape the web. The name of this library is "Requests HTML", easily installed by "pip install requests-html". Unfortunately I have some money problems currently and would beg you to be my first customer here at Freelancer. Best greetings from Germany Sofian