Find Jobs
Hire Freelancers

need a web scraper - open to bidding

$30-250 USD

Closed
Posted over 9 years ago

$30-250 USD

Paid on delivery
I need a web scraper for vBulletin forums. for - Member name - Post html content - Post date/time - Post #id - Post permalink - Thread name - Thread #id (the #id may be at the beginning of the thread url or at the end, this should be configurable) and insert it into newdatabase how much it
Project ID: 6778807

About the project

8 proposals
Remote project
Active 9 yrs ago

Looking to make some money?

Benefits of bidding on Freelancer

Set your budget and timeframe
Get paid for your work
Outline your proposal
It's free to sign up and bid on jobs
8 freelancers are bidding on average $126 USD for this job
User Avatar
A proposal has not yet been provided
$50 USD in 7 days
5.0 (3 reviews)
1.1
1.1
User Avatar
I can do this for you using Scrapy running on Python, with the results inserted into a SQL server (your choice - MySQL, Postgresql, etc).
$100 USD in 3 days
0.0 (0 reviews)
0.0
0.0
User Avatar
A proposal has not yet been provided
$147 USD in 3 days
0.0 (0 reviews)
3.7
3.7
User Avatar
I have 7 years experience in vbulletin 4.0, I already built a script which scrap first post of any thread of vbulletin or any other template and insert as new thread in other vbulletin, I can modify that script as per your requirement. I will write script in PHP
$130 USD in 3 days
0.0 (0 reviews)
0.0
0.0
User Avatar
Hello, I will do the work for you by using the library Grab for python. Will suit you save data in mongodb? E-mail me. Thank you.
$155 USD in 5 days
0.0 (0 reviews)
0.0
0.0
User Avatar
Dear Client: I can do the jobs using open-source Python/Scrapy framework. I have very python + web data scraping experiences in following tech/libraries/languages: • Parsing XML, HTML, JSON, JS code, text etc. • Hadoop/MR, nltk • Proxying, Delay/throttling, cookies • Scrapy • Python, lxml, XPath, beautifulsoup, urrllib, • mySQLdb, xlrd, xlwt, csv, minidom, Image, • Smarty, PHP, C/C++, Java • Ruby, mechanize, nokogiri, scraping • Regex, JS/Ajax/JSON, html/xml, PyV8 • Csv, excel, mySQL • Selenium Webdriver/FF/Chrome, Xvbf, etc. • Linux/CentOS/Ubuntu, Windows I have scraped over 30s of websites containing XML/JS/Ajax/Dynamic data contents – some websites with multiple regions, countries, currencies. I have installed and configured Scrapy on several platforms: CentOS, Ubuntu, Windows. I am currently maintaining a Scrapy based web data capturing/harvesting platform on Ubuntu 12.x for a private US client. It is used to source products attributes and images, classify products, and determine prices of over 30,000 products of different categories (toys, books, medical devices, footwear, apparels etc.) from 15s of different websites (in multiple formats/feeds: HTML/XML/JSON, csv, Excel, PDF etc.) for feeding to an e-commerce site. The scrapers store the data directly in a mySQL database comprising 5 tables. Thanks, Malik.
$166 USD in 5 days
0.0 (0 reviews)
0.0
0.0

About the client

Flag of EGYPT
Cairo, Egypt
0.0
0
Payment method verified
Member since Apr 7, 2014

Client Verification

Thanks! We’ve emailed you a link to claim your free credit.
Something went wrong while sending your email. Please try again.
Registered Users Total Jobs Posted
Freelancer ® is a registered Trademark of Freelancer Technology Pty Limited (ACN 142 189 759)
Copyright © 2024 Freelancer Technology Pty Limited (ACN 142 189 759)
Loading preview
Permission granted for Geolocation.
Your login session has expired and you have been logged out. Please log in again.