Find Jobs
Hire Freelancers

Crawl Weixin (WeChat) and Weibo data

$10-2000 USD

Closed
Posted almost 6 years ago

$10-2000 USD

Paid on delivery
Hi all I would like to be able to build up a database of Weixin and Weibo posts. You would use scrapy to do this. The data would be saved via the Django ORM. We would run the crawls regularly (possibly once per week), and only new data would be saved in the database. We would need to save the timestamp, message, username (if possible). Must be able to save both English and Chinese. Ideally you would be available for continuous improvements and maintenance. Thanks for reading.
Project ID: 17202604

About the project

15 proposals
Remote project
Active 6 yrs ago

Looking to make some money?

Benefits of bidding on Freelancer

Set your budget and timeframe
Get paid for your work
Outline your proposal
It's free to sign up and bid on jobs
15 freelancers are bidding on average $1,043 USD for this job
User Avatar
Hi. I would like to discuss more details about the project. I set for now a higher bid price to see all the big picture before we can discuss that. As I understand we need to login into those chat app and do the crawling, or there is some API for that? Can you provide more details about the how we start the crawling. You mention messages, but what kind of message? From specific user/groups/channels? Please elaborate on this. Also, if you have login details for this app then I would like you to provide me one for tests, if possible. Thx, waiting for details and we can discuss more.
$2,000 USD in 10 days
5.0 (124 reviews)
7.5
7.5
User Avatar
Dear Sir, I'm very much delighted to let you know that i did data scraping with PHP-cURL, PhantomJS, Node.js, Selenium from many sites. I just scraped the data from web site and then wrote the data in mysql database or excel or csv or xml file. I worked on many similar projects, I have big experience in data mining projects. I have written hundreds of web scrapers which scrape millions of pages each day. I'm ready to fulfill your requirement. I can finish this task in short time, with the best quality. I can assure 100% accuracy. Please give me the opportunity to do the work. With Kind Regards, Debdulal Roy Proshanta
$1,116 USD in 15 days
4.9 (70 reviews)
7.3
7.3
User Avatar
Hi, I have great experience on web scraping and automation. Will write a Python script to extract the requested data . Thanks
$1,333 USD in 10 days
4.9 (105 reviews)
6.2
6.2
User Avatar
H there, I have read through your project description, I can satisfy the requirement in the speculated time. Please contact me on PM for details. I will be willing to work with you on a long term basis.
$250 USD in 10 days
4.9 (41 reviews)
5.6
5.6
User Avatar
Nice to see you, stevebranding. Do you need to be able to build up a database of weixin and weibo posts and save the timestamp, message,you ername (if possible) ?.I have the ability to do it We have experience in thoses skills: Web Scraping,Python. I always: -Do project fast as possible. -Charge a reasonable cost. -Provide Quality Product. All my previous project was feedbacked 5 stars. because i care the customer feeling. Please text me via inbox. i very happy about that
$1,205 USD in 3 days
4.8 (21 reviews)
5.0
5.0
User Avatar
Hi there! I have done web scraping before using Python for my previous Freelancer.com project, so I am sure I can help you out. Can you send me the details via chat? Cheers!
$500 USD in 3 days
5.0 (13 reviews)
4.4
4.4
User Avatar
Ready to start the work to make the scrapper in python for scrap the data from Weixin and Weibo posts. data base and store using the django ORM ,please check my recent similar work ,we can discuss more over chat,thanks regards Arjun S.
$444 USD in 10 days
4.7 (9 reviews)
4.3
4.3
User Avatar
Hello, We are a team of IITians having more than 8 years of experience in Python, Web Scraping, Statistics, Software Architecture and much more. We can help you with this project. Kindly connect to discuss in detail and see our recent work as well. Thanks Athmin Team
$1,116 USD in 10 days
5.0 (2 reviews)
2.8
2.8
User Avatar
Hi. I am a python developer with extensive experience in building web crawling and data Scrapping softwares. I use Selenium and beautiful soup for building crawlers to extract specific part of information from website. Selenium extracts cleanest data that helps to not stuff memory with the junk. I offer you to see some Extracted results of your project. that will help you understand the. capabilities of the technologies I use. also you will get new ideas for this project. have a chat I will show samples of my previous similar projects and also give you a working sample and output file of your own project. Hope to hear more from you. thanks
$1,444 USD in 20 days
3.5 (4 reviews)
3.4
3.4

About the client

Flag of HONG KONG
Hong Kong, Hong Kong
5.0
8
Payment method verified
Member since Dec 2, 2016

Client Verification

Thanks! We’ve emailed you a link to claim your free credit.
Something went wrong while sending your email. Please try again.
Registered Users Total Jobs Posted
Freelancer ® is a registered Trademark of Freelancer Technology Pty Limited (ACN 142 189 759)
Copyright © 2024 Freelancer Technology Pty Limited (ACN 142 189 759)
Loading preview
Permission granted for Geolocation.
Your login session has expired and you have been logged out. Please log in again.