Find Jobs
Hire Freelancers

Build a database and crawler for indexing specific information

£250-750 GBP

Closed
Posted over 5 years ago

£250-750 GBP

Paid on delivery
Okay, I'm looking at a bit of a project - What I need is a database into which I can add a title, for arguments sake lets say 'The Incredible Hulk'. I need a web crawler to use the title data to then crawl specific websites, for example wikipedia and imdb, catalogue the information stored in a specific section such as 'reviews', 'rating' or 'publisher' as well as a link to the page and add that to the database so I can display it on a website. Is this even possible? Quote me your best ;) I just need the database and crawler built, I can add the content later on down the line (post obtaining relevant permissions)
Project ID: 18218619

About the project

32 proposals
Remote project
Active 5 yrs ago

Looking to make some money?

Benefits of bidding on Freelancer

Set your budget and timeframe
Get paid for your work
Outline your proposal
It's free to sign up and bid on jobs
32 freelancers are bidding on average £687 GBP for this job
User Avatar
Hello, Yes its possible , I'd Love to know more if you'd like to chat about it or we could set up a call to discuss the detailed scope. Thank you.
£500 GBP in 10 days
4.7 (325 reviews)
8.1
8.1
User Avatar
Hi there I have carefully gone through with your requirements and I would like to help you with this job ! I can start immediately and finish it within the agreed deadline. Check out my profile, portfolio and former clients feedback - that'll let you know everything about me. Please feel free to contact me so that we can discuss further details. Thank you for taking the time to read my proposal.I am looking forward to hearing from you. Best regards, Miljan
£500 GBP in 7 days
4.9 (134 reviews)
7.6
7.6
User Avatar
Greetings. I just have a visual over your project's details and feel privileged to tell you that this correlates with my domain of expertise. Please message me as I will like to ask a few questions. I have a lot to disclose as of my skills and looking forward to show all of it on chat. Please provide all requirements (Technical, Non-Technical and business logic). It seems like an interesting project. I would like to discuss all the requirements with you, so I can mark the scope of this project. Please also note that final estimation will be provided once all the requirements will be revealed from your end. Hence, my cost of development & deadline solely depends on what you reveal (in detail). Looking forward to conduct an extensive chat with you.
£555 GBP in 10 days
5.0 (45 reviews)
7.5
7.5
User Avatar
Hello there Myself having has 10 + years experience of web site development. Expert in Custom programming in php / Mysql / Jquery / Wordpress/ Joomla / OSC / Magento /OpenCart / Android / Mobile development / Responsive. Ready to start the work immediately. I am confident to handle your projects with dedication and good quality. Thanks and regards, Harpreet Singh
£600 GBP in 10 days
4.9 (272 reviews)
7.6
7.6
User Avatar
Hi there, I have checked the details I have rich experienced with C# Programming, Database Development, MySQL, PHP, Web Scraping. Please initiate chat so we can discuss this job.
£555 GBP in 10 days
4.7 (50 reviews)
7.5
7.5
User Avatar
Hello Sir, I read your project description. We did work like that on WordPress to crawl data from IMDB using plugin. You want only for movies and videos? We have more solutions to complete your project using APIs. Please send me message to more discuss about project with you. looking forward Thank you, Michael
£500 GBP in 8 days
4.8 (171 reviews)
6.9
6.9
User Avatar
yes this should be possible. I'm UK based too so we can discuss further
£555 GBP in 10 days
4.9 (64 reviews)
6.6
6.6
User Avatar
Hello Sir, I am the expert freelancer here. I am on the 6th position through out the world to deliver the quality job. I have deliver here more than 400 + projects with 100% client satisfaction. I have more than 5 years of the experience in C# Programming, Database Development, MySQL, PHP, Web Scraping. Please check the profile reviews. I can deliver your job with in your deadline. Please ping me for more discussion. Thanks.
£500 GBP in 5 days
4.9 (76 reviews)
6.7
6.7
User Avatar
hi, sir. i read your description. i have many experience in scrapping and db. what is your detail requirement? we can discuss about this project. i will wait your reply. thanks.
£555 GBP in 10 days
5.0 (24 reviews)
5.7
5.7
User Avatar
Hello, I am a Technical Developer working on following Technologies :- #- Basic Skills(HTML5,CSS3,Bootstrap4,AJAX, Javascript, jQuery / Prototype) #- CMS(WordPress, Prestashop, Shopify) #- MEAN STACK #- MVC(Laravel,CodeIgniter,Django) #- Web Scraping(PHP, Python, Googlesheet) #- Data Management(MYSQL, MSSQL, SQLite, PostgreSQL, MongoDB) #- Preferred Backend Language(PHP, Python, NodeJS, Django) #- Database(MySQL, Sqlite, MongoDB) I am mastering *English* course and sure that you will be utilizing my professional and technical skills developed through past work experiences. Feel free to contact me anytime. Thank you a lot.
£555 GBP in 10 days
4.6 (31 reviews)
5.5
5.5
User Avatar
I am Network Security certified and always on the lookout for training and new trends in the technology. I take direction well and can complete a heavy workload and complete projects under minimal supervision. As a developer, I make algorithms and coding stuff (java, c, c++, c#,sql), i have experience of 4 years in this field. kindly inbox we can discuss here!
£444 GBP in 10 days
4.9 (32 reviews)
5.1
5.1
User Avatar
Hello there. How are you doing? I have read your description and I don't think I have understood 100%. But I am a decent programmer who can build a GUI web crawler and database and its interface to manage it. I have been doing desktop programming for the past 8+ years and it's not a problem for me to do it. The thing is that I have got a few questions on the requirements, and we need some discussion to clarify everything. Is it possible? Wish you contact me. Thanks.
£888 GBP in 10 days
5.0 (14 reviews)
5.1
5.1
User Avatar
is it possible : yes how fast will it be ? : depends on the number of websites to crawl from it will need to be sophisticated enough for detecting blocks and rotating ips with if needed headless multi-threaded browser support. for wikipedia and imdb i would say tis would cost around 90 euros certainly not 250 euros.
£250 GBP in 3 days
5.0 (45 reviews)
5.2
5.2
User Avatar
Hello. Such a solution is possible indeed. But as the each site has its own structure, scraper has to work for each one with different approach taken. I can do the solution for You. Would be adding site one by one as we would agree on. Please contact me so we could discuss a details. Regards Michal
£333 GBP in 10 days
5.0 (4 reviews)
4.2
4.2
User Avatar
Dear Hiring Manager, Hope you are doing well !! I have read job post and i want to discuss first about this job. I can start your immediately after that discussion. Waiting for your prompt response. Thanks, Mehul (Senior software & website developer)
£327 GBP in 15 days
4.4 (17 reviews)
4.0
4.0
User Avatar
Hello, We have extreme experience in Web Scraping. Have done a lot of work of Scraping using python. We use tools scrappy, selenium, scoop for scraping. We scraped data from many e-commerce websites and pushed it in excel and in a database. Also used selenium for creating Wassup bot.
£500 GBP in 10 days
3.6 (7 reviews)
4.4
4.4
User Avatar
Hi, I am a full stack .net/C# developer with more than 7 years experience and very much interested in developing the web crawler with DB. Please give me complete details so I can share my plan accordingly. Regards, Sam
£1,111 GBP in 30 days
5.0 (1 review)
3.3
3.3
User Avatar
hi, i am c# windows and web application developer for past 4.5 years. Have written many macro scripts for fortune companies and received appreciation from clients. Currently working in one of the top companies in india. worked in many vba scraping project and successfully delivered to client on time with high quality.
£250 GBP in 3 days
5.0 (5 reviews)
2.5
2.5
User Avatar
I have a lot of experience in crawling and creating auto-buy bots for 3rd-party websites. To estimate whole project We must create exact list of websites to fetch and need to understand what exactly need to fecth. because of for example wikipedia is very huge and fetch whole website will take very long time on one server. Also some websites have crawling protection. This could require usage of proxies. And moreover: some sensitive info could be fetched only via simulating for real user. All above is reason why I need exact list of sites and object to fetch to estimate budget and timeline. Also need to understand purpose of this fetch to store data in proper format. If you have answers to my questions please pm me. My bid is not final and depend on your answers it could be much less or even much more
£5,555 GBP in 30 days
5.0 (5 reviews)
1.4
1.4
User Avatar
your project is poorly explained, but I am able to do it.
£555 GBP in 10 days
0.0 (0 reviews)
0.0
0.0

About the client

Flag of UNITED KINGDOM
Folkestone, United Kingdom
0.0
0
Member since Aug 17, 2018

Client Verification

Thanks! We’ve emailed you a link to claim your free credit.
Something went wrong while sending your email. Please try again.
Registered Users Total Jobs Posted
Freelancer ® is a registered Trademark of Freelancer Technology Pty Limited (ACN 142 189 759)
Copyright © 2024 Freelancer Technology Pty Limited (ACN 142 189 759)
Loading preview
Permission granted for Geolocation.
Your login session has expired and you have been logged out. Please log in again.