Find Jobs
Hire Freelancers

Crawling/Scraping Engineer

€12-18 EUR / hour

Closed
Posted almost 5 years ago

€12-18 EUR / hour

We're looking for a scraping/crawling engineer to join full time our 3-people Crawling team for a 3-month period. This team is responsible for extracting information from thousands of websites every day. Due to constant changes in some of these websites, a number of our extractors break every day, so we need to continuously adapt them. We also need to continuously create new extractors for new sources. Our tech stack: scrapy + Selenium. We use JIRA for the management of tasks. Requirements: - fluency in English, both written and spoken - scraping/crawling experience (3+ years) using scrapy + Selenium - python programming experience - experience with online services, such as AWS and Cloudera Please apply only in case you're an individual (i.e. no agencies) interested in joining the team full time for the next 3 months. Links to GitHub projects that you've developed in the past and any other references will be much appreciated. A technical interview will be conducted before awarding the job.
Project ID: 19991162

About the project

22 proposals
Remote project
Active 5 yrs ago

Looking to make some money?

Benefits of bidding on Freelancer

Set your budget and timeframe
Get paid for your work
Outline your proposal
It's free to sign up and bid on jobs
22 freelancers are bidding on average €18 EUR/hour for this job
User Avatar
Hi. We are working on a new web crawling platform which we think have some advantages over scrapy and especially Selenium, which is limited in many ways. If you are interested to find out more let me know and we can talk.
€17 EUR in 5 days
5.0 (125 reviews)
7.4
7.4
User Avatar
Hi there,I am Web Scraping expert from Bosnia & Herzegovina,Europe. I have carefully gone through with your requirements and I would like to help you with this project ! I can start immediately and finish it within the agreed deadline. Check out my profile and former clients feedback - that'll let you know everything about me. Please feel free to contact me so that we can discuss further details. Thank you for taking the time to read my proposal.I am looking forward to hearing from you. Best regards, Miljan
€20 EUR in 40 days
4.9 (133 reviews)
7.5
7.5
User Avatar
Hello, I have gone through your job posting and become very much interested to work with you. I am an expert in this field. I have already completed several projects like this. For evidence you can see my profile. Please visit : https://www.freelancer.com/u/schoudhary1553 I have excellent command over English. I am a hard worker, productive and worthy of your attention I hope, I would be the right candidate for this post. Awaiting an affirmative response from you. Kinds Regards, Sandeep
€18 EUR in 40 days
4.9 (53 reviews)
6.5
6.5
User Avatar
Hi Nice to meet you. I have enough experience in python script. Below the libraries are I used in past project. selenium, pandas, matplotlib, lxml, beautifulsoup, scipy, and other useful libraries. I have written some automation and scraping, scientific scripts. So I think I can help you in your project. Just let me know if you want start job. Regards. Lian
€16 EUR in 40 days
4.9 (81 reviews)
6.4
6.4
User Avatar
Dear Sir. Glad to meet you. I'm Web developer specializing in web scraping crawling and indexing web pages. Skills: python, scrapy, selenium, requests, beautifulsoup, mechanize, lxml, urllib2, automation, bots, spiders I worked with 50+ differenct individuals/startups/companies and helped them archive their goals. Here's what you will get by working with me: * Working only on projects that I can deliver 100% * Ridiculous quality of work * Smart suggestions on increasing results/revenue and decreasing costs * Responsibility for tasks/project I work on * Reliability * Short response time * Good sense of humor ;) Hope I could awake you interest in me. Thank you for your attention. Shuaixing.(call me Shuaixing L.)
€15 EUR in 40 days
5.0 (28 reviews)
6.4
6.4
User Avatar
‌Hi, I have gone through your requirement to scrape lots of websites. I am EXPERT in building scraping tools /scripts. Hence, I can SURELY work on your project. I am having 4 YEARS of EXPERIENCE in developing PHP-PYTHON (Scrapy, Selenium) based web scraper as well as WINDOWS BASED web scraping software through which I have crawled many sites such as Craigslist, Amazon, Yelp and many others. I have also worked on complex site to bypass CAPTCHA with the use of PROXY IP bouncing techniques.. Let's work together :) Have a great day! I am glad to see your WORK HISTORY and positive reviews of other freelancers. I am really excited to work with you and would love to have a long-term business association for any of your data related needs less  ,,,,,,,,,,,,. ,
€16 EUR in 3 days
4.9 (93 reviews)
5.7
5.7
User Avatar
Hello, We are IT-Engineers and Business Analysts, creating complete web and mobile solutions, for already more than 15 years, supporting our products with custom digital marketing strategies and instruments. Scraping systems are especially preferred by our engineers, as we've created a lot of them already, so it seems to be a good match. Before the implementation starts - the initial briefing round takes place, which is free of charge. We are interested in all the details of your specific case. They will allow us to obtain a better vision of your concept and help us create unique solutions for you. Let's schedule a convenient time for the first kick-off conversation. Best Regards, Andrei Costenco Team Lead, Business Analyst, Senior Engineer Dev Experts Team
€70 EUR in 40 days
5.0 (1 review)
5.6
5.6
User Avatar
Note: We are an Agency but still placing the bids because in data fetching we have developed a product "Dragon SRCH, which may help you run the daily routine job. Dragon SRCH Platform is a cloud-based research engine which combines the power of automation to research and present eye-catching and insightful reports. The automated research platform is not limited to a particular language, it supports translation capability with 60+ languages. Dragon SRCH deployment services are customized to business needs. Our team of data engineers set up a completely automated pipeline to fetch, extract, clean, transform and report on the data. This platform is capable of ingesting data from 90 different kinds of data sources. Let me know your availability to schedule a quick demo. Regarding. Synapse Team
€20 EUR in 40 days
5.0 (3 reviews)
5.1
5.1
User Avatar
Hello, I'm Android (since 2012) and web (since 2013)developer. I can speak in English freely. I tend to keep myself up to date with important changes in the Android world and web frameworks and regularly look into new ways of solving things. Always looking for new challenges and opportunities. I am a man of my word so you can trust me. Good skills: • Android development: - Clean Architecture; - Data storage: Realm, SQLite, SharedPreferences, Internal/External memory; - Creating applications for multiple screen resolutions/sizes; - Integrations with social networks (facebook, google, twitter, foursquare, vkontakte); - Signing and publishing applications. Successfully implemented pet-projects on Google Play (2m+ downloads); • Web development: - E- Commerce,Laravel,Codeigniter,Wordpress, Node.js, Angular, React; Basic skills: • C# – desktop applications, tools. • Python (Powershell, bash) – scripts to automate routine tasks. • PHP – simple back-ends, mostly for pet projects. • HTML, CSS, Javascript,Java,jQuery. • React Native, Flutter, Object c, Ionic, PhoneGap, Swift, X code...
€16 EUR in 40 days
4.9 (8 reviews)
4.7
4.7
User Avatar
Hello, I have experience in web scraping with Python. I can use Selenium, Scrapy, BeautifulSoup and Requests to make the best web scrapers! I hope to work with you!
€16 EUR in 36 days
5.0 (5 reviews)
4.1
4.1
User Avatar
Respected Sir/Ma'am Job seems challenging, but, I can do it. You have mentioned that the structure of the sites is changing frequently, I can handle it. Try me, you won't be disappointed, give me a site(whose structure is constantly changing), I will show you the demo, if I satisfy you, then if you want you can hire me. I am an Individual. Regards Navpreet Singh
€12 EUR in 80 days
5.0 (5 reviews)
3.9
3.9
User Avatar
First:- Chatbot --> This can be integrated by any Facebook page, Slack etc. Its main aim is to reduce the human effort. For example, if this Chatbot is integrated with company page so it can easily answer you some basic questions about the company. Second:- Word Predictor --> This will be integrated with my Chatbot and it's an algorithm is such that it will learn according to previous input given and then It will suggest the next question and next word accordingly. Third:- Comment Checker --> This has a huge set of words inbuilt with its degree and level and it will analyze each comment and according to that it can give the report or if any inappropriate comment is taken it can forward to the authority. Speech Recognisation Train the database using deep learning, doing language model and lexical model for Arabic , adding functions to increase different types of noise at different levels as the picture shows. Then we notice the results.
€16 EUR in 40 days
5.0 (3 reviews)
2.5
2.5

About the client

Flag of GERMANY
Munich, Germany
0.0
0
Member since Jun 14, 2019

Client Verification

Thanks! We’ve emailed you a link to claim your free credit.
Something went wrong while sending your email. Please try again.
Registered Users Total Jobs Posted
Freelancer ® is a registered Trademark of Freelancer Technology Pty Limited (ACN 142 189 759)
Copyright © 2024 Freelancer Technology Pty Limited (ACN 142 189 759)
Loading preview
Permission granted for Geolocation.
Your login session has expired and you have been logged out. Please log in again.