Web scraping ruby on rails jobs

I require your expertise for an end-to-end testing of my Ruby on Rails application. Inclusive of all the components, which are Models, Controllers, and Views. Knowledge and usage of MiniTest, Simplecov, and Capybara for the testing frameworks are also required for this project. Key features for testing: - User Authentication - Database Queries - Form Validation The ideal candidate would be someone experienced with Ruby on Rails applications, fluent in the use of multiple testing frameworks, and specializes in identifying and rectifying potential pitfalls.

I need a fully bilingual professional (I will interview in English) to do some tasks for my agency such as: PR Outreach Content editing or creating CRM management Email marketing Email scraping Researching Organizing data in spreadsheets Copywriting Wordpress And others You must be a fast learner, attentive, curious, with great writing skills. Looking for someone that pays attention and doesn’t keep making the same mistakes. This job will start part-time as a test period, after that it will be full-time. Payment for part-time during trial period: Fee: 250 USD Performance bonus: 50 USD Results bonus: 50 USD If your work complies with my quality requirements and you give more than asked, you’ll get performance and results bonuses each month. After a two-month...

I'm looking for a talented freelancer who can assist with scraping automobile ads from website. Key Requirements: - Scraping specific automobile ads. - Extracting ad titles, descriptions and prices. The ideal candidate should have: - Experience in web scraping. - A strong understanding of data collection from websites. - Attention to detail to ensure accurate extraction of data. Please note that the exact websites and the car details are not provided yet, so the freelancer should be able to work with changing parameters.

I want to scrape daily leads from LinkedIn Jobs, Indeed Jobs, , etc. The task involves extracting data from these job sites and exporting it to Excel sheets. It would be preferable to have some kind of automation that reduces human dependency in obtaining leads every day. If someone has already set up a similar process before, I would prefer that. Preference will be given to those who have previously performed lead extraction tasks for recruitment websites.

Create an executable scraper in Python that can extract the SKU (product) list from the following Indonesian online grocery apps: - Astro - Sayurbox - Segari The scraper must be IP-block tolerant, meaning if the scraper gets blocked, execution can be continued from the point where the last row of data was successfully extracted. Scraper Functions Function: list_category_tree Input: competitor_name(astro | sayurbox | segari), existing_csv (optional - CSV file to append to for continuing execution, if the scraper stopped or got IP blocked) Output: CSV of category tree with the following columns (scrape_date, URL, category name, position index, parent_category (null if top level)) Function: extract_sku Input: competitor_name, location (autocomplete place from google maps API), category ...

About Us: We're a dynamic team operating in the healthcare sector, committed to leveraging data to enhance our services and support for medical professionals. Our focus is on identifying and connecting with newer medical professionals and travel nurses to offer them tailored opportunities and support. What We Need: We're seeking a talented web scraper who can help us gather specific data on medical professionals with new NPI numbers. Your task will involve targeting individuals in specific states and collecting their information accurately and efficiently. Your Responsibilities: Develop a web scraping solution capable of targeting specific states and names of medical professionals with new NPI numbers. Ensure the accuracy and reliability of t...

Please Sign Up or Login to see details.

About Us: We're a dynamic team operating in the healthcare sector, committed to leveraging data to enhance our services and support for medical professionals. Our focus is on identifying and connecting with newer medical professionals and travel nurses to offer them tailored opportunities and support. What We Need: We're seeking a talented web scraper who can help us gather specific data on medical professionals with new NPI numbers. Your task will involve targeting individuals in specific states and collecting their information accurately and efficiently. Your Responsibilities: Develop a web scraping solution capable of targeting specific states and names of medical professionals with new NPI numbers. Ensure the accuracy and reliability of t...

I’m looking for an experienced programmer who can create an automation script for a website. Key Requirements: - Automation Tasks: Your main job would be to automate various tasks on a website. This could involve anything from data entry to form submissions, and possibly content scraping. The specific tasks will be shared with you in detail. - Python Expertise: Given the nature of this task, your proficiency in Python is a must. If you have experience with automating websites using Python, that would be a huge plus. - Experience: Your application should showcase your relevant experiences and past projects. I’m looking for someone who has a proven track record in this field. Please include relevant examples of your past work in your application. Looking forward t...

we need a Web Scraping expert for a long term. will give you 1 site a day. per site $15. It's all about scraping product data like product title, description, image link etc.

...Key Features: - Efficient data scraping: The tool should successfully extract rental prices, occupancy rates, and property descriptions from Airbnb and AirDna. - Localized scraping: The data scraping should be focused on a specific city, which will be revealed once the project commences. Use of Data: The scraped information will be primarily used for market analysis purposes. The data will be instrumental in helping me understand the dynamics of the rental market within the specific city. Skills & Experience Required: - Proven experience in data scraping, especially from websites like Airbnb and AirDna. - Brilliant understanding of how to work with different types of data, such as numerical and textual data. - Strong ability to tailor the tool to...

...search of a skilled freelancer proficient in web scraping with Scrapy to extract product data from This project involves scraping the Category page to retrieve product details including name, price, SKU, URL, breadcrumb, currency, and brand. Targeted webpage: Category page of Required data: Product name, price, SKU, URL, breadcrumb, currency, and brand Experience: Prior experience in scraping product-related information from e-commerce sites is essential, with proficiency in Scrapy being crucial for accurate and efficient data extraction. Data Handling: Ability to ensure accuracy and consistency of extracted data. Familiarity with different data formats is advantageous. Dynamic Scraping: Navigation logic for all categories must be

I'm looking for an experienced API developer to help with syncing and scraping data from Confluence. Ideal Skills and Experience: - Proficient in Confluence API - Expertise in data synchronization and data scraping - Knowledge of handling Confluence pages, spaces, attachments, and content images - Able to preserve formatting and filter by date Key Responsibilities: - Develop an API integration for data synchronization - Implement scraping functionality for Confluence pages, spaces, and attachments - Ensure the scraped content maintains original formatting - Implement filtering logic to sort data by date

...for companies outside the U.S. and preferrably in Cyprus Malta U.K. and LATAM Brazil Key Requirements: - Focus on the Online Gaming Industry: The primary focus of this data scraping project is the online gaming sector specifically. All data should be relevant to companies operating within this industry. - Company Contact Information: The main data that I'm seeking here are Marketing manager and Business development email contacts for companies within the online gaming sector. This could include CEO founder and other decision-makers within these companies. Skills and Expertise: - Proficient in Data Scraping: The ideal candidate should have a strong background in web scraping, with prior experience in compiling email lists from online sources. ...

As discussed previous. Project already done

I am seeking an expert in email scraping for the purpose of building a marketing database. The ideal candidate can efficiently scrape emails and the company names. Key Aspects: - Attention to detail to ensure all relevant emails are scraped accurately and company name is also with. - Quick turn around, the project should be completed within a month. - Extensive experience in email scraping and database construction. I need this in a google sheet document. The approx amount of names/emails is 12.000 - 14.000 on the website. I need a fixed price offer and also time frame for this.

I need a database for the UK market, with a focus on company names and Email ID. Key Points: - The project primarily involves creating a comprehensive database for the UK market - The main data points to be included are company names and Email ID's - Information can be extracted from Yellow Pages, Business Pages, Associations, Business Chambers and similar. - Accuracy of data, specially Emails - Sample File of Required database is attached - To start with we require 10,000 records. - Will pay INR 0.60 per record. Ideal Freelancer: - Prior experience in creating detailed databases - Proficiency in data gathering, scraping and organization - Familiarity with the UK market would be a plus Please include your relevant experience in your application.

Join our team as a Python Selenium Web Scraper responsible for developing scraping scripts using Python and Selenium. You'll gather data from diverse websites, utilizing your expertise in web technologies, HTML, CSS, and JavaScript. Key responsibilities include analyzing website structures, extracting and cleaning data, and collaborating with team members to integrate data into existing systems. Ideal candidates possess proficiency in Python, experience with Selenium, and a strong understanding of web technologies. This role offers competitive compensation, flexible work hours, health benefits, and opportunities for career growth in a dynamic, collaborative environment

... including main operators, target audience, regulative organisations, etc. Please don't use a complicated diagrams with numbers and dry copy paste, cause we have already done it on our side :) As result of this project we are waiting for simple and well structured document no matter pdf, page in Notion or Google docs. That will be a starting point to do things. We are going to understand how people spin in Spain and who is in charge of it. We are not gonna launch another online casino there. Just for research purpose. What we are expecting to see in this market research 1. The main local players e.g. top 10 on the market including international ones, if any, that target their products in Spain (main products, websites, links to the social medias, blogs, etc) 2. The...

For this project, I require an expert who can efficiently extract text content from two distinct webpages...webpages and input my data into an Excel file organized by rows. Given that all types of data hold equal importance to me, of essence is for the professional to: - Accurately scrape all text content from the specified webpages - Ensure no data is skewed or omitted during this process - Neatly organize the data by rows in the Excel file The ideal candidate for this job should be proficient in web scraping tools and techniques, possesses an acute attention to detail, and is experienced in using Excel to ensure data is properly formatted and easy to analyze. Please note that minimizing errors during this process is critical, as the data collected will directly influence...

I am in need of a well-...need of a well-versed Python expert to assist in managing a Linux server. This project is task oriented and requires specific skills including: • Working with server data analysis • Implementing web scraping techniques • Establishing automation processes The role also demands a comprehensive understanding of Linux operations and the ability to print headers. A background in server security, setting up database servers and performance optimization would be ideal, but the focus is primarily on Linux server management via Python. Proficiency in Python, Linux, server data analysis and web scraping are must-haves. Experience in automation and server management will highly be appreciated. Looking forward to your know...

LinkedIn profile matching and scraping

I'm looking for an experienced web scraper to access and download specific information and images from the Used Inventory section of the White Rock Honda website. Here are the specifics of what I need: - Car make and model - Year of the car - Price of the car For each car listing, I need ALL available images downloaded. Furthermore, I require the images in JPG format. Candidates applying should have successful experience in web scraping, data extraction, and handling myriad images. Efficiency and accuracy are critical for this project.

I'm currently seeking a skilled backend developer who has proven expertise in Python, Java, and Ruby. I need someone who can guide me through whether to use the current source code or start from scratch, a decision that we can make together as the project evolves. As our project's main responsibility is to handle authentication and server configuration, the perfect candidate should be experienced in: - Setting up, managing, and sustaining server configurations - Handling various authentication tasks - Expertise in Python, Java, and Ruby - Decision-making skills concerning source code development This project will be rewarding for someone who enjoys tackling unique challenges and has a flair for problem-solving. If you're up to the task, please don’t ...

Looking for a skilled individual to undertake data scraping project. Key tasks will involve: - Focused on scraping 'Website 1' - Specific data requirement is 'price' - Data collection should be conducted periodically Ideal freelancers should be proficient in PHP, and have a track record in successful and ethical data scraping projects. Advise on suitable scraping schedule is appreciated. Efficiency and meticulous attention to detail are highly sought.

We are looking for a freelancer with strong web scraping experience for an exciting and challenging project. We need to gather specific data from multiple online sources and transform it into useful, structured information for analysis. Responsibilities: Utilize web scraping techniques to extract data from selected websites. Automate the extraction process to ensure accuracy and efficiency. Clean and structure the collected data into readable and usable formats. Integrate the extracted data into a database or spreadsheet as needed. Collaborate with our team to understand specific requirements and ensure the quality of the obtained data. Requirements: Demonstrable experience in web scraping using tools like Python (Beautiful Soup, Scrapy), Seleni...

I require a professional with a high level of expertise in web scraping and API integration to assist with a critical project. Here are the specifics of the project: - I need you to scrape data from , a website where we dropship our designer clothing products. - Specifically, I need the following details scraped: Product names, Product Colour, Product Sizes In Stock & Not in Stock, Product Prices (Only Black & Grey Pricing, not red sale price), and Search Key. - The scraped data should be automatically updated on a daily basis. - The scrapped data should be integrated into our Shopify store through an API bot. The ideal candidate should have a proven track record of working with similar projects and should be able to tailor the solution to our specific needs...

I need assistance in compiling a large, extensive database o...- Name and contact details - Education and qualifications - Current job title and company Interestingly, these professionals should spread across various industry sectors such as Technology and IT, Healthcare and Medicine, as well as Marketing and Advertising. Particular skills and experience that would set freelancers apart for this job include: - Proven experience in data mining and data scraping - Familiarity with the mentioned industry sectors - Ability to accurately cross-reference and verify data - Excellent attention to detail Freelancers with extensive experience in maintaining data integrity and confidentiality will be seriously considered. Successful completion of this project could lead to long-term coll...

I'm on the lookout for a skilled freelancer who can expertly scrape old leads from multiple sources. These sources include social media platforms, business directories, and various websites. Unfortunately, the purpose of this project hasn't been specified, but the successful freelancer must be capable of performing high-quality data scrapings, potentially for lead generation, market research, or data analysis. As a dedicated data professional, you should have a strong background in web scraping, data extraction, and data analysis. Please be sure to include in your application: - Your previous experience and samples of past work - A detailed project proposal outlining your approach. Your proficiency in using software and tools for data scraping, knowl...

I'm looking for an experienced data scraper. I need someone with excellent knowledge and expertise in web scraping. I will need the following with regards to mid sized collectible stores around the world: Company Name City Country URL Contact person Email address. Ongoing work for the right candidate/s

Hi mark i would like to hire you once again

Generic replied will be rejected. You must have experience in Radix, Scraping Data and be able to create a script that will import directly into woocommerce. We need an experienced radix developer to perform data scraping tasks for our client. The fundamental requirements include: - Scraping data from a suppliers website - Data to be scraped includes textual content , pricing and metadata - Skilled in managing and maintaining the scraped data's quality and relevance This data then needs to be imported into a woocommerce site as a variable product. The ideal candidate should have: - Expertise in working with WooCommerce platform - Proficiency in radix software - Experience in data scraping and storing large volumes of data The scraped data should be ...

I'm quietly on the hunt for a skilled professional to design an Instagram bot that can perform a series of tasks on my behalf. The main functionalities I'm interested in include: - Auto-liking posts - Auto-following users - Auto-commenting on posts I'm not in search of basic or hyper-detailed, but I'm aiming for moderate customization. While I don't want a merely plug-and-play tool, I do want one which allows me to adjust some settings to suit my preferences. The bot should focus its engagement on two types of accounts: - The ones I manually specify - Accounts within particular niches I'm interested in Having knowledge in Instagram bot programming, web scraping and understanding of Instagram API will play a vital ...

I need a skilled developer to create an automation bot for Telegram Channels. This bot will have the essential functions of: - Auto-joining channels - Extracting basic channel information including the description and links I want the bot to be able to extract the following specific information from the channels it joins: - Channel Name - Channel Desc...information from the channels it joins: - Channel Name - Channel Description - Channel Links - Member Count The frequency of this extraction should be set to a weekly basis. Ideal skills and experience for this job would include proficiency in Python or a similar programming language, previous experience with Telegram's API, and prior experience creating chatbots or automation bots. Expertise in web scraping techno...

I'm seeking a professional who can develop a web scraping tool with the following specifications: - The tool should be able to scrape text content from a specific website. - It will need to log in to the website in order to access the data. - The data should be extracted in real-time, meaning that the scraping should be continuous and up-to-date. Ideal candidates should have: - Proficiency in web scraping tools and techniques - Experience in developing real-time data extraction tools - Familiarity with log-in processes in web scrapers - Ability to work efficiently and deliver on time If you have the skills and experience required for this project, please get in touch. Thank you.

I'm in need of a professional to help generate a list of highly accurate and verified telephone numbers for marketing purposes. The ideal freelancer will have experience with web scraping and be able to deliver a high volume of numbers with high accuracy. Key deliverables: - Extracting telephone numbers from websites of businesses in the UK which could be open to a new website - Ensuring the numbers are accurate and verified for marketing purposes. Ideal freelancer skills: - Proficient in web scraping - Strong attention to detail - Experience with marketing data Please only bid if you can provide concrete evidence of similar past work.

I am in need of an individual with strong data collection skills, particularly in the area of web scraping. The job entails extracting text data from a certain selection of websites for me. My key focus is the content of various articles present on these sites. Ideal candidates should: - Have experience in web scraping for article content - Be meticulous in collecting data to ensure no valuable information is missed - Have a strong attention to detail to maintain the quality of collected data - Be capable of maintaining the confidentiality and integrity of the information collected To jumpstart, please provide your experience with similar projects and your available start date.

...to deliver a solution capable of scraping specific data from websites like and Makemytrip. The chief aim is to collate the room type and rates, along with rates applicable for specific dates. Ideal Skills and Experience: - Extensive Python programming skills, particularly in web scraping - Prior experience with data extraction from travel or hotel booking websites - Familiarity with various data extraction techniques and handling dynamic web content Your role will involve programming a robust and efficient scraper that can collect and deliver the desired data in a structured format. Familiarity with and adherence to legal and ethical aspects of data scraping is necessary. Efficiency in output delivery and importantly, minimal error in scraping...

... Freelancers with no rating need not apply. Generic copy-paste responses will be marked as spam. Your past freelance feedback should clearly show that you have completed similar tasks. I require a specialist in web scraping to extract the body text from articles on Google News. The information will be earmarked for natural language processing, hence, accuracy of extraction and correct formatting into an excel file is of utmost importance. Key responsibilities and skills: - Experience in web scraping, specifically from news websites. - Knowledge of creating Python or PHP scraping scripts or using API. - Ability to deliver results fast, as the project needs to be completed ASAP. Please note that the sole requirement is to extract the body of ...

...marketing and web scraping professional to help me generate quality leads through email campaigns. - The primary goal of this project is to generate leads for my business. - The ideal candidate should have a track record of successful lead generation through email campaigns. - Additionally, I need someone who can scrape the web to find relevant email addresses of potential leads. You must have Good English and most importantly manage the whole process from start to finish outside of us reply to leads generated. This will mean you need to be able to scrape websites in Ireland like directories/maps etc and Linkedln. Generate marketing lists of each niche and setup emails to contact relevant niche. You must have or recommend bulk sending platform (which we won�...

I need a proficient data miner to help me extract student leads from the following websites - , college , , , mbauniverse.com. Key Information to Extract: - Student contact numbers As I require this data urgently, a prompt turnaround time is essential. Freelancers should possess the following skills and experience: - Expertise in web scraping - Familiarity with the aforementioned websites - Can deliver a high level of accuracy - Can ensure data is categorized correctly. Applications from freelancers who can demonstrate past experience in similar projects will be looked upon favorably. Immediate availability is preferred due to the urgent nature of this project.

...proficient freelancer with a strong background in data scraping from LinkedIn, various social media platforms, and websites. The objective of this project involves harvesting old leads interested in job-oriented training courses in areas such as programming, digital marketing, business, and finance. The skillset and experience required include: - Excellent knowledge of data scraping techniques - Familiarity with LinkedIn, and other social media platforms for data extraction - A good understanding of programming courses, digital marketing, business, and finance topics The targeted audience for these training courses are students, working professionals, and entrepreneurs. I am expecting high-quality leads, so experience in targeted scraping is a must. To be successf...

I am in need of a proficient freelancer who can scrape image data effectively. This project involves: - Scraping image content efficiently from various types of websites. - No particular specification was given about the type of websites to scrape from, so flexibility in handling different sites is essential. - The timeline for project completion was not specified, suggesting flexibility in delivery time, although efficiency and promptness are always appreciated. Ideal Skills: - Proficiency in data scraping - Ability to handle varying website formats - Strong work ethic and punctuality in project completion - Attention to detail when scraping images.

Hi, The task is to scrape a pdf that is downloaded on website. Steps: 1. Go to website 2. Enter code in search and click search. (We provide list code) 3. On the results page Click on pdf document and open or download it 4. Extract 14 pieces of data from the PDF and export into excel sheet. There are about 150.000. Some codes do not have any data then skip. I have attached a word document with pictures and flow for you to review. Thanks!

I'm looking for a skilled developer to build me a web scraper for the Kumon UK website. The scraping needs to be able to: - Extract the names of tutors - Retrieve their addresses - Fetch contact information like phone numbers or email addresses The scraping process should be set to run just once, and must be accurate and reliable. The data should be presented in a structured format, ideally a XLSX file. Please provide an overview of your experience with web scraping and any similar projects you've worked on.

Hey everyone, i search someone who can do a task for my existing Wordpress Website. Actually i scrap every morning the data from soccer results from a website with WINHTTRACK and upload this to my website. Now i need automation. - Data Scraping from other website to my website - Data Refresh every Day 7 o'clock - 1:1 Copy with Design and my login - Only 3 Site ! I provide wordpress test access. On This access u can build a scraping automation. I can migrate myself. THANKS :)

I'm looking for a tool or app to scrape specific da...scrape specific data from car rental websites. Key Features & Requirements: - Targeted Websites: Avis, Budget, Sixt - Data to Scrape: - Pricing information - Car specifications - Add-on options - Total after tax and fees - Maximum rental period 330 days for Avis/Budget (Sixt 365 days) Additional Info: - The tool should be capable of automating the scraping process at regular intervals. - Data should be well-organized and easily exportable for further analysis. - The goal is to find deals and or pricing errors for specific vehicles Ideal Freelancer: - Prior experience working on web scraping projects is a must. - Proficiency in data analysis and presentation. - Strong underst...

I'm in need of a skilled website scraper to collect pricing information from various technology product websites. The specific websites aren't yet defined, providing opportunity for shared direction and collaboration. Key Tasks & Experience Required: - Data scraping expertise - Familiarity with technology product websites - Proficient in data extraction tools - Experience in data cleansing and categorization - Expertise in populating website with extracted information Your role will be central in aiding price comparison capabilities, making this an ideal project for those experienced in intelligent data mining and competitive market analyses.

...Type: Full-time / Part-time Job Duration: 3 months Job Description: As a Full Stack Developer, you will be responsible for developing and designing front end web architecture, ensuring the responsiveness of applications, and working alongside graphic designers for web design features, among other duties. Roles and Responsibilities: • Develop front end website architecture. • Design user interactions on web pages. • Develop backend website applications. • Create servers and databases for functionality. • Ensure cross-platform optimization for mobile phones. • Ensure responsiveness of applications. • Work alongside graphic designers for web design features. • See projects through from conception to finished pro...

Scrape license data from the FL DBPR website and deliver into an excel spreadsheet. Two counties: Osceola and Polk. Two license types: Vacation Rental - Dwelling and Vacation Rental - Condo. In the attached spreadsheet the required fields to identify the license type and county are shown in screenshots and the second tab as an example. The extracted data is then to put into tabs for each county and license type. Multiple rental locations for a primary name should have multiple entries (rows) with the license details repeated and only the rental location being different each row. There maybe some dynamic features in the website that complicates data extraction. Website: