Web scraping vs data mining jobs

I'm looking for a skilled Python developer with experience in web scraping and Selenium. Your task is to extract a domain list from a given URL (). The data extracted should be cross-referenced for each domain with the following fields: name, full address, email, and phone. Key Requirements: - Extract domain list from a specific website () - Implement cross-referencing for each domain with name, full address, email, and phone - Proficiency in Python and Selenium for web scraping - Ideally, experience with data cleaning and manipulation Please note that the number of records on the dealer locator is unknown. Your ability to handle large data sets will be crucial for the successful completion of this project.

...perform searches and click on search results multiple times. Key Project Requirements: - The tool should be built using Python, Java or Visual Basic - The primary goal of the tool is to perform automated web browser searches and click on various results - The tool should utilize Google Chrome as the web browser To give you a better idea, the tool should: - Conduct multiple web searches on Google - Click on a configurable number of search results from the returned search page Ideal Skills and Experience: - Proficient in Python, Java or Visual Basic - Experience in browser automation and web scraping - Familiarity with Google Chrome's automation capabilities If you have experience with similar projects or expertise in the mentioned languages, I&...

I am looking for a skilled graphic designer to assist with the rebranding of my company, PumpSpec, along with its divisions R&D Pumps & Power, National Mining & Civil Solutions, , and Thinkwater Fleurieu. The primary goal is to create a cohesive and modern visual identity that reflects our businesses. Key deliverables include: - Design of letterheads and business cards for each division, aligned with the new visual identity - Incorporating the chosen color scheme of Black and Blue, with the option to add other complementary colors - Inclusion of essential information on the stationery such as company name, address, phone number, website and email address, logo and tagline we want all businesses to be on the footer The desired design style should be bold and modern. T...

I'm seeking the expertise of a seasoned designer to create engaging Instagram templates representing my mining and emergency services company. The overall aesthetic should be simple yet captivating, mainly focusing on blue, white, and black palettes. Watermarked images are encouraged. Posts will be focused heavily on photos. I have attached some examples below as well as our company name and graphic to possibly be included on posts. We would like to have an overall theme for every post. Key Elements: - Despite the user not selecting any specific template designs, your creative acumen to propose a diverse mix of templates is welcome. - The templates should effectively communicate our company's values and mission, depict the benefits of our products and services, and provid...

I'm in need of a skilled Python developer to work on a web scraping project. Key Requirements: - I'm primarily focusing on Web scraping as the main functionality for the project. - You should be well-versed in Python and have a proven track record in data analysis. - Knowledge of web scraping is essential to ensure efficient and reliable data extraction.

...schedules (head-to-head matchups by week), weekly lineups, scoring settings, and league settings The Yahoo API Endpoints you'll need to use as inputs to derive the above data extracts for a particular league are: - the associated League ID (each league created by Yahoo is given it's own unique ID that a league member can provide) - the associated Game Key (there is a unique Game Key provided by Yahoo by fantasy sport and by year) - I have an online resource that outlines the baseline setup for what is required to leverage the Yahoo API, so can provide that I'm looking for a programmer who has experience in web scraping and working with APIs, especially the Yahoo API. Knowledge of fantasy football would be a very helpful plus, but not an absolute nec...

I have a web scraper script that needs fixing. It's designed to scrape various URLs from the Apollo website. Key Requirements: - Scraper debugging: The script is currently not working properly, and needs to be fixed. - URL scraping: The script should be able to successfully pull the data from the selected URLs on Apollo website. Experience with: - Web Scraping: Previous experience in web scraping is essential, as the data needs to be pulled accurately from this specific website. - Script Debugging: Ability to identify and fix issues within an existing script. - Proficiency in Python or relevant language for web scraping. - Knowledge of Apollo website structure. Please make sure your bid includes information ...

I'm seeking an experienced data extraction specialist to scrape both HTML and text files for specific data. Particulars to look for will involve the text content within these files that follows a mixed format structure so would require vast knowledge and understanding of both table format data and paragraph-style data. Key Skills and Experience Required: - Strong abilities in web scraping - Adept with HTML, text parsing - Knowledge of data formats and how to transform data - Proficient in CSV file generation. We need a comprehensive extraction that maintains the integrity and accuracy of the data. As these files do come in multiple formats, versatility and attention to detail are paramount on this project.

...development - Proficiency in developing both web and mobile applications - Previous experience with managing and implementing complex systems with multiple user roles The successful candidate should be able to deliver a high quality, user-friendly system within a reasonable timeframe. 1. Quiz manager: Implement a quiz online app You, as a user, you can login(or register) and make quizzes from a variety of domains. You can choose the domain for the questions. After the quiz is finished the user will receive a score. Structure (minimum requirements): Register page: a form with the necessary data Login page: a form with login details Quiz page: the quiz area (you can use cards) contact form On all pages: the user can change the theme: dark vs light the user can...

...CV and also be able to download it. admin area This page is protected by a login From here I can add multiple languages and add translation for each language From here I can also change the text that is displayed on the page Structure for page (minimum requirements): Page: header biography portfolio contact form footer At least 3 different animations are used The user can change the theme: dark vs light The user can change the language: at least en and ro It will be responsive at least on mobile. Recommendation: Text that will be translated based on language should come via an api call Nice to have: Use Angular Allow admins to create dynamic content: Use a text area to capture the html text on the admin area Use that html and injected in the page. E.g. below the portfoli...

...skilled and experienced Data Scraping Specialist to optimize and significantly increase the speed of our current data scraping processes. The ideal candidate will have extensive experience in web scraping, advanced knowledge of bypassing anti-scraping measures, and proficiency in utilizing cloud-based solutions for enhanced performance. Strong problem-solving and hacking skills to navigate complex web security systems are essential for this role. Responsibilities: Analyze and improve existing data scraping scripts to maximize efficiency and speed. Implement and manage cloud-based solutions (AWS, GCP, Azure, etc.) for scalable scraping tasks. Develop advanced strategies to bypass anti-scraping measures ...

I'm looking for a skilled freelancer with prior experience in data scraping to help me extract specific text content and URLs from a public site. Key Details: - Your main task will be to collect the text content and URLs from the site. - Previous experience in a similar project is a must. - Please provide me with details regarding your experience in your application. The purpose of this data scraping project is for market analysis.

I'm looking for a data scraping specialist proficient in leveraging social media platforms, business directories and website scraping. The goal is to create an Excel sheet with approximately 500 entries for market research purposes. Skills & Requirements: - Proficient in data scraping from multiple sources - Capable of filtering and sorting data - Able to extract and compile the following data fields: zip codes, locations, contact information, business name and industry. The successful candidate should demonstrate experience in similar projects, showcasing their ability to find and compile information efficiently and accurately for market research purposes.

I'm looking for an experie...website or through a manually updated database. Key Features: - Development for both iOS and Android platforms - Implementation of user notification features including push notifications, email alerts, and SMS alerts. Ideal Skills and Experience: - Proven track record in developing and launching user-friendly mobile applications for both iOS and Android - Familiarity with APIs and web scraping to acquire real-time data from government websites or the ability to create a reliable, manually updated database - Experience in integrating push notifications, email alerts, and SMS alerts into a mobile application Please note that this project may involve a degree of flexibility, as the method for acquiring flag status information has not b...

I need a comprehensive web scraping task done on Yellowpages for business broker. The goal is to extract the following data about businesses: - Business name - Address - Phone number - Email - Website - Contact Person I'm looking for a professional who is well-versed in web scraping and can deliver accurate and complete data. Skills required: - Proficiency in web scraping techniques - Experience with scraping - Attention to detail to ensure all relevant data is captured - Ability to deliver in a timely manner Please note that the number of pages to be scraped is not defined, meaning the task might involve a large number of results. The scraper should be able to handle this efficiently.

...Excel sheet that I need you to help me with. Here's how you can assist: - **Scraping from Multiple Platforms**: I need you to scrape email addresses, phone numbers, and any available social media accounts of these companies. You'll need to do this across Yelp, Google Maps, and TripAdvisor. - **Social Media Scraping**: In addition to the primary two platforms (Instagram and Twitter), I'll also need you to scrape Facebook accounts if available. Ideal candidates for this project should have: - **Web Scraping Experience**: A good knowledge of web scraping techniques and tools, which will ensure you can obtain accurate and reliable data. - **Data Mining Knowledge**: The ability to identify and extract the necess...

...me extract financial data and regulatory filings from a tax website. This involves scrapping website using the provided credentials by the client, i am looking for getting the python code as i can run the code myself in the future or integrate it to another system. Key Requirements: - I need approximately 300 data points extracted. - The output for these data points should be organized into a PDF or Word. This project is about creating an automated system to generate instant reports about a company. Only difficulty is the website has drops downs to select the period involved and in those 300 data points actually many come from the same source. Ideal Skills and Experience: - Experience in web scraping (Python) - Proficient in creating PDF doc...

Please Sign Up or Login to see details.

I need a freelancer with web scraping skills who can extract product prices and models from my 17 competitors. Ideally, the freelancer should be able to: Extract information accurately and comprehensively. Upload all the extracted information into an Excel sheet. Create a simple online website to facilitate this process. I have hosting and a domain. Enable me to update the extracted information with a single click. Complete this task within a maximum of 48 hours. Please include detailed proposals in your application on how you would approach this project.

...Java or python3 programmer to create a sensor-data generator for the website www.voeazul.com.br. The objective is to send a POST request to the site with valid sensor-data in order to obtain a particular cookie (_abck) for data analysis purposes. The sensor data to be simulated includes mouse movements, keyboard interactions, and browser interactions. Key Requirements: - Create a sensor-data generator in Java or python3 - The generator should simulate mouse movements, keyboard interactions, and browser interactions - The sensor-data should be valid enough to trigger the generation of the _abck cookie upon sending a POST request to Ideal Skills and Experience: - Proficiency in Java/python3 programming - Experience in web scraping...

I'm in need of a skilled builder who can create a powerful cross-platform crypto mining app. The app should not only facilitate the mining of a new crypto every hour, but also give users the option to purchase premium packages using a variety of crypto wallets. Key Requirements: - Development for both iOS and Android platforms - User-initiated mining process - Support for mining of a new, specific cryptocurrency - Inclusion of secure transactions for premium package purchases Your role in this project will be to design and implement a user-friendly interface that enables seamless navigation and functionality across both iOS and Android. You'll also need to integrate secure and reliable crypto wallet options to facilitate premium package purchases. ...

I need a Blender expert to import the Textures I downloaded from my Turbo Squid account for the product (please see what i currently have vs what It should look like). I've had a play around myself with nodes etc, but I'm relatively new to the software and haven't had much success bar the buttons in the middle. I have all the textures as a .tif, I just need them importing and correctly set up so they look the same when rendered.

Looking for help in modifying an existing python script and related sql database table The current script - (1) scrapes company financial data from website and populates database (2) scrapes news related to keywords from google news (3)sentiment classification of news items (4)pushes data to sql database The company names and keywords are currently hardcoded in the script Requirement- (1) Company names/urls/keywords (will be provided) to be put in master table in the database (2) The script to loop through and scrape the relevant data and put in database

I'm looking for an expert to help configure my Cyclecloud HPC cluster. This is a specific project with the following requirements: - Configuring the cluster for machine learning and simulations tasks - Ensuring the cluster can handle large data processing in a timely manner - Implementing efficient resource utilization strategies - Validating the performance of the cluster with real-world workloads The ideal candidate for this role should have: - Proven experience in configuring Cyclecloud HPC clusters - A strong understanding of machine learning and simulation requirements - The ability to optimize resource utilization and improve scalability - Excellent communication and problem-solving skills read the specs: What I would like to do is to set up a Cyclecloud cluster w...

I'm looking for a freelancer who's great at web scraping to help with a project involving a specific website initially, with potential for more. I'll give you the specific data fields to extract. It'd be great if you: Are really good at web scraping and or Python. Know your way around MS SQL Server databases, not essential but definately an advantage. Understand how to extract data effectively. Understand the need for security and captcha integration if needed. Can work quickly since this project is a priority and needs to be done ASAP. Ultimately, I want to be able to manage the code with your ongoing help, so this could lead to a long-term partnership. I'll share the full details when needed. You will provide source code...

I'm looking to compile a comprehensive list of e-mail addresses from various companies. This list will serve as our contact database for marketing outreach purposes. The ideal candidate for this task should have the following qualifications: - Proficiency in internet research and data mining. - Previous experience in compiling e-mail lists for marketing purposes. - Strong organizational skills to categorize the e-mail addresses by company name. - Ability to cross reference collected e-mail addresses against our existing list of company names to ensure no duplication. The e-mail addresses should be those of general contacts within the companies, rather than specific executive or departmental level personnel.

I'm in need of a concert ticket bot that can operate on several platforms, including Ticketmaster, Live Nation, ThaiTicketMajor, and BookMyShow Malaysia. The ideal bot should be able to perform sev...solving techniques or third-party captcha services if there is any available captcha yet to be solve, ensure scalability to handle high request volumes - Session tracking : the bot should extract and log the link for any session that successfully passes the queue The bot should be smart enough to navigate through the ticketing process of these platforms and complete the purchase. Experience in web scraping, automation, and ticketing bots, as well as knowledge of the mentioned platforms, is a must. If you can build a robust, reliable bot that meets these requirements, I�...

...expert, specializing in web scraping. I require someone who can proficiently extract data from various websites. The specifics of the data may vary from text content, images, links, to contact information. Your key responsibilities will include: - Writing effective and efficient Python scripts to scrape data - Ensuring the data is extracted accurately and in a structured format - Delivering the data in a timely manner The ideal candidate should have: - Proficient experience in Python and web scraping - A strong understanding of data extraction techniques - Proven experience in handling and parsing a variety of data types - Excellent communication skills and the ability to meet deadlines Please be prepared...

I'm looking for an experienced hacker who specializes in database scraping to assist with lead generation. My main aim is to get detailed contacts to grow my business. - Specific Tasks: - Database scraping - Extract contact details - Contact Information: - Email addresses - Phone numbers Ideal candidates should have previous experience in the field. Proficiency in data mining and scraping is a must, along with an understanding of lead generation strategies. Strong grips and successful track records on obtaining accurate contact details are key to perform this job efficiently.

I'm looking for an experienced developer to help with real-time text data scraping via API and management using BeautifulSoup. This project is primarily focused on retrieving text data and storing it in a database. Key Responsibilities: - Implement an API scraper to continuously retrieve text data in real-time - Utilize BeautifulSoup for data extraction and management - Develop a robust database to store all the scraped text data The ideal candidate should have: - Proficiency in Python programming language - Strong experience with API scraping and BeautifulSoup - Previous work involving real-time data scraping - A good understanding of database management It is important that the data scraping runs seaml...

Introduction We are seeking proposals from experienced web scraping and data analysis firms to conduct a comprehensive data collection and analysis project. The purpose of this project is to gather detailed information on menu items, pricing, customer ratings, promotions, and deals from various food delivery mobile apps operating within our city. The goal is to mine this data for actionable insights to inform our advertising, promotional strategies, and competitive benchmarking. 2. Project Scope The selected vendor will be responsible for developing and implementing a solution to: • Subscribe to and navigate through multiple food delivery mobile apps. • Collect data on menu items including descriptions, pricing, customer ratings, and ass...

Title: Automated Data Retrieval from Websites Using CRM and CID Numbers Description: We are looking for an experienced developer to automate the process of retrieving data from specific websites using CRM and CID numbers. The goal is to develop a script or tool that will: Look up Doctor's Specialization: Use CRM numbers to search on the website: CFM Doctors Search Extract doctor's information including their specialization. Look up Disease Descriptions: Use CID numbers to search on the website: MedicinaNet CID10 Search Extract the disease description. Deliverables: ( ) A script or tool that can take a list of CRM and CID numbers as input. Automate the search process on the specified websites. Extract

...find the contact name, position, email and LinkedIn account for each and every recruitment/HR/Headhunting person within each company. This could be anywhere between 10 to 30 people per company. - The information should be accurate and up to date. - If you have a strategy for obtaining this data, please share it in your bid. Skills/Experience: - Strong research skills - Data entry and data mining expertise - Proficient in Saudi Arabian business landscape - Attention to detail and accuracy - Web scraping - Web search - Leads Results should be in an excel sheet format, outlining the name, position, email address for each contact. Contacts for each company should be grouped together, end file should be in 1 sheet, not separate sheets. Sen...

Please Sign Up or Login to see details.

...Example of books and categories: Here are the suggested titles for the 15 ebooks/scripts on artificial intelligence. If you think something is missing or should be changed, please let me know. Theory Background History of AI Machine Learning and Data Mining Neural Networks Reinforcement Learning Speech-to-Text and Text-to-Speech (and Deep Learning in this Relation) Robotics Limits of AI, Deepfake, and Ethics Practical Guide - Tools ChatGPT for Beginners Image Creation Tools with AI (DALL-E, MidJourney, Assistants - Market Overview) & Computer Vision Data Analysis in Enterprises with AI Python - Introduction and First Overview Additional Books Natural Language Processing (NLP) AI in Healthcare Autonomous Vehicles and AI AI in Finance and Trading Please start yo...

I need a professional to scrape names and email addresses from specific public websites. I'm looking to populate a database with details from a range of public websites. This data will be used for lead generation and market research purposes. Ideal skills and experience: - Proficient in web scraping - Familiar with public data extraction - Able to structure data effectively

I need to Extract followers of group members of the link I will provide

I am looking for a web-scraping expert to retrieve both images and text from a specific website for research purposes. The text data will need to be structured and saved in a CSV file, including paths to saved images. Key details to consider: - Knowledge of web scraping tools and techniques is essential to accomplish this task. - Quality control to ensure accurate data extraction and image quality is critical. - Structure page information and freeform descriptions should be made available in a CSV file. - The images should be saved in their original resolution and quality settings. Please provide any relevant experience you have in web scraping, including free and paid services you have used before to help with your work. I would...

I need a professional who can help me with scraping data API from a specific website or platform. I'm looking to extract specific data points or information and potentially set up a regular scraping process. Key Requirements: - Proficiency in Web Scraping: I need someone who has experience with web scraping tools and techniques. - Data Mining Skills: The ability to identify and extract the specific data points I require is crucial. - Automation Expertise: If you have experience setting up automated scraping processes, that would be a huge advantage.

I'm in need of a comprehensive marketing list for Charlotte, NC that specifically targets businesses, particularly within the following industry sectors: dentist offices, chiropractor offices, restaurants, gyms, warehouses, lawyer offices, and doctor offices. Key requirements include: - Contact name - Phone number - Emai...within the following industry sectors: dentist offices, chiropractor offices, restaurants, gyms, warehouses, lawyer offices, and doctor offices. Key requirements include: - Contact name - Phone number - Email address - Address The ideal freelancer for this job would: - Have experience in compiling marketing lists. - Possess excellent data research and mining skills. - Demonstrate attention to detail for accuracy. - Understand the importance of GDP...

I'm working on a school project that involves the development of a Coal Mining Security Alert System. I need someone who can code in Quarky to create this block code system. Unfortunately, I haven't gotten to the point of defining the complete scope of the project, but I'd like to start with the code development. I'm looking for someone who can: - Use Quarky to build a block code system - Understand and implement basic security alert functionalities - Be ready for subsequent feature additions and changes Key Features: = Face Detection: Implement face detection functionality to identify individuals within the mining area. = PPE Kit Verification: Utilize image processing techniques to ensure that miners are wearing proper PPE kits. The system should stop i...

...functioning as expected. I need a developer to address these issues, described below. - **Issue Description**: The script is crashing when scraping certain Telegram groups, which is likely due to the fact that it's not respecting selections. The error presented is “ AttributeError: 'MessageMediaWebPage' object has no attribute 'document'” I can provide the script if you want to check how it’s working. I am open to a whole new script being made. So long as it functions in a similar way. If not familiar you can view telethon api - **Expected Behavior**: The scraping script is supposed to collect data that matches specific regex patterns. This means that it's not just supposed to collect all messages or only new mes...

...script that can scrape the Google Play store specific data from list of apps in the search result url of any keyword. Need data in Excel spreadsheet. Eg : if i search cat in playstore, i need the below mentioned details of first 100 apps shown in the search result. Key Project Details: - I require the script to scrape app names, descriptions, emails, download counts, and URL of the app. - The scraped data should be compiled into an Excel spreadsheet format for my review and analysis. - deploy the script into my server The Ideal Freelancer: - Proficient in web scraping tools and techniques - Experience working with Google Play store data - Competent in automating data extraction and processing - Ability to deliver a reliable, daily ...

I'm on the hunt for a skillful coder proficient in web scraping, specifically for Website A. The goal of this project is for obtaining valuable and significant data for analysis, competitive intelligence, and price comparison. While there's no explicit mention of the type of data to be scraped, I anticipate that a capable offering will cater to a variety of needs such as: - Text content - Image content - Metadata Ideal Experience and Skills: - Proven experience with web scraping - High proficiency in handling large data sets - Comfort in navigating Website A - Ability to collect comprehensive data categories Looking forward to a potential collaboration to achieve this goal!

I need a developer to help me create an automated web scraper. - This scraper should be able to operate on multiple websites. The ideal candidate should have experience in web scraping, data extraction, and automation. The ability to adapt to different types of data and websites is essential. Thank you

We are seeking a skilled developer or development team to create a comprehensive web crawler system. This system should scrape, structure, and update information from web pages, handle large projects, and be accessible via a powerful API. The system should offer user-friendly features for both individuals and businesses and include flexible user management for both customers and employees. Project Requirements 1. Web Crawling and Data Extraction -Develop a system capable of scraping entire websites and extracting data from each page. -The system should divide the scraped information into sections to facilitate easy reading and understanding. -For e-commerce sites, the system should identify and structure the following information: --Product catego...

Hi, I need the following scraped. You can use scraping software or script. YellowPages might be the easiest - law firms and lawyers - only name and email - Colorado, USA

...complete the project in a timely manner more details--- ### Task Description: Google Sheets Data Entry Expert for Cricket Schedule **Objective:** Create a comprehensive cricket schedule for the English summer season using Google Sheets. The schedule should include fixtures for various tournaments and teams, organized by date and start time. **Scope:** The schedule should cover the following: 1. England Men 2. England Women 3. England Disability 4. Vitality County Championship 5. Vitality Blast 6. Metro Bank One Day Cup 7. Charlotte Edwards Cup 8. Rachael Heyhoe Flint Trophy 10. The Hundred **Details to Include:** For each match, include the following columns: - Date - Match Number - Teams (Example: Team A vs Team B) - Match Format (Example: T20, ODI, Test, League 100) ...

I need historical stock prices and income statement data, deliver python script to collect this data for an arbitrary stock from google finance.

Hello, This is a $20 project. Looking for a freelancer to develop a python script to retrieve restaurant data from Google Maps using the Maps/Places API. The script should target restaurants that have a phone number and *do not* have a website. The inputs I need to enter are: - Location (latitude and longitude) - Search Radius (in meters) - Ensure the business/place is a restaurant, bakery, etc. Key Data to Retrieve, output in a .CSV: - Business Name - Address - Phone Number - Google Maps URL Thank you, trooper501