Perl scrapy web jobs

Filter

My recent searches
Filter by:
Budget
to
to
to
Type
Skills
Languages
    Job State
    2,000 perl scrapy web jobs found, pricing in USD

    We are in search of a skilled freelancer proficient in web scraping with Scrapy to extract product data from This project involves scraping the Category page to retrieve product details including name, price, SKU, URL, breadcrumb, currency, and brand. Targeted webpage: Category page of Required data: Product name, price, SKU, URL, breadcrumb, currency, and brand Experience: Prior experience in scraping product-related information from e-commerce sites is essential, with proficiency in Scrapy being crucial for accurate and efficient data extraction. Data Handling: Ability to ensure accuracy and consistency of extracted data. Familiarity with different data formats is advantageous. Dynamic Scraping: Navigation logic for all categories

    $36 (Avg Bid)
    $36 Avg Bid
    15 bids
    Web Scrapper 6 days left
    VERIFIED

    We are looking for a freelancer with strong web scraping experience for an exciting and challenging project. We need to gather specific data from multiple online sources and transform it into useful, structured information for analysis. Responsibilities: Utilize web scraping techniques to extract data from selected websites. Automate the extraction process to ensure accuracy and efficiency. Clean and structure the collected data into readable and usable formats. Integrate the extracted data into a database or spreadsheet as needed. Collaborate with our team to understand specific requirements and ensure the quality of the obtained data. Requirements: Demonstrable experience in web scraping using tools like Python (Beautiful Soup, Scrapy), Selenium, etc. Solid...

    $28 (Avg Bid)
    $28 Avg Bid
    38 bids
    Scrapy setup 3 days left
    VERIFIED

    Purpose is to instlal Scrapy on an Ubuntu server, so it'll work with http ip proxies (i'll send you 2 IP proxies so you can test to confirm it's working fine)

    $25 (Avg Bid)
    $25 Avg Bid
    14 bids

    ...specific data from Twitter, Reddit, and YouTube. Emphasizing on: - Tweets - Hashtag trends - SM users' specific usage of a small number of terms relating to claims of "stochastic terrorism" and "stochastic violence" Priority would be given to freelancers demonstrating: - Previous experience in web scraping, particularly from social media platforms. - Strong Python skills since Python-based tools are commonly used for web scraping. Knowledge of libraries such as BeautifulSoup, Selenium or Scrapy would be a plus. - Ability to organize and clean the data into an easy-to-understand format. - Understanding of Twitter’s policies on data scraping to ensure the legality of the data collection process. The prompt completion of this project ...

    $34 / hr (Avg Bid)
    $34 / hr Avg Bid
    54 bids
    Server Perl Scripts Debugging 16 hours left
    VERIFIED

    II. the task #2 (less important but fast to fix) email notifications do not work for some reason (on server with webUI @159.65...) The email sending works with cron there contains 1 task here /var/spool/cron/tabs/root and 4 here as i understand /var/spool/cron/tabs/serg guess user serg is not configured properly(but it is a full disk copy, so not sure) or cron tasks are not active or lunching.. also i see 3 cron procs on old sever (ps-A|grep cron) and only 1 on new server... you can change email in scripts and test (the email sending is working ok tested it with small /root/) p.s. you can check working details on old server @213.168.... I. the most important but could take more time The statistics section do not work at all on the New server here is active clients on OLD server(s)...

    $75 (Avg Bid)
    $75 Avg Bid
    32 bids

    As the project lead, I'm seeking a highly skilled developer to construct a Scrapy web crawler for multiple sites. Although I omitted website specifics for now, rest assured we will provide the necessary details post-engagement. The ideal candidate is capable of: - Building an optimized web crawler with Scrapy - Extracting text data proficiently from various web pages, accurately and efficiently For the application, please provide: - Detailed project proposals outlining your approach Experience in web crawling design and Scrapy framework are a must for this project. Your technical capacity to generate the explained particulars is critical for success here. This is a golden opportunity to exhibit your proficiencies and contribute t...

    $505 (Avg Bid)
    $505 Avg Bid
    105 bids

    I require an experienced data scrapping professional to extract tables from 4 specific webpages. The details include: - Scrapping Tables: Each page has structured tables with consistent columns that need to be scraped. T...scrapping professional to extract tables from 4 specific webpages. The details include: - Scrapping Tables: Each page has structured tables with consistent columns that need to be scraped. The tables have a mix of textual and numeric data. The task requires accuracy in extracting these data elements. - Expertise: Ideal experts must have prior experience in HTML/CSS, Python, and Web Scrapping. Experience with BeautifulSoup, Scrapy, or similar tool is a plus, as it will make dealing with tables easier and more efficient. Please bid with your past experie...

    $12 (Avg Bid)
    $12 Avg Bid
    19 bids

    I'm looking for a specialist to create a scrapy bot flask to automate certain actions. The purpose of this project is predominantly aimed at automation processes. The specific platforms to be automated haven't been determined yet, so a versatile approach will be appreciated. Following are the skills and experiences required for this project: • Extensive knowledge and experience with scrapy, flask, and automation. • Familiarity and proficiency in working with different platforms. • Ability to create versatile bots that can be adjusted according to the platform. Though we have no stringent time limit for project completion, we appreciate a dedicated, efficient approach. The capability to work efficiently without strict deadlines will be a plus point.

    $605 (Avg Bid)
    $605 Avg Bid
    82 bids

    I urgently need an experienced data scraper who can meticulously extract the text content and links from specific webpages. Your core respo...specific webpages. Your core responsibilities will include: - Accurate and efficient data extraction from targeted webpages - Utilizing cutting-edge scraping tools and scripts to automate the process - Ensuring all text content and links are correctly pulled and stored Ideal Skills: - Prior experience in data scraping, particularly with webpages. - Proficiency in using scraping tools such as Scrapy, BeautifulSoup, or other similar utilities. - Keen attention to detail and accuracy. - Ability to deliver work promptly as this project has high time sensitivity. Please bid if you can deliver this project ASAP without compromising the qualit...

    $14 (Avg Bid)
    $14 Avg Bid
    19 bids

    I need an experienced Python developer who can proficiently extract tables from a PDF document. Key Requirements: - The tables in the PDF are mostly well-structured but there might be few exceptions where you will need to han...irregularities. - You must have extensive experience in handling and extracting data particularly for inconsistent or complex table structures. - The final scraped data should be delivered in an Excel file. Ideal Candidate: - Extensive experience with Python and data scraping, with particular experience in handling table data. - Proficient in using Python data scraping tools like BeautifulSoup, Scrapy etc. - Good understanding of handling and transforming data in Microsoft Excel. - Strong problem-solving skills to handle potential challenges with table s...

    $12 / hr (Avg Bid)
    $12 / hr Avg Bid
    86 bids

    ...of election monitoring websites. 2.⁠ ⁠Extract relevant data points such as election dates, candidates, voter turnout, election results, and any other pertinent information. 3.⁠ ⁠Ensure accuracy and completeness of scraped data. 4.⁠ ⁠Organize and format the scraped data for easy analysis and integration into our database. *Requirements:* 1.⁠ ⁠Proficiency in web scraping techniques using tools like Python's BeautifulSoup, Scrapy, or similar frameworks. 2.⁠ ⁠Experience in data extraction and manipulation. 3.⁠ ⁠Ability to work with large datasets and handle multiple sources simultaneously. 4.⁠ ⁠Attention to detail and accuracy in data collection. 5.⁠ ⁠Strong communication skills and ability to provide regular updates on progress. 6.⁠ ⁠Time commitment: Expected...

    $1182 (Avg Bid)
    $1182 Avg Bid
    149 bids

    I'm in need of a skilled freelancer who has expertise in Perl scripting, primarily for file manipulation tasks. Key Requirements: --Gather date from a table in oracle. Based on that date find the records available in a home directory and store it in a .txt file. Skills and Experience: - Proficiency in Perl scripting is a must. - Experience in handling various file formats, specifically .txt and .csv. - Strong understanding of file operations including renaming, formatting, and sorting (although the specific task was skipped). I need the code done within 2 days and willing to pay 3000 which would be double the cost of what is given .

    $24 (Avg Bid)
    $24 Avg Bid
    10 bids

    I'm currently using PERL 5.10 system and requires a proficient expert to aid in modifying how passwords are hashed in my system. Initially, we employed SHA-256 but we're looking to switch to PBKDF2. Ideal Skills and Experience: - Proficient in PERL 5.10 - Familiarity with SHA-256 and PBKDF2 hashing methods - Prior experience in password re-hashing Task Objectives: - Identify current SHA-256 hashing method in the system - Modify hashing method to use PBKDF2 instead - Validate successful implementation of the PBKDF2 hashing method The project necessitates a strict focus on security and confidentiality given its sensitive nature.

    $13 (Avg Bid)
    $13 Avg Bid
    26 bids

    Script Feature: - Login to a list of SSH servers by domain or IP (from text file) - Use a set of usernames + password (can be multiple passwords) to login to the servers. - Run Bash Script on the connected server (which comes from a txt file on the server running the script, not on the connected to server) - Timeout if SSH server did not answer. - Display results at the end of a run (show which servers the script did not run because of errors). Login simultaneously to all available ssh servers. Not server by server.

    $29 (Avg Bid)
    $29 Avg Bid
    19 bids

    ...data schema, and instructions for executing the scraper. Compliance and Ethics: Ensure the scraping initiative adheres to online marketplace terms of service and abides by legal stipulations. Ideal Candidate: Demonstrated prowess in web scraping and data extraction ventures. Proficiency in scraping utilities and frameworks (e.g., Beautiful Soup, Selenium, Scrapy). Fluent in programming languages pertinent to web scraping, like Python or JavaScript. Capable of extracting data from dynamically generated content and sites reliant on JavaScript. A solid grasp of web fundamentals (HTML, CSS, DOM). Previous experience tackling anti-scraping mechanisms and CAPTCHAs will be considered a plus. A staunch advocate for ethical scraping practices and data protection compl...

    $126 (Avg Bid)
    $126 Avg Bid
    87 bids

    Hoping to connect with a proficient web scraping specialist to extract data from Website 1. The type of information to be extracted has not been specifically pointed out, so ability to gather comprehensive data is instrumental. Key Requirements: - High-level understanding of web scraping techniques - Experience extracting different types of data (Product Information, User Reviews, Pricing Details, etc.) - The ability to complete the task in 2 days Ideal skills: - Experience with Python, Scrapy or other web scraping tools - Familiarity with data extraction and storage - Strong speed and accuracy, with proven ability to meet tight deadlines. Please provide examples of similar work in your bid. Immediate completion required.

    $30 (Avg Bid)
    $30 Avg Bid
    22 bids

    Hello everyone, As a Web Scraping Expert at our company, you will have the opportunity to work on cutting-edge projects, collaborate with a dynamic team, and contribute to the success of our data-driven initiatives. If you have a strong background in web scraping techniques and tools, and are passionate about extracting and analyzing data from various sources, we want to hear from you! Key Responsibilities: Develop web scraping scripts using Python, Beautiful Soup, Scrapy, and other relevant technologies Extract data from websites, APIs, and databases Transform data into structured formats for analysis and visualization Collaborate with stakeholders to understand requirements and deliver tailored solutions Lead and manage web scraping projects from ince...

    $153 (Avg Bid)
    $153 Avg Bid
    61 bids

    I need to convert the following Perl code to PHP: The expected output is a PHP class that can convert a docx file into text. The attached zip contains a mockup of such class (with demo code) and a test docx file. The task is straight forward. If you place a bid, expect it to be accepted. If you fail to deliver, you'll be subjected to a bad review. This is to avoid wasting my time with autoposters and people who lowball the bid and then try to ask for more money. You have been warned. Read the brief, check the code and place a bid accordingly.

    $214 (Avg Bid)
    $214 Avg Bid
    24 bids

    Python Script of web spiders to fetch data crawling the web data。familiar with BeautifulSoup or selenium or scrapy ,Request etc What type of data do you want to scrape and crawl from websites? Fbeautiful soup vs selenium vs scrapy The function is easy to design

    $32 (Avg Bid)
    $32 Avg Bid
    41 bids

    I am looking for an expert in web scraping, preferably skilled in Beautiful Soup, Selenium, or Scrapy. The task at hand involves scraping 83 distinct URLs and integrating the collected data - specifically showtimes - onto my website's TV channels page. Key aspects of the project include: - Displaying current showtimes on the website - Automatically updating these showtimes This project is needed ASAP, and thus requires a freelancer able to swiftly yet accurately complete the task. Proficiency in Python, PHP and JavaScript would highly benefit the project execution. ----- I require a freelancer with expertise in web scraping to update my existing scraper tools which gather show time information from a multitude of television channel websites. You will use selen...

    $96 (Avg Bid)
    $96 Avg Bid
    27 bids

    I'm urgently in search of a well-rounded and outstanding programmer fluent in numerous programming languages. It's essential for you to excel in Python, Java, C++, C#, Scala, Ruby, Python, Perl, Javascript, Go, SQL, Rust, Swift, Kotlin, HTML/CSS, and be experienced with NoSQL and LaTeX. Ideal technical expertise includes: - Data Visualization: Proficiency in matplotlib, D3.js, bokeh, or comparable tools - Machine Learning: Familiarity with TensorFlow, scikit-learn, PyTorch, or equivalent - Unit & Functional Tests: Experience using Selenium, Cypress, Mocha, or similar - Cloud Computing: AWS, Azure, Google Cloud Platform, or equivalent knowledge - Containerization: Docker The central task is to perform insightful programming assessments and coding within my enterpris...

    $25 / hr (Avg Bid)
    $25 / hr Avg Bid
    51 bids

    Hi, Today i have created a Scrapy crawler to crawl the website , but i'm not able to crawl the website because when i run the crawler, any request i do to the website, i got the 403 error to me. I just neeed you fix my code to do a request at someway the website return the code 200 instead of 403. I'm sending my code attached. Send me a print screen in the chat showing you received code 200 using the same url, then i will hire you to send me your code.

    $10 (Avg Bid)
    $10 Avg Bid
    2 bids

    I'm seeking a proficient Python programmer who ...for the list of websites and LinkedIn profiles. Your task will include: - Using Python with Scrapy to collect desired information. - Developing scripts that can identify and retrieve the services provided by the mentioned sites, along with their relevant contact details. - Ensuring that the scripts can also gather a comprehensive list of requirements from LinkedIn profiles. - Lastly, providing the compiled data in an Excel file format. Experience with Python and Scrapy is vital, and a firm understanding of web scraping and data manipulation is necessary. A proven track record in similar tasks would be advantageous. The freelancer must also be aware of and adhere to the legal boundaries around web scraping ...

    $484 (Avg Bid)
    $484 Avg Bid
    111 bids

    I am in need of a proficient Python developer with a wealth of experience in web scraping to create a system that can scrape multiple types of websites; News sites, E-commerce and Social media. While I didn't specify which particular sites, an ideal candidate should be capable of developing versatile scrapers that can adapt to different website structures. Key responsibilities: - Develop a Python web scraping system - Ensure that the scraper is versatile for news, e-commerce, and social media sites Ideal Skills: - Extensive experience in Python - Proficiency in web scraping, preferably with Python libraries like Beautiful Soup and Scrapy - Familiarity with multiple website structures Although I did not specify the frequency at which the scraper should ...

    $587 (Avg Bid)
    $587 Avg Bid
    19 bids

    ...scrap textual content from a specific website and save the data into a .xlsx file. I want three different scripts to scrape different sections of content from the same domain. See attached example for each of the three inputs and outputs required. Key skills required: - Excellent command over Python programming, especially for web scraping - Experience with Libraries like BeautifulSoup, Scrapy - Familiarity with xlsx file operating in Python - Strong understanding of web automation and bots Please make sure you: - Have a good grasp of exception handling to make sure the scraping script can handle errors and won't crash. - Can design the script in a way that it respects the terms of the website and avoids the potential of getting blocked. - Are meticulous a...

    $318 (Avg Bid)
    $318 Avg Bid
    34 bids

    I need an experienced professional who's an expert in using Scrapy to daily scrape Information to be retrieved includes price, SKU or internal ID, product URL, breadcrumb, title, price, currency, and brand. Key requirements include: - Strong comprehension of Scrapy - Proven experience in web scraping, particularly e-commerce sites The freelancer should be adept in handling large datasets and ensuring the accuracy and consistency of the data gathered. An understanding of e-commerce dynamics, especially pricing, would be a beneficial addition. The milestone is completed once the Scrapy project is delivered and tested. We have many more websites to work with once the first one is delivered

    $25 (Avg Bid)
    $25 Avg Bid
    21 bids

    I need an experienced professional who's an expert in using Scrapy to daily scrape Information to be retrieved includes price, SKU or internal ID, product URL, breadcrumb, title, price, currency, and brand. Key requirements include: - Strong comprehension of Scrapy - Proven experience in web scraping, particularly e-commerce sites The freelancer should be adept in handling large datasets and ensuring the accuracy and consistency of the data gathered. An understanding of e-commerce dynamics, especially pricing, would be a beneficial addition.

    $32 (Avg Bid)
    $32 Avg Bid
    16 bids

    I am in search of a proficient freelance developer to create a specialized web crawler focused on extracting vital data from e-commerce websites, primarily targeting ''. Key Requirements: The web crawler must adeptly parse text-based content and efficiently navigate the site's structure to extract pertinent information and links. Extensive expertise in Web crawling, Web scraping, and Data mining is essential for this project's success. Prior successful engagements in web scraping projects centered on e-commerce platforms would be greatly advantageous. Proficiency in programming Python is required. Familiarity with web scraping frameworks and libraries like BeautifulSoup, Scrapy, or Selenium is highly desirable. Whi...

    $28 (Avg Bid)
    $28 Avg Bid
    14 bids

    I'm looking for an expert Python/Vue Js developer to help with creating a task automation app, specifically aimed at web scraping, for Windows operating system. Notably, the application should be able to handle basic to intermediate data extraction tasks, details of which will be shared upon selection. Understanding of web scraping libraries like Beautiful Soup, Scrapy is highly desirable. Experience in automating tasks on Windows is a significant plus. Python prowess alongside Vue Js for interface creation is key. Optimal skills and experience include: - Proficiency in Python for scripting the automation tasks - Familiarity with web scraping libraries in Python - Experience with Vue Js for frontend development - Understanding of Windows platform and comp...

    $165 (Avg Bid)
    $165 Avg Bid
    14 bids

    I'm seeking an expert to help cr...an expert to help create a Dockerfile that runs Perl and DBD::mysql so that I can run a legacy website. This should be a simple task if you have the knowledge. Specific requirements include: - A Dockerfile is the only output required, roughly corresponding to mine - It should build and run in wsl, i.e. docker run -p 8080:80 image_name - It must use Apache, Perl and the CPAN module DBD::MySQL - It should have been tested on a MySql database, the file is provided to run on localhost:8080/ - A screenshot of the above is required to prove that it is working (you just need a MySql Table with fields Id and Name) Candidates should ideally have: - Extensive experience in Docker and a basic knowledge of Perl - Understanding of Per...

    $68 (Avg Bid)
    $68 Avg Bid
    5 bids

    We're in need of a skilled Scrapy/Python expert to assist us in setting up a bot capable of efficiently scraping large online databases. The ideal candidate should have extensive experience with web scraping techniques and be proficient in Python programming. Our primary goal is to automate the extraction of data from these databases. If you have the expertise required for this task, we'd love to hear from you. Website URl: Please include examples of your previous work in your proposal. Looking forward to your proposals.

    $8 / hr (Avg Bid)
    $8 / hr Avg Bid
    12 bids

    ...working. MochaHost tech support got the Import buttons on the forms fixed but suggests they may not be able to fix the XML & XML+XSL submission buttons at the bottom of the forms. Here's what they say about that: When the server is upgraded, the Perl modules in the new server might not be fully imported. That's why your website doesn't work because some Perl module dependencies might be deprecated. MochaHost support says: We highly suggest you talk about the error with your Web Developer to ensure they can help you add the missing path on the Perl module. Based on our check, your website form processing is missing pointing to the `File::Spec` module which has been installed on the server. It seems like that might be a fairly easy fix and...

    $30 - $250
    Sealed
    $30 - $250
    1 bids

    ...of cutting-edge applications. This position requires extensive experience with Django apps, along with proficiency in AWS, web scraping, and deployment using Nginx and Gunicorn. The ideal candidate will have a passion for building scalable and secure systems, with a focus on delivering high-quality solutions that meet our clients' needs. Key Responsibilities: Collaborate with cross-functional teams to design and implement Django-based web applications. Develop and maintain database schemas using SQLAlchemy, ensuring optimal performance and reliability. Utilize AWS services for server administration, database management, and deployment of web applications. Implement web scraping techniques to gather data from various sources and integrate it into our sy...

    $20 / hr (Avg Bid)
    $20 / hr Avg Bid
    45 bids

    ...performance tuning, sizing and capacity planning, database backup and recovery in a Unix O/S using RMAN and Oracle export/import utilities, administration, and maintenance to provide backup and disaster recovery. • Knowledge of installation, configuration, and maintenance of multi-node Oracle RAC enabled databases, including Oracle ASM and Oracle CRS management. Knowledge of PL/SQL packages, shell, and Perl scripts for task automation, and proactive database monitoring and notification using Oracle OEM Grid Control. • Demonstrated written and oral communication skills reviewing and editing established database policies and procedures and developing new SOPs for database software installation and configuration. • Experience with Cloud(AWS/Azure/OCI) migrations (DB a...

    $2622 (Avg Bid)
    $2622 Avg Bid
    4 bids

    I'm looking for seasoned coders that excel in Perl, to reconfigure my current Perl email script. The primary aim is to make it efficient in sending out emails using Google's SMTP. Key Deliverables: - Modify Perl script to use Google's SMTP via the Net::SMTP::SSL or Email::Send::SMTP::Gmail modules - Integrate secure connection to Gmail - Integrate Email authentication No requirement for handling attachments is necessary. Need to understand how the forms work. Proficiency in Perl, understanding of SMTP protocols, specifically Google's SMTP, and experience with Net::SMTP::SSL and Email::Send::SMTP::Gmail modules are crucial for success in this task.

    $15 (Avg Bid)
    $15 Avg Bid
    2 bids

    I'm looking to gather ...this project should have significant experience in data scraping, particularly from the resources mentioned. A successful freelancer will demonstrate knowledge of legal and ethical considerations around data scraping, including understanding and working within the guidelines and terms of use for each website. Proficiency in relevant programming languages and tools, such as Python, BeautifulSoup, Scrapy, Selenium, or comparable technologies, is necessary. Experience within the recruitment industry would also be beneficial, as it could inform a more effective approach to refining and organizing the gathered data. It's essential that the successful candidate can deliver a clean, organized, and usable list of email contacts for IT professionals at the...

    $4 / hr (Avg Bid)
    $4 / hr Avg Bid
    16 bids

    I am searching for a Python developer proficient in Scrapy to forge web security testing tools. As a key deliverable, these tools must have the features below: - Subdomain Enumeration: Subdomains to be listed and categorized. - Directory Enumeration - Sensitive Parameter Detection - XSS Testing - SQL Testing Proven experience in creating security software is ideal. The developer should be adept at creating intermediate-level subdomain enumeration features. The project completion requires an understanding and implementation of Scrapy. I expect a functional, well-tested software package at the end of the project.

    $243 (Avg Bid)
    $243 Avg Bid
    18 bids

    ...Dm message me for any questions For the purpose of in-depth analysis, I require a skilled data acquisition specialist to develop a script for web scraping legal documents. Key data points of interest include: - Case title - Document date - Details of the lawsuit - Analysis for legal issues - Case citations Adherence to ethical guidelines and laws is necessary, thus a strong understanding of legal operation is essential. The script needs to ensure efficient data retrieval and storage. A high standard for accuracy and reliability will be expected in the delivered work. Candidates with hands-on experience using Beautiful Soup, Scrapy, or similar web scraping tools will find this relevant. Sufficient knowledge in legal documentation and practice is also an added a...

    $166 (Avg Bid)
    $166 Avg Bid
    42 bids

    I'm seeking skilled Perl coders to modify my email script. This script currently sends out emails well after a web form submission using the Net::SMTP::SSL module. Success in this project will mean updating the script to instead utilize the Email::Send::SMTP::Gmail module. Ideal Skills: - Proficient in Perl coding - Familiarity with Net::SMTP::SSL and Email::Send::SMTP::Gmail modules - Understanding of Google SMTP Key Responsibilities: - Reconfigure Perl script to work with Email::Send::SMTP::Gmail module - Ensure the script remains efficient for sending out web form submission emails - Test script after modifications to verify seamless integration with Gmail SMTP

    $25 (Avg Bid)
    $25 Avg Bid
    9 bids

    ...- Utilizing web scraping techniques to extract relevant data from LinkedIn profiles and posts. - Implementing automation frameworks such as Selenium or BeautifulSoup for efficient task execution. - Integrating email functionalities for sending personalized emails to recruiters and candidates. - Ensuring strict adherence to LinkedIn's user policies and API usage guidelines. Consideration should be given to the fact that the bot is intended to work specifically with LinkedIn Basic accounts. Previous experience developing similar tools or working with LinkedIn's APIs and interfaces will be a definite asset for this project. Key Skills and Qualifications: - Proficiency in Python programming language. - Experience with web scraping techniques and tools (e.g., Beauti...

    $260 (Avg Bid)
    $260 Avg Bid
    14 bids

    ...display up-to-date data from popular real estate listing sites, using web scraping techniques that comply with the directives of the files of the targeted sites. Project Goals: Create an intuitive and user-friendly dashboard that displays the collected data, with filtering and sorting features to aid in analysis. Ensure automatic updating of data in the dashboard to reflect current market prices in real estate. Implement security measures to protect collected data and comply with data protection regulations. Required Skills: Proven experience in web development and dashboard creation. Strong programming skills, especially in Python, JavaScript, and the use of web scraping libraries such as BeautifulSoup, Scrapy, or similar. Knowledge of front-end developmen...

    $186 (Avg Bid)
    $186 Avg Bid
    32 bids

    This project involves conducting a dark web websites crawl with the primary objective of gathering dynamic intelligence and monitoring online activity. Key Details: - ACHE Crawler needs to be used to crawler dark web and collect available websites urls Required Skills and Experience: - You need to be proficient in Python programming and have previous experience in web crawling, especially on the dark web. - Familiarity with network security and understanding of dark web dynamics is highly preferred. - Familiarity with ACHE Crawler, Docker and Scrapy is needed. On completion, a detailed report of the findings, as well as the script code used, will be expected.

    $197 (Avg Bid)
    $197 Avg Bid
    30 bids

    ...to collect data in an automatic fashion from various web pages. Hence, the successful candidate for this project will have a wealth of experience working with web scraping, data collection, and task automation. Familiarity with top web scraping tools and strategies will be a must. Following are the primary tasks for this project: - Establishing a system for collecting real-time data from web pages - Implementing this system so that data input tasks can be automated - Ensuring that the system runs smoothly and efficiently, with minimal errors Proficiency in programming languages commonly used for web scraping such as Python or Java, strong knowledge of web scraping frameworks such as Scrapy or Beautiful Soup, and understanding of w...

    $185 (Avg Bid)
    $185 Avg Bid
    67 bids

    I'm looking for a skilled developer to assist with a Google Earth project, focusing on user interface design. Main Tasks: - Designing the user interface Features Required: I would like a Google Maps web based application. Where the users are able to click features on a map using terrene view(for example trees) JavaScript to pick up the location and address of the property that’s been selected, and the address to be saved into a database using perl CGI in my SQL database. The perl component is optional. Areas that have previously been selected should be highlighted in a yellow highlight or similar The code should work on windows and a Unix platform. I will provide a Unix platform login

    $135 (Avg Bid)
    $135 Avg Bid
    28 bids

    ...BELOW TO GET A BETTER UNDERSTANDING OF WHAT IS NEEDED. THANK YOU] I am looking for a Data Engineer who can help automate the collection and processing of data, utilizing web scraping technology, APIs, and python libraries like beautiful soup for processing. For this project, the main tasks include: - Designing and implementing effective scraping systems to collect and process data - Integrating to our current system Skills and Experience Ideal candidates for this project should have: - Proven experience in data engineering, API, ETL, and scraping projects. - Proficiency in Python Libraries such as BeautifulSoup or Scrapy. - Demonstrable past work related to data science or data engineering Here are some additional details to help you understand the specific project...

    $21 / hr (Avg Bid)
    $21 / hr Avg Bid
    68 bids

    Hello, I'm seeking a professional with expertise in Perl who can integrate and manage the Gmail API for sending emails. Specifically, the tasks include: - Developing an application from scratch - Integrating the Gmail API to send emails - Activating basic email sending functionality with the Gmail API The ideal candidate would be proficient in Perl and have a solid understanding of APIs, particularly the Gmail API. Knowledge of email handling and management is desirable, but not necessary. This project requires the development of new software, so considerable experience in software development and project management will be beneficial. Please include details of your API integration experience in your bid.

    $23 (Avg Bid)
    $23 Avg Bid
    6 bids

    ...and maintaining web applications, ensuring optimal performance and scalability. Key Responsibilities: - Develop and maintain web applications using Django, Flask, and Python. - Integrate frontend technologies such as JavaScript and React JS to create seamless user experiences. - Utilize Axios/AJAX for promise-based HTTP requests and manage state in React applications. - Implement Docker for application containerization and streamline deployment processes. - Deploy applications on cloud platforms like Digital Ocean, ensuring high availability and scalability. - Manage databases using SQL, Postgres, and MongoDB, ensuring data integrity and efficiency. - Work with JSON for data interchange and leverage Pandas for data analysis and manipulation. - Conduct web scraping ...

    $337 (Avg Bid)
    $337 Avg Bid
    16 bids

    I’m searching for an Python expert with a solid foundation in Scrapy, Beautiful Soup, and Selenium packages. Apart from this, you should also have a strong understanding of Google Maps API , Telegram API, and WhatsApp API. Your main function would be to systematically scrape data from Google Maps as well as various eCommerce platforms. While the exact data to be scrapped and the main purposes of doing so haven't been defined yet, I believe someone with the correct skills set would easily navigate through the process once those details are clarified. Additionally, you might be provided with a list of specific websites or regions or be asked to scrape from any website or region, details of which are currently undefined. Hence, adaptability will be a key trait for succe...

    $34 (Avg Bid)
    $34 Avg Bid
    21 bids

    ...years of Perl + XML + SQL experience, please submit your bid with exact monthly payment requirement. The budget range specifies our monthly budget per developer for full time ( 8 hours per day) commitment, Monday to Friday. Monthly budget is 80K to 120K per month depending on the experience. This job is open to developers from INDIA only. Bangalore based candidates who can work in hybrid mode will be given priority. The ideal candidate should have a minimum of 3 years of experience in Perl development and scripting, with expertise in XML and SQL (Preferred) Below is the Job Description for an in-depth understanding of the requirements. JOB DESCRIPTION: 3 – 5 years of proven knowledge of programming languages and operation systems as outlined Programming lang...

    $1258 (Avg Bid)
    $1258 Avg Bid
    4 bids

    I need an expert in Google Dork searches to assist me in finding a long-lost perl file. The file was from 2001. File name is: Some text within the file is: File Name: Version: 3.0b, Date: Friday May 18th 2001 *Look at source for more info. If you find it put in your bid "FOUND IT!" Pay is $40.00

    $130 (Avg Bid)
    $130 Avg Bid
    11 bids