Overview
Online system that automatically keeps track of expired domains, plus various information on each (eg. DA / PA, Alexa, etc.). Basically a clone of [login to view URL], but with a more polished and professional look / feel.
Project Details
• Import all existing domains and zone files that you've obtained.
• Every 24 hours, scrape various sites for newly expired domains and/or domains coming up for expiration. These sites include:
o [login to view URL]
o [login to view URL]
o [login to view URL]
o [login to view URL]
o [login to view URL]
o DynaDot
o Sedo
o Private URL
• Full account registration, including password protected member's area, from where registered members can browse / search all expired domains, and domains coming up for expiration.
• The following basic details need to be gathered for each domain. Users would be able to browse, search, and export domain details based on the following metrics:
o Date Registered
o Date Expired / Expiring
o Available or not?
o Page Rank
o Fake PR Check (via info:// via proxies)
o Google Index (yes/no and # of pages indexed)
o Index Count
o DMOZ Listing
o Yahoo Directory Listing
o Wikipedia Listing
o # of characters in length
o BOTW
o Domain Age (need free check source that can be scraped initially..[login to view URL] ??)
o Web Archive (display # of entries-not sure how many domains can be checked month..possible scrape job)
o Date site was last checked
o Registrar Listing (godaddy,dynadot, etc.)
o Auction (public, buy, prerelease, etc. all categories)
o Date Auction updated
o Bid Price
o Buy Now Price
o Auction Expire Date
o # of Bidders
o Alexa Rank
o Google mentions (Google Search TLD in registercompass backend)- displays # of good listings for domain in search engine
o
• Statistics -- On top of the metrics listed above, must scrape the following statistics for each domain. Due to API limitations and other things, must have full support for proxies, multiple API keys, and throttling limits (eg. X domains per API key/hour / day / week / month).
o Moz Stats -- DA, PA, # of backlinks, # of linking root domains, and Moz Trust score.
o SEM Rush Stats -- Rank, traffic, monthly search volume of domain keywords, semrush traffic price
o Majestic Stats -- Citation Flow, Trust Flow, # of backlinks, # of linking domains, # of referring IPs, # of pages indexed by Google.
o Spyfu Stats -- Exact local monthly search volume, cost per-click, SEO difficulty, value per-month.
o Grab top 3 anchor text keywords for domains, checking for botw dir link? niche based on kw in domain? checking links for PR? maybe for upgrade?
• Domains that are within the grace period provided by registrars, the software must check them every day for availability to register.
I will also need a front end system, so your ability to either design a front end would be nice or ability to work with others.
Hi.. Expert web scraper/Data Minor here. Interested in your project. I assure you 100% accurate and good quality work. Ready to start. have a look at PM. Regards
Dear Sir,
Greetings!
We are WeExcel Technologies Pvt. Ltd with 10 years of experience under our belt. We are really interested to work on your project.
Please see PM.
Thank you.
Regards,
WeExcel.
Hello mia79, I have read your requirements and I am very confident to do this project. I guarantee COMPLETE satisfaction before payment. Please check PM for more details!
This is one the complex and interesting project to work on and it will be taking few months to complete it perfectly as per the list of requirements mentioned by you