Find Jobs
Hire Freelancers

Stock/finance: Python Selenium scraping and Curses output

$250-750 USD

Closed
Posted about 5 years ago

$250-750 USD

Paid on delivery
My technical skills have hit a wall. I need someone to finalize my Python-script. It's a script that scrapes 2 sources of stock data, saving to tinyDB and continuously printing to terminal with using Courses. Note: I'm open to refactoring and changing libraries/technologies and such if improvements/stability can be made. To-do: Output/Curses: - Print Curses directly on start - Print and updated all lines continuously using Curses for use in Terminal - Alert on price below base (Ticker name and base) ([login to view URL]) TradingView scraping: - Ongoing scraping, 5-min and 1-hour chart, as long as script runs (Min 2 updates per day) - Multithreaded base scraping for increased speed - Improve base scraping stability (Handle stale elements and 0, N/A bases) Price scraping: Multithreaded price scraping (Updated 2 times per minute) Key technologies used for now: Python Curses Selenium TinyDB
Project ID: 18890194

About the project

15 proposals
Remote project
Active 5 yrs ago

Looking to make some money?

Benefits of bidding on Freelancer

Set your budget and timeframe
Get paid for your work
Outline your proposal
It's free to sign up and bid on jobs
15 freelancers are bidding on average $491 USD for this job
User Avatar
Hello, Dear How are you? I have read your project description and am ready for discussing with you about project for now. I have experienced in developing Python, Selenium Webdriver, Software Architecture, Web Scraping. I will work very hard and best for you. Best Regards
$500 USD in 10 days
5.0 (79 reviews)
7.6
7.6
User Avatar
Hello sir I checked the requirement carefully and am suitable for this project. Because I am familiar with Curses, Python, Selenium and Tinydb and have experience in scraping from tradingview. Also I can make a multi-threading. I am ready to start the work. Best Regards, Yongtao
$555 USD in 10 days
4.9 (128 reviews)
7.6
7.6
User Avatar
Hello, I have gone through your job posting and become very much interested to work with you. I am an expert in this field. I have already completed several projects like this. For evidence you can see my profile. Please visit : https://www.freelancer.com/u/schoudhary1553 I have excellent command over English. I am a hard worker, productive and worthy of your attention I hope, I would be the right candidate for this post. Awaiting an affirmative response from you. Kinds Regards, Sandeep
$500 USD in 5 days
4.9 (88 reviews)
6.9
6.9
User Avatar
Hello I'm experienced Python developer and I have strong expertise in building web scrapers. I've checked you script and found several point that we have to discuss in order to create the scraper more effective. Let's discuss it in detail over the chat. Regards, Alex.
$550 USD in 10 days
5.0 (52 reviews)
6.2
6.2
User Avatar
Hi there, I took a glance at the code. It's really clear and looks good. However, it's not obvious how many symbols it's going to track which will directly effect the performance. The reason is that unfortunately selenium is not thread safe. For parallel operations and multithreading, you need to spawn several selenium instances and put each one into its own thread. But this way RAM and CPU usage will increase linearly as the number of symbols to track increase. To get the better of both worlds you need to create a queue system and spawn a certain number of instances which will constantly dequeue the symbols, update the price and/or tradingview where another component schedules the symbols to be processed again by putting back to queue. I did create a similar system in c# and it was definitely not fun so if you have a better alternative in mind we should go for that. Still, if the number of symbols to track is low, e.g 10 or something, and since you need 1 update every 30sec. for each symbol that means 1 update every 3sec. which can be handled with a single instance just fine. In this case, above is a total overkill since a single instance will do and please ignore my bid if so, thanks.
$700 USD in 7 days
5.0 (36 reviews)
6.0
6.0
User Avatar
‌Hi, I have gone through your requirement to scrape lots of websites. I am EXPERT in building scraping tools /scripts. Hence, I can SURELY work on your project. I am having 4 YEARS of EXPERIENCE in developing PHP-PYTHON (Scrapy, Selenium) based web scraper as well as WINDOWS BASED web scraping software through which I have crawled many sites such as Craigslist, Amazon, Yelp and many others. I have also worked on complex site to bypass CAPTCHA with the use of PROXY IP bouncing techniques.. Let's work together :) Have a great day! I am glad to see your WORK HISTORY and positive reviews of other freelancers. I am really excited to work with you and would love to have a long-term business association for any of your data related needs less ,,,,,,
$311 USD in 10 days
4.9 (100 reviews)
5.8
5.8
User Avatar
Dear, we are Team of French + US. I checked your project description, I can scrap your data. I will focus on user friendly interface. As you can see I have very good rate, you can be sure I am serious. Regards, Fabrice
$277 USD in 10 days
4.9 (19 reviews)
5.8
5.8
User Avatar
Hello! I am a python developer. I looked at your project and it seems interesting. I have all necessary skills required for this project. Ping me to discuss in detail.
$500 USD in 2 days
4.7 (41 reviews)
5.6
5.6
User Avatar
Hi, I'm not applying for the project, I simply wanted to have a talk with a fellow trader. I'm curious to hear about your work process and share some ideas and thoughts about strategies and tools. Hope to hear from you, Andy
$555 USD in 10 days
5.0 (6 reviews)
4.0
4.0
User Avatar
I believe I am the best candidate for this project as for my experience in selenium. However, instead of using technologies that are operating system limited, I would prefer to use ones that are not. Also, I have not yet done the research to see why you have chosen to use selenium + proxies + user-agents to scrape tradingview. I have an inkling, however, as I am sure you are aware, they do have an api, and I would be inclined to use this rather than selenium. If you would like me to scrape rather than use an api I would be happy to do so. Thank you for your time and consideration. Cody Quist
$750 USD in 15 days
5.0 (2 reviews)
2.8
2.8
User Avatar
Ms. Degree, Moscow Institute of Physics and Technology, Appl. Math. Ph.D U of A, Canada, Appl. Math. Tons of algo trading code already written, and not just strategies but systematic quantitative finance such as IS-OOS etc. Very interested in this challenge. Price is negitiable with the client providing valuable interaction and insight.
$400 USD in 5 days
5.0 (1 review)
1.1
1.1

About the client

Flag of SWEDEN
Sweden
0.0
0
Member since Apr 19, 2010

Client Verification

Thanks! We’ve emailed you a link to claim your free credit.
Something went wrong while sending your email. Please try again.
Registered Users Total Jobs Posted
Freelancer ® is a registered Trademark of Freelancer Technology Pty Limited (ACN 142 189 759)
Copyright © 2024 Freelancer Technology Pty Limited (ACN 142 189 759)
Loading preview
Permission granted for Geolocation.
Your login session has expired and you have been logged out. Please log in again.