Quick Web Scraping of page with AJAX requests

I want to scrape [login to view URL] using the following parameters: - Platform: I'm using Ubuntu 14.04. I started this project using Python 3. If there's a good reason to use Python 2, I suppose that would be acceptable. - Target site to scrape: [login to view URL] - Change the user agent to a common browser, and, if possible, the accept-language to US English - Select the following office locations: Atlanta, Boston, Chicago, Cleveland, Columbus, Dallas, Detroit, Houston, Irvine, Los Angeles, Miami, Minneapolis, New York, Pittsburgh, San Diego, San Francisco, Silicon Valley, Washington - Click the "Submit" button - New page loads, showing 10 of 1658 results (takes about 8-10 seconds to load AJAX content). - Click the "View All" button. This AJAX request takes a long time (~160 seconds) to complete, so we'll need some type of wait with expected conditions. - The results are contained in <table id='tabdata_Professionals' ...> so I would use the following two lines (but I'm not saying you have to use them): bsObj=BeautifulSoup(driver.page_source, 'lxml') # full html content of page attyResults = [login to view URL]('table', {'id':'tabdata_Professionals'}) # just the attys I can take it from there, but I'm scraping hundreds of sites, so I'm sure that I'll have additional work as questions come up.