![]() I’ve tried adding waits but it doesn’t work. Sometimes my scraper clicks on other links rather than the button itself. Page_max=127 #I get this with another piece of code Wd = webdriver.Chrome(PATH, options=options)Įlement_present = EC.visibility_of_element_located((By.XPATH, gSlsBf"]/i'))īoton = WebDriverWait(wd,5).until(element_present) PATH = "C:Program Files (x86)chromedriver.exe" Hints: To find out if the button detected is the correct one, click 'Check' and watch it gets highlighted on the webpage. Check this option if you want Octoparse to click the 'Next' button to extract data from more pages. Options.add_argument('-disable-dev-shm-usage') Click the 'Next' button to capture multiple pages - Apparently, Octoparse has detected a 'Next' button on the page. I’ve tried doing this: from selenium import webdriverįrom webdriver_manager.chrome import ChromeDriverManagerįrom import expected_conditions as ECįrom import Byįrom import WebDriverWait However, I’m having trouble clicking on the next-page button to scrape all the pages. ![]()
0 Comments
Leave a Reply. |
AuthorWrite something about yourself. No need to be fancy, just an overview. ArchivesCategories |