Explore

While running the selenium script in grid. The download popup window is getting appeared. The same script is getting run in local computer. These are the pref for the chromedriver prefs.put("profile.default_content_settings.popups", 0); prefs.put("download.prompt_for_download", false); prefs.put("directory_upgrade", true); prefs.put("profile.default_content_setting_values.notifications", 2); prefs.put("download.default_directory", Config.getBrowserDownloadLocation()); I have checked the download settings in the grid laptop the Ask where to save each file before downloading was off in the that...

I'm trying to scrape this website: https://www.globusmedical.com/patient-education-musculoskeletal-system-conditions/resources/find-a-surgeon/ It appears that the website uses JavaScript so that when I load inspect the code, I don't see the table with the doctors listed. However, when you inspect the element specifically, it's there with all of the information. I'm trying to click the "Load More" button multiple times until it disappears and then parse through the page...

Please help me.I use WebDriverManager for configuration drivers. Configuration.browser = "edge"; WebDriverManager.edgedriver().setup(); but when run tests I have next error: Step failed org.openqa.selenium.SessionNotCreatedException: Could not start a new session. Response code 500. Message: session not created: This version of Microsoft Edge WebDriver only supports Microsoft Edge version 125 Current browser version is 123.0.2420.53 How I can fix this error?

I'm a total beginner to webscraping using Selenium. I am trying to open a specific google profile (since all the sites would be already signed in). I'm happy that the code is able to open the specific profile window (profile being default). However, it fails to open the site in the window and start scraping. Here's the code: from selenium import webdriver from selenium.webdriver.chrome.service...

Using Python Selenium, I am trying to interact with "https://www.screener.in/explore/" page with has a input textbox to search for a Company name. But the code throws an error "raise exception_class(message, screen, stacktrace) selenium.common.exceptions.ElementNotInteractableException: Message: element not interactable" Below is the code using Python import time from selenium import webdriver from selenium.webdriver.common.by import By driver = webdriver.Chrome() driver.maximize_window() driver.get("https://www.screener.in/explore/") button = driver.find_element(By.XPATH, "//input[@class='u-full-width']") button.send_keys("TCS") time.sleep(100)...

I am working on project where I want to pull raw data from zerodha to pandas. I am using selenium with python and facing issue while clicking toggle button which will show raw data. Please see the code below and let me know the fix for the same. Version details: Python 3.12.1 selenium 4.17.2 Zerodha Source code of toggle button: <cq-toggle class="ciq-DT tableview-ui" cq-member="tableView">...

Using Python/Selenium, I'm able to get several pages deep into a password protected website I use for work. However, I've hit a wall with a JavaScript array from which I need to open a drop-down and select the first option. Here is the location on the page: Copy JS Path: document.querySelector("#miFavorite") Copy XPATH: //*[@id="miFavorite"] And this is the JS: XPATH: //*[@id="Form1"]/script[3]/text() How can I...

from urllib.request import urlopen from urllib.error import HTTPError from bs4 import BeautifulSoup url = 'https://www.pythonscraping.com/pages/warandpeace.html' html = urlopen(url) bsObj2 = BeautifulSoup(html, "html.parser") bsObj3 = BeautifulSoup(html, "html.parser") print(bsObj3) This is my Python code. The result of bsObj2 is Okay. That result is my goal. But, Why I cant't see the result of print(bsObj3)? It's just Blank. from urllib.request import urlopen from urllib.error import HTTPError from...

So I have installed python3.8, selenium 4.16 and chromedriver on my web server with root ssh access. I can run chromedriver in terminal, looking good. When I try a simple python script it crashes with error: Traceback (most recent call last): File "/usr/local/lib/python3.8/dist-packages/selenium-4.16.0-py3.8.egg/selenium/webdriver/common/driver_finder.py", line 38, in get_path path = SeleniumManager().driver_location(options) if path is None else path File "/usr/local/lib/python3.8/dist-packages/selenium-4.16.0-py3.8.egg/selenium/webdriver/common/selenium_manager.py", line 84, in driver_location browser =...

I'm working on a small web scraping project that uses selenium wherein I scrape some product information from a clothes website: (https://www.asos.com/us/search/?q=shirt), I've been able to get most of the product information after quite some trial and error but I'm having a bit of issues with scraping the src images from the page source - which I believe is relatively similar in approach as...