{"id":11496,"date":"2024-08-28T11:07:14","date_gmt":"2024-08-28T11:07:14","guid":{"rendered":"https:\/\/scrapingdog.com\/?p=11496"},"modified":"2025-08-25T09:25:16","modified_gmt":"2025-08-25T09:25:16","slug":"web-scraping-myntra","status":"publish","type":"post","link":"https:\/\/www.scrapingdog.com\/blog\/web-scraping-myntra\/","title":{"rendered":"Web Scraping Myntra with Selenium and Python"},"content":{"rendered":"\t\t<div data-elementor-type=\"wp-post\" data-elementor-id=\"11496\" class=\"elementor elementor-11496\" data-elementor-post-type=\"post\">\n\t\t\t\t<div class=\"elementor-element elementor-element-4e9cce9 e-flex e-con-boxed e-con e-parent\" data-id=\"4e9cce9\" data-element_type=\"container\">\n\t\t\t\t\t<div class=\"e-con-inner\">\n\t\t\t\t<div class=\"elementor-element elementor-element-0998dc5 elementor-widget elementor-widget-html\" data-id=\"0998dc5\" data-element_type=\"widget\" data-widget_type=\"html.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t<!-- Gutenberg \u201cCustom HTML\u201d block -->\r\n<div style=\"\r\n  background:#d9f4e5;\r\n  border-left:4px solid #1d9b6c;\r\n  padding:18px 24px;\r\n  margin:24px 0;\r\n  border-radius:6px;\r\n  font-family:'Montserrat',sans-serif;\r\n  font-size:18px;\r\n  line-height:1.65;\r\n  color:#1a1a1a;\">\r\n  <p style=\"margin:0 0 8px 0; font-weight:600;\">TL;DR<\/p>\r\n\r\n  <ul style=\"margin:0; padding-left:20px;\">\r\n    <li>Scrape <strong>Myntra<\/strong> with <strong>Python<\/strong>: render JS via <code>Selenium<\/code>, then parse with <code>BeautifulSoup<\/code>.<\/li>\r\n    <li><strong>Setup:<\/strong> install <code>Selenium<\/code>\/<code>bs4<\/code>, use the matching <code>ChromeDriver<\/code>, open a product page, read <code>page_source<\/code>.<\/li>\r\n    <li><strong>Extract:<\/strong> product title, price, and rating; print a small list \/ dict result.<\/li>\r\n    <li>Handy starter pattern for JS-heavy sites.<\/li>\r\n  <\/ul>\r\n<\/div>\r\n\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<div class=\"elementor-element elementor-element-c397b20 font-color-green elementor-widget elementor-widget-text-editor\" data-id=\"c397b20\" data-element_type=\"widget\" data-widget_type=\"text-editor.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t\t\t\t\t<p id=\"0784\">Today many websites cannot be scraped with a normal XHR request because they render data through Javascript execution.<\/p><p>Traditional web scraping libraries like\u00a0<code>requests<\/code>\u00a0and\u00a0<code>Scrapy<\/code>\u00a0are excellent for extracting data from websites where the content is directly embedded in the HTML of the page.<\/p><p>However, a growing number of modern websites use JavaScript to dynamically load and render content.<\/p><p>So, when you make a simple HTTP request (like an XHR request) using <code>requests<\/code>\u00a0or similar libraries, you get the initial HTML, but it might lack the dynamically loaded content.<\/p><p id=\"2042\">Headless browsers or browser automation tools can help. These tools simulate a browser environment and can execute JavaScript on a page.<\/p><p>In this tutorial, we will learn how to scrape dynamic websites using Selenium and Python. For this tutorial, we are going to scrape\u00a0<strong>myntra.com<\/strong>.<\/p>\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t<div class=\"elementor-element elementor-element-7d0a355 e-flex e-con-boxed e-con e-parent\" data-id=\"7d0a355\" data-element_type=\"container\">\n\t\t\t\t\t<div class=\"e-con-inner\">\n\t\t\t\t<div class=\"elementor-element elementor-element-6c14f3f elementor-widget elementor-widget-heading\" data-id=\"6c14f3f\" data-element_type=\"widget\" data-widget_type=\"heading.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t<h2 class=\"elementor-heading-title elementor-size-default\">Requirements<\/h2>\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<div class=\"elementor-element elementor-element-ae156ae font-color-green elementor-widget elementor-widget-text-editor\" data-id=\"ae156ae\" data-element_type=\"widget\" data-widget_type=\"text-editor.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t\t\t\t\t<p>I am assuming that you already have\u00a0<code class=\"cx me mf mg mh b\">Python 3.x <\/code>installed on your machine. If not then you can install it from <a href=\"https:\/\/www.python.org\/downloads\/\" rel=\"nofollow noopener\" target=\"_blank\">here.<\/a> Let\u2019s start with creating a folder in which we are going to keep our Python script.<\/p>\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<div class=\"elementor-element elementor-element-7805148 elementor-widget elementor-widget-code-highlight\" data-id=\"7805148\" data-element_type=\"widget\" data-widget_type=\"code-highlight.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t\t\t<div class=\"prismjs-default copy-to-clipboard \">\n\t\t\t<pre data-line=\"\" class=\"highlight-height language-python \">\n\t\t\t\t<code readonly=\"true\" class=\"language-python\">\n\t\t\t\t\t<xmp>mkdir seleniumtut<\/xmp>\n\t\t\t\t<\/code>\n\t\t\t<\/pre>\n\t\t<\/div>\n\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<div class=\"elementor-element elementor-element-edb8992 font-color-green elementor-widget elementor-widget-text-editor\" data-id=\"edb8992\" data-element_type=\"widget\" data-widget_type=\"text-editor.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t\t\t\t\t<p>Then after creating the folder, we have to install two libraries that will be needed in the course of this tutorial.<\/p><ul><li><a href=\"https:\/\/pypi.org\/project\/selenium\/\" rel=\"nofollow noopener\" target=\"_blank\"><strong><em>Selenium<\/em><\/strong><\/a>\u2013 It is used to automate web browser interaction from Python.<\/li><li><a href=\"https:\/\/www.crummy.com\/software\/BeautifulSoup\/bs4\/doc\/\" rel=\"nofollow noopener\" target=\"_blank\"><strong><em>Beautiful Soup<\/em><\/strong><\/a><strong>\u00a0<\/strong>is a Python library for parsing data from the raw HTML downloaded using Selenium.<\/li><li><strong><em>Chromium<\/em><\/strong>\u2013 It is a web browser that will be controlled through selenium. You can download it from\u00a0<a href=\"https:\/\/edgedl.me.gvt1.com\/edgedl\/chrome\/chrome-for-testing\/119.0.5997.0\/win64\/chrome-win64.zip\" target=\"_blank\" rel=\"noreferrer noopener nofollow\">here<\/a>.<\/li><\/ul>\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<div class=\"elementor-element elementor-element-d759f35 elementor-widget elementor-widget-code-highlight\" data-id=\"d759f35\" data-element_type=\"widget\" data-widget_type=\"code-highlight.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t\t\t<div class=\"prismjs-default copy-to-clipboard \">\n\t\t\t<pre data-line=\"\" class=\"highlight-height language-python \">\n\t\t\t\t<code readonly=\"true\" class=\"language-python\">\n\t\t\t\t\t<xmp>pip install bs4\r\npip install selenium<\/xmp>\n\t\t\t\t<\/code>\n\t\t\t<\/pre>\n\t\t<\/div>\n\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<div class=\"elementor-element elementor-element-9833197 font-color-green elementor-widget elementor-widget-text-editor\" data-id=\"9833197\" data-element_type=\"widget\" data-widget_type=\"text-editor.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t\t\t\t\t<p id=\"91fa\">Remember that you will need the exact version of the Chromium driver as your Chrome browser. Otherwise, it will not run and throw an error.<\/p><p id=\"5221\">Now, create a Python file where we can write our code. I am naming the file as\u00a0<code>tutorial.py<\/code>.<\/p>\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t<div class=\"elementor-element elementor-element-55acaac e-flex e-con-boxed e-con e-parent\" data-id=\"55acaac\" data-element_type=\"container\">\n\t\t\t\t\t<div class=\"e-con-inner\">\n\t\t\t\t<div class=\"elementor-element elementor-element-dbf78b1 elementor-widget elementor-widget-heading\" data-id=\"dbf78b1\" data-element_type=\"widget\" data-widget_type=\"heading.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t<h3 class=\"elementor-heading-title elementor-size-default\">What are we going to scrape?\n<\/h3>\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t<div class=\"elementor-element elementor-element-afa09ee e-flex e-con-boxed e-con e-parent\" data-id=\"afa09ee\" data-element_type=\"container\">\n\t\t\t\t\t<div class=\"e-con-inner\">\n\t\t\t\t<div class=\"elementor-element elementor-element-1668999 font-color-green elementor-widget elementor-widget-text-editor\" data-id=\"1668999\" data-element_type=\"widget\" data-widget_type=\"text-editor.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t\t\t\t\t<p>For this tutorial, we are going to <a href=\"https:\/\/www.myntra.com\/trousers\/the+indian+garage+co\/the-indian-garage-co-men-black-slim-fit-solid-joggers\/9922235\/buy\" rel=\"nofollow noopener\" target=\"_blank\">scrape this page<\/a>.<\/p>\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<div class=\"elementor-element elementor-element-5f26485 elementor-widget elementor-widget-image\" data-id=\"5f26485\" data-element_type=\"widget\" data-widget_type=\"image.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t<img fetchpriority=\"high\" decoding=\"async\" width=\"768\" height=\"288\" src=\"https:\/\/www.scrapingdog.com\/wp-content\/uploads\/2024\/08\/image-1-768x288-1.jpg\" class=\"attachment-full size-full wp-image-11995\" alt=\"\" srcset=\"https:\/\/www.scrapingdog.com\/wp-content\/uploads\/2024\/08\/image-1-768x288-1.jpg 768w, https:\/\/www.scrapingdog.com\/wp-content\/uploads\/2024\/08\/image-1-768x288-1-300x113.jpg 300w\" sizes=\"(max-width: 768px) 100vw, 768px\" \/>\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<div class=\"elementor-element elementor-element-e70d276 font-color-green elementor-widget elementor-widget-text-editor\" data-id=\"e70d276\" data-element_type=\"widget\" data-widget_type=\"text-editor.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t\t\t\t\t<p>We are going to scrape three data points from this page.<\/p><ul><li style=\"list-style-type: none;\"><ul><li><em>Name of the product<\/em><\/li><li><em>Price of the product<\/em><\/li><li><em>Rating of the product<\/em><\/li><\/ul><\/li><\/ul><p>First, we will download the raw HTML from this page using selenium, <a href=\"https:\/\/tiiny.host\/test-html\/\" target=\"_blank\" rel=\"noopener\">test HTML code<\/a> and then using BS4 we are going to parse the required data.<\/p>\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t<div class=\"elementor-element elementor-element-4353299 e-flex e-con-boxed e-con e-parent\" data-id=\"4353299\" data-element_type=\"container\">\n\t\t\t\t\t<div class=\"e-con-inner\">\n\t\t\t\t<div class=\"elementor-element elementor-element-a0a0ee8 elementor-widget elementor-widget-heading\" data-id=\"a0a0ee8\" data-element_type=\"widget\" data-widget_type=\"heading.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t<h3 class=\"elementor-heading-title elementor-size-default\">Downloading the data with Selenium\n<\/h3>\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t<div class=\"elementor-element elementor-element-4a89869 e-flex e-con-boxed e-con e-parent\" data-id=\"4a89869\" data-element_type=\"container\">\n\t\t\t\t\t<div class=\"e-con-inner\">\n\t\t\t\t<div class=\"elementor-element elementor-element-11d90d3 font-color-green elementor-widget elementor-widget-text-editor\" data-id=\"11d90d3\" data-element_type=\"widget\" data-widget_type=\"text-editor.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t\t\t\t\t<p>First step would be import all the required libries inside our file\u00a0<code>tutorial.py<\/code><\/p>\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<div class=\"elementor-element elementor-element-df9138e elementor-widget elementor-widget-code-highlight\" data-id=\"df9138e\" data-element_type=\"widget\" data-widget_type=\"code-highlight.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t\t\t<div class=\"prismjs-default copy-to-clipboard \">\n\t\t\t<pre data-line=\"\" class=\"highlight-height language-python \">\n\t\t\t\t<code readonly=\"true\" class=\"language-python\">\n\t\t\t\t\t<xmp>from bs4 import BeautifulSoup\r\nfrom selenium import webdriver\r\nfrom selenium.webdriver.chrome.service import Service<\/xmp>\n\t\t\t\t<\/code>\n\t\t\t<\/pre>\n\t\t<\/div>\n\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<div class=\"elementor-element elementor-element-5593d1f font-color-green elementor-widget elementor-widget-text-editor\" data-id=\"5593d1f\" data-element_type=\"widget\" data-widget_type=\"text-editor.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t\t\t\t\t<p>Here we first imported the\u00a0<code>BeautifuSoup<\/code>,\u00a0<code>webddriver<\/code>\u00a0module from selenium and the\u00a0<code>Service<\/code>\u00a0class from selenium<\/p>\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<div class=\"elementor-element elementor-element-7435126 elementor-widget elementor-widget-code-highlight\" data-id=\"7435126\" data-element_type=\"widget\" data-widget_type=\"code-highlight.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t\t\t<div class=\"prismjs-default copy-to-clipboard \">\n\t\t\t<pre data-line=\"\" class=\"highlight-height language-python \">\n\t\t\t\t<code readonly=\"true\" class=\"language-python\">\n\t\t\t\t\t<xmp>PATH = 'C:\\Program Files (x86)\\chromedriver.exe'<\/xmp>\n\t\t\t\t<\/code>\n\t\t\t<\/pre>\n\t\t<\/div>\n\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<div class=\"elementor-element elementor-element-1cb5cee font-color-green elementor-widget elementor-widget-text-editor\" data-id=\"1cb5cee\" data-element_type=\"widget\" data-widget_type=\"text-editor.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t\t\t\t\tHere I have declared the path where I have installed my chromium driver. Your location might be different.\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<div class=\"elementor-element elementor-element-dabdf85 elementor-widget elementor-widget-code-highlight\" data-id=\"dabdf85\" data-element_type=\"widget\" data-widget_type=\"code-highlight.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t\t\t<div class=\"prismjs-default copy-to-clipboard \">\n\t\t\t<pre data-line=\"\" class=\"highlight-height language-python \">\n\t\t\t\t<code readonly=\"true\" class=\"language-python\">\n\t\t\t\t\t<xmp>service = Service(executable_path=PATH)\r\noptions = webdriver.ChromeOptions()\r\ndriver = webdriver.Chrome(service=service, options=options)<\/xmp>\n\t\t\t\t<\/code>\n\t\t\t<\/pre>\n\t\t<\/div>\n\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<div class=\"elementor-element elementor-element-64b0740 font-color-green elementor-widget elementor-widget-text-editor\" data-id=\"64b0740\" data-element_type=\"widget\" data-widget_type=\"text-editor.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t\t\t\t\t<p id=\"95f1\">The\u00a0<code>executable_path<\/code>\u00a0parameter is used to provide the path to the ChromeDriver executable on your system. This is necessary for Selenium to locate and use the ChromeDriver executable.<\/p><p id=\"4b99\"><code>webdriver.ChromeOptions<\/code>\u00a0is a class in Selenium that provides a way to customize and configure the behavior of the Chrome browser.<\/p><p id=\"ffdc\"><code>webdriver.Chrome<\/code>\u00a0is a class in Selenium that represents the Chrome browser. The\u00a0<code>service<\/code>\u00a0parameter is used to specify the ChromeDriver service, which includes the path to the ChromeDriver executable.<\/p><p>The\u00a0<code>options<\/code>\u00a0parameter allows you to provide the\u00a0<code>ChromeOptions<\/code>\u00a0instance created earlier, customizing the behavior of the Chrome browser according to your needs.<\/p>\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<div class=\"elementor-element elementor-element-0f6c61d elementor-widget elementor-widget-code-highlight\" data-id=\"0f6c61d\" data-element_type=\"widget\" data-widget_type=\"code-highlight.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t\t\t<div class=\"prismjs-default copy-to-clipboard \">\n\t\t\t<pre data-line=\"\" class=\"highlight-height language-python \">\n\t\t\t\t<code readonly=\"true\" class=\"language-python\">\n\t\t\t\t\t<xmp>driver.get(\"https:\/\/www.myntra.com\/trousers\/the+indian+garage+co\/the-indian-garage-co-men-black-slim-fit-solid-joggers\/9922235\/buy\")\r\n\r\nhtml_content = driver.page_source\r\nprint(html_content)\r\n\r\n\r\n# Close the browser\r\ndriver.quit()<\/xmp>\n\t\t\t\t<\/code>\n\t\t\t<\/pre>\n\t\t<\/div>\n\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<div class=\"elementor-element elementor-element-d9744bf font-color-green elementor-widget elementor-widget-text-editor\" data-id=\"d9744bf\" data-element_type=\"widget\" data-widget_type=\"text-editor.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t\t\t\t\t<p id=\"f0c8\">The\u00a0<code>get<\/code>\u00a0method is used to navigate the browser to a specific URL, in this case, the URL of a Myntra product page for trousers.<\/p><p id=\"4c9a\"><code>driver.page_source<\/code>\u00a0is a property of the WebDriver that returns the HTML source code of the current page. After this step we are printing the result on the console.<\/p><p id=\"d97a\"><code>driver.quit()<\/code>\u00a0closes the browser, ending the WebDriver session.<\/p><p id=\"6014\">Once you run this code you will get this on your console.<\/p>\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<div class=\"elementor-element elementor-element-ac42811 elementor-widget elementor-widget-image\" data-id=\"ac42811\" data-element_type=\"widget\" data-widget_type=\"image.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t<img decoding=\"async\" width=\"768\" height=\"282\" src=\"https:\/\/www.scrapingdog.com\/wp-content\/uploads\/2024\/08\/image-2-768x282-1.jpg\" class=\"attachment-full size-full wp-image-12031\" alt=\"\" srcset=\"https:\/\/www.scrapingdog.com\/wp-content\/uploads\/2024\/08\/image-2-768x282-1.jpg 768w, https:\/\/www.scrapingdog.com\/wp-content\/uploads\/2024\/08\/image-2-768x282-1-300x110.jpg 300w\" sizes=\"(max-width: 768px) 100vw, 768px\" \/>\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<div class=\"elementor-element elementor-element-184b923 font-color-green elementor-widget elementor-widget-text-editor\" data-id=\"184b923\" data-element_type=\"widget\" data-widget_type=\"text-editor.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t\t\t\t\tThis means that we have successfully managed to download the raw HTML from the target website. Now, we can use BS4 for parsing the data.\n\nTo understand more you should refer to <a href=\"https:\/\/www.scrapingdog.com\/blog\/scraping-with-python-selenium\/\">this guide on scraping with Python &amp; Selenium.<\/a>\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t<div class=\"elementor-element elementor-element-5e91d70 e-flex e-con-boxed e-con e-parent\" data-id=\"5e91d70\" data-element_type=\"container\">\n\t\t\t\t\t<div class=\"e-con-inner\">\n\t\t\t\t<div class=\"elementor-element elementor-element-ccfe519 elementor-widget elementor-widget-heading\" data-id=\"ccfe519\" data-element_type=\"widget\" data-widget_type=\"heading.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t<h3 class=\"elementor-heading-title elementor-size-default\">Parsing the data with BS4<\/h3>\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<div class=\"elementor-element elementor-element-00d321f font-color-green elementor-widget elementor-widget-text-editor\" data-id=\"00d321f\" data-element_type=\"widget\" data-widget_type=\"text-editor.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t\t\t\t\t<p>Since we have already decided what we are going to extract from this raw data let\u2019s find out the DOM location of each of these data points.<\/p>\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<div class=\"elementor-element elementor-element-b2b95ec elementor-widget elementor-widget-image\" data-id=\"b2b95ec\" data-element_type=\"widget\" data-widget_type=\"image.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t<img decoding=\"async\" width=\"768\" height=\"170\" src=\"https:\/\/www.scrapingdog.com\/wp-content\/uploads\/2024\/08\/image-3-768x170-1.jpg\" class=\"attachment-full size-full wp-image-12048\" alt=\"\" srcset=\"https:\/\/www.scrapingdog.com\/wp-content\/uploads\/2024\/08\/image-3-768x170-1.jpg 768w, https:\/\/www.scrapingdog.com\/wp-content\/uploads\/2024\/08\/image-3-768x170-1-300x66.jpg 300w\" sizes=\"(max-width: 768px) 100vw, 768px\" \/>\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<div class=\"elementor-element elementor-element-07212f7 font-color-green elementor-widget elementor-widget-text-editor\" data-id=\"07212f7\" data-element_type=\"widget\" data-widget_type=\"text-editor.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t\t\t\t\t<p>The title of the product is located inside the\u00a0<code>h1<\/code>\u00a0tag with class\u00a0<code>pdp-title<\/code>.<\/p>\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<div class=\"elementor-element elementor-element-f72032f elementor-widget elementor-widget-image\" data-id=\"f72032f\" data-element_type=\"widget\" data-widget_type=\"image.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t<img loading=\"lazy\" decoding=\"async\" width=\"1003\" height=\"334\" src=\"https:\/\/www.scrapingdog.com\/wp-content\/uploads\/2024\/08\/1_E95jdy0YVrNYHfFFv8a7ag.webp\" class=\"attachment-full size-full wp-image-18786\" alt=\"\" srcset=\"https:\/\/www.scrapingdog.com\/wp-content\/uploads\/2024\/08\/1_E95jdy0YVrNYHfFFv8a7ag.webp 1003w, https:\/\/www.scrapingdog.com\/wp-content\/uploads\/2024\/08\/1_E95jdy0YVrNYHfFFv8a7ag-300x100.webp 300w, https:\/\/www.scrapingdog.com\/wp-content\/uploads\/2024\/08\/1_E95jdy0YVrNYHfFFv8a7ag-768x256.webp 768w\" sizes=\"(max-width: 1003px) 100vw, 1003px\" \/>\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<div class=\"elementor-element elementor-element-7993fdb font-color-green elementor-widget elementor-widget-text-editor\" data-id=\"7993fdb\" data-element_type=\"widget\" data-widget_type=\"text-editor.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t\t\t\t\t<p>The rating is located inside the first\u00a0<code class=\"cx me mf mg mh b\">div<\/code>\u00a0tag of the parent\u00a0<code class=\"cx me mf mg mh b\">div<\/code>\u00a0with the class\u00a0<code class=\"cx me mf mg mh b\">index-overallRating<\/code>.<\/p>\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<div class=\"elementor-element elementor-element-dc856b2 elementor-widget elementor-widget-image\" data-id=\"dc856b2\" data-element_type=\"widget\" data-widget_type=\"image.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t<img loading=\"lazy\" decoding=\"async\" width=\"1016\" height=\"334\" src=\"https:\/\/www.scrapingdog.com\/wp-content\/uploads\/2024\/08\/1_YCIVqtrk5KZ__Ql4WEgrtg.webp\" class=\"attachment-full size-full wp-image-18787\" alt=\"\" srcset=\"https:\/\/www.scrapingdog.com\/wp-content\/uploads\/2024\/08\/1_YCIVqtrk5KZ__Ql4WEgrtg.webp 1016w, https:\/\/www.scrapingdog.com\/wp-content\/uploads\/2024\/08\/1_YCIVqtrk5KZ__Ql4WEgrtg-300x99.webp 300w, https:\/\/www.scrapingdog.com\/wp-content\/uploads\/2024\/08\/1_YCIVqtrk5KZ__Ql4WEgrtg-768x252.webp 768w\" sizes=\"(max-width: 1016px) 100vw, 1016px\" \/>\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<div class=\"elementor-element elementor-element-d476286 font-color-green elementor-widget elementor-widget-text-editor\" data-id=\"d476286\" data-element_type=\"widget\" data-widget_type=\"text-editor.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t\t\t\t\t<p id=\"8f4f\" class=\"pw-post-body-paragraph lg lh fq li b lj lk ll lm ln lo lp lq lr ls lt lu lv lw lx ly lz ma mb mc md fj bk\" data-selectable-paragraph=\"\">Similarly, you can see that the pricing text is located inside the\u00a0<code class=\"cx me mf mg mh b\">span<\/code>\u00a0tag with class\u00a0<code class=\"cx me mf mg mh b\">pdp-price<\/code>.<\/p><p id=\"d4ca\" class=\"pw-post-body-paragraph lg lh fq li b lj lk ll lm ln lo lp lq lr ls lt lu lv lw lx ly lz ma mb mc md fj bk\" data-selectable-paragraph=\"\">We can now implement this into our code using BS4.<\/p>\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<div class=\"elementor-element elementor-element-7328367 elementor-widget elementor-widget-code-highlight\" data-id=\"7328367\" data-element_type=\"widget\" data-widget_type=\"code-highlight.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t\t\t<div class=\"prismjs-default copy-to-clipboard \">\n\t\t\t<pre data-line=\"\" class=\"highlight-height language-javascript line-numbers\">\n\t\t\t\t<code readonly=\"true\" class=\"language-javascript\">\n\t\t\t\t\t<xmp>from bs4 import BeautifulSoup\r\nfrom selenium import webdriver\r\nfrom selenium.webdriver.chrome.service import Service\r\nimport time\r\n\r\nl=[]\r\no={}\r\n\r\nPATH = 'C:\\Program Files (x86)\\chromedriver.exe'\r\n\r\n# Set up the Selenium WebDriver\r\nservice = Service(executable_path=PATH)\r\noptions = webdriver.ChromeOptions()\r\n# options.add_argument(\"--headless\")\r\ndriver = webdriver.Chrome(service=service, options=options)\r\n\r\n# Navigate to the home page\r\ndriver.get(\"https:\/\/www.myntra.com\/trousers\/the+indian+garage+co\/the-indian-garage-co-men-black-slim-fit-solid-joggers\/9922235\/buy\")\r\n\r\nhtml_content = driver.page_source\r\n\r\nsoup=BeautifulSoup(html_content,'html.parser')\r\n\r\n\r\ntry:\r\n    o[\"title\"]=soup.find('h1',{'class':'pdp-title'}).text.lstrip().rstrip()\r\nexcept:\r\n    o[\"title\"]=None\r\n\r\ntry:\r\n    o[\"rating\"]=soup.find('div',{'class':'index-overallRating'}).find('div').text.lstrip().rstrip()\r\nexcept:\r\n    o[\"rating\"]=None\r\n\r\ntry:\r\n    o[\"price\"]=soup.find('span',{'class':'pdp-price'}).text.lstrip().rstrip()\r\nexcept:\r\n    o[\"price\"]=None\r\n\r\n\r\nl.append(o)\r\n\r\n\r\nprint(l)\r\n\r\n\r\n# Close the browser\r\ndriver.quit()<\/xmp>\n\t\t\t\t<\/code>\n\t\t\t<\/pre>\n\t\t<\/div>\n\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t<div class=\"elementor-element elementor-element-0c86936 e-con-full e-flex e-con e-child\" data-id=\"0c86936\" data-element_type=\"container\" data-settings=\"{&quot;background_background&quot;:&quot;classic&quot;}\">\n\t\t\t\t<div class=\"elementor-element elementor-element-22f1719 font-color-green elementor-widget elementor-widget-text-editor\" data-id=\"22f1719\" data-element_type=\"widget\" data-widget_type=\"text-editor.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t\t\t\t\t<code>soup = BeautifulSoup(html_content, \u2018html.parser\u2019)<\/code>\u00a0initializes a BeautifulSoup object (<code>soup<\/code>) by parsing the HTML content (<code>html_content<\/code>) using the HTML parser.\n<ul class=\"wp-block-list\">\n \t<li><code>o[\u201ctitle\u201d] = soup.find(\u2018h1\u2019, {\u2018class\u2019: \u2018pdp-title\u2019}).text.lstrip().rstrip()<\/code>\u00a0finds an\u00a0<code>&lt;h1&gt;<\/code>\u00a0element with the class \u2018pdp-title\u2019 and extracts its text content after stripping leading and trailing whitespace. If not found, sets \u2018title\u2019 to\u00a0<code>None<\/code>.<\/li>\n \t<li><code>o[\u201crating\u201d] = soup.find(\u2018div\u2019, {\u2018class\u2019: \u2018index-overallRating\u2019}).find(\u2018div\u2019).text.lstrip().rstrip()<\/code>\u00a0finds a\u00a0<code>&lt;div&gt;<\/code>\u00a0element with the class \u2018index-overallRating\u2019, then finds another\u00a0<code>&lt;div&gt;<\/code>\u00a0inside it and extracts its text content. If not found, sets \u2018rating\u2019 to\u00a0<code>None<\/code>.<\/li>\n \t<li><code>o[\u201cprice\u201d] = soup.find(\u2018span\u2019, {\u2018class\u2019: \u2018pdp-price\u2019}).text.lstrip().rstrip()<\/code>\u00a0finds a\u00a0<code>&lt;span&gt;<\/code>\u00a0element with the class \u2018pdp-price\u2019 and extracts its text content after stripping leading and trailing whitespace. If not found, sets \u2018price\u2019 to\u00a0<code>None<\/code>.<\/li>\n<\/ul>\n<p id=\"81d9\">At the end, we pushed the complete object\u00a0<code>o<\/code>\u00a0to the list\u00a0<code>l<\/code>\u00a0using\u00a0<code>.append()<\/code>\u00a0method.<\/p>\n<p id=\"4e41\">Once you run the code you will get this output.<\/p>\n<p id=\"81d9\">At the end, we pushed the complete object\u00a0<code>o<\/code>\u00a0to the list\u00a0<code>l<\/code>\u00a0using\u00a0<code>.append()<\/code>\u00a0method.<\/p>\n<p id=\"4e41\">Once you run the code you will get this output.<\/p>\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<div class=\"elementor-element elementor-element-a86e526 elementor-widget elementor-widget-code-highlight\" data-id=\"a86e526\" data-element_type=\"widget\" data-widget_type=\"code-highlight.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t\t\t<div class=\"prismjs-default copy-to-clipboard \">\n\t\t\t<pre data-line=\"\" class=\"highlight-height language-javascript line-numbers\">\n\t\t\t\t<code readonly=\"true\" class=\"language-javascript\">\n\t\t\t\t\t<xmp>[{'title': 'The Indian Garage Co', 'rating': '4', 'price': '\u20b9545'}]<\/xmp>\n\t\t\t\t<\/code>\n\t\t\t<\/pre>\n\t\t<\/div>\n\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t<div class=\"elementor-element elementor-element-263a423 e-flex e-con-boxed e-con e-parent\" data-id=\"263a423\" data-element_type=\"container\">\n\t\t\t\t\t<div class=\"e-con-inner\">\n\t\t\t\t<div class=\"elementor-element elementor-element-3ef7356 elementor-widget elementor-widget-heading\" data-id=\"3ef7356\" data-element_type=\"widget\" data-widget_type=\"heading.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t<h3 class=\"elementor-heading-title elementor-size-default\">Complete Code<\/h3>\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t<div class=\"elementor-element elementor-element-ae3b0c7 e-flex e-con-boxed e-con e-parent\" data-id=\"ae3b0c7\" data-element_type=\"container\">\n\t\t\t\t\t<div class=\"e-con-inner\">\n\t\t\t\t<div class=\"elementor-element elementor-element-4288a14 font-color-green elementor-widget elementor-widget-text-editor\" data-id=\"4288a14\" data-element_type=\"widget\" data-widget_type=\"text-editor.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t\t\t\t\t<p>You can of course extract many other data points from this page by finding the location of those elements. But for now, to keep the article concise the code looks like this.<\/p>\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<div class=\"elementor-element elementor-element-ec30156 elementor-widget elementor-widget-code-highlight\" data-id=\"ec30156\" data-element_type=\"widget\" data-widget_type=\"code-highlight.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t\t\t<div class=\"prismjs-default copy-to-clipboard \">\n\t\t\t<pre data-line=\"\" class=\"highlight-height language-javascript line-numbers\">\n\t\t\t\t<code readonly=\"true\" class=\"language-javascript\">\n\t\t\t\t\t<xmp>from bs4 import BeautifulSoup\r\nfrom selenium import webdriver\r\nfrom selenium.webdriver.chrome.service import Service\r\nimport time\r\n\r\nl=[]\r\no={}\r\n\r\nPATH = 'C:\\Program Files (x86)\\chromedriver.exe'\r\n\r\n# Set up the Selenium WebDriver\r\nservice = Service(executable_path=PATH)\r\noptions = webdriver.ChromeOptions()\r\n# options.add_argument(\"--headless\")\r\ndriver = webdriver.Chrome(service=service, options=options)\r\n\r\n# Navigate to the home page\r\ndriver.get(\"https:\/\/www.myntra.com\/trousers\/the+indian+garage+co\/the-indian-garage-co-men-black-slim-fit-solid-joggers\/9922235\/buy\")\r\n\r\nhtml_content = driver.page_source\r\n\r\nsoup=BeautifulSoup(html_content,'html.parser')\r\n\r\n\r\ntry:\r\n    o[\"title\"]=soup.find('h1',{'class':'pdp-title'}).text.lstrip().rstrip()\r\nexcept:\r\n    o[\"title\"]=None\r\n\r\ntry:\r\n    o[\"rating\"]=soup.find('div',{'class':'index-overallRating'}).find('div').text.lstrip().rstrip()\r\nexcept:\r\n    o[\"rating\"]=None\r\n\r\ntry:\r\n    o[\"price\"]=soup.find('span',{'class':'pdp-price'}).text.lstrip().rstrip()\r\nexcept:\r\n    o[\"price\"]=None\r\n\r\n\r\nl.append(o)\r\n\r\n\r\nprint(l)\r\n\r\n\r\n# Close the browser\r\ndriver.quit()<\/xmp>\n\t\t\t\t<\/code>\n\t\t\t<\/pre>\n\t\t<\/div>\n\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t<div class=\"elementor-element elementor-element-9d1a4ba e-flex e-con-boxed e-con e-parent\" data-id=\"9d1a4ba\" data-element_type=\"container\">\n\t\t\t\t\t<div class=\"e-con-inner\">\n\t\t\t\t<div class=\"elementor-element elementor-element-ad2f2d0 elementor-widget elementor-widget-heading\" data-id=\"ad2f2d0\" data-element_type=\"widget\" data-widget_type=\"heading.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t<h3 class=\"elementor-heading-title elementor-size-default\">Conclusion<\/h3>\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<div class=\"elementor-element elementor-element-5c42a64 font-color-green elementor-widget elementor-widget-text-editor\" data-id=\"5c42a64\" data-element_type=\"widget\" data-widget_type=\"text-editor.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t\t\t\t\t<p>In this article, we learn how we can easily scrape JS-enabled websites using Selenium.<\/p><ul><li>Selenium is highlighted for its capability to automate browser interactions seamlessly.<\/li><li>The focus was to parse HTML with elegance using Selenium to extract valuable insights.<\/li><li>The scope of insights includes a wide range, from product details to user ratings.<\/li><li>Overall, the article demonstrates how Selenium can be a powerful tool for web scraping tasks involving dynamic content and JavaScript execution.<\/li><li>Some websites may force you to use a web scraping API for heavy scraping. <a href=\"https:\/\/www.scrapingdog.com\/\">Web Scraping APIs<\/a> will take your headless browser and proxy management part on an autopilot mode and you will just have to focus on data collection.<p>I hope you like this little tutorial and if you do then please do not forget to share it with your friends and on social media.<\/p><\/li><\/ul>\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t<div class=\"elementor-element elementor-element-4606785 e-flex e-con-boxed e-con e-parent\" data-id=\"4606785\" data-element_type=\"container\">\n\t\t\t\t\t<div class=\"e-con-inner\">\n\t\t\t\t<div class=\"elementor-element elementor-element-264526d elementor-widget elementor-widget-heading\" data-id=\"264526d\" data-element_type=\"widget\" data-widget_type=\"heading.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t<h3 class=\"elementor-heading-title elementor-size-default\">Additional Resources<\/h3>\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<div class=\"elementor-element elementor-element-b043896 font-color-green elementor-widget elementor-widget-text-editor\" data-id=\"b043896\" data-element_type=\"widget\" data-widget_type=\"text-editor.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t\t\t\t\t<ul><li><a href=\"https:\/\/www.scrapingdog.com\/blog\/scrape-amazon\/\">Scraping Amazon using Python<\/a><\/li><li><a href=\"https:\/\/www.scrapingdog.com\/blog\/scrape-google-shopping\/\">Web Scraping Google Shopping using Python<\/a><\/li><li><a href=\"https:\/\/www.scrapingdog.com\/blog\/scrape-ebay\/\">Web Scraping eBay using Python<\/a><\/li><li><a href=\"https:\/\/www.scrapingdog.com\/blog\/scrape-walmart\/\">Web Scraping Walmart using Python<\/a><\/li><li><a href=\"https:\/\/www.scrapingdog.com\/blog\/scrape-flipkart\/\" target=\"_blank\" rel=\"noopener\">Web Scraping Flipkart using Python<\/a><\/li><\/ul>\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t<div class=\"elementor-element elementor-element-e2cb8f9 e-con-full web-scraping-right-con elementor-hidden-desktop elementor-hidden-tablet e-flex e-con e-child\" data-id=\"e2cb8f9\" data-element_type=\"container\" data-settings=\"{&quot;background_background&quot;:&quot;classic&quot;,&quot;sticky&quot;:&quot;top&quot;,&quot;sticky_on&quot;:[&quot;desktop&quot;,&quot;tablet&quot;],&quot;sticky_parent&quot;:&quot;yes&quot;,&quot;sticky_offset&quot;:0,&quot;sticky_effects_offset&quot;:0}\">\n\t\t<div class=\"elementor-element elementor-element-d2634af e-con-full e-flex e-con e-child\" data-id=\"d2634af\" data-element_type=\"container\">\n\t\t\t\t<div class=\"elementor-element elementor-element-dc4a0fd elementor-widget elementor-widget-heading\" data-id=\"dc4a0fd\" data-element_type=\"widget\" data-widget_type=\"heading.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t<h4 class=\"elementor-heading-title elementor-size-default\">Web Scraping with Scrapingdog<\/h4>\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<div class=\"elementor-element elementor-element-030b221 elementor-widget elementor-widget-text-editor\" data-id=\"030b221\" data-element_type=\"widget\" data-widget_type=\"text-editor.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t\t\t\t\tScrape the web without the hassle of getting blocked\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t<div class=\"elementor-element elementor-element-ffb2c5e e-con-full e-flex e-con e-child\" data-id=\"ffb2c5e\" data-element_type=\"container\">\n\t\t\t\t<div class=\"elementor-element elementor-element-b6006ad elementor-align-justify elementor-widget elementor-widget-button\" data-id=\"b6006ad\" data-element_type=\"widget\" data-widget_type=\"button.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t\t\t\t\t<div class=\"elementor-button-wrapper\">\n\t\t\t\t\t<a class=\"elementor-button elementor-button-link elementor-size-sm\" href=\"https:\/\/api.scrapingdog.com\/register\" target=\"_blank\" rel=\"noopener\">\n\t\t\t\t\t\t<span class=\"elementor-button-content-wrapper\">\n\t\t\t\t\t\t\t\t\t<span class=\"elementor-button-text\">Try for Free<\/span>\n\t\t\t\t\t<\/span>\n\t\t\t\t\t<\/a>\n\t\t\t\t<\/div>\n\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<div class=\"elementor-element elementor-element-3b9472e elementor-align-justify elementor-widget elementor-widget-button\" data-id=\"3b9472e\" data-element_type=\"widget\" data-widget_type=\"button.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t\t\t\t\t<div class=\"elementor-button-wrapper\">\n\t\t\t\t\t<a class=\"elementor-button elementor-button-link elementor-size-sm\" href=\"https:\/\/share.hsforms.com\/1ex4xYy1pTt6rrqFlRAquwQ4h1b2\" target=\"_blank\" rel=\"noopener\">\n\t\t\t\t\t\t<span class=\"elementor-button-content-wrapper\">\n\t\t\t\t\t\t\t\t\t<span class=\"elementor-button-text\">Contact sales<\/span>\n\t\t\t\t\t<\/span>\n\t\t\t\t\t<\/a>\n\t\t\t\t<\/div>\n\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t<div class=\"elementor-element elementor-element-625f3ad e-con-full e-flex e-con e-child\" data-id=\"625f3ad\" data-element_type=\"container\">\n\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t","protected":false},"excerpt":{"rendered":"<p>In this blog, we will be scraping product details from Myntra using Selenium and Python.<\/p>\n","protected":false},"author":5,"featured_media":18791,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"_acf_changed":false,"inline_featured_image":false,"footnotes":""},"categories":[25],"tags":[],"class_list":["post-11496","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-blog"],"acf":[],"_links":{"self":[{"href":"https:\/\/www.scrapingdog.com\/wp-json\/wp\/v2\/posts\/11496","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.scrapingdog.com\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.scrapingdog.com\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.scrapingdog.com\/wp-json\/wp\/v2\/users\/5"}],"replies":[{"embeddable":true,"href":"https:\/\/www.scrapingdog.com\/wp-json\/wp\/v2\/comments?post=11496"}],"version-history":[{"count":0,"href":"https:\/\/www.scrapingdog.com\/wp-json\/wp\/v2\/posts\/11496\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.scrapingdog.com\/wp-json\/wp\/v2\/media\/18791"}],"wp:attachment":[{"href":"https:\/\/www.scrapingdog.com\/wp-json\/wp\/v2\/media?parent=11496"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.scrapingdog.com\/wp-json\/wp\/v2\/categories?post=11496"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.scrapingdog.com\/wp-json\/wp\/v2\/tags?post=11496"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}