I am trying to scrape the data from an esteemed bengali newspaper, wherein the said data content is available in public domain. When I try with the browser, everything works perfect without an issue, but when I try through webscraping, I get 403 error.However, I got a solution by using headers and cookies in my script along with the url. The BeautifulSoup helps accessing the data, but all I need to do is to find a way to feed the cookies and headers through a recipe in calibre. Is there any way to do that?Any help would be greatly appreciated. Thank you.
↧
