Hi @The-Gupta , Thank you for this great scraper. I used the code and was able to successfully run it on colab, although there is one problem in the final output. After running the code there is no value for any of the videos regarding the number of comments in the videos and for finding out if the structure of the TED webpage has changed or not, I scraped the content of one sample page and searched for the 'comment' word and I couldn't find any. Do you think there is any way I can actually get this number given the fact that apparently there is nothing related to comments in the contents of the page?
Hi @The-Gupta , Thank you for this great scraper. I used the code and was able to successfully run it on colab, although there is one problem in the final output. After running the code there is no value for any of the videos regarding the number of comments in the videos and for finding out if the structure of the TED webpage has changed or not, I scraped the content of one sample page and searched for the 'comment' word and I couldn't find any. Do you think there is any way I can actually get this number given the fact that apparently there is nothing related to comments in the contents of the page?