I recently started up FreshRSS in my docker environment. I was super excited about the web scraping feature.

Now that I’m setting it up, it looks like that it is able to scrape single web pages, but I am unable to figure out how to get it to crawl into the actual article to scrape the full content.

Is anyone aware of how to do this. For example, runescape.com/m=news/ This page has a list of articles with a thumbnail, title, category, date, and a short description of the article. Would it be possible for FreshRSS to crawl into the article link and scrape the contents within?

  • EliteCow@lemmy.dbzer0.comOPEnglish
    2·
    1 year ago

    Thanks for that link! That site is able to pull the full article so it makes me think it is possible! I will try to adapt it to FreshRSS.

    Thanks again!

    • Calcium5332@lemmy.worldEnglish
      1·
      1 year ago

      It is definitely possible, as RSS readers like ReadYou can do it. Maybe try FreshRSS in conjuction with an RSS reader?