Summary

Websites generally do not create RSS feeds automatically. There are various ways to create RSS feeds from websites. Some programs read (scrape) websites and create RSS feeds.


Detail

Programs are available that scrape a website to create a feed

Programs use the technique known as "scraping" or "screen scraping", which is reading a website, webpage screen, or HTML and creating the RSS Feed.

Programs read the website and generally create the RSS Feed as follows:


Programs do not do well trying to decide what is important or "What's New"

There are two typical characteristics of a website RSS Feed.

Each of those characteristics means that it is probably going to take manual intervention to create effective feeds.

The scrape programs are a brute force approach that do not make intelligent decisions.


The Programs are controversial because they can be used improperly.

The scrape programs are controversial because they can be used to read the website of someone else and steal the content.

I do not recommend any program, product, or system that reads the website or webpage to try to figure out what should be on the RSS Feed.  They just do not do a good job.

I certainly do not recommend these sorts of programs to steal content.

References
New Trend: Scraping Via Email
An article on some new techniques of scraping.
Stop RSS Feed Scraping with AntiLeech WordPress Plugin
A review of a WordPress Plugin that prevents scraping.
Google KidSense

blog comments powered by Disqus

Add your comments or questions above.

The comments that were part of the Echo commenting system are gone.
Comments start over with the Disqus system


Contact Us | Privacy Policy | Change Log | Testimonials
Wizard Creek Consulting
744 San Bruno Ave. | Brisbane, CA 94005
les.bain@wizard-creek.com | (925) 209-9483
Copyright 2003 - 2017 Wizard Creek Consulting - All Rights Reserved