Class 13

Change Notification Tools

RSS feed reader & inbox

Email Alerts (Site based & Search based)

site based email alerts

  • see info through web interface
  • site provide email alerts (daily/weekly newsletter) - they figure out what to send you
  • you find these sites (millions) through google search
  1. Monitor entire site
  2. These are set up by the Web site and you subscribe to them
  3. No false positives
  4. Sometimes you want email (cell phone! or even Messenger)

search based email alerts/General email alert services

Google Alerts / Yahoo Alerts - enter query and subscribe to updates of the results of those queries - changes to results, new results (follow query over time)

  1. Yahoo Alerts
    • Some types of alerts
    • Be sure to look over the whole list of categories of alerts.
  2. Google Alerts (help)
    • All of this is based on submitting queries
      • Once a day
      • Once a week
      • "As it happens"
    • Broad-ranging alerts
      • Web & comprehensive alerts
    • More specific
      • Keyword-based alerts for news, blogs, video and groups
    • Can receive as email or as an RSS feed

Search for email alerts

* Query: "email alerts" OR "e-mail alerts" OR "email alert" OR "e-mail alert" 206,000,000

More specific search for email alerts
* Query: inurl:mail OR inurl:alert "email alerts" OR "e-mail alerts" OR "email alert" OR "e-mail alert"

Science email alerts - specific alerts
* Query: science "email alerts" OR "e-mail alerts" OR "email alert" OR "e-mail alert"

Page monitors

Another way to get emails
* Monitor specific pages (but not sites)
* Lots of false positives unless keyword based

Webpages that you want to know when it has been change: e.g. Goldman Sachs press release page

It is a program or web based program that you download. Each day (or whatever time period you want to set) it downloads the webpage, and if it's different it will send you an email. Some tell you what has changed while others just tell you that it has changed.

At first, you might not be that impressed with page monitors. But after realizing that it can be used for a lot more than news, it can be quite a useful tool. WatchThatPage.com is the best free site.

WatchThatPage has a limit of 250 characters for the URL. Also, shortened URLs (from tinyurl.com or bit.ly) do not work. To get around these problems, use TrackEngine, where neither of these problems exist.

Web-based
  • WatchThatPage
    • Free (for any number of pages), or $20/year for priority service
    • Can highlight changes in pages
    • Changes sent in an email
    • Keyword matching
    • This site doesn't appear to be updated any more (4+ years)
  • TrackEngine
    • Free for 5 bookmarks, or $20/year for 10 pages, or $59/year for 50 pages
    • Highlights new content in HTML email
    • Monitors changes daily
    • Does do keyword matching
    • This site hasn't been worked on for 7+ years
  • Other possible sites: InfoMinder, ChangeDetect, Trackle
Windows software

RSS Feeds

* Problem: False positives
o Unless keyword based or filtered somehow
* Focused RSS feed — If you’re lucky, there is a keyword-based, or specific-topic defined, RSS feed available for a site you can subscribe to.
o Specific sites (findable in all the usual ways)
o Dapps at Dapper.net
o Pipes at Yahoo Pipes
* General RSS feed: If there's simply a general RSS feed (such as "Yahoo breaking news"), then you should run that feed through a keyword tool:
o FeedRinse
o Yahoo Pipes (if other processing is needed)
* The following are useful if there's no RSS feed available on a page but you would like to set one up:
o FeedYes: I would try this first since it's the easiest to use when setting up a feed.
o Feed43: This is more powerful but more difficult to use.
o Dapper: This is another powerful tool.

Feed creation software

Overview

Make a feed

From other feeds

Start with some pagesites that have RSS feeds, throw them in Feed Rinse/ Yahoo Pipes, end up with filtered info
ex. subscribe to NY Times Business, use Feed Rents to filter info for just a specific company

use when you have a bunch of rss feeds that don't have info daily, but want for just one specific company

From a page (structured web pages)

There's a page with info in a list / table, you want to know when items change - with these tools, you make the RSS feed
page monitor - does this page change?
Forming RSS feeds lets you subscribe to specific lists

  • Dapper
  • FeedYes
  • Feed43
    • Feed43 is a little bit more complicated. You have to find the actual html within the source code of the page.
      • Define Extraction Rules – By finding the specific places (within the code) of the information that you’re looking to have monitored by the RSS feed. There are directions for what specific code to use in the program.
      • Then click extract
      • Then you can give it a title, description, url, etc
      • Then put in where the title, date, etc are etc
    • If these sites are updated once a month, its too much of a hassle to make one of these (use a page monitor). But if it is updated daily and you want to monitor it, then it might be a good idea to make one!
    • Free, or $29/year for 20 hourly updates
    • My feeds

Examples

Why not just use RSS

* Some sites don't have RSS feeds
o So use site-based email alerts
o Or use a tool to make an RSS feed
* Some information isn't site based
o So use search-based email alerts
* Some information is too fine-grained to be covered by RSS feeds
o So use page monitors

Email filtering

  1. Gmail
    • Limit around 7.2GB (4.5GB in October 2007)
    • Can use a filter
      • To forward just some emails (to different people?)
      • To apply a label to emails
    • Plus addressing
      • A powerful method that can be applied to Email alerts is using “plus addressing” service when you sign up for an Email alert (e.g. from some query), i.e. tell them that your address is dummy+moc.liamg|reifitnedIyreuQemos#moc.liamg|reifitnedIyreuQemos instead of the normal address moc.liamg|ymmud#moc.liamg|ymmud. Thus, if you get this address to your mail account, you can filter it by what comes after the plus! This is a extremely helpful since it makes it easier to filter emails.
      • Description for GMail
      • Use a different address for each email alert
      • Helps you filter
      • Helps you track who is selling your email address
  2. Defining a filter
    • Keep definition to a minimum, as simple as possible
    • Test, test, test

Tools you now have at your disposal

  • Method to follow to find site-based email alerts
  • Tools to create search-based email alerts
  • Tools to monitor Web pages for any changes to their contents
  • Tools to apply keyword-based filters to RSS feeds
  • Tools to convert tabular Web page content to an RSS feed

Your term project

Email alerts and your term project

You should do the following for your project wiki:

  1. You should figure out some way that you are going to document the email alerts that you use in your email account to route your incoming alerts. Maybe print the alert page to a PDF file and link it to your wiki? Maybe take a screenshot of your email inbox and highlight the email alerts?
  2. In either case, you are going to want to have a section in your wiki called "Email alerts".
  3. On this page you should describe each of the email alerts that you used: the page from which you subscribed to it, why it is useful, and if there are any keywords (or such) that you used to generate it.

All of the above also applies to your page monitors, any feeds you create using FeedYes/Feed43/Dapper, and any feeds you filter using FeedRinse or Yahoo Pipes.

Possible blog topics

You do not have to write a blog. These are suggested blog topics if you were to write one. There are lots of possibilities in this class.

  • Describe different ways that you found these tools useful.
  • Describe how you used Yahoo Pipes, possibly differently than how we have described them here.

Hints about possible test questions

You're definitely going to be held responsible for the following topics:

  1. What WatchThatPage (as an example of a page monitor) can do
  2. What Dapper can do
  3. What Feed43 can do and how its search patterns work
  4. What Yahoo Pipes can do and how feeds can be manipulated (for example, Fetch Feeds, Union, Filter, Sort)
  5. Under what circumstances would you use each one of these tools (as opposed to another)
Unless otherwise stated, the content of this page is licensed under Creative Commons Attribution-ShareAlike 3.0 License