Review: AtWatch

AtWatch is a hosted monitoring service that (according to their web site) was acquired in 2001 by the company InternetSeer.  In fact, I believe that @watch (as their logo is written), provides all of the higher-end services for InternetSeer.  The service they provide seems to have at least four locations and some dedicated network lines, including one they announced in July that is situated in Germany.  In signing up for a testing account, it only lets you add one URL to crawl, but this will hopefully give some sense of what they can do.

To begin, I signed up for their 14 Day Free Trial account.  This asked for the (one) URL to monitor, the timezone in which I reside, which greographical area I want to be crawling from (the choices were California,  Pennsylvana, New York or Germany) and the usual name, email, and password info I would need to log in.

That's cool.  One caveat for later is that it seems to want you to log in using your assigned account number as the username, rather than something more traditional like your email address.  If you forget it, their 'forgot it' page allows to to enter your email address in able to have the account number emailed back to you.

When it brings you to the Account Administration page, you should see the URL you chose.  There won't be any reports or pretty graphs to look at just this minute, you will have to wait at least a day.  The Trial Account only does a check once each 20 minutes, so basically, don't expect any interesting data until the next day, unless your test site is already crashing.

They do have a 'snapshot' feature that allows you to generate a checksum of the front page of your test URL, and in a minute we can see how to enable this 'Hacker Alert' (i.e. the page has changed.  Go ahead and click on the camera icon next to your URL, and we can play with it a little.

Clicking the 'Edit' link directly next to the URL on the Administration Page should allow you to begin playing around with the advanced features of @watch.  The Service Level and Availability Interval are not configurable in trial mode, but several other things are.

You can choose not to receive daily, monthly or weekly email reports with simple summaries of what went on during that period of time.   But does that simply mean that you are not going to be emailed links to these statistical reports, or that they are not going to be available to you even when you are there?  I am unsure, and will investigate.

You can modify basic information on the URL (including changing the URL to something else if you want), and add a name and a URL of your ISP.

Alert Options are always the most fun and variable parts of these systems, and @watch is simple without being too basic.  You are allowed a Primary and a Secondary contact, whose information you enter in the 'Contact Info' section of the site.  Anyway, back in the Alert Options section, I will set my primary alert contact to get email and a page if something goes wrong, and then email and a page if a problem resolves itself.  If a problem is detected more than a certain number of times in a row, it will be 'Escalated'.  I can then set up my secondary alert contact to receive an email and a page on an escalated item.

According to their documentation, they would normally check twice (although I am uncertain if this means twice through the Availability Interval, or if they initiate a second check immediately).  My guess is the former, since there is a specific 'Immediate Alerts' checkbox that starts alerting immediately after the first error is detected.

Then there are 'Watch Options'.  You can ask it to verify that a particular string of characters (or two sets) are present in the first 1k of the HTML.  This might be a way to determine if a dynamic job running on your site (near the top) is correctly returning the proper text.  They also have a URL Image Check, that makes sure each image referenced on the test URL is not breaking.  The 'Hacker Check' compares a checksum of the URL's HTML to a previously taken 'Snapshot', and alerts you if they do not match.  This feature is only useful for checking static pages, since dynamic pages resulting in slowly changing content over time should trigger an alert.  The 'URL Image Check' and 'Hacker Check' are only available with their highest level of service.

Their final Watch Option is the 'Site Content Check', available with their highest and mid-level service plans.  This tool will crawl through a limited section of your site, searching for and telling you about broken links to a maximum depth of 4 levels, or 3000 links, whichever comes first.  They do check to make sure that links to outside pages respond, but @watch does not traverse them itself.  Since you can't do it on demand, and it wouldn't finish larger sites, this is really just a quality control measure, to make sure your top level pages aren't embarassing you with formerly-working links.

The periodic reports themselves (daily or weekly were the only ones I saw during my two week trial) were simple enough.  They show you a graph of response times for DNS lookups and retrieving the first 1k of the page, and the low, high, and average times for these statistics.  If you had any alerts during that time period, you would see those too, showing the date and time, the alert condition and how many times it occurred, a little text detail about what it meant, and how many alerts (and escalated alerts) were sent.

Alerts also generally send emails.  This email would include the time of the alert and its severity, specific descriptions of what is not working, how long the system has been in this condition, and a network traceroute, which could give your network folks an idea of whether it is a routing problem, rather than a software problem.

@watch has some features I did not test, namely having alerts Faxed to me, or having them sent to me through an email to SMS gateway.  They also seem to have the ability to log in to password protected sites, track cookies your site is sending, etc.  My test site did none of that, but I assume it works as well as the rest, which is to say, pretty well.

All in all, this system is focused specifically on website uptime, and seems to have the features a webmaster with a lot of pages to look after. The user interface was pretty easy to use, although I wish that the page where you enter your Primary and Secondary Alert Contacts was integrated somewhere on the 'Alert Options' page, since I can see some confusion arising there.   The prices seem a little steep to me, but then, I am cheap.

Review: Keynote RedAlert

Keynote RedAlert is a hosted web and network device monitoring service offered by Plano Texas's Keynote Systems, Inc.  They offer a 30-day free trial, which I took, and which is supposed to be a fully-functional version of their monitoring system.  I added the 5 URLs I generally use for these trials, hosted at various locations in California.  These reference sites tend to have a good amount of variability, and at least one of them is flaky enough that I thought it might give us a workout.

First, the system itself.  They have multiple locations from which RedAlert will crawl your site.  The interface itself took some getting used to, as it is somewhat less than verbose, and not terribly well-designed.  That aside, however, I had no trouble adding my 5 sample URLs.  Be warned, though, what the first page lacks in options, the next page more than makes up for.  When you add a URL, it takes you to a page only slightly shorter than the Gutenberg Bible and chock full of fiddly options.

You enter the URL, give it a shorthand name, and choose either a 5 minute or 15 minute crawl interval.  So far so good.  Then it asks you for an optional keyword, and suggests that you scroll down the page to learn more about Error Type 4.  You can give it a username and password, optional fields to post to a form, options about following redirections and whether or not to check a router or switch in association with this device (for which you need to provide an IP address).

Next there are near-identical tables in which you configure your response to each of 7 different error types, ranging from 'Device inaccessible' to 'File Size Error'.  I only used the first three, namely 'Device Inaccessible', 'Device Not Accepting TCP Connections', 'No Data Sent Within 30 Seconds of Request', and in each case, asked them to send me an email alert up to twice, and when the device recovered.  You can also choose how long the error needs to persist before someone is notified (I chose immediate notification), the email address to notify, and a range of times to crawl (apparently, in case your website is only being used from 9 to 5).

I did have to examine all of these options for each of the devices I added, however, much later, when clicking around, I came across a link to 'bulk edit notification options', under Alerts => Edit Notifications.  They do appear to have a lot of features, it is just that the user interface is so horrible that I eventually stopped looking for them.

Each day, RedAlert sent me an email message 'Monitoring Statistics from RedAlert', which almost invariably told me that my URLs had 100% uptime.  Unfortunately, they didn't convey any other data, such as the average response time, heavy load periods, or anything like that.  Still it was vaguely reassuring, and I could have asked it to stop sending me those messages.

Other monitoring systems, running concurrently, seemed to think these URLs had a bit more downtime than RedAlert reported.  However, whenever RedAlert did send me a failure notification (which it did three times that month), the other systems concurred.  This gave me even more confidence when I send the webmaster an email asking them to look into it.  Anyone who co-locates machines with smaller firms knows that it is sometimes difficult to get them to admit when there is very occasional, but very real  flakiness on their network.

RedAlert has a number of features that I did not test, but I presume work fine.  They can monitor many other types of internet service, such as FTP server, SMTP, POP3, IMAP, etc.  Notifications can be sent via pager, SMS, etc.  Be warned, though, that they charge you for every conceivable option, and it ain't cheap.

All in all, this is a system with an extensive (albeit expensive) range of options, but a difficult user interface that might keep people from getting the most out of their service.

Review: WatchThatPage.com

First, a caveat:  WatchThatPage.com is not meant to be an uptime monitoring system in the same sense as a RedAlert or a Dotcom Monitor.  Here is the description from their front page:

WatchThatPage is a service that enables you to automatically collect new information from your favorite pages on the Internet. You select which pages to monitor, and WatchThatPage will find which pages have changed, and collect all the new content for you. The new information is presented to you in an email and/or a personal web page. You can specify when the changes will be collected, so they are fresh when you want to read them. The service is free!

However, since I have a bit of a one-track mind, I thought I would try to use it as an uptime monitor, to see what happened.

The service, as mentioned, is free.  Signup is minimal, requiring just an email address, your name and a country.  It also allows you to set your timezone, which is a simple feature, but very welcome.  Then I chose some update times.  Since I wanted to push the system a little, I used the 'add update time' feature on my profile page to tell it to check 9 times per day, once per hour from 1am to 4pm, at 8am, and once per hour from 10 am to 1pm.  I was happy to see a checkoff for 'report broken pages', which is a little more in tune with the services that are actually meant to do uptime monitoring.  There was also a pulldown asking whether I wanted the notification email to show me the actual changes, or just to tell me which page had changed.  I chose to see the changes.

You then want to pick some pages to watch.  I hit the 'Pages' nav button, and chose about 5 pages that I was interested in, including one that changes a lot (practially every time you look at it, in fact).

Now, since I had a page that changes frequently as one of my monitored sites, I got a LOT of email from WatchThatPage, as you can imagine.  The email itself contained the text-based and link-based content that is different from the last time each page was changed.  If a site has not changed, it is not reported.  The system did tell me at least once when a page was not responding, but I probably should have chosen the 'only show me which pages have changed' option, since after receiving 9 emails from them every day, I stopped looking at the content, and just started deleting them.

They also have a keyword matching option, which I did not end up using.  Theoretically, I could have looked for error conditions, but since it seems to be a global option rather than configurable for each page, all of the sites would have to report errors in the same way.  Of course, I have already mentioned that I am using this system in a way that was not intended, so we can't really fault the authors of WatchThisPage for not supporting my twisted use of their service. :)

Apparently, Thomas Edison once said "I have not failed. I've just found 10,000 ways that won't work."

  WatchThatPage seems like it could be a nifty tool for some purposes, but not for ours.  Thus, we have found one way that doesn't work.

Commercial and Hosted Web Monitoring Systems

All of these sites seem to be doing business as of December, 2004. They are all commercially-driven in one way or another, which makes sense given that they actually have to use their own bandwidth and servers to provide the information we all want from a monitoring package.   Hopefully we'll have a chance to try most or all of them out, and get some feedback on what works, and what doesn't.

            http://www.dotcom-monitor.com

  • Accessibility check: Is the site reachable.
  • Performance check:  Does the site respond within a user-specified amount of time.
  • Content check:  Is the appropriate content visible on the page.
  • They also check cookies, site certificates, and myriad protocols (POP3, SMTP, DNS, etc) to make sure those services are up.
  • Alerts by email, pager, or automated 'voice call' system.

http://alertsite.com/
  • Checks from multiple locations spread around the globe.
  • Break down performance by DNS time, redirect time, time to first byte, etc.
  • Pricing starts at 9.95/page/month for checks every 60 minutes (+19.95 one-time setup fee).
  • 34.95/page/month for 10 minute checks.  All from three different cities.
  • Notification by voice call or SMS for additional fees.
  • Good description of who would use the service. :)

http://ipwatcher.com/
  • Hosted, $9.95/url for 60 minute checks, $24.95/url for 15 minute checks.
  • Discounted 35% for 10 or more services.
  • $19.95 one time setup fee, 10 day free trial.

http://www.internetseer.com/
  • They have 24/7 staff that attempts to get your site back up, contacts your hosting provider, etc.
  • Can add different notification lists for various types of problems, so particular people are called when various things are down.
  • They charge 99.95 per year for the basic service, or 29.95 if you get the 'small business discount' (for which you have to fill out a form. Also, you can get it for free if you agree to take periodic surveys, receive emails, etc.

http://www.webmetrics.com/
  • SiteMonitor service from $10/month per URL to $250 for content checks and benchmark comparisons to other sites.
  • Checked from 20 servers around the world.
  • They offer many other services, including web analytics to see how things are converting, etc.

http://www.checkupdown.com/
  • Extremely basic service, just checking up or down, with rudimentary interface.
  • Starts at $75/year for 1 URL monitored once every 60 minutes. Prices go up with frequency of check, as do many of the other services listed above.

http://www.hisoftware.com/
  • Interesting service that checks sub-pages (presumably by spidering through all of them) to make sure they comply with privacy, content, or other guidelines. A service to check for profanity, inappropriate content, etc, would be interesting.

http://www.websitepulse.com/
  • Interesting pricing model, very configurable.  Starting at $1/server, up to $29 additional for minute-by-minute checks.

http://directory.google.com/Top/Computers/Software/Internet/Site_Management/Monitoring/
  • List of website monitoring sites in DMOZ.

http://alertra.com
  • ICQ, AIM, etc. as alert methods.
  • Alerts that escalate according to a particular schedule (notifying different people as they escalate).
  • Ability to suspend checks during system maintenance times.
  • Charge per device and monitoring time. $1/month per device for checks every 60 minutes, up to $60/month per device for checks every 1 minute.
  • Interesting-looking interface, highly graphical.

         http://mercury.com/
         http://www.ipmonitor.com/
         http://siteimprove.com/

http://www.business.com/directory/internet_and_online/site_management/monitoring/

  • List of website monitoring sites in business.com.