Cheerful Curmudgeon

I got a frantic email from a friend this week. One of his subcontractors went crazy and trashed several of my friend’s clients’ web sites as well as my friend’s own business site. The police have been involved but much damage has already been done. I wish I had been hosting my friend’s sites. Had I been, I could have recovered everything from backups. As it is, all I could do was sit by and fume, wishing that his hosting company had had something to offer him in the way of assistance.

I know my friend’s pain. In the 30 years that I have been doing system administration, there have been numerous times when my own bacon has been saved by backups. I have been struck by the dread BUOD error (Bad User On Device) in which a glitch sitting between the chair and the keyboard has made the computer do all kinds of hideous deeds. The worst, early in my career, idled a team of a dozen programmers for three days. Why three full days? You guessed it: no backups. At the other end of the spectrum, a member of my team recently trashed a critical configuration file on one of our servers. This, however, resulted in no downtime; we simply grabbed a copy from the backups and continued on our merry ways.

If you accidentally delete a file from your web site (or, in my friend’s case, all of the files), can you recover it? Does your hosting company provide backups and, if so, can  you recover files from their backup? In many cases, hosting companies’ backups are only for their use in cases of disk drive failure.

My company offers one (excellent, in my opinion) solution, Nest Egg Backup for Web Servers. There are many other alternatives. Do choose and implement one. When you go comparison shopping, ask the key question: How long are the backups retained? If only for one night, that means that your window of opportunity is extremely limited. If you delete a file at 10:00pm and wait until 8:00am to try to get it back, you are out of luck. You should have at least three days of retention, preferably more, preferably a lot more. Thirty days can give you a nice warm, fuzzy feeling of safety and security.

Lesson of the day: Back up your hosting accounts! And be sure to include everything (email folders, MySQL databases, PHP config files, etc. etc. etc.) The day disaster strikes is a day too late to start backing stuff up.

As I predicted in Google Chrome to Replace Microsoft Windows, Apple OSX, and Linux (September 2008) and again in Step 2: Google Chrome to Replace Microsoft Windows, Apple OSX, and Linux (December 2008), Google is moving to replace the operating system, not just the browser. What changed two days ago is that Google is finally being up-front about it, instead of masquerading their plans as “only” a browser.

In Introducing the Google Chrome OS on the Official Google Blog, Google writes,

We designed Google Chrome for people who live on the web — searching for information, checking email, catching up on the news, shopping or just staying in touch with friends….

Google Chrome OS is an open source, lightweight operating system that will initially be targeted at netbooks. Later this year we will open-source its code, and netbooks running Google Chrome OS will be available for consumers in the second half of 2010….

Speed, simplicity and security are the key aspects of Google Chrome OS. We’re designing the OS to be fast and lightweight, to start up and get you onto the web in a few seconds. The user interface is minimal to stay out of your way, and most of the user experience takes place on the web….

Google Chrome OS will run on both x86 as well as ARM chips and we are working with multiple OEMs to bring a number of netbooks to market next year….

What does this mean to you? Several things, all good if you a) use your computer mostly for stuff on the web, and b) like to save money, and c) don’t mind that virtually all of your files will be “elsewhere” instead of stored on your own computer.

1. Turn on your Google Chrome OS based computer and, within a very few seconds, you will be up and running on the web (using Google Chrome, of course).
2. No (or at least few) worries about viruses and Trojans which exploit Microsoft Windows, Internet Explorer, Microsoft Outlook, or Microsoft Office. You will have the security of Linux without the geeky requirements that you actually understand Linux.
3. You will be able to run this on existing hardware, which ought to breathe new life into old machines.

The kicker is that, in Google’s grand vision, all of your email, letters, documents, spreadsheets, databases, etc., will be stored on Google’s servers. You will use GMail for your mail and Google Apps instead of Microsoft Office or OpenOffice.org. If you are big, you will use the paid versions of these apps. If you are small, ads might be in your face all the time. It is not coincidence that GMail and Google Apps came out of “beta” the same day that Google introduced Google Chrome OS.

Is this good for you? How much do you trust Google? It is certainly cool technology, certainly priced right, and certainly convenient.

I am not surprised, but I am still dismayed, by the continued erosion of our personal privacy in the shadow of George W. Bush’s administration. The New York Times reports in E-Mail Surveillance Renews Concerns in Congress that the National Security Agency (NSA), as recently as early this year, is illegally collecting email from Americans:

Since April, when it was disclosed that the intercepts of some private communications of Americans went beyond legal limits in late 2008 and early 2009, several Congressional committees have been investigating. Those inquiries have led to concerns in Congress about the agency’s ability to collect and read domestic e-mail messages of Americans on a widespread basis, officials said. Supporting that conclusion is the account of a former N.S.A. analyst who, in a series of interviews, described being trained in 2005 for a program in which the agency routinely examined large volumes of Americans’ e-mail messages without court warrants. Two intelligence officials confirmed that the program was still in operation.

A decade ago, I was a strong proponent of OpenPGP-encrypted email. I gave up when I got tired of trying to push that rope uphill. Maybe it’s time to try again.

Did you know that, unless you encrypt your email, it is as easy to read as a note written on a postcard? Now before you say, “So what? I don’t care,” consider how you would feel if NSA wanted to listen to all of your phone calls or wanted to read all of your regular mail. I suspect that, even though you are a law-abiding citizen and have nothing to hide, you might object a tad to that invasion of your privacy.

I have published my PGP key on this web site (and it is in the popular key servers). Using this key, you can send encrypted messages to me and you can confirm that messages which I sign electronically actually were signed by me.

I sign and encrypt my email messages using EnigMail and GnuPG (Gnu Privacy Guard) with Thunderbird, all highly reliable and free software. If you use something other than Thunderbird for your email (like Outlook or Eudora), here is a list of other mail user agent frontends. And if you use Gmail or any of the other email systems though a web browser, FireGPG is just the ticket.

Setting up the software is a little bit of work, but you will probably be done in less time than it would take you to drive to Office Depot and buy a box of envelopes. Once you have the software installed, you can encrypt an email message faster than you can lick and seal an envelope.

Cindy and Geoff did a great job and produced Caedmon Geoffrey, a wonderful, healthy baby boy at 7:12pm on May 20. He’s 9 lbs 1 oz, 21 inches tall. His plumbing works so well that he peed on the doctor during delivery. I take that as a great omen!

I have been writing a new program, having a ball doing it, and it has brought to consciousness something which I have not thought about for years: There is a bit of Dr. Henry Frankenstein in me. I love to create things which do stuff autonomously and, when I create these things, bigger is definitely better.

My current creation has lots of parts, including:

1. A daemon (I love that word, all the more since daemon’s are useful and not evil at all) which runs all the time and wakes up once a minute to see if anything interesting has happened and decide whether it should do something.
2. A script which watches for people to click special links in email messages. It leaves a “note” for the daemon, telling it that a human being received the email and did something. Cool; my program is making humans do things!
3. A script which watches for secret messages sent from another program on another computer. This script also leaves notes for the daemon, telling it that the other computer is set up and running and ready to do a human being’s bidding.

The daemon gets to do all sorts of fun things, including summoning new (virtual) computers into existance and turning them loose on the world. In the end, the daemon even gets to kill off the computers. The daemon spends real money (hopefully, this part does not get out of control!) with a real multi-national company.  And as the daemon works, it attracts the attention of people at four different companies, all of which are very interested in what this little beastie is doing.

Not bad for a creation which only exists in the virtual world inside a computer. If you see me walking around with a smug smile on my face, now you know why.

I woke up in a good mood this morning and then…

Sometimes one piece of technology makes another, seemingly unrelated, piece of technology misbehave. It happened this morning at 12:15am CDT when an automated program that I run in Amazon EC2 failed to do its thing. The EC2 instances (that’s geek speak for “virtual machines” which is geek speak for “computers which aren’t really there but act like they are”) started up but never got around to doing any useful work. Six hours later, all of the instances were still running; they should have finished their work and died off in about two hours. I killed all of the instances, grumbling because I had paid for six hours of time and gotten nothing for it and did not even know why.

The underlying problem, it turned out, was a new SSL certificate that we had installed on our e-commerce store yesterday. One of the first things that each EC2 instance does is to fetch the latest version of the software from a Subversion server, which, coincidentally, is on the same machine as our e-commerce store. With a new SSL certificate on the server, each instance was waiting for a human being to say that the new certificate was OK. Inconveniently, the human being was sound asleep.

Who would have thought that renewing the SSL certificate for our on-line store would break an unrelated Amazon EC2-based application? Hidden dependencies suck.

Now I am in a bad mood, grumbling because I did not get my relaxed waking-up time after my shower, sitting next to my wife, drinking coffee, cruising blogs. Instead I dove directly from the shower into debugging and it left me feeling edgy.

We have a mechanism at Hen’s Teeth Network which works pretty well to keep emotional baggage like this from blindsiding our coworkers: we check-in every morning. It is a chance for me to say, “I’m in a bad mood. Better watch out; I may bite.” Better forewarned than not.

I am finishing this post a couple of hours later, after checking in with my coworkers. The check-in worked beautifully, giving me a chance to blow off some of the steam. I am more relaxed and I got some support from sympathetic ears. We even laughed a bit about the situation.

We missed the hidden dependency between the e-commerce store’s SSL certificate and the EC2 application and were caught unawares. Fortunately, we did not miss the hidden dependency between my early morning upset and my interactions with my co-workers. Knowing about the dependency and having tools at hand and in daily use for handling the dependency, proved a good thing for all of us.

Do you remember when I predicted that Google Chrome would take over the world replace Microsoft Windows, Apple OSX, and Linux? Here is the next step, to be released for CES which begins January 8, 2009.

If all you want from your computer is to read your email (Gmail) and surf the web and use the other applications that Google provides, it is just seven seconds away. No, that is not a typo. In less time than you have spent reading this article, you will be able to boot your computer and be doing useful stuff.

Of course, you could use this system for web-based applications other than Google’s, but how many people will bother. I wonder how long it will be until you can get a free, ad-supported computer with this operating system pre-installed.

The headline The end of an era – Windows 3.x startled me this morning. My first thought was to look at the dateline; it had to be in the distant past and I wanted to see how distant. I will save you the tension and anticipation; the dateline is November 1, 2008, just four days distantly past.

My favorite quote:

Windows 3.x required an 8086/8088 processor or better that had a clock speed of up to 10MHz. It needed at least 640KB of RAM, seven megabytes of hard drive space, and a graphics card that supported CGA, EGA and VGA graphics.

By comparison, the Home Basic version of Windows Vista requires a 32-bit 1GHz processor, 512MB of RAM, 20GB of hard drive space, and a graphics card with at least 32MB of memory.

Microsoft released Windows 3.x in May 1990. I remember joyfully using the heck out of it for years, running Microsoft Word and Microsoft Excel on an Epson 80286 machine with two 5 1/4″ floppies and a 20 MB (yes, that’s really “MB” and not “GB”) hard drive. We probably had 1 MB (yes, there is that “MB” again) of RAM. We printed stuff out on an HP LaserJet capable of (breathe deeply now) 300 dpi.

I still have a shrink wrapped copy of Microsoft Windows for Workgroups sitting in the basement. It came with an 80486-based computer that I bought back in about 1983. Tempting though it is to unwrap it and install it, I won’t. I no longer have any computers with a 3 1/2″ floppy drive.

Today is a good day: looking to the future with cautious hope and to the past with gentle nostalgia.

You might have noticed a bit of “uncertainty” in the economy these days. I was fascinated to see these two articles show up within 24 hours of each other:

We do not know who is right, of course, but I am an optimist and strongly biased toward Updegrove’s view.

I believe that we live in a plentiful universe, that there is more than enough of everything to go around and our challenges are in distribution and not in production. We have, for instance, more than enough food to feed everybody; we just need to get the food from where it sits to the mouths of the hungry people. I believe that we are bright enough to solve this problem.

I also believe in the basic generosity of human beings. Innumerable projects have been accomplished through the donated time of unemployed and under-employed people. People with full-time jobs and plenty of money also donate their time, of course, but history proves that unemployment does not transform normally generous people into the selfish animals which Keen predicts.

Open source software is good for everyone. The programmers get to do stuff which they enjoy, learn new technologies, and bask in the warm fuzzies of seeing the works of their hands thoroughly enjoyed and appreciated. The companies which use open source software see lower costs and (hopefully) higher profits. And last but certainly not least, the people who use open source software get to enjoy a much wider choice of solutions to their problems than would exist if only commercial software were available. With all of this goodness in a naturally abundant universe, we are certainly going to see new bounties in the open source software cornucopia.