Is your email being "miscarried"?

Networking consultant Keith Moore doesn't ask for return receipts to confirm that his email has been delivered. This is somewhat ironic, as he was co-author of the 1996 specification that generates a confirmation message when an e-mail safely reaches its destination server. Moore, an advocate of measures to confirm email delivery, is "frustrated because end users' e-mail software still lacks the design capability to use the server-to-server messages about completed email delivery" without user intervention, reports the New York Times.

We're all familiar with email. Messages to and from colleagues arrive in seconds. Such efficiency often leads to the expectation that every email, no matter where it originates or is destined to go, must behave in the very same way. Yet, "in the wild" of the Internet the actual dynamics of email transmission may be different each and every time an email is sent -- even when the sender and the recipient are the same.

Why? It goes back to the creation of the Internet and its architecture. Initially the network was a cooperating group of educational institutions and a few technology corporations. Because data transmission lines were expensive, few of these institutions were directly connected to one another. As a result, senders had to completely describe each of the "hops" a message would need to make from one computer to the next to which it was connected until it reached its destination. Sometimes those transmission lines or the computers connected to them would temporarily stop working, so each computer stored the message locally before passing it along, then deleted the copy after it was passed.

This ensured a robust system because at each step of the way a copy of the file existed on both sides of the transfer. If a line or computer failed during transmission it was possible to wait for the problem to be corrected and then pick up the transmission at a prior step. Called "store and forward" transmission, this technique is still used today. The difference is that transmission details are now mostly hidden from the sender and the recipient. Also the number of hops required to send an email is now far less because the modern Internet passes data through a connected series of transmission lines at a much smaller granularity than that of entire files, providing the illusion that any two computers can connect directly to one another.

The advent of such "direct" connections has led to its own set of problems. Two computers communicating over the network is similar to a phone call, and although it is possible for a computer to answer a lot of calls, it eventually reaches a limit. To keep email flowing, a mechanism is used to identify more than one "phone number" that can be used to answer the "calls" going to the same destination. Called "mail exchangers," these numbers are announced by an Internet domain by publishing "MX records" that also include instructions that senders are expected to obey for how to choose an exchanger for each new email transmission. Generally, the more end recipients an Internet domain represents, the more mail exchangers it will advertise.

AOL, Yahoo, MSN and other large ISPs publish many MX records, as do large corporations. Smaller businesses publish fewer records or share MXs with other small businesses through their ISP. Each record represents a finite resource under the control of its provider. Line and computer failures are far less common than they were back when "store and forward" transmission was invented, but they still happen, and in most cases the system works and gets your email through. Keep in mind, however, that for email the Internet is still largely a cooperative that depends more on the resources of the receivers than of the senders.

Successful email campaigns rely on emails reaching their destination. They rely on the ecosystem working. In a future post, I'll discuss some of the ways that system can work against you, but also some ways you can take better advantage of it.