Sunday, January 25, 2004

previous entry | main | next entry | TrackBack (0)


Hunting spam

I've written previously that my preference for dealing with annoyances like e-mail spam has been through technological rather than regulatory recourses. It's not that I necessarily think legal options are wrong; they're just not my first choice.

We've been through this regarding phone solicitations, in which the regulatory outcome seemed to win. Intriguingly, the battle for Internet spam might be a case of technological solutions mattering more than regulatory ones.

The New York Times reports that increasingly sophisticated filtering software is eroding the "quality" of spam:

Measured in bits and bytes, the sheer volume of spam may not have diminished. But advanced filtering software, which learns to recognize the mercurial traits of junk e-mail, is having an effect. The spammers' messages are becoming harder and harder to decipher. Sense is inevitably degenerating into nonsense, like a pileup of random mutations in an endangered species gasping its last breaths.

Earlier this month, when Internet experts met in Cambridge, Mass., for the 2004 Spam Conference (available as a Web broadcast at spamconference.org), they showed just how far the science of spam fighting has come. For all the recent talk of suing spammers and compiling a national do-not-spam list, most speakers were putting their hopes in technological, not legal solutions. The federal government's new junk e-mail law, the Can Spam Act, barely rated a mention....

Many experts believe that solving the spam problem will require a combination of [legal and technological] approaches. But laws take forever to pass and amend. Technological fixes like sender authentication and electronic stamps would also take time to carry out, but filtering is already here - and it is reducing the spammers' messages to feeble signals swamped by a roar of alphanumeric noise.

Meanwhile Bill Gates is now weighing in on the issue:

Microsoft chief Bill Gates has vowed to make spam emails obsolete in two years’ time, sources confirmed tonight.

Mr Gates admitted spamming, which usually relates to pornography, pyramid schemes or financial scams, was innovative.

But, he revealed that Microsoft was investigating three solutions to rid in-boxes from the clutter of unsolicited bulk emails....

Filters could be used to sift real mail from spam but would not be the “magic solution” as spammers used random words in subject headers and replaced text with pictures to go undetected.

“Human challenges”, forcing the sender to solve a puzzle or the computer sending the email to do a simple computation, would be easy for a machine sending a few emails, but expensive and difficult when dealing with lots of spam.


posted by Dan on 01.25.04 at 12:16 PM




Comments:

The spam I've been getting has declined in number since the new year, and some of them are just nonsensical. I got this spam recently:

Re: flannelette

copy minimax supervise

DO NOT REPLY TO THIS EMAIL

hamadryad openly acrophobia hydroponics
musculature reactionary sirloin pantomime
milk nonpartisan pastel solder
crete danger lo boudoir

Babara Keenum

posted by: Hei Lun Chan on 01.25.04 at 12:16 PM [permalink]



Spammers are reducing to sending more garbage mainly because they can't afford to send messages that a filter can parse.

S(o) t(h)(e) n@xt m@ss@ge y(ou g3t w(ill) look something like this :)

posted by: Suresh on 01.25.04 at 12:16 PM [permalink]



I've had my business email address for over 12 years (not the one on this post.) As partner in a consulting firm, customers from several years ago still send emails for assistance. I am now getting over 380 spam emails a day to my business email address. I filter them into a spam folder, but still have to go through the titles to prevent overlooking a customer email. I find one or two false rejects a week, representing lost business, or at least customers who would have been displeased by a lack of reaponse.

I initially resisted the idea of the US Postal Service getting into the email business, but now I'd be the first to sign up. I don't believe private business can or will provide the level of oversight, control, investigation, and prosecution that we currently receive for mail fraud today through the US Postal Service.

posted by: germ on 01.25.04 at 12:16 PM [permalink]



Part of the reason for this, of course, is that a regulatory solution is feasible for telemarketing but much less so for spam. If anyone thought that legislation could seriously impact spam, I'll bet there would be a lot more support for it.

posted by: Kevin Drum on 01.25.04 at 12:16 PM [permalink]



As you can see from my email address I use Hotmail, and have for several years. The filter I use is provided by the Hotmail service. It simply separates my email into two buckets: items from people I know (in my Contacts list) and items from people I don't know.

This is not my work email address so I only check it a few times (at most) per day. I have to say spam, while annoying and often comical, has never been a huge burden. I do peruse the Junk Mail folder to make sure new contact email is added to my "good" list, but otherwise it is just emptied by Hotmail.

Btw, this is not an advert for Hotmail, just trying to show that for me, the solution to unwanted email is pretty simple and effective - and accomplished without a costly government bureaucracy.

posted by: steve on 01.25.04 at 12:16 PM [permalink]



Mozilla 1.6

http://www.mozilla.org/

The price is right -- $0.00(Zero Dollars)

and

http://www.mozilla.org/products/mozilla1.x/

Mail & Newsgroups

Junk mail controls helps you take back control of your e-mail from spammers. Mozilla's adaptive junk mail control gets smarter with use and is personalized to the e-mail that you receive.

Manage your mail with customizable Labels and Mail Views. Color code your e-mail to help you prioritize. Sort your mail with views to help you through your e-mail much faster.

Mozilla supports Multiple Accounts to help you manage all your mail through one interface.

Mozilla Messenger includes Enterprise ready features such as S/MIME, return receipts, LDAP support, and digital signing.

Navigator

Tabbed browsing gives you a better way to surf the net. You no longer have to open one page at a time. With tabbed browsing, open several pages at once with one click. And now your homepage can be multiple tabbed pages.

Popup blocker lets you surf the web without intrusion. Advanced popup blocker notifies you when popups are blocked. You can also block pop-ups on a site per site basis.

Image Manager lets you block images to block offensive images or to speed up the rendering of web sites.

Find as you type gives you another way to navigate a page. Just start typing to jump from link to link or to find a word or phrase within a page.

Plus all the features a modern browser should have including: Advanced security settings; Password, Download, and Cookie managers; Themes; multi-language and multi-platform support; and, the latest in Web Standards.

posted by: Robert Schwartz on 01.25.04 at 12:16 PM [permalink]



To Robert Schwartz:

Nice advert. What? No blocking of spam on blogs?

To Steve:

I know what you mean. That's why I'm not using my business address here. (I've already received two spam mails to this address from yesterday's blog comment.) But in general, consultants want potential customers to contact us - we don't know who they are yet, so we can't put them on an acceptable list. We have to go through the spam. I speak at conferences about twice a month, and many of our customers are referrals from people who heard me speak. I need my email address published.

Seems to me it's the low cost of email and the anonymity that enables the abuse that's dragging all of us down. Unsolicited email prohibitions aren't the answer - prevents reasonable businesses from sending their ads while abusers still overload our systems.

The Postal Service is going to have to change anyway - they're in the right place to take on the task.

And it fits in well with where the Patriot Act is heading. Ashcroft can match up my sent and received emails with my book purchases! I'm not a person of interest (yet) so I trust him; don't you?

posted by: germ on 01.25.04 at 12:16 PM [permalink]



See http://www.paulgraham.com/antispam.html for a rather exhaustive discussion of spam. Personally, I prefer the "charge to get into my inbox" approach. To email me, you have to pay a small fee, say 25 cents. If I read your email and decide that I don't mind corresponding with you, the 25 cents gets refunded. Of course anyone I know would be exempted from the charges.

For libertarians like professor Drezner, the best part is that such a solution would be completely voluntary. You could choose to not charge for your inbox. You could also choose to not pay anyone's inbox fee.

Of course, the only problem with this system is that it doesn't exist. Seems like it's technically feasible though.

posted by: Dustin on 01.25.04 at 12:16 PM [permalink]



I think Bill Gates is missing something.

"Filters could be used to sift real mail from spam but would not be the “magic solution” as spammers used random words in subject headers and replaced text with pictures to go undetected."

I am not sure about what you do to deal with pictures instead of text (except turn off viewing HTML mail!) but I've been using Bayesian antispam filters for months now and random words in subject headers are not really effective unless those words happen to be words that would be in legitimate mail to me. Since that set of words is different for everyone, it's a failing strategy.

posted by: Rick C on 01.25.04 at 12:16 PM [permalink]



My email is filtered by SpamAssassin. I'm sure some good email gets put in the trash, but, I'm not loading and looking through 1000 subject headings. Even so, a lot of spam gets through to my inbox. I use Pine, sorting the inbox by subject. I can look through 100 or 200 messages fairly quickly that way.

As for "human challenges" what would people who run mailing lists (like Microsoft) do?

Even if I got 2000 spams a day, I still wouldn't want MS or the US or the UN inventing some system to get rid of spam. Eventually some, for instance, political messages would be unrightfully declared spam and blocked.

Sending special ops troops in to shut down mail servers in Russia and China would be a better solution. Just kidding about the last.

posted by: Lonewacko on 01.25.04 at 12:16 PM [permalink]



The BBC was ticking me off this weekend, reporting on Gates' proposal and repeatedly referring to him as "Internet pioneer Bill Gates", which couldn't be farther from the truth.

It's even more of a distortion than anything Al Gore was ever alleged to have said.

posted by: Jon H on 01.25.04 at 12:16 PM [permalink]






Post a Comment:

Name:


Email Address:


URL:




Comments:


Remember your info?





Politics, economics, globalization, academia, pop culture... all from a untenured tenured perspective

Main home page
Main blog page
About Me
Search My Blog
Favorite Blogs
Book Recommendations
Books of the Month (Summer 2008)






Reviews of DanielDrezner.com:

"Sharp but informal commentary on politics and foreign policy." -- The New Republic

"Dan Drezner is terrific.... Excellent blog." -- Andrew Sullivan

"Dan's stuff is always worth reading." -- Eugene Volokh

"One of the essential weblogs." -- Gawker.com

"Old battle horse of the blogosphere." -- Jewcy.com

"Soft porn." -- Amitai Etzioni

"Spawned grave atrocities and vast destruction." -- Glenn Greenwald

"Monday morning quarterback... conservative robot... the very foundation of troubles in this country." -- not-so-random readers


Contact me at:
ddrezner@gmail.com
(But click here to read my e-mail policy)









Search the Site


Try advanced site search









Favorite Blogs

TNR's Open University
Jacob Levy
Glenn Reynolds
Andrew Sullivan
Mickey Kaus
Virginia Postrel
The Volokh Conspiracy
Josh Marshall
Crooked Timber
OxBlog
Real Clear Politics
Kevin Drum
Across the Aisle
Economist's Free Exchange
TNR's The Plank
NRO's The Corner
TAP's Tapped
America Abroad
Duck of Minerva
Opinio Juris
Brad DeLong

Jeff Jarvis
Mystery Pollster
Mark Kleiman
Meryl Yourish
Megan McArdle
Marginal Revolution
Michael Munger
Chris Lawrence
Matthew Yglesias
Hit and Run
Cold Spring Shops
Stephen Green
Outside the Beltway
Pejman Yousefzadeh
Laura McKenna (11D)
Elected Swineherd
Phil Carter
Joe Gandelman
Winds of Change
Andrew Samwick
Greg Mankiw
Dani Rodrik
Roger L. Simon
Tom Maguire
Greg Djerejian
The American Scene
Post Global
Democracy Arsenal




Recent articles online

"Foreign Policy Goes Glam."
The National Interest, November/December 2007

"Rise of the Hipster Statesmen."
Newsweek International, November 1, 2007

"The New New World Order."
Foreign Affairs, March/April 2007

"Mind the Gap."
The National Interest, January/February 2007

"The Grandest Strategy Of Them All."
Washington Post, December 17, 2006

U.S. Trade Strategy: Free Versus Fair
Council on Foreign Relations Press, September 2006.

Complete online article archive




Blog Archives

June 2008
May 2008
April 2008
March 2008
February 2008
January 2008
December 2007
November 2007
October 2007
September 2007
August 2007
July 2007
June 2007
May 2007
April 2007
March 2007
February 2007
January 2007
December 2006
November 2006
October 2006
September 2006
August 2006
July 2006
June 2006
May 2006
April 2006
March 2006
February 2006
January 2006
December 2005
November 2005
October 2005
September 2005
August 2005
July 2005
June 2005
May 2005
April 2005
March 2005
February 2005
January 2005
December 2004
November 2004
October 2004
September 2004
August 2004
July 2004
June 2004
May 2004
April 2004
March 2004
February 2004
January 2004
December 2003
November 2003
October 2003
September 2003
August 2003
July 2003
June 2003
May 2003
April 2003
March 2003
February 2003
January 2003
December 2002
November 2002
October 2002
September 2002

Academia
Area studies
Book club
culture
economics
fence-sitting
from Blogger
globalization
homeland security
international relations
law
Mediasphere
My very important posts
New Republic
outsourcing
personal
politics
Sports
The blog paper
the blogosphere
thesis ideas
Trade and Development
U.S. foreign policy
website maintenance

See full archives listing




Recent Entries

Someone keep Fleet Street away from Bill Clinton
It rivals Buckley vs. Vidal, I tell you
So.... are the Clintons morons?
The New York Times didn't ask me, but then again, that's why I have this blog
Monica Crowley's jet black pot
Al Qaeda is losing
Speaking of karma....
The blog post that writes itself
What made me laugh today
Where should Hillary go?




Site Credits