Who has Better Spam Protection? Yahoo, Gmail & Hotmail Tested
71The Great Free Webmail Spam Filter Experiment
How I Tested:
- On January 9th, I signed up for a free Yahoo, Hotmail, and Gmail address: woahmatt@yahoo.com, woahmatt@gmail.com, woahmatt@hotmail.com
- Posted all three addresses on a few forums, and on my blog and made them clickable. This is one way that spambots find your email address, by crawling the web looking for clickable email addresses. I didn't see much result from this because having your email address "harvested" this way, takes time. I did this experiment for about 30 days, so I never really saw the fruits of my labor for this method.
- Entered all three addresses in a seedy "Win a Free iPod!" website. (Believe it or not, I didn't win!) The spam REALLY starting flowing after this, starting with about one piece every couple of days, and then suddenly growing exponentially.
- Waited 29 days.
Critera for "Winning"
If a piece of junk mail enters the junk folder, I consider that to be a success. So, whoever has the least amount of spam in the inbox, is the winner.
3rd Place: Yahoo Mail
Yahoo Mail lost, hands down. No contest. I was surprised actually how poorly Yahoo handled spam. Sixty-two pieces of Spam accumulated in my inbox (not counting my three "welcome" emails from Yahoo), in a mere 29 days. Phishing emails, shady credit cards, you name it, this address got it.
- INBOX: 62 (not counting the three "welcome to Yahoo" emails)
- Bulk Folder: 89
2nd Place: Hotmail
Compared to Yahoo Mail, Hotmail did a fairly respectable job of keeping my inbox from being cluttered with spam. Eleven emails, minus one "welcome" email from Hotmail. Honestly, I thought that Hotmail was going to perform the worst of the three. One interesting thing is that it's junk folder only had eight emails inside.
- Inbox: 11 (not including the one "welcome to Hotmail" email)
- Junk Folder: 8
The Winner: Gmail
With a mere three pieces of spam in my inbox, Gmail is the winner, by far. Gmail's Spam folder had a whopping 579 emails in it.
Why are there so many more pieces of spam in my Gmail spam folder than in my other folders? Often times, mail services will off block items that they determine are undeniably spam BEFORE they even get to your email account. Gmail seems to let a lot more of them through. I'm not sure why. Maybe its a psychological thing, so you can see just how much spam Gmail is blocking, so you can feel really impressed. Well, I'm impressed anyway!
- Inbox: 3 (Not including one "welcome to Gmail" email)
- Spam folder: 580
It's Not Over
I'm not done with my webmail spam experiment just yet. To be fair, I'm going to start marking items as "junk mail". Some mail filters need to be "trained" to work more effectively. So for the next couple of months, I'll see which of the three services will improve with "training". I'll let you know what I find.
Screenshots of Yahoo, Gmail, & Hotmail After 29 Days
Click thumbnail to view full-sizePrintShare it! — Rate it: up down flag this hub
Comments
Hey Michael,
This study was done in 2008.
I can see where you're coming from with regards to who you think won. However, what was important to me was what actually ended up IN my inbox. Those three addresses should've received the same amount of spam. Mail hosts often will block items that are undboubtedly spam from even getting to the users spam folder. So I can't judge it just on ratios of spam folder to inbox folder.
Excellent article and informative!
hmmm... I wonder if I should mark that as spam.......
I did the same experiment a long time ago... Gmail is the best hands down. It's by google after all, the number 1 "harvester."
Some unwanted message came through my hotmail advertizing bar telling me I'd won something, and wouldn't go away,until I gave some personal info. Then I received some spam, then it died down. I won't do that again, but was curious about what would happen.
The logic behind more mail in Junk for Gmail is pretty simple...they have unlimited stoarage so they block zero mails. All mails are delivered. But the spam is delevered to spam folder is where they Win. Again, its the same algorithm used for G search. And hotmail missing mails - they block email and do not deliver it once their filters recognize it as spam...Alas few legitimate mails get blocked too...that sucks. Now..am surprised how AOL was ommited from this test?
hello
ADD:lov_elin@live.com
Thanks for this post. It is a great articles.
One further point to add to gmails supremecy is that I have never had a false-positive: a non-spam email end up in the spam folder. With Yahoo and Hotmail, I've had emails from friends and emails that I have actually requested (eg password reminders) filed into the junk or bulk folders, which makes it just like another inbox I have to check. This has never happened with gmail.











Michael Clark says:
2 years ago
Actually, based on the numbers you've posted above, Yahoo should be in second place, and Hotmail should be in 3rd. Yahoo blocked correctly 59% of the spam, while Hotmail blocked 42%. You can't only use the number of messages that got into your inbox, you have to look at the number that didn't as well.
Was this study done in 2007 or 2008? It hasn't been 30 days yet since January 9th.