Ignore List for Learning Filter?

For all users, who don't speak German!

Moderator: Forum-Team

Ignore List for Learning Filter?

Beitragvon bbfi » 17. Mär 2004, 16:49

Is there a way to implement an Ignore List for the Learning (Bayesian) Filter? Other spam checkers like SpamPal and G-Lock SpamCombat have this feature. :!:

For instance, I have all of my emails checked by an antivirus checker (Avast) and the word Avast (85 -good, 3 - bad) appears in many emails. The word prisonministry (74 -good, 117 - bad) does also. And this occurs for many other words too. :?

It would be a good feature to be able to ignore these words. And wouldn't these words mess up the Learning Filter and its ability to learn? :(

Also, I'd like to say that the new version 0.9.8 appears to be working better than the last version which I stopped using last year because too many spams were getting through. Thanks for the improvement. :D
WinXP Home SP1 - Pentium 4 - 1.5 GHz - 512MB RAM
True Launch Bar 3.0 - Firefox 0.9.3 - Thunderbird 0.7.3
Spamihilator 0.9.8.3 - Avast 4.1 - Kerio Firewall 4.1.0B5
Benutzeravatar
bbfi
Spam-Terminator
Spam-Terminator
 
Beiträge: 52
Registriert: 27. Dez 2003, 20:51
Wohnort: USA

Re: Ignore List for Learning Filter?

Beitragvon Bob Loeffler » 22. Mär 2004, 04:16

s there a way to implement an Ignore List for the Learning (Bayesian) Filter?


Currently there isn't any way to do this, but I'm sure Michel will put this on his "wish list" for possible implementation in a future version of Spamihilator.

nd wouldn't these words mess up the Learning Filter and its ability to learn? :(


If these non-spam words appear many times in spam mails, then yes, it could mess up the Learning Filter a little.

lso, I'd like to say that the new version 0.9.8 appears to be working better than the last version which I stopped using last year because too many spams were getting through. Thanks for the improvement. :D


This is good to hear, bbfi!

Regards,

Bob
- Spamihilator questions and answers in English!
Author of these plugins and filters: Attachment Extensions Filter, Empty Mail Filter, HTML Links Filter, No Comment! Filter, Plain Text Links Filter, Scripts Filter, Unclassified Filter, Export Senders Plugin and Filter Statistics Plugin.
Benutzeravatar
Bob Loeffler
 
Forum-Team
Plugin-Programmierer
 
Beiträge: 1132
Registriert: 5. Dez 2003, 20:20
Wohnort: Colorado, USA
Nach oben

Re: Ignore List for Learning Filter?

Beitragvon bbfi » 23. Mär 2004, 00:55

Thanks for the reply Bob. I did an experiment with the order that Avast and Spamihilator check the emails. I noticed that a guy by the name of Technical (from the Avast forum), who has been using Spamihilator for a while, had a different setup then me.

My settings: Pop3ServerName&UserName#127.0.0.1:port
Technical's settings: localhost&UserName#Pop3ServerName

I used the spami-wordlist-extractor and viewed both the good.spamihilator and bad.spamihilator word lists.

Using my configuration for 10 days, I had these results for certain words that Avast writes to the email as a notification of it being checked -

Good Words List
Avast - 142
Alwil - 67
VPS - 21
Bad Words List
Avast - 17
Alwil - 2
VPS - 6

Using Technical's configuration for 1 day, I had these results for certain words -

Good Words List
Avast - 74
Alwil - 32
VPS - 28
Bad Words List
Avast - 287
Alwil - 120
VPS - 116

So it appears to me that Technical's configuration is causing Spamihilator's Learning Filter to add these Avast words to it's good and bad lists therefore messing up the filter. :cry:

Until Michel implements an Ignore List for the Learning (Bayesian) Filter, I believe that if one has a antivirus write a notification that appears on the email, then they should make sure that Spamihilator checks the email first, then the antivirus checker, otherwise the notification words will be placed in the Learning Filter. :?
WinXP Home SP1 - Pentium 4 - 1.5 GHz - 512MB RAM
True Launch Bar 3.0 - Firefox 0.9.3 - Thunderbird 0.7.3
Spamihilator 0.9.8.3 - Avast 4.1 - Kerio Firewall 4.1.0B5
Benutzeravatar
bbfi
Spam-Terminator
Spam-Terminator
 
Beiträge: 52
Registriert: 27. Dez 2003, 20:51
Wohnort: USA

Re: Ignore List for Learning Filter?

Beitragvon michel » 24. Mär 2004, 14:54

Hi!

There will be an Ignore-List in the next Spamihilator release. Please stay tuned! ;-)

Sincerely
Michel Krämer
Chuck Norris doesn't kill Spam. He uses Spamihilator! ;-)
Benutzeravatar
michel
Administrator
Administrator
 
Administration
Beta-Tester
Forum-Team
Plugin-Programmierer
 
Beiträge: 4335
Registriert: 22. Mär 2003, 01:16
Wohnort: Buseck

Re: Ignore List for Learning Filter?

Beitragvon Bob Loeffler » 24. Mär 2004, 19:11

Awesome!!! Thanks Michel!

Bob
- Spamihilator questions and answers in English!
Author of these plugins and filters: Attachment Extensions Filter, Empty Mail Filter, HTML Links Filter, No Comment! Filter, Plain Text Links Filter, Scripts Filter, Unclassified Filter, Export Senders Plugin and Filter Statistics Plugin.
Benutzeravatar
Bob Loeffler
 
Forum-Team
Plugin-Programmierer
 
Beiträge: 1132
Registriert: 5. Dez 2003, 20:20
Wohnort: Colorado, USA

Re: Ignore List for Learning Filter?

Beitragvon bbfi » 24. Mär 2004, 22:46

Michel,

Thank you for the info and the future implementation of an ignore list. I look forward to the next version. This was the only thing I really missed when I switched from SpamPal. :cry:

I have two questions about the ignore list you will add in the next version.
1) Will there also be a minimum amount of letters that could be ignored? For instance, all words 3 letters or less will be ignored.
2) What will happen to all the words that have already been added to the learning filter that we would like to be ignored? Will they still be there or will the ignore list automatically erase them? :?:

I really appreciate your help and your Spamihilator program. Keep up the good work. Thanks. :D
WinXP Home SP1 - Pentium 4 - 1.5 GHz - 512MB RAM
True Launch Bar 3.0 - Firefox 0.9.3 - Thunderbird 0.7.3
Spamihilator 0.9.8.3 - Avast 4.1 - Kerio Firewall 4.1.0B5
Benutzeravatar
bbfi
Spam-Terminator
Spam-Terminator
 
Beiträge: 52
Registriert: 27. Dez 2003, 20:51
Wohnort: USA

Re: Ignore List for Learning Filter?

Beitragvon michel » 25. Mär 2004, 14:54

) Will there also be a minimum amount of letters that could be ignored? For instance, all words 3 letters or less will be ignored.

This is already implemented in the current version. The Learning Filter doesn't log words shorter than 3 characters or longer than 20 characters. This is really efficient.
) What will happen to all the words that have already been added to the learning filter that we would like to be ignored? Will they still be there or will the ignore list automatically erase them? :?:

You can use the improved compact feature to delete all these words.

Sincerely
Michel Krämer
Chuck Norris doesn't kill Spam. He uses Spamihilator! ;-)
Benutzeravatar
michel
Administrator
Administrator
 
Administration
Beta-Tester
Forum-Team
Plugin-Programmierer
 
Beiträge: 4335
Registriert: 22. Mär 2003, 01:16
Wohnort: Buseck
Nach oben

Re: Ignore List for Learning Filter?

Beitragvon bbfi » 25. Mär 2004, 20:00

his is already implemented in the current version. The Learning Filter doesn't log words shorter than 3 characters or longer than 20 characters. This is really efficient.

I didn't know that. Thanks. :)

ou can use the improved compact feature to delete all these words.

Yes, I know about the compact feature, but if I used that to delete a certain word which has 500 occurrences, wouldn't this also delete every other word with occurrences of 500 and less? If so, it would wipe out most of the training of the filter. Right? Then I would have to basically start from scratch. :cry:

My friend, Technical, just posted his findings after running the spami-wordlist-extractor and they are -

Good Words List
Avast - 4579
Alwil - 1159
VPS - 80

Bad Words List
Avast - 235
Alwil - 0
VPS - 0

If he were to compact the filter using 4,579, it would definitely put him back to the beginning for training the filter. :roll:
WinXP Home SP1 - Pentium 4 - 1.5 GHz - 512MB RAM
True Launch Bar 3.0 - Firefox 0.9.3 - Thunderbird 0.7.3
Spamihilator 0.9.8.3 - Avast 4.1 - Kerio Firewall 4.1.0B5
Benutzeravatar
bbfi
Spam-Terminator
Spam-Terminator
 
Beiträge: 52
Registriert: 27. Dez 2003, 20:51
Wohnort: USA
Nach oben

Re: Ignore List for Learning Filter?

Beitragvon Bob Loeffler » 26. Mär 2004, 06:21

hat will happen to all the words that have already been added to the learning filter that we would like to be ignored? Will they still be there or will the ignore list automatically erase them?


@Michel: Maybe Spami can automatically delete all words from the Spam and Non-spam Lists that are in the Ignore List. For example, if bbfi puts "Avast" in his Ignore List, then the next time he uses the Compact feature, Spami could search the spam and non-spam lists for that word and delete them if found. It could be a user-selectable checkbox (e.g. "Delete words from the Spam and Non-Spam lists if found in the Ignore list") in the Compact dialog window. It would default to "enabled" but the user could disable it if he wants to.

Bob
- Spamihilator questions and answers in English!
Author of these plugins and filters: Attachment Extensions Filter, Empty Mail Filter, HTML Links Filter, No Comment! Filter, Plain Text Links Filter, Scripts Filter, Unclassified Filter, Export Senders Plugin and Filter Statistics Plugin.
Benutzeravatar
Bob Loeffler
 
Forum-Team
Plugin-Programmierer
 
Beiträge: 1132
Registriert: 5. Dez 2003, 20:20
Wohnort: Colorado, USA
Nach oben

Re: Ignore List for Learning Filter?

Beitragvon Andreas_Z » 26. Mär 2004, 08:05

Yes!

That is a good idea.

Greetings Andreas
Core i7 3,4 GHz, 8 GB RAM, Win7 64bit SP1, GDATA Bussiness 11.0
Exchange-Server 2003, VM mit WinXP Pro SP3.
, ,
Benutzeravatar
Andreas_Z
Administrator
Administrator
 
Administration
Beta-Tester
Forum-Team
 
Beiträge: 4380
Registriert: 6. Nov 2003, 08:10
Wohnort: Schwielowsee, Germany

Re: Ignore List for Learning Filter?

Beitragvon michel » 26. Mär 2004, 13:35

@Bob: That's what I meant! ;-) ;-)

Sincerely
Michel Krämer
Chuck Norris doesn't kill Spam. He uses Spamihilator! ;-)
Benutzeravatar
michel
Administrator
Administrator
 
Administration
Beta-Tester
Forum-Team
Plugin-Programmierer
 
Beiträge: 4335
Registriert: 22. Mär 2003, 01:16
Wohnort: Buseck

Re: Ignore List for Learning Filter?

Beitragvon Bob Loeffler » 26. Mär 2004, 20:14

Bob: That's what I meant! ;-) ;-)


@Michel: Cool!!!!!!!!!!!!!!!!!!!!!!!!!!!! :-)

Hey, nice bunny rabbit ears! :roll:

Bob
- Spamihilator questions and answers in English!
Author of these plugins and filters: Attachment Extensions Filter, Empty Mail Filter, HTML Links Filter, No Comment! Filter, Plain Text Links Filter, Scripts Filter, Unclassified Filter, Export Senders Plugin and Filter Statistics Plugin.
Benutzeravatar
Bob Loeffler
 
Forum-Team
Plugin-Programmierer
 
Beiträge: 1132
Registriert: 5. Dez 2003, 20:20
Wohnort: Colorado, USA
Nach oben

Re: Ignore List for Learning Filter?

Beitragvon bbfi » 26. Mär 2004, 23:54

Michel,

Thanks. :D :D :D :D

Any ideas when this will become a reality? :wink:
WinXP Home SP1 - Pentium 4 - 1.5 GHz - 512MB RAM
True Launch Bar 3.0 - Firefox 0.9.3 - Thunderbird 0.7.3
Spamihilator 0.9.8.3 - Avast 4.1 - Kerio Firewall 4.1.0B5
Benutzeravatar
bbfi
Spam-Terminator
Spam-Terminator
 
Beiträge: 52
Registriert: 27. Dez 2003, 20:51
Wohnort: USA

Re: Ignore List for Learning Filter?

Beitragvon michel » 27. Mär 2004, 14:03

At the moment there are still some bugs, which have to be fixed first. I think this will take some time.... :-(

Sincerely
Michel Krämer
Chuck Norris doesn't kill Spam. He uses Spamihilator! ;-)
Benutzeravatar
michel
Administrator
Administrator
 
Administration
Beta-Tester
Forum-Team
Plugin-Programmierer
 
Beiträge: 4335
Registriert: 22. Mär 2003, 01:16
Wohnort: Buseck

Re: Ignore List for Learning Filter?

Beitragvon bbfi » 3. Mai 2004, 21:23

t the moment there are still some bugs, which have to be fixed first. I think this will take some time....

Michel,

Any updates on how this is coming along? :roll:
WinXP Home SP1 - Pentium 4 - 1.5 GHz - 512MB RAM
True Launch Bar 3.0 - Firefox 0.9.3 - Thunderbird 0.7.3
Spamihilator 0.9.8.3 - Avast 4.1 - Kerio Firewall 4.1.0B5
Benutzeravatar
bbfi
Spam-Terminator
Spam-Terminator
 
Beiträge: 52
Registriert: 27. Dez 2003, 20:51
Wohnort: USA
Nach oben


Zurück zu English Forum

Wer ist online?

Mitglieder in diesem Forum: 0 Mitglieder und 0 Gäste

cron

 industrious-southeast