Announcing the new spam detector.

このエントリーをはてなブックマークに追加
1Code Monkey ★
Our new spam detector will detect spam in real time.

You can see the spam detector here:
http://stream.bbspink.com/spamindex.html

The page is regenerated every time the spam detector reads 10 new post replies.
You need to refresh the page manually.
The spam detector displays the top-ten spam candidates.
If there is no spam, then it displays the ten most recent posts.
"Total seen posts" is how many posts the spam detector has analyzed since the last reset.
The spam detector will periodically reset back to 0 total seen posts.

The "spam index" is a number assigned to each post. If the spam index number is 0 or 1, then that post is not spam.
The higher the spam index number, the more likely a post is to be spam.
The spam index number will slowly decrease back to zero if the spam stops.

Here is an example of spam that has been detected by the Spam Detector:
http://i.imgur.com/d5sFRLN.png

The spam detector is still being improved.
You can expect the detector algorithm to become better at detecting spam in the future.

If you want to help, then you can watch the spam detector and report any spam to the housekeeping board.
2xerxes.maido3.net@Apparently admin ★:2014/01/12(日) 21:44:56.34 ID:???
どもありがとうございますCodemonkey.
3 ◆f6tx3Tsqbo :2014/01/13(月) 17:48:47.02 ID:UwKTB3dW
Good job Ron.
4Code Monkey ★:2014/01/14(火) 16:54:17.45 ID:???
I will be working on the spam detector and restarting it periodically today.
5Code Monkey ★:2014/01/14(火) 17:58:50.34 ID:???
The spam detector will not display posts with a 0 or 1 spam index anymore.

If there is no detected spam, then it will say, "No Spam Detected".
http://i.imgur.com/FsvaJ0w.png
6Code Monkey ★:2014/01/14(火) 22:28:22.79 ID:???
I just added a post locator. You can now click "Locator" and retrieve a list of URLs where that specific spam has been posted.

The list of URLs will be reset once per day.
7xerxes.maido3.net@Apparently admin ★:2014/01/15(水) 15:22:20.55 ID:???
>>6
It is working well. It even finds troll posts. However it currently does
not do anything with the troll postings.
8名無し編集部員:2014/01/15(水) 22:12:38.39 ID:AWKewuDw
It is ok for now that Jim-san happen to know there are lots of trolls
everywhere in pink.

And it must be obvious by now that more than 80% of the total spams are
posted by a one particular spammer who uses (ad-55.com/party-boy/
secret-g.net/hpyvv.com/merry2.info/mankees.com/moonshining.net/
finderz.biz and so on) I hope there will be some kind of
preventive measure to come up with.
(voiding the spammer's ●, help bringing back ROCK system which
prevent particular word from posting, regulating spammer's ISP, etc)
9xerxes.maido3.net@Apparently admin ★:2014/01/16(木) 19:39:43.63 ID:???
Have you brought that up on the ccc board?
>>8
10xerxes.maido3.net@Apparently admin ★:2014/01/16(木) 22:49:51.39 ID:???
>>8
Is Rock system disabled again?
11名無し編集部員:2014/01/17(金) 12:17:37.91 ID:jTXni2Pl
>>9
No, because ccc is not functioning. Jack-san was not willing
to help even against spam.

example
  Tried ccc for spam reporting
     http://pele.bbspink.com/test/read.cgi/ccc/1380627185/
  Refusal by Jack-san. No advice whatsoever.
     http://pele.bbspink.com/test/read.cgi/erobbs/1372645155/84
     Jack: "I am not going to look at it at that point"
Final
Solution: Asked Jim-san to register the word to NG-word list and the case was closed.
     http://pele.bbspink.com/test/read.cgi/erobbs/1378224674/595,596,598
12名無し編集部員:2014/01/17(金) 12:23:41.12 ID:jTXni2Pl
>>10
Old ROCK system is still working, although I think behavior of it between pele and kilauea
server is somewhat different (kilauea server accept some NG word which pele server doesn't.
Maybe looking at different ROCK NG word list? It may mean it lost NG word list fetch feature
from 2ch central ROCK server now)
2ch ROCK system now lacks new NG word registration capability and only relying
on same old NG word list. The reason for it, I heard, was the developer
could not log in to the certain 2ch server after the registration system crash
and unable to re-construct the system.
13xerxes.maido3.net@Apparently admin ★:2014/01/17(金) 19:01:56.36 ID:???
>>12
We are working on something else. We will make Pink good. At this time
I can't help 2ch.
14名無し編集部員:2014/01/17(金) 21:26:23.71 ID:jTXni2Pl
>>13
Thank you for the reply. Since the spammer is posting spams
greater than consecutive posting limit and faster than consecutive
posting time limit, he/she must be using ● to break thru the
regulation. It may be good to void his ● ID to slow him down a bit, I think.
Anyway, I will be looking forward to "something else", if ISP regulation,
ROCK modification are not feasible. 200-300 spam posts 16 hours a day to specific
boards are just getting too much.
15※ ◆Rock54hC3G0C :2014/01/20(月) 01:36:40.56 ID:8M/u+NSY
Rock54は更新が止まっているだけです。
bbs.cgi内の"sub Is_Koukoku"が呼び出されている限り、古いNGWordリストを参照し続けています。
しかも効率の良くない方法で参照しているので、Is_Koukokuを呼ばないようにするのも手かもしれません。
たしか、名前、メール、本文を結合してregexpしているかと思います。
そしてNGwordはメタ文字で描かれています。
16xerxes.maido3.net@Apparently admin ★:2014/01/23(木) 13:44:25.32 ID:???
>>15
I was able to explain this to Codemonkey. Bells rang, steam engine began to move
and encoding begins. Thanks for the hint.
17Code Monkey ★:2014/01/24(金) 10:36:16.26 ID:???
>>15
Thank you. I am working on this now.
18Code Monkey ★:2014/01/26(日) 20:43:20.89 ID:???
My internet was broken all weekend. I will continue work on this now.
19Code Monkey ★:2014/01/26(日) 21:11:20.54 ID:???
>>15
What is the purpose of the md5 checksum in the Rock54.txt file?
20Code Monkey ★:2014/01/26(日) 23:18:19.24 ID:???
I have figured out what to do. I will begin implementation for it tomorrow. Now I will take a rest. Have a good evening.
21Code Monkey ★:2014/01/28(火) 01:12:38.98 ID:???
The new anti-spam system is now online for Pele.

If the spam detector detects spam over a certain spam-index threshold, then that spam will be added to the Rock54.txt file for `x` amount of minutes.
After the certain amount of minutes is complete, then it checks if the spam is still over the threshold or not.
If the spam is still over the threshold, then it will remain on the Rock54.txt for another `x` amount of minutes.

The spam-index threshold and amount of minutes to stay on Rock54 can be easily changed in the future.

Once spam is on the Rock54.txt, then it is business as usually for the Rock54 system.

If you encounter a bug with the system, please tell me on this thread. Have a good day!
22xerxes.maido3.net@Apparently admin ★:2014/01/28(火) 07:38:56.19 ID:???
>>21
どもありがとうございます。乙です。
23Code Monkey ★:2014/01/28(火) 10:47:17.99 ID:???
Installed on Kilauea now.
24xerxes.maido3.net@Apparently admin ★:2014/01/30(木) 21:10:45.32 ID:???
>>23
It is starting to be an effective tool.
Thank you.
25※ ◆Rock54hC3G0C :2014/01/30(木) 22:51:27.74 ID:Gf+YSkvX
wktk:)
26xerxes.maido3.net@Apparently admin ★:2014/01/31(金) 13:21:56.55 ID:???
It is exciting.
27名無し編集部員:2014/02/01(土) 11:58:53.68 ID:XwIZ61v2
To our unfortunate, the spammer started to change IP address between
every post since this morning, which void regular ROCK54.
http://pele.bbspink.com/test/read.cgi/erobbs/1390815733/255-256

hmmm....any possibility for SAKURA?

Note:) Regular Rock54 allows registered words to be posted twice or
three times from a given IP address in a day before blocking further
posting. SAKURA is the special registered word in Rock54 which never
allow the word to be posted even once. I have no idea that the Sakura
word is described in the Rock54 word lists though.
28名無し編集部員:2014/02/01(土) 12:11:35.67 ID:XwIZ61v2
Correction:
Wrong: I have no idea that the...
Right: I have no idea how the...

Maybe advice from ◆Rock54hC3G0C^-san as a developer of Rock54?
29※ ◆Rock54hC3G0C :2014/02/01(土) 20:06:29.07 ID:m539gcdE
既に削除されていますね。
Those contents already had been deleted... >>27
元々のNGワードが判れば、Rock54リストを眺めることは出来ます。
I can be searching a Rock54-list if the original word is known.

そういえば、BBRが動いていないのだった。。(BBXは動いていると思います)
When saying so, BBR was not moving.(I thinking that BBX is moving),
30名無し編集部員:2014/02/01(土) 20:27:51.18 ID:soKCzqTx
31※ ◆Rock54hC3G0C :2014/02/01(土) 20:39:43.16 ID:m539gcdE
ふむ。
手動で更新掛けてみる?(但し反応するのはbbspinkだけだったはず)
32※ ◆Rock54hC3G0C :2014/02/01(土) 21:06:43.59 ID:m539gcdE
401吐いてくる('A`)

寝ようw
33名無し編集部員:2014/02/01(土) 21:15:18.94 ID:soKCzqTx
にゃあ板でテストするために登録してそうなワードはどうでもいいとしても
ソープ板で埋め立てしてる人の分を逐次登録してそうだったり
何かさわってありそうだからやめた方がいい気が…
って書き込もうとしてたら失敗した後でしたか
34Code Monkey ★:2014/02/01(土) 22:15:59.19 ID:???
>>27
I have already implemented SAKURA words.
35Code Monkey ★:2014/02/01(土) 23:44:50.92 ID:???
My apologies. Something bad happened. I am investigating the problem now.
36Code Monkey ★:2014/02/01(土) 23:50:54.46 ID:???
At least we all know SAKURA words for Rock54 works correctly now. Sorry about that!
37Code Monkey ★:2014/02/02(日) 00:36:30.00 ID:???
Everything is fixed and back to normal now. Sorry about the inconvenience.
38名無し編集部員:2014/02/02(日) 14:15:43.99 ID:a9Woy5K6
>>34
Thank you for your great effort.
Somehow the spammer got it thru still.
http://pele.bbspink.com/test/read.cgi/erobbs/1390815733/290
(Remaining 30 posts out of 120 spam postings in an hour. Other
90 posts were already deleted.)
39Code Monkey ★:2014/02/02(日) 15:55:45.43 ID:???
>>38
Although, this one spammer managed to get through, there have been many spammers who have not been able to get through.
I am still tweaking the settings and fixing bugs in the new spam software. As the software matures, less spammers will be able to get through.
40xerxes.maido3.net@Apparently admin ★:2014/02/02(日) 16:17:19.25 ID:???
>>38-39
It is a cat and mouse game now.
41名無し編集部員:2014/02/02(日) 18:04:48.19 ID:a9Woy5K6
>>39
Thank you for the comments. I wonder why the spammer gets thru...
I noticed one behavior difference, he was posting to pub/hneta/kageki/kageki2/
pinkqa/sureh/pinkcafe boards mainly until late yesterday.
Today he posted 300 posts to pub board only. I suppose the Rock54 behavior
difference between kilauea and pele server exist? I hope you could check
for it, if you have time.
42Code Monkey ★:2014/02/02(日) 20:23:18.56 ID:???
>>41
I just made a new update to Rock54. Lets see if this can beat the spammers or not.
I dont think there is a difference between Rock54 on Pele and Kilauea. I will check that.
43名無し編集部員:2014/02/03(月) 16:46:22.68 ID:bF96vQou
Since new anti-spam program instaiied at pele and kilauea,
our posts are often failed in blackhole.
Please stop uncompleted program online until you fix aod complete it.
44名無し編集部員:2014/02/03(月) 17:03:56.22 ID:Cf3ilou8
スレッドのURLを貼れないのは痛いので
完全一致する場合のみに変更するなどできないでしょうか?

pele.bbspink.com/t e s t/read.cgi/erobbs/1383978434/
            ↑↑
45Code Monkey ★:2014/02/03(月) 18:12:29.22 ID:???
>>43
Okay. I understand.
46Code Monkey ★:2014/02/03(月) 18:14:48.42 ID:???
>>43
I have disabled the spam detector. It was too over-zealous. Sorry about the inconvenience.
47名無し編集部員:2014/02/03(月) 19:08:17.63 ID:0mtXWldJ
>>46
Thanks a lot for your replying,Code-Monkey san.
I wish newer program will help avoiding evil spams.
48名無し編集部員:2014/02/03(月) 23:22:04.44 ID:R99XF0Fs
>>47
You are welcome. I hope we can find a good spam solution.
49Code Monkey ★:2014/02/04(火) 18:42:46.74 ID:???
I have installed captcha on bbspink. It is currently only available on kilauea's meow board.
This will be a very good solution against spammers.

You can use this URL in your browser to test it:
http://kilauea.bbspink.com/test/read.cgi/meow/1374116859/

If you have any concerns, please talk to me.
50名無し編集部員:2014/02/04(火) 18:47:34.94 ID:vhv2n9df
>>49
wow,
It would better if it can distinguish "CAPTCHA empty" or "CAPTCHA invalid".
51Code Monkey ★:2014/02/04(火) 18:49:22.46 ID:???
>>50
It does distinguish "CAPTCHA empty" and "CAPTCHA invalid"
This is the error for "CAPTCHA empty": CAPTCHAを記入する必要があります
This is the error for "CAPTCHA invalid": ERROR:誤っCAPTCHA
52名無し編集部員:2014/02/04(火) 18:51:59.11 ID:vhv2n9df
>>51
well, my post is refused "ERROR:CAPTCHAを記入する必要があります" anyway...
53Code Monkey ★:2014/02/04(火) 18:54:42.39 ID:???
>>52
Are you using a PROXY?
54Code Monkey ★:2014/02/04(火) 18:56:29.66 ID:???
>>52
Give me 5 minutes, I will turn on debugging so we can see what the problem is.
55Code Monkey ★:2014/02/04(火) 18:58:45.22 ID:???
>>52
Okay debugging is on. Please try again and give me the results.
56名無し編集部員:2014/02/04(火) 19:00:13.35 ID:vhv2n9df
>>55
same error, and i don't use proxy.

ERROR:CAPTCHAを記入する必要があります
ip: 204.XX.XX.XX response:
57Code Monkey ★:2014/02/04(火) 19:04:29.16 ID:???
>>56
Lets try to figure out what is wrong:

Did you type the captcha into the box that says "Type the text"?
Are you using shift-jis keyboard? Maybe it only works with utf8 encoding?
Do you have javascript enabled in your browser?
58名無し編集部員:2014/02/04(火) 19:09:38.97 ID:vhv2n9df
>>57
I always input a captcha "hello hello". I type english only.
It is refused "CAPTCHAを記入する必要があります"
My browser is google chrome.
59xerxes.maido3.net@Apparently admin ★:2014/02/04(火) 19:11:49.07 ID:???
>>58
Please try again. Maybe you typed it wrong. I made a mistake my first
time typing p instead of P.
60Code Monkey ★:2014/02/04(火) 19:22:50.84 ID:???
>>58
Are you using a desktop computer, laptop, or a mobile phone?
61名無し編集部員:2014/02/04(火) 19:28:47.34 ID:vhv2n9df
I type true captcha, windows chrome. but same error
62名無し編集部員:2014/02/04(火) 19:31:18.40 ID:vhv2n9df
Chrome debugger message

FROM:test
mail:aa
recaptcha_challenge_field:03AHJ_Vuu-d4ryXtkm8k6vH_cJm0_dEeylns5e5Tg5r-sQ3F5_mMECq3NZGvKpp
0pM9qYXbUoSNr3rWdnS5yEFWC_lDZrBQ0P0WNoIQVu3-t7eyWKpCOMDjERT-HIfolceUQNxHQDFdRa
9OFDAgk7mt0iUwwRJZAm4OBnP1_H5bvl9S1bsdjXmtBo
recaptcha_response_field:ntryeur seen
MESSAGE:aaa
bbs:meow
key:1374116859
time:1104688508
63Code Monkey ★:2014/02/04(火) 19:34:31.57 ID:???
>>62
Your debug message looks correct. I dont see any problem with it. Im not sure why it doesnt work.
It works correctly on my opera, chrome, and firefox on Mac OSX. I have not tested on Windows yet.
64Code Monkey ★:2014/02/04(火) 19:44:16.68 ID:???
I think I know what the problem is. Give me a few minutes to make the solution.
65Code Monkey ★:2014/02/04(火) 20:27:07.92 ID:???
Does it work now? I just made a few changes.
66Code Monkey ★:2014/02/06(木) 00:09:07.23 ID:???
67Code Monkey ★:2014/02/06(木) 21:26:14.33 ID:???
I have made some changes today.
68名無し編集部員
>>65
works! thank you.