Statistics
| Branch: | Tag: | Revision:

root / lib @ master

# Date Author Comment
90da63dd 01/16/2012 04:34 PM Hiroyuki Yamamoto

fixed compilation error because of missing config.h inclusion.

2d9cf61c 01/13/2012 03:48 PM Hiroyuki Yamamoto

updated documents.

a1de4e94 01/10/2012 05:36 PM Hiroyuki Yamamoto

added --with-libsylph configure option which enables the use of external
libsylph.

351eb643 11/17/2011 01:45 PM Hiroyuki Yamamoto

added missing lib/filter-kvs-gdbm.[ch] to the repository.

eabb1ee9 11/09/2011 05:10 PM Hiroyuki Yamamoto

textcontent-filter.c: modified Received: header parser (remove newlines and id)

610bbd17 10/28/2011 05:48 PM Hiroyuki Yamamoto

added option to specify database dir.

747cfa3a 10/19/2011 02:57 PM Hiroyuki Yamamoto

only use important part of Received header. Fixed status output.

611af83f 10/19/2011 01:17 PM Hiroyuki Yamamoto

made verbose mode have several levels. Improved verbose status output.

1876b294 10/13/2011 04:50 PM Hiroyuki Yamamoto

win32: convert locale filename to UTF-8.

223a9416 10/12/2011 02:28 PM Hiroyuki Yamamoto

changed the default of robs to 1.0.

74d66af9 10/12/2011 02:08 PM Hiroyuki Yamamoto

fixed Robinson-Fisher combined probability calculation (wrong N was
passed)
min-dev, robs, robx can be configured by command-line option now.

d0643362 10/06/2011 03:47 PM Hiroyuki Yamamoto

bayes-filter.c: modified s parameter of Fisher method (1 -> 0.02).

f8d23451 10/06/2011 10:59 AM Hiroyuki Yamamoto

sylfilter: added option to specify filtering method.

cd92d070 10/05/2011 04:27 PM Hiroyuki Yamamoto

also use total word number for Robinson-Fisher scale factor.

f29deabd 10/05/2011 03:22 PM Hiroyuki Yamamoto

implemented Robinson-Fisher method to calculate combined probability.

b66a0587 09/22/2011 03:07 PM Hiroyuki Yamamoto

added APIs for global configuration. Added no-bias option.

ef372ee8 09/22/2011 01:33 PM Hiroyuki Yamamoto

add AC_CANONICAL_SYSTEM to configure.ac for target variable.

f10b98d6 09/21/2011 02:31 PM Hiroyuki Yamamoto

added --enable-windows to configure.

e2dc4a59 09/21/2011 01:28 PM Hiroyuki Yamamoto

Add GDBM support.
Add mode switch for standalone and libsylph app.

3c215c37 09/16/2011 03:50 PM Hiroyuki Yamamoto

changed n-gram processing to 4-gram.

a88bc9d0 09/15/2011 04:31 PM Hiroyuki Yamamoto

implemented trigram filter in wordsep-filter.

a555b3db 09/13/2011 03:43 PM Hiroyuki Yamamoto

fixed filter-utils.c. Updated NEWS and README.

54c569fb 09/13/2011 02:23 PM Hiroyuki Yamamoto

use APPDATA for Windows data dir.

d8d2c92d 09/13/2011 11:26 AM Hiroyuki Yamamoto

made status.dat robust.

63e002d0 09/12/2011 05:58 PM Hiroyuki Yamamoto

removed unrequired freopen().

d75428f4 09/12/2011 05:47 PM Hiroyuki Yamamoto

use plain text file to store status.

fbcd41fa 09/08/2011 05:12 PM Hiroyuki Yamamoto

bayes-filter.c: use transaction for prob.db update.

1a30f58b 09/05/2011 12:09 PM Hiroyuki Yamamoto

sqlite_foreach: pass kvs object to callback corrently.

5e5a7e6a 09/05/2011 12:00 PM Hiroyuki Yamamoto

suppress error message on sqlite engine init.

0b67a65a 09/02/2011 04:55 PM Hiroyuki Yamamoto

speedup learning.

d1c95f4e 09/02/2011 04:18 PM Hiroyuki Yamamoto

speedup classifying.

ed122a7f 09/02/2011 01:54 PM Hiroyuki Yamamoto

added filter-private.h to distribution.

fca7eb7e 09/01/2011 06:01 PM Hiroyuki Yamamoto

introduced limit of max token length.

9f5f77e3 09/01/2011 03:40 PM Hiroyuki Yamamoto

explicitly use 32bit integer type.

fd8e2542 09/01/2011 02:43 PM Hiroyuki Yamamoto

addes SQLite3 support.

aebfd4cc 08/31/2011 04:07 PM Hiroyuki Yamamoto

Made the license BSD-like one.

fb7b6f35 08/31/2011 01:36 PM Hiroyuki Yamamoto

textcontent-filter.c: remove garbage lines (such as base64 data)

d50abb95 08/30/2011 05:02 PM Hiroyuki Yamamoto

added APIs to set base directory.

4b7e2419 08/30/2011 03:59 PM Hiroyuki Yamamoto

changed probability denominator from message number to word number to lessen the bias.

9b245a85 08/30/2011 03:30 PM Hiroyuki Yamamoto

extract all text parts and filenames.

da8a1280 08/30/2011 11:44 AM Hiroyuki Yamamoto

weighted probability for small frequency number of words.

6fb72384 08/30/2011 10:57 AM Hiroyuki Yamamoto

check for QDBM on configure.

a0b81e12 08/29/2011 05:24 PM Hiroyuki Yamamoto

implemented unregister of messages.

6177032a 08/29/2011 04:48 PM Hiroyuki Yamamoto

link libsylph-builtin to libsylfilter.

519f8cf9 08/29/2011 03:26 PM Hiroyuki Yamamoto

use fixed db path under ~/.sylfilter .

fc4bd9f7 08/29/2011 02:59 PM Hiroyuki Yamamoto

add parameter for directory path to xfilter_bayes_db_init().

cfadedec 08/29/2011 11:55 AM Hiroyuki Yamamoto

lib/filters/bayes-filter.c: skip if either junk or clean database is
empty.
src/sylfilter.c: fixed bulk learning.

704a6ae7 08/25/2011 06:11 PM Hiroyuki Yamamoto

enabled multiple file testing. Fixed error output.

0113a62c 08/25/2011 04:49 PM Hiroyuki Yamamoto

implemented debug mode switch.

ce81a473 08/25/2011 03:47 PM Hiroyuki Yamamoto

handle URL in word separator.

fe4d11cc 08/25/2011 01:44 PM Hiroyuki Yamamoto

modified word-separator.

8d7dcace 08/25/2011 01:14 PM Hiroyuki Yamamoto

added built-in libsylph, and use it from textcontent-filter.c.

3815f7e2 08/24/2011 05:43 PM Hiroyuki Yamamoto

commented out debug output (wordsep-filter.c)

940d391b 08/24/2011 05:38 PM Hiroyuki Yamamoto

break after full-width alphabets.

3e93864c 08/24/2011 04:34 PM Hiroyuki Yamamoto

removed unused code in bayes-filter.c.

5c9fbf02 08/24/2011 03:57 PM Hiroyuki Yamamoto

tuned probs of clean-only words.

f1db2e5b 08/24/2011 03:47 PM Hiroyuki Yamamoto

fixed word separator.

34ae426c 08/24/2011 03:20 PM Hiroyuki Yamamoto

implemented word degeneration.

54aea252 08/23/2011 06:01 PM Hiroyuki Yamamoto

also parse specific headers.

93ecf147 08/22/2011 05:17 PM Hiroyuki Yamamoto

add bias for junk-only tokens.

e260dbfd 08/22/2011 05:04 PM Hiroyuki Yamamoto

sylfilter: allow multiple file input.

fd3b9e72 08/22/2011 04:39 PM Hiroyuki Yamamoto

treat some special characters word-letters.

afc49e81 08/22/2011 03:24 PM Hiroyuki Yamamoto

drop two-letters hiragana.

15b78962 08/22/2011 03:06 PM Hiroyuki Yamamoto

modified debug output.

af7ecefa 08/22/2011 02:01 PM Hiroyuki Yamamoto

added option to show learning status.

4cab1247 08/22/2011 01:03 PM Hiroyuki Yamamoto

renamed old sylfilter.c to sylfilter-test.c and added new sylfilter.c.

faa55f07 08/18/2011 06:30 PM Hiroyuki Yamamoto

implemented basic bayesian filter.

c6867d94 08/18/2011 03:01 PM Hiroyuki Yamamoto

removed redundant code.

28703c7f 08/18/2011 02:06 PM Hiroyuki Yamamoto

modified interface of XFilter result. Added API to open/close bayes db.

29dd8dfb 08/17/2011 04:43 PM Hiroyuki Yamamoto

added API to get kvs total sum.

b45b0705 08/17/2011 04:13 PM Hiroyuki Yamamoto

added API to get kvs record number.

761f2955 08/17/2011 03:20 PM Hiroyuki Yamamoto

implemented KVS APIs and QDBM implementation.

ebcfee46 08/17/2011 12:53 PM Hiroyuki Yamamoto

don't normalize case.

cbb0d1ac 08/16/2011 05:06 PM Hiroyuki Yamamoto

drop OTHER_SYMBOL on word separator.

de7bb84e 08/16/2011 04:23 PM Hiroyuki Yamamoto

bayes-filter.c: added word-count func.

5a583287 08/16/2011 02:37 PM Hiroyuki Yamamoto

implemented simple stopword.

ccd4115d 08/16/2011 11:17 AM Hiroyuki Yamamoto

Implemented simple word separator.

ff656913 08/10/2011 10:26 AM Hiroyuki Yamamoto

added a function to read message files.

56393467 08/09/2011 04:22 PM Hiroyuki Yamamoto

added xfilter_manager_add_filters().

4012ec30 08/09/2011 04:05 PM Hiroyuki Yamamoto

Initial commit