Changesets: NewsStats

next b31f7850

2012-10-12 23:36:17

thh

Details Diff
Improve INSTALL documentation.

Fix wrong example for newsfeeds entry (lacking
backslashes).

Fix typos, update copyright, improve phrasing.

Signed-off-by: Thomas Hochstein <thh@inter.net>
Attach Issues:
mod - doc/INSTALL Diff File

next 435a9978

2012-10-12 23:35:34

thh

Details Diff
README: Update copyright notice.

Signed-off-by: Thomas Hochstein <thh@inter.net>
Attach Issues:
mod - doc/README Diff File

next 98563c61

2012-10-12 23:27:54

thh

Details Diff
Refactor database initialisation in feedlog.pl.

* Move database initialisation to a separate function.

* (Re-)try to connect every five seconds
(instead of going into an endless loop) and
log successful (re-)connections.

* Log postings that are dropped due to database failures
to syslog (Message-ID) for recovery.

* If the connection to the database is lost, try to
recover it (every five seconds) and try again to
write the pending data.

* Input will be buffered automatically by INN until
feedlog is able to process it (see man 5 newsfeeds).

Fixes 0000030, 0000031.

Signed-off-by: Thomas Hochstein <thh@inter.net>
Affected Issues
0000030, 0000031
mod - feedlog.pl Diff File
mod - doc/TODO Diff File

next 93c8eae2

2012-05-27 13:53:29

thh

Details Diff
Change interpretation of --checkgroups to template

In most hierarchies, the list of valid newsgroups will
change over time, so you'll have to use another
checkgroups file for each month. gatherstats will now
understand the value of --checkgroups to be a template
and amend it with each month it is processing.

Documentation changed accordingly.

Signed-off-by: Thomas Hochstein <thh@inter.net>
Attach Issues:
mod - gatherstats.pl Diff File

next 7662b106

2012-05-27 13:33:11

thh

Details Diff
Be more fault-tolerant when reading checkgroups.

* Accept lines starting with whitespace.

* Drop empty "groups", i.e. lines containing only
whitespace.

Signed-off-by: Thomas Hochstein <thh@inter.net>
Attach Issues:
mod - NewsStats.pm Diff File

next 0dc13b39

2012-05-27 13:31:49

thh

Details Diff
Remove call to &Bleat where not appropriate.

Some warn()ings are used for debugging purposes.

Signed-off-by: Thomas Hochstein <thh@inter.net>
Attach Issues:
mod - NewsStats.pm Diff File

next 1fa94799

2012-05-27 12:32:58

thh

Details Diff
Adapt install.pl to new coding style.

* Switch to Getopt::Long, change coding style;
limit line length.

* Replace 'die' and 'warn' by calls to &Bleat().

* Completely changed options due to new
GetOpt::Long processing.

* Adapt to changes in NewsStats.pm

* Redo documentation.

* Update TODO.

Signed-off-by: Thomas Hochstein <thh@inter.net>
Attach Issues:
mod - install/install.pl Diff File
mod - doc/TODO Diff File

next f05ec4ae

2012-05-27 12:30:14

thh

Details Diff
Adapt feedlog.pl to new coding style.

* Switch to Getopt::Long, change coding style;
limit line length.

* Completely changed options due to new
GetOpt::Long processing.

* Adapt to changes in NewsStats.pm

* Redo documentation.

* Update TODO.

Signed-off-by: Thomas Hochstein <thh@inter.net>
Attach Issues:
mod - feedlog.pl Diff File
mod - doc/TODO Diff File

next 314e31aa

2012-05-27 12:00:14

thh

Details Diff
Allow more characters in TLH definitions.

TLH may now also contain literal dots '.',
allowing for using second or third level
hierarchies as "TLH". To faciliate that,
'+' and '-' will be allowed, too.

Signed-off-by: Thomas Hochstein <thh@inter.net>
Attach Issues:
mod - gatherstats.pl Diff File

next 7773fb6d

2012-05-27 11:58:32

thh

Details Diff
Match TLHs correctly, not only partially.

The TLH was checked to match the beginning
of the newsgroup name, not the whole TLH part.
So the TLH "de" would match not only "de.test",
but also "denver.test", which was not the
desired outcome.

Signed-off-by: Thomas Hochstein <thh@inter.net>
Attach Issues:
mod - gatherstats.pl Diff File

next 43a0fc77

2012-05-27 11:56:06

thh

Details Diff
Fix parsing of more than one TLH in config.

The code introduced in 17ffbebad562acd3af71328cdbf187297b5a9e6d
did not check the correct variable for being an array.

Improve an unrelated comment, too.

Signed-off-by: Thomas Hochstein <thh@inter.net>
Attach Issues:
mod - gatherstats.pl Diff File

next 880c3eb2

2012-05-07 18:29:25

thh

Details Diff
Adapt gatherstats.pl to new coding style.

* Switch to Getopt::Long, change coding style;
limit line length.

* Replace 'die' and 'warn' by calls to &Bleat().

* Completely changed options due to new
GetOpt::Long processing.
- merged -m/-p into --month

* Adapt to changes in NewsStats.pm

* Redo documentation.

* Update TODO.

Signed-off-by: Thomas Hochstein <thh@inter.net>
Attach Issues:
mod - doc/TODO Diff File
mod - gatherstats.pl Diff File
mod - NewsStats.pm Diff File

master 3c7a7dfe

2012-05-07 15:53:52

thh

Details Diff
Merge branch 'tools' into pu

* tools:
Add tools directory, move untracked stuff top /tmp
Attach Issues:

master fe46be21

2012-05-04 05:41:02

thh

Details Diff
Add tools directory, move untracked stuff top /tmp

Signed-off-by: Thomas Hochstein <thh@inter.net>
Attach Issues:
mod - .gitignore Diff File

next edd250f2

2012-05-02 16:11:43

thh

Details Diff
Complete rewrite of groupstats.pl and NewsStats.pm.

* Switch to Getopt::Long, change coding style;
limit line length.

* Replace 'die' and 'warn' by calls to &Bleat().

* Completely redo options and processing:
- merge -m/-p/-a into --month
- replace -i/-q/-d with - much more powerful -
--group-by/--order-by
- replace -t/-l with - much more powerful -
--lower/--upper/--boundary
- remove -b and replace it with --report

Fixes 0000033.

* Add new report types, boundaries and sorting options:
- report types 'average' and 'sums'
- boundaries 'average' and 'sums'
- upper and/or lower boundary
- sort output independently

Issue 0000035.
Fixes 0000034, 0000038.

* Add possibility to cross-check newsgroups against
checkgroups file.

* Complete rewrite of groupstats.pl internal logic:
- modularize construction fo SQL queries
- remove unnecessary special cases
- refactor code into NewsStats.pm functions as much
as possible

Issue 0000037.
Fixes 0000036.

* Rework output formats, fix padding problem by making use
of modularized SQL queries.

Fixes 0000015, 0000032.

* Add some more consistency checks.

Issue 0000012.

* Redo documentation.

* Update TODO list.

Signed-off-by: Thomas Hochstein <thh@inter.net>
Affected Issues
0000012, 0000015, 0000032, 0000033, 0000034, 0000035, 0000036, 0000037, 0000038
mod - groupstats.pl Diff File
mod - NewsStats.pm Diff File
mod - doc/TODO Diff File

next 36cffe7a

2011-01-12 15:41:21

thh

Details Diff
Add database creation to installer.

It's not enough to create tables, one should
create the database first if it is still
missing ...

Signed-off-by: Thomas Hochstein <thh@inter.net>
Attach Issues:
mod - install/install.pl Diff File

next da6fc073

2011-01-12 15:39:10

thh

Details Diff
Handle undefined previous version when installing.

$OptUpdate is undefined when not upgrading, so don't
prepare an upgrade notice to avoid calling an
undefined variable.

Signed-off-by: Thomas Hochstein <thh@inter.net>
Attach Issues:
mod - install/install.pl Diff File

master 17ffbeba

2010-11-01 20:45:35

thh

Details Diff
gatherstats.pl: Allow for more than one TLH in config.

New syntax for TLH: tlh1:tlh2:tlh3
Check for illegal characters and reformat to RegExp.

Signed-off-by: Thomas Hochstein <thh@inter.net>
Attach Issues:
mod - gatherstats.pl Diff File

master a02fdc16

2010-11-01 20:38:07

thh

Details Diff
Documentation: Add ChangeLog

Signed-off-by: Thomas Hochstein <thh@inter.net>
Attach Issues:
add - doc/ChangeLog Diff File

master 06402a25

2010-11-01 20:28:48

thh

Details Diff
Update To-Do list.

Signed-off-by: Thomas Hochstein <thh@inter.net>
Attach Issues:
mod - doc/TODO Diff File

master 71f0178b

2010-11-01 17:51:26

thh

Details Diff
gatherstats.pl: Change database update mechanism.

DELETE old records and INSERT (INTO) the new ones
instead of just REPLACEing them, which will not
remove wrong entries (i.e. non-existing newsgroups).

Signed-off-by: Thomas Hochstein <thh@inter.net>
Attach Issues:
mod - gatherstats.pl Diff File

master 89db2f90

2010-11-01 16:53:14

thh

Details Diff
gatherstats.pl: Move TLH check to NewsStats.pm.

Signed-off-by: Thomas Hochstein <thh@inter.net>
Attach Issues:
mod - gatherstats.pl Diff File
mod - NewsStats.pm Diff File

master ad609792

2010-11-01 16:04:05

thh

Details Diff
gatherstats.pl: Add '-l' option.

Add '-l' option to check newsgroup names against a list of valid
newsgroups read from a file (each group on one line, ignoring
everything after the first whitespace and so accepting files in
checkgroups format as well as (parts of) an INN active file).
New ReadGroupList().
Change ListNewsgroups() accordingly.
Amend documentation accodingly.

See 0000017.

Signed-off-by: Thomas Hochstein <thh@inter.net>
Attach Issues:
mod - NewsStats.pm Diff File
mod - gatherstats.pl Diff File

master 54d04e84

2010-11-01 15:20:05

thh

Details Diff
groupstats.pl: Precedence of -m / -p / -a

Unset -m if either -p or -a is set,
unset -m if -p is set.

Print caption (-c) for -a, too.

Signed-off-by: Thomas Hochstein <thh@inter.net>
Attach Issues:
mod - groupstats.pl Diff File

master 628a183c

2010-11-01 14:58:07

thh

Details Diff
groupstats.pl: Change default output format to 'pretty'.

Change documentation accordingly.

Signed-off-by: Thomas Hochstein <thh@inter.net>
Attach Issues:
mod - groupstats.pl Diff File
 First  Prev  1 2 3 4 5  Next  Last