N2logplus

Downloadable Software

Description

N2logplus is a real-time log-parsing package for Squid. Specifically, it is designed to parse logs generated by N2H2- or Squidguard-enhanced Squid proxies, with output to a MySQL database.

Features

  • Designed for continuous processing and writeback to a MySQL database
  • Handles very large corpora, very high traffic, SQL tables are striped--at the flagship site, n2logplus regularly handles >350K hits/hour, and stores hundreds of millions of data rows
  • Designed for parsing of enhanced Squid logs from N2H2, a commercial proxy package widely used in US K-12 sites, or a slightly customized version of Squidguard, also available from this site
  • Integrated with a PHP-based reporting package called Tentacle, also available from this site, suitable for interactive searching
  • Written in ANSI Common Lisp--and actually, almost an ideal application of that language. It's extremely fast, cannot leak memory, with a bounded memory utilization of around 24MB on i386 Linux

Requirements

N2logplus was developed in SBCL .8.7, and uses the following ASDF pacakges:
  • CL-SQL
  • CL-PPCRE
  • CL-SYSLOG
  • LOCAL-TIME
  • One SBCL-specific interface (to fstat)

Credits

N2logplus is by Matt Benjamin. Tentacle is primarily by Adam Gorski. Squidguard modifications are by Adam Gorski.

License

N2logplus is released under the GNU General Public License (GPL).

Download