REJECT_STATS_LNK(1)

NAME
reject_stats_lnk - compute rejection statistics from lnknet error file

SYNOPSIS
reject_stats_lnk -ferr f [-verbose]

OPTIONS
LNKnet error file from a recent experiment Verbosity flag causes a line to be printed for every substitution. This makes it possible to analyze the substitutions alone separate from rejections. Prints man page describing this function

DESCRIPTION
reject_stats_lnk reads in a LNKnet error file and computes statistics for classifiers such as the hypersphere classifier that allow rejections. LNKnet summary statistics for these classifiers treat rejections and substitutions both as errors and doesn't separate the two types of errors. This program counts up substitution and rejections errors separately and prints the totals. The example below shows a summary produced from a cross-validation experiment with the hypersphere classifier. The first five lines after the command show the first five substitution errors. Each line shows the line number of the exemplar in the test file followed by the true class number followed by an arrow and the assigned class number. The summary line contains the total number of exemplars tested (810) followed by the number and percentage of rejections out of this total. This is followed by the number and percentage of substitutions out of the number of exemplars that were not rejected. This is followed by the total number of errors counting a substitution and rejection as an error. This total is the same total that the current LNKnet summary statistics print.

EXAMPLE RUN AND OUTPUT
    reject_stats_lnk.pl -verbose -ferr X1hyper.err.cv
    Substitution: exemplar number 4  true 11 -> 10
    Substitution: exemplar number 8  true 11 -> 4
    Substitution: exemplar number 357  true 7 -> 10
    Substitution: exemplar number 72  true 11 -> 4
    Substitution: exemplar number 558  true 10 -> 11
        ...
    N:810 Reject: 695/810 85.80%  Subs: 27/115 23.48%  Total: 722/810 89.14%

LIMITATIONS
The first line of the reject_stats_lnk file is the path to perl on your system. It sometimes needs to be changed by hand to point to where perl is located on different systems.

AUTHOR
Richard Lippmann - 1 Sept 2003 - MIT Lincoln Laboratory