tokenizer v 1.0.2, contribution by David Paktor <dlpaktor@netscape.net>
git-svn-id: svn://coreboot.org/openbios/fcode-utils@100 f158a5a8-5612-0410-a976-696ce0be7e32
initial merge of David Paktor's fine work.
I redid all of the Makefiles and fixed some minor
issues with the code.
git-svn-id: svn://coreboot.org/openbios/fcode-utils@76 f158a5a8-5612-0410-a976-696ce0be7e32
