AGONIXX15/language_nivy

AI Summary: Implement a lexer in Zig that reads a file character by character, generating tokens (identifiers, numbers, symbols, whitespace, newlines, EOF) with position information (line, column, start/end). The lexer should use an implicit state machine, accumulate lexical errors without halting, and support line/block comments. The output should be a list of tokens and a list of errors.