Lexer tokenized input:
======================
[C:/* Lexer tests */][NL:
][Setvar::setvar][WS: ][T:a][WS: ][T:"df df""
"][NL:
][T:ABC][NL:
][Include::r][NL:
][Include::r][WS: ][T:input2.txt][NL:
][WS:	][Include::r][NL:
][Setvar::setvar][WS:	][NL:
][Setvar::setvar][NL:
][T::setvariable asd][NL:
][T:GOTO][NL:
][T::on errors][NL:
][OnError::on error][WS: ][T:exit][NL:
][OnError::on error][WS: ][T:ignore][NL:
][T:DEF][NL:
][NL:
][Go:go][NL:
][Go:go][NL:
][T:abc][C:--def][NL:
][WS:	][T:select '$$' '$$(s)asd)' werwer$$(Y)ss][NL:
][Setvar::Setvar][WS:   ][T:x][WS:   ][T:y][NL:
][Setvar::Setvar][WS:   ][T:Y][WS:   ][T:"VALUE OF Y"][NL:
][WS:  ][T:from    x][NL:
][WS:   ][Go:GO][WS: ][T:2][NL:
][WS:  ][Setvar::SETVAR][WS: ][T:Z][WS: ][T:"WE"][NL:
][T::include x][NL:
][T:This is a comment: ][C:/*
:SETVAR w e
"
*/][NL:
][T:Select 1][NL:
][Go:go][WS: ][T:3][NL:
][OnError::on error][WS: ][T:exit][NL:
][Go:go][NL:
][WS: ][T:select 2Y==>$(Y)][NL:
][WS: ][T:A==>$(a)<==][NL:
][Setvar::setvar][WS: ][T:x][WS: ][T:"y"][NL:
][Setvar::setvar][WS: ][T:z][WS: ][T:"z"][NL:
][T:select $(x_y)][NL:
][WS: ][T:from DUAL][NL:
][NL:
][WS: ][C:-- on error commands][NL:
][WS: ][OnError::on error][WS: ][T:exit][NL:
][WS: ][OnError::on error][WS: ][T:ignore][NL:
][WS: ][OnError::on error][WS: ][T:$(variable)][NL:
][WS: ][OnError::on error][WS: ][T:invalid][WS: ][T:value][NL:
][NL:
][WS: ][C:-- Line comment][NL:
][WS: ][C:/* Multi line
    block comment
-- with nested line comment */][NL:
][NL:
][C:/*** block comment 2 ***/][NL:
][T:select '/*', '*/'][NL:
][NL:
][C:-- Unsupported commands][NL:
][Reset::reset][NL:
][Ed::ed][NL:
][Execute::!!][NL:
][Quit::quit][NL:
][Exit::exit][NL:
][Serverlist::serverlist][NL:
][List::list][NL:
][ErrorCommand::error][WS: ][T:errorfile.txt][NL:
][Out::out][WS: ][T:stdout][NL:
][Perftrace::perftrace][WS: ][T:perftrace.txt][NL:
][Connect::connect][WS: ][T:server\instance][NL:
][Help::help][NL:
][Xml::xml][WS: ][T:on][NL:
][ListVar::listvar][NL:
][Eof:]
Tokens:
=======
[Token Comment at TS-input2.txt(1:1 [0] - 1:18 [17]): '/* Lexer tests */']
[Token NewLine at TS-input2.txt(1:18 [17] - 2:1 [19]): '\r\n']
[Token Setvar at TS-input2.txt(2:1 [19] - 2:8 [26]): ':setvar']
[Token Whitespace at TS-input2.txt(2:8 [26] - 2:9 [27]): ' ']
[Token Text at TS-input2.txt(2:9 [27] - 2:10 [28]): 'a']
[Token Whitespace at TS-input2.txt(2:10 [28] - 2:11 [29]): ' ']
[Token Text at TS-input2.txt(2:11 [29] - 3:2 [40]): '"df df""\r\n"']
[Token NewLine at TS-input2.txt(3:2 [40] - 4:1 [42]): '\r\n']
[Token Text at TS-input2.txt(4:1 [42] - 4:4 [45]): 'ABC']
[Token NewLine at TS-input2.txt(4:4 [45] - 5:1 [47]): '\r\n']
[Token Include at TS-input2.txt(5:1 [47] - 5:3 [49]): ':r']
[Token NewLine at TS-input2.txt(5:3 [49] - 6:1 [51]): '\r\n']
[Token Include at TS-input2.txt(6:1 [51] - 6:3 [53]): ':r']
[Token Whitespace at TS-input2.txt(6:3 [53] - 6:4 [54]): ' ']
[Token Text at TS-input2.txt(6:4 [54] - 6:14 [64]): 'input2.txt']
[Token NewLine at TS-input2.txt(6:14 [64] - 7:1 [66]): '\r\n']
[Token Whitespace at TS-input2.txt(7:1 [66] - 7:2 [67]): '\t']
[Token Include at TS-input2.txt(7:2 [67] - 7:4 [69]): ':r']
[Token NewLine at TS-input2.txt(7:4 [69] - 8:1 [71]): '\r\n']
[Token Setvar at TS-input2.txt(8:1 [71] - 8:8 [78]): ':setvar']
[Token Whitespace at TS-input2.txt(8:8 [78] - 8:9 [79]): '\t']
[Token NewLine at TS-input2.txt(8:9 [79] - 9:1 [81]): '\r\n']
[Token Setvar at TS-input2.txt(9:1 [81] - 9:8 [88]): ':setvar']
[Token NewLine at TS-input2.txt(9:8 [88] - 10:1 [90]): '\r\n']
[Token Text at TS-input2.txt(10:1 [90] - 10:17 [106]): ':setvariable asd']
[Token NewLine at TS-input2.txt(10:17 [106] - 11:1 [108]): '\r\n']
[Token Text at TS-input2.txt(11:1 [108] - 11:5 [112]): 'GOTO']
[Token NewLine at TS-input2.txt(11:5 [112] - 12:1 [114]): '\r\n']
[Token Text at TS-input2.txt(12:1 [114] - 12:11 [124]): ':on errors']
[Token NewLine at TS-input2.txt(12:11 [124] - 13:1 [126]): '\r\n']
[Token OnError at TS-input2.txt(13:1 [126] - 13:10 [135]): ':on error']
[Token Whitespace at TS-input2.txt(13:10 [135] - 13:11 [136]): ' ']
[Token Text at TS-input2.txt(13:11 [136] - 13:15 [140]): 'exit']
[Token NewLine at TS-input2.txt(13:15 [140] - 14:1 [142]): '\r\n']
[Token OnError at TS-input2.txt(14:1 [142] - 14:10 [151]): ':on error']
[Token Whitespace at TS-input2.txt(14:10 [151] - 14:11 [152]): ' ']
[Token Text at TS-input2.txt(14:11 [152] - 14:17 [158]): 'ignore']
[Token NewLine at TS-input2.txt(14:17 [158] - 15:1 [160]): '\r\n']
[Token Text at TS-input2.txt(15:1 [160] - 15:4 [163]): 'DEF']
[Token NewLine at TS-input2.txt(15:4 [163] - 16:1 [165]): '\r\n']
[Token NewLine at TS-input2.txt(16:1 [165] - 17:1 [167]): '\r\n']
[Token Go at TS-input2.txt(17:1 [167] - 17:3 [169]): 'go']
[Token NewLine at TS-input2.txt(17:3 [169] - 18:1 [171]): '\r\n']
[Token Go at TS-input2.txt(18:1 [171] - 18:3 [173]): 'go']
[Token NewLine at TS-input2.txt(18:3 [173] - 19:1 [175]): '\r\n']
[Token Text at TS-input2.txt(19:1 [175] - 19:4 [178]): 'abc']
[Token Comment at TS-input2.txt(19:4 [178] - 19:9 [183]): '--def']
[Token NewLine at TS-input2.txt(19:9 [183] - 20:1 [185]): '\r\n']
[Token Whitespace at TS-input2.txt(20:1 [185] - 20:2 [186]): '\t']
[Token Text at TS-input2.txt(20:2 [186] - 20:39 [223]): 'select '$$' '$$(s)asd)' werwer$$(Y)ss']
[Token NewLine at TS-input2.txt(20:39 [223] - 21:1 [225]): '\r\n']
[Token Setvar at TS-input2.txt(21:1 [225] - 21:8 [232]): ':Setvar']
[Token Whitespace at TS-input2.txt(21:8 [232] - 21:11 [235]): '   ']
[Token Text at TS-input2.txt(21:11 [235] - 21:12 [236]): 'x']
[Token Whitespace at TS-input2.txt(21:12 [236] - 21:15 [239]): '   ']
[Token Text at TS-input2.txt(21:15 [239] - 21:16 [240]): 'y']
[Token NewLine at TS-input2.txt(21:16 [240] - 22:1 [242]): '\r\n']
[Token Setvar at TS-input2.txt(22:1 [242] - 22:8 [249]): ':Setvar']
[Token Whitespace at TS-input2.txt(22:8 [249] - 22:11 [252]): '   ']
[Token Text at TS-input2.txt(22:11 [252] - 22:12 [253]): 'Y']
[Token Whitespace at TS-input2.txt(22:12 [253] - 22:15 [256]): '   ']
[Token Text at TS-input2.txt(22:15 [256] - 22:27 [268]): '"VALUE OF Y"']
[Token NewLine at TS-input2.txt(22:27 [268] - 23:1 [270]): '\r\n']
[Token Whitespace at TS-input2.txt(23:1 [270] - 23:3 [272]): '  ']
[Token Text at TS-input2.txt(23:3 [272] - 23:12 [281]): 'from    x']
[Token NewLine at TS-input2.txt(23:12 [281] - 24:1 [283]): '\r\n']
[Token Whitespace at TS-input2.txt(24:1 [283] - 24:4 [286]): '   ']
[Token Go at TS-input2.txt(24:4 [286] - 24:6 [288]): 'GO']
[Token Whitespace at TS-input2.txt(24:6 [288] - 24:7 [289]): ' ']
[Token Text at TS-input2.txt(24:7 [289] - 24:8 [290]): '2']
[Token NewLine at TS-input2.txt(24:8 [290] - 25:1 [292]): '\r\n']
[Token Whitespace at TS-input2.txt(25:1 [292] - 25:3 [294]): '  ']
[Token Setvar at TS-input2.txt(25:3 [294] - 25:10 [301]): ':SETVAR']
[Token Whitespace at TS-input2.txt(25:10 [301] - 25:11 [302]): ' ']
[Token Text at TS-input2.txt(25:11 [302] - 25:12 [303]): 'Z']
[Token Whitespace at TS-input2.txt(25:12 [303] - 25:13 [304]): ' ']
[Token Text at TS-input2.txt(25:13 [304] - 25:17 [308]): '"WE"']
[Token NewLine at TS-input2.txt(25:17 [308] - 26:1 [310]): '\r\n']
[Token Text at TS-input2.txt(26:1 [310] - 26:11 [320]): ':include x']
[Token NewLine at TS-input2.txt(26:11 [320] - 27:1 [322]): '\r\n']
[Token Text at TS-input2.txt(27:1 [322] - 27:20 [341]): 'This is a comment: ']
[Token Comment at TS-input2.txt(27:20 [341] - 30:3 [363]): '/*\r\n:SETVAR w e\r\n"\r\n*/']
[Token NewLine at TS-input2.txt(30:3 [363] - 31:1 [365]): '\r\n']
[Token Text at TS-input2.txt(31:1 [365] - 31:9 [373]): 'Select 1']
[Token NewLine at TS-input2.txt(31:9 [373] - 32:1 [375]): '\r\n']
[Token Go at TS-input2.txt(32:1 [375] - 32:3 [377]): 'go']
[Token Whitespace at TS-input2.txt(32:3 [377] - 32:4 [378]): ' ']
[Token Text at TS-input2.txt(32:4 [378] - 32:5 [379]): '3']
[Token NewLine at TS-input2.txt(32:5 [379] - 33:1 [381]): '\r\n']
[Token OnError at TS-input2.txt(33:1 [381] - 33:10 [390]): ':on error']
[Token Whitespace at TS-input2.txt(33:10 [390] - 33:11 [391]): ' ']
[Token Text at TS-input2.txt(33:11 [391] - 33:15 [395]): 'exit']
[Token NewLine at TS-input2.txt(33:15 [395] - 34:1 [397]): '\r\n']
[Token Go at TS-input2.txt(34:1 [397] - 34:3 [399]): 'go']
[Token NewLine at TS-input2.txt(34:3 [399] - 35:1 [401]): '\r\n']
[Token Whitespace at TS-input2.txt(35:1 [401] - 35:2 [402]): ' ']
[Token Text at TS-input2.txt(35:2 [402] - 35:18 [418]): 'select 2Y==>$(Y)']
[Token NewLine at TS-input2.txt(35:18 [418] - 36:1 [420]): '\r\n']
[Token Whitespace at TS-input2.txt(36:1 [420] - 36:2 [421]): ' ']
[Token Text at TS-input2.txt(36:2 [421] - 36:13 [432]): 'A==>$(a)<==']
[Token NewLine at TS-input2.txt(36:13 [432] - 37:1 [434]): '\r\n']
[Token Setvar at TS-input2.txt(37:1 [434] - 37:8 [441]): ':setvar']
[Token Whitespace at TS-input2.txt(37:8 [441] - 37:9 [442]): ' ']
[Token Text at TS-input2.txt(37:9 [442] - 37:10 [443]): 'x']
[Token Whitespace at TS-input2.txt(37:10 [443] - 37:11 [444]): ' ']
[Token Text at TS-input2.txt(37:11 [444] - 37:14 [447]): '"y"']
[Token NewLine at TS-input2.txt(37:14 [447] - 38:1 [449]): '\r\n']
[Token Setvar at TS-input2.txt(38:1 [449] - 38:8 [456]): ':setvar']
[Token Whitespace at TS-input2.txt(38:8 [456] - 38:9 [457]): ' ']
[Token Text at TS-input2.txt(38:9 [457] - 38:10 [458]): 'z']
[Token Whitespace at TS-input2.txt(38:10 [458] - 38:11 [459]): ' ']
[Token Text at TS-input2.txt(38:11 [459] - 38:14 [462]): '"z"']
[Token NewLine at TS-input2.txt(38:14 [462] - 39:1 [464]): '\r\n']
[Token Text at TS-input2.txt(39:1 [464] - 39:14 [477]): 'select $(x_y)']
[Token NewLine at TS-input2.txt(39:14 [477] - 40:1 [479]): '\r\n']
[Token Whitespace at TS-input2.txt(40:1 [479] - 40:2 [480]): ' ']
[Token Text at TS-input2.txt(40:2 [480] - 40:11 [489]): 'from DUAL']
[Token NewLine at TS-input2.txt(40:11 [489] - 41:1 [491]): '\r\n']
[Token NewLine at TS-input2.txt(41:1 [491] - 42:1 [493]): '\r\n']
[Token Whitespace at TS-input2.txt(42:1 [493] - 42:2 [494]): ' ']
[Token Comment at TS-input2.txt(42:2 [494] - 42:22 [514]): '-- on error commands']
[Token NewLine at TS-input2.txt(42:22 [514] - 43:1 [516]): '\r\n']
[Token Whitespace at TS-input2.txt(43:1 [516] - 43:2 [517]): ' ']
[Token OnError at TS-input2.txt(43:2 [517] - 43:11 [526]): ':on error']
[Token Whitespace at TS-input2.txt(43:11 [526] - 43:12 [527]): ' ']
[Token Text at TS-input2.txt(43:12 [527] - 43:16 [531]): 'exit']
[Token NewLine at TS-input2.txt(43:16 [531] - 44:1 [533]): '\r\n']
[Token Whitespace at TS-input2.txt(44:1 [533] - 44:2 [534]): ' ']
[Token OnError at TS-input2.txt(44:2 [534] - 44:11 [543]): ':on error']
[Token Whitespace at TS-input2.txt(44:11 [543] - 44:12 [544]): ' ']
[Token Text at TS-input2.txt(44:12 [544] - 44:18 [550]): 'ignore']
[Token NewLine at TS-input2.txt(44:18 [550] - 45:1 [552]): '\r\n']
[Token Whitespace at TS-input2.txt(45:1 [552] - 45:2 [553]): ' ']
[Token OnError at TS-input2.txt(45:2 [553] - 45:11 [562]): ':on error']
[Token Whitespace at TS-input2.txt(45:11 [562] - 45:12 [563]): ' ']
[Token Text at TS-input2.txt(45:12 [563] - 45:23 [574]): '$(variable)']
[Token NewLine at TS-input2.txt(45:23 [574] - 46:1 [576]): '\r\n']
[Token Whitespace at TS-input2.txt(46:1 [576] - 46:2 [577]): ' ']
[Token OnError at TS-input2.txt(46:2 [577] - 46:11 [586]): ':on error']
[Token Whitespace at TS-input2.txt(46:11 [586] - 46:12 [587]): ' ']
[Token Text at TS-input2.txt(46:12 [587] - 46:19 [594]): 'invalid']
[Token Whitespace at TS-input2.txt(46:19 [594] - 46:20 [595]): ' ']
[Token Text at TS-input2.txt(46:20 [595] - 46:25 [600]): 'value']
[Token NewLine at TS-input2.txt(46:25 [600] - 47:1 [602]): '\r\n']
[Token NewLine at TS-input2.txt(47:1 [602] - 48:1 [604]): '\r\n']
[Token Whitespace at TS-input2.txt(48:1 [604] - 48:2 [605]): ' ']
[Token Comment at TS-input2.txt(48:2 [605] - 48:17 [620]): '-- Line comment']
[Token NewLine at TS-input2.txt(48:17 [620] - 49:1 [622]): '\r\n']
[Token Whitespace at TS-input2.txt(49:1 [622] - 49:2 [623]): ' ']
[Token Comment at TS-input2.txt(49:2 [623] - 51:31 [687]): '/* Multi line\r\n    block comment\r\n-- with nested line comment */']
[Token NewLine at TS-input2.txt(51:31 [687] - 52:1 [689]): '\r\n']
[Token NewLine at TS-input2.txt(52:1 [689] - 53:1 [691]): '\r\n']
[Token Comment at TS-input2.txt(53:1 [691] - 53:26 [716]): '/*** block comment 2 ***/']
[Token NewLine at TS-input2.txt(53:26 [716] - 54:1 [718]): '\r\n']
[Token Text at TS-input2.txt(54:1 [718] - 54:18 [735]): 'select '/*', '*/'']
[Token NewLine at TS-input2.txt(54:18 [735] - 55:1 [737]): '\r\n']
[Token NewLine at TS-input2.txt(55:1 [737] - 56:1 [739]): '\r\n']
[Token Comment at TS-input2.txt(56:1 [739] - 56:24 [762]): '-- Unsupported commands']
[Token NewLine at TS-input2.txt(56:24 [762] - 57:1 [764]): '\r\n']
[Token Reset at TS-input2.txt(57:1 [764] - 57:7 [770]): ':reset']
[Token NewLine at TS-input2.txt(57:7 [770] - 58:1 [772]): '\r\n']
[Token Ed at TS-input2.txt(58:1 [772] - 58:4 [775]): ':ed']
[Token NewLine at TS-input2.txt(58:4 [775] - 59:1 [777]): '\r\n']
[Token Execute at TS-input2.txt(59:1 [777] - 59:4 [780]): ':!!']
[Token NewLine at TS-input2.txt(59:4 [780] - 60:1 [782]): '\r\n']
[Token Quit at TS-input2.txt(60:1 [782] - 60:6 [787]): ':quit']
[Token NewLine at TS-input2.txt(60:6 [787] - 61:1 [789]): '\r\n']
[Token Exit at TS-input2.txt(61:1 [789] - 61:6 [794]): ':exit']
[Token NewLine at TS-input2.txt(61:6 [794] - 62:1 [796]): '\r\n']
[Token Serverlist at TS-input2.txt(62:1 [796] - 62:12 [807]): ':serverlist']
[Token NewLine at TS-input2.txt(62:12 [807] - 63:1 [809]): '\r\n']
[Token List at TS-input2.txt(63:1 [809] - 63:6 [814]): ':list']
[Token NewLine at TS-input2.txt(63:6 [814] - 64:1 [816]): '\r\n']
[Token ErrorCommand at TS-input2.txt(64:1 [816] - 64:7 [822]): ':error']
[Token Whitespace at TS-input2.txt(64:7 [822] - 64:8 [823]): ' ']
[Token Text at TS-input2.txt(64:8 [823] - 64:21 [836]): 'errorfile.txt']
[Token NewLine at TS-input2.txt(64:21 [836] - 65:1 [838]): '\r\n']
[Token Out at TS-input2.txt(65:1 [838] - 65:5 [842]): ':out']
[Token Whitespace at TS-input2.txt(65:5 [842] - 65:6 [843]): ' ']
[Token Text at TS-input2.txt(65:6 [843] - 65:12 [849]): 'stdout']
[Token NewLine at TS-input2.txt(65:12 [849] - 66:1 [851]): '\r\n']
[Token Perftrace at TS-input2.txt(66:1 [851] - 66:11 [861]): ':perftrace']
[Token Whitespace at TS-input2.txt(66:11 [861] - 66:12 [862]): ' ']
[Token Text at TS-input2.txt(66:12 [862] - 66:25 [875]): 'perftrace.txt']
[Token NewLine at TS-input2.txt(66:25 [875] - 67:1 [877]): '\r\n']
[Token Connect at TS-input2.txt(67:1 [877] - 67:9 [885]): ':connect']
[Token Whitespace at TS-input2.txt(67:9 [885] - 67:10 [886]): ' ']
[Token Text at TS-input2.txt(67:10 [886] - 67:25 [901]): 'server\instance']
[Token NewLine at TS-input2.txt(67:25 [901] - 68:1 [903]): '\r\n']
[Token Help at TS-input2.txt(68:1 [903] - 68:6 [908]): ':help']
[Token NewLine at TS-input2.txt(68:6 [908] - 69:1 [910]): '\r\n']
[Token Xml at TS-input2.txt(69:1 [910] - 69:5 [914]): ':xml']
[Token Whitespace at TS-input2.txt(69:5 [914] - 69:6 [915]): ' ']
[Token Text at TS-input2.txt(69:6 [915] - 69:8 [917]): 'on']
[Token NewLine at TS-input2.txt(69:8 [917] - 70:1 [919]): '\r\n']
[Token ListVar at TS-input2.txt(70:1 [919] - 70:9 [927]): ':listvar']
[Token NewLine at TS-input2.txt(70:9 [927] - 71:1 [929]): '\r\n']
[Token Eof at TS-input2.txt(71:1 [929] - 71:1 [929]): '']

Setting variable a to [df df"
]
[PARSER ERROR: code TokenExpected at 5:3 [49] - 6:1 [51] in TS-input2.txt, token text: 
, message: Incorrect syntax was encountered while parsing '
'.]