7 commits

Author	SHA1	Message	Date
janis	5f63d4303e	formatting, strings, comments	2025-10-28 18:16:39 +01:00
janis	43a06ad55c	test numbers	2025-10-28 17:16:28 +01:00
janis	44ee13246e	is_number	2025-10-28 17:07:05 +01:00
janis	1886231dcd	return lexeme str slice from find_lexeme function	2025-10-28 16:30:15 +01:00
janis	cfc1c8e3b3	more tests for tokeniser	2025-10-28 13:12:27 +01:00
janis	63fbca378b	can tokenise simple tokens	2025-10-28 12:44:08 +01:00
janis	719451b935	reduce warnings, enable edition 2024, fix tokeniser (1/?)	2025-10-28 12:06:24 +01:00