add some tokenizer function

[clo] / README.md

diff --git a/README.md b/README.md
index 4975992936a734d802e13bf7029459d017b96b18..4d8beeb8974d3c4fb057f89ff6ff1703d69bbf4f 100644 (file)
--- a/README.md
+++ b/README.md
@@ -3,3 +3,8 @@ another personal draught of a typesetting language and engine.
 
 ## changing journal
  - 20230904 建立 thenDo、matchRange的函數、refactor harfbuzzjs 以及libpdf 等測試界面
+ - 20230905-06: 建立 : `toSome`, initial of basic tokenizer (`tokenize`),
+   `matchAny`, `notDo`, `orDo`, `zeroOrMoreDo`, `zeroOrOnceDo`
+ - 20230905-07:強化`tokenize`, 加強功能，加`Token`界面。
+ - 20230907-08:強化`tokenize`。
+ - 20230910 : add basic parser `CONST` rule, and add the grammar rule.