add tokenize's function, add interface `Token`

[uann] / README.md

diff --git a/README.md b/README.md
index 73ea9cead531f2b1e2ac70400e778061ded1f314..aaba90e7455b1da42d009f658d7d7bd566967119 100644 (file)
--- a/README.md
+++ b/README.md
@@ -5,3 +5,4 @@ another personal draught of a typesetting language and engine.
  - 20230904 建立 thenDo、matchRange的函數、refactor harfbuzzjs 以及libpdf 等測試界面
  - 20230905-06: 建立 : `toSome`, initial of basic tokenizer (`tokenize`),
    `matchAny`, `notDo`, `orDo`, `zeroOrMoreDo`, `zeroOrOnceDo`
+ - 20230905-07:強化`tokenize`, 加強功能，加`Token`界面。