From: Tan Kian-ting <chenjt30@gmail.com>
Date: Wed, 6 Sep 2023 16:01:15 +0000 (+0800)
Subject: add tokenize's function, add interface `Token`
X-Git-Url: https://git.kianting.info/?a=commitdiff_plain;h=5fbb467bdf501dee03c78817242581d962547c4f;hp=5fbb467bdf501dee03c78817242581d962547c4f;p=clo

add tokenize's function, add interface `Token`
---