Abstract: The mainstreamTransformer-based Large Language Models (LLMs) have demonstrated to exhibit remarkable performance in various Natural Language Processing (NLP) tasks. However, high ...