media websites develop natural language processing technology based on pre-trained models. pretrained models refer to models trained on large-scale datasets, which usually have pretraining steps and fine-tuning steps. the main goal of the pre-training step is to learn common language features using a massive corpus and generate a common language model, i.e.
