【英文】高盛报告：生成式AI投资框架（60页）

英文研究报告 2023年04月27日 07:03 管理员

The concept of large lends itself to large language models as a result of being trained on millions of parameters and the use of Natural Language Processing to communicate with the model introduces the language aspect to LLMs.True to its name, Large Language Models are a type of machine learning model that are trained on large parameters of inputs while using natural language to process queries. LLMs are based on transformer architecture and use deep neural networks to generate outputs. Transformer neural networks use the self-attention mechanism to capture relationships between different elements in a data sequence, irrespective of the order of the elements in the sequence.The computational power of transformer models to process data sequencing in parallel on massive data sets is the biggest driving force behind large language models. Breaking down how LLMs work.

The fifirst step in training a large language model is building a large training data set. The data typically is derived from multiple sources across websites, books and other public datasets.The model is then trained using supervised learning, where it is trained to predict output words in a sequence. A LLM learns which words are most commonly used together, the order they appear in and how they relate to each other. These relationships are taught by training the neural network on large datasets. The more data the model is trained on, the better the outputs.The process of training LLMs involves fifirst converting the natural language text data into a numerical representation that can be input into the model. This process of converting the input sequence to a vector representation is called word embedding.The self-attention mechanism of the transformer model then captures the relationship between the input sequence.