목록Transformer (3)

Tech for good

[Google Cloud Skills Boost(Qwiklabs)] Introduction to Generative AI Learning Path - 8. Transformer Models and BERT Model

https://www.youtube.com/playlist?list=PLIivdWyY5sqIlLF9JHbyiqzZbib9pFt4x Generative AI Learning Path https://goo.gle/LearnGenAI www.youtube.com RNN/LSTM -> Sequence-to-sequence model i.e. Translation, Text classification Although all the models before Transformers were able to represent words as vectors, these vectors did not contain the context. And the usage of words changes based on the conte..
IT/Cloud 2023. 9. 9. 20:32
[Google Cloud Skills Boost(Qwiklabs)] Introduction to Generative AI Learning Path - 7. Attention Mechanism

https://www.youtube.com/playlist?list=PLIivdWyY5sqIlLF9JHbyiqzZbib9pFt4x Generative AI Learning Path https://goo.gle/LearnGenAI www.youtube.com Attention mechanism is behind all the transformer models and which is core to the LLM models. Encoder-Decoder is a popular model that is used to translate sentences. The encoder-decoder takes one word at a time and translates it at each time step. Howeve..
IT/Cloud 2023. 9. 9. 15:51
자연어 언어모델 ‘BERT’ 2강 - 언어 모델(Language Model) | T아카데미

모든 출처: Sk techx Tacademy (www.youtube.com/watch?v=zia49ZyKiX0&t=4s) 강의 목표 자연어 처리의 종류와, 자연어 처리가 현업에서 적용된 예제를 소개한다. BERT가 탄생하게 된 과정과, BERT에 적용된 메커니즘을 살펴본다. BERT를 이용한 다양한 자연어 처리 실험 결과들을 소개한다. Open source로 공개된 BERT 코드를 이용해 한국어 BERT를 학습해보고, 다양한 자연어 처리 task를 직접 실습해본다. 목차 2.언어 모델(Language Model) 2.1. 모델이란? 2.2. 언어 모델 2.2.1. Markov 확률 기반의 언어 모델 2.2.2. Recurrent Neural Network(RNN)기반의 언어 모델 (1) RNN 언어 모델..
IT/Data Science 2021. 4. 19. 13:21
이전 Prev 1 Next 다음