ํ‹ฐ์Šคํ† ๋ฆฌ

KATE.log
๊ฒ€์ƒ‰ํ•˜๊ธฐ
๋ธ”๋กœ๊ทธ ํ™ˆ

๋ธ”๋กœ๊ทธ ํ™ˆ

KATE.log

he-kate1130.tistory.com/m
์‹ ๊ณ 

mingyung ๋‹˜์˜ ๋ธ”๋กœ๊ทธ์ž…๋‹ˆ๋‹ค.

๊ตฌ๋…์ž
1
๋ฐฉ๋ช…๋ก ๋ฐฉ๋ฌธํ•˜๊ธฐ

์ฃผ์š” ๊ธ€ ๋ชฉ๋ก

  • [NLP] Seq2Seq๋ชจ๋ธ๊ณผ Attention ๋ฉ”์ปค๋‹ˆ์ฆ˜ ์ดํ•ด ์˜ค๋Š˜์€ Seq2Seq๋ชจ๋ธ๊ณผ Attention ๋ฉ”์ปค๋‹ˆ์ฆ˜ ์— ๋Œ€ํ•˜์—ฌ ์ •๋ฆฌํ•ด๋ณด๋ ค๊ณ  ํ•œ๋‹ค. (๊ณต๋ถ€๋ฅผ ํ•˜๋ฉด์„œ ์ •๋ฆฌํ•œ ๋‚ด์šฉ์ด๋ฏ€๋กœ ์˜ค๋ฅ˜๊ฐ€ ์žˆ์„ ์ˆ˜ ์žˆ์Šต๋‹ˆ๋‹ค. ๋Œ“๊ธ€๋กœ ๋‚จ๊ฒจ์ฃผ์„ธ์š”!) ์ด ํฌ์ŠคํŒ…์€ ์•„๋ž˜ ์ž๋ฃŒ๋ฅผ ์ฐธ๊ณ ํ•˜์—ฌ ์ž‘์„ฑ๋˜์—ˆ๋‹ค.https://gaussian37.github.io/dl-concept-attention/https://jalammar.github.io/visualizing-neural-machine-translation-mechanics-of-seq2seq-models-with-attention/https://wikidocs.net/22893https://www.youtube.com/watch?v=AA621UofTUA Visualizing A Neural Machine Translation Model (Me.. ๊ณต๊ฐ์ˆ˜ 1 ๋Œ“๊ธ€์ˆ˜ 0 2025. 4. 16.
  • [NLP] 1. Word Embadding (1) Word Vectors์–ด๋–ค ๋ฌธ์žฅ์ด ์ฃผ์–ด์กŒ์„๋•Œ, ๋ฌธ์žฅ์˜ ์–ด๋–ค ๋ถ€๋ถ„์ด ๋ฌธ์žฅ์˜ ์˜๋ฏธ๋ฅผ ๋” ์ค‘์š”ํ•˜๊ฒŒ ํ‘œํ˜„ํ•˜๋Š”์ง€๋ฅผ ์–ด๋–ป๊ฒŒ ์•Œ ์ˆ˜ ์žˆ์„๊นŒ?์‚ฌ๋žŒ์˜ ์–ธ์–ด๋ผ๋Š” ๊ฒƒ์€ ๋‹ค์–‘ํ•œ ์˜๋ฏธ์™€ ๋‰˜์•™์Šค๋ฅผ ๊ฐ€์ง€๊ณ  ์žˆ๊ธฐ ๋•Œ๋ฌธ์—, ์–ธ์–ด์˜ ์ •๋ณด๋ฅผ ์ž˜ ํฌํ•จํ•˜๊ฒŒ ํ‘œํ˜„ํ•˜๊ณ , ์ด๋ฅผ ๋‹ค๋ฃจ๋Š”๊ฒƒ์€ ์ •๋ง ์–ด๋ ค์šด ์ผ์ด๋‹ค.one hot vectorword๋ฅผ ๋‹ค๋ฃจ๋Š” ๊ฐ€์žฅ ์‰ฝ๊ณ  ๊ธฐ๋ณธ์ ์ธ ๋ฐฉ๋ฒ•์€ ๋‹จ์–ด๋ฅผ ์„œ๋กœ ์˜์กดํ•˜์ง€ ์•Š๋Š” ๊ฐœ๋ณ„์˜ ๊ฐœ์ฒด๋กœ ์ƒ๊ฐํ•˜๋Š” ๊ฒƒ์ด๋‹ค.์ฆ‰, ๋‹จ์–ด๋ฅผ one hot vector๋ฅผ ํ†ตํ•ด์„œ ๋‚˜ํƒ€๋‚ผ ์ˆ˜ ์žˆ๋‹ค. ์˜ˆ๋ฅผ ๋“ค์–ด์„œ finite set {coffee, cafe, tea}์˜ ๊ฐœ๋ณ„ ๋‹จ์–ด๋ฅผ ๋‹ค์Œ์ฒ˜๋Ÿผ 1-hot vector๋กœ ํ‘œํ˜„ํ•œ๋‹ค.์ „ํ†ต์ ๋”˜ NLP์—์„œ ๋‹จ์–ด๋ฅผ ์ด์™€ ๊ฐ™์€ ํ˜•ํƒœ๋กœ ํ‘œํ˜„ํ•˜์—ฌ ์‚ฌ์šฉํ•œ๋‹ค. ์ด๋ ‡๊ฒŒ ํ‘œํ˜„ํ•˜๊ฒŒ ๋˜๋ฉด, ๋‘ ๋‹จ์–ด ์‚ฌ์ด์˜ L1, L2 distan.. ๊ณต๊ฐ์ˆ˜ 0 ๋Œ“๊ธ€์ˆ˜ 0 2024. 8. 6.
    ๋ฌธ์˜์•ˆ๋‚ด
    • ํ‹ฐ์Šคํ† ๋ฆฌ
    • ๋กœ๊ทธ์ธ
    • ๊ณ ๊ฐ์„ผํ„ฐ

    ํ‹ฐ์Šคํ† ๋ฆฌ๋Š” ์นด์นด์˜ค์—์„œ ์‚ฌ๋ž‘์„ ๋‹ด์•„ ๋งŒ๋“ญ๋‹ˆ๋‹ค.

    ยฉ Kakao Corp.