์ „์ฒด ๊ธ€

I'm Game Challenger
๐Ÿ“ NLP (์ž์—ฐ์–ด์ฒ˜๋ฆฌ)/๐Ÿ—จ๏ธ Linguistic Engineering

[Syntax] Sentence Structure - ๋ฌธ์žฅ ๊ตฌ์กฐ

Sentence Sentence Structure “The child found the puppy” ๋ฌธ์žฅ์€ ๋‹ค์Œ๊ณผ ๊ฐ™์€ ํ…œํ”Œ๋ฆฟ์„ ๊ธฐ๋ฐ˜์œผ๋กœ ํ•œ๋‹ค๊ณ  ๋งํ•  ์ˆ˜ ์žˆ๋‹ค. Det—N—V—Det—N ์ด๊ฒƒ์€ ๋ฌธ์žฅ์ด ๋‚ด๋ถ€ ๊ตฌ์กฐ๊ฐ€ ์—†๋Š” ๋‹จ์–ด์˜ ๋ฌธ์ž์—ด์— ๋ถˆ๊ณผํ•˜๋‹ค๋Š” ๊ฒƒ์„ ์˜๋ฏธ ๋ฌธ์žฅ์€ ํ•œ์ธต ์งœ๋ฆฌ ๋šœ๋ ทํ•œ ๊ตฌ์กฐ๋กœ ์ด๋ฃจ์–ด์ ธ ์žˆ์ง€ ์•Š๊ณ , ๊ณ„์ธต์  ๊ตฌ์กฐ ๋กœ ์ด๋ฃจ์–ด์ ธ ์žˆ๋‹ค. ์ด ๋ฌธ์žฅ์€ ์‹ค์ œ๋กœ ์—ฌ๋Ÿฌ ๊ทธ๋ฃน์œผ๋กœ ๋‚˜๋ˆŒ ์ˆ˜ ์žˆ๋‹ค ์–ด๋–ป๊ฒŒ ๊ฒฐํ•ฉํ•˜๋Š” ์ง€์— ๋”ฐ๋ผ ๋ง์˜ ์˜๋ฏธ๊ฐ€ ๋‹ฌ๋ผ์ง„๋‹ค. ๐Ÿ’ก example [the child] [found a puppy] [the child] [found [a puppy]] [[the] [child]] [[found] [[a] [puppy]] ํŠธ๋ฆฌ ๋‹ค์ด์–ด๊ทธ๋žจ์€ ๋ฌธ์žฅ์˜ ๊ณ„์ธต ๊ตฌ์กฐ๋ฅผ ๋ณด์—ฌ์ฃผ๋Š” ๋ฐ ์‚ฌ์šฉ๋œ๋‹ค. Syntactic Ca..

๐Ÿ“ NLP (์ž์—ฐ์–ด์ฒ˜๋ฆฌ)/๐Ÿ—จ๏ธ Linguistic Engineering

[Syntax] Syntax Intro - ๊ตฌ๋ฌธ

Syntax - ๋ฌธ์žฅ์˜ pattern ์—ฐ๊ตฌ (๋ฌธ๋ฒ•) Syntax ๋ชจ๋“  ์ธ๊ฐ„ ์–ธ์–ด๋ฅผ ๊ตฌ์‚ฌํ•˜๋Š” ์‚ฌ๋žŒ์€ ๋ฌดํ•œํ•œ ์ˆ˜์˜ ๊ฐ€๋Šฅํ•œ ๋ฌธ์žฅ์„ ์ƒ์‚ฐํ•˜๊ณ  ์ดํ•ดํ•  ์ˆ˜ ์žˆ๋‹ค. ํ•˜์ง€๋งŒ, ์šฐ๋ฆฌ๋Š” ๊ฐ€๋Šฅํ•œ ๋ชจ๋“  ๋ฌธ์žฅ๋“ค์— ๋Œ€ํ•œ mental dictionary์„ ๊ฐ€์งˆ ์ˆ˜ ์—†๋‹ค. ์˜คํžˆ๋ ค, ์šฐ๋ฆฌ๋Š” ์šฐ๋ฆฌ์˜ ๋‡Œ์— ์ €์žฅ๋œ ๋ฌธ์žฅ์„ ํ˜•์„ฑํ•˜๊ธฐ ์œ„ํ•œ ๊ทœ์น™์„ ๊ฐ€์ง€๊ณ  ์žˆ์Šต๋‹ˆ๋‹ค. What Grammaticality Is Not Based On ๋ฌธ๋ฒ•์„ฑ ์€ ์˜๋ฏธ & ์ง„์‹ค์„ฑ์— ๊ธฐ์ดˆ ํ•˜์ง€ ์•Š๋Š”๋‹ค. ๐Ÿ’ก example Enormous crickets in pink socks danced at the prom. ๋ฌด๋„ํšŒ์—์„œ ๋ถ„ํ™์ƒ‰ ์–‘๋ง์„ ์‹ ์€ ๊ฑฐ๋Œ€ํ•œ ๊ท€๋šœ๋ผ๋ฏธ๊ฐ€ ์ถค์„ ์ถ”์—ˆ๋‹ค. ๊ท€๋šœ๋ผ๋ฏธ๊ฐ€ ์ถค์„ ์ถ”์—ˆ๋‹ค๋Š”๊ฑด → ๋ง์ด ๋˜์ง€ ์•Š์Œ. ๋ฌธ๋ฒ•์€ ๋งž์•„๋„ ๋ง์ด ๋˜์ง€ ์•Š๋Š”๋‹ค. → ๊ทธ๋ ‡์ง€๋งŒ Di..

๐Ÿ–ฅ๏ธ Deep Learning

[DL] Preparations for Deep Learning - ์ค€๋น„์‚ฌํ•ญ & Python ๊ธฐ๋ณธ๋ฌธ๋ฒ•

๋”ฅ๋Ÿฌ๋‹์„ ๊ณต๋ถ€ํ•˜๊ธฐ ์œ„ํ•˜์—ฌ ํ•„์š”ํ•œ ์ค€๋น„๋ฌผ ๋”ฅ๋Ÿฌ๋‹์„ ๊ณต๋ถ€ํ•˜๋ฉด์„œ ์ตœ์†Œํ•œ์œผ๋กœ ํ•„์š”ํ•œ ์ค€๋น„๋ฌผ์ด ์žˆ๋‹ค๋ฉด 3๊ฐ€์ง€๋ฅผ ์ ์–ด๋ณผ์ˆ˜ ์žˆ์„๊ฑฐ ๊ฐ™์•„์š”. Python 3.X ๋ฒ„์ „, Numpy Library, Matplotlib Library ์ž…๋‹ˆ๋‹ค. Numpy Library Python ์—์„œ ๊ณผํ•™์  ๊ณ„์‚ฐ & ์ˆ˜์น˜๋ฅผ ๊ณ„์‚ฐํ•˜๊ธฐ ์œ„ํ•œ ํ•ต์‹ฌ ๋ผ์ด๋ธŒ๋Ÿฌ๋ฆฌ์ž…๋‹ˆ๋‹ค. NumPy๋Š” ๊ณ ์„ฑ๋Šฅ์˜ ๋‹ค์ฐจ์› ๋ฐฐ์—ด ๊ฐ์ฒด์™€ ์ด๋ฅผ ๋‹ค๋ฃฐ ๋„๊ตฌ๋ฅผ ์ œ๊ณตํ•ฉ๋‹ˆ๋‹ค. ์ˆ˜์น˜ ๊ณ„์‚ฐ์„ ์œ„ํ•œ ๋งค์šฐ ํšจ๊ณผ์ ์ธ ์ธํ„ฐํŽ˜์ด์Šค๋ฅผ ์ œ๊ณตํ•˜๋ฉฐ, ์ด๋Š” ๋ฐ์ดํ„ฐ ๋ถ„์„, ๋จธ์‹  ๋Ÿฌ๋‹ ๋“ฑ ๋‹ค์–‘ํ•œ ๋ถ„์•ผ์—์„œ ์‚ฌ์šฉ๋ฉ๋‹ˆ๋‹ค. Matplotlib Library ๋ฐ์ดํ„ฐ๋ฅผ ์ฐจํŠธ๋‚˜ ํ”Œ๋กฏ์œผ๋กœ ์‹œ๊ฐํ™”ํ•˜๋Š” ๋ผ์ด๋ธŒ๋Ÿฌ๋ฆฌ์ž…๋‹ˆ๋‹ค. ๋ผ์ธ ํ”Œ๋กฏ, ์Šค์บํ„ฐ ํ”Œ๋กฏ, ํžˆ์Šคํ† ๊ทธ๋žจ ๋“ฑ ๋‹ค์–‘ํ•œ ํ”Œ๋กฏ์„ ์ง€์›ํ•˜๋ฉฐ, ๊ทธ๋ž˜ํ”„์— ๋Œ€ํ•œ ์ƒ์„ธํ•œ ์„ค์ •์„ ํ•  ์ˆ˜ ์žˆ์Šต๋‹ˆ..

๐Ÿ“ NLP (์ž์—ฐ์–ด์ฒ˜๋ฆฌ)/๐Ÿ—จ๏ธ Linguistic Engineering

[Words] Words - ๋‹จ์–ด

The Words of Language ๋‹จ์–ด๋Š” ์–ธ์–ด์  ์ง€์‹์˜ ์ค‘์š”ํ•œ ๋ถ€๋ถ„ & ๋ฌธ๋ฒ•์˜ ๊ตฌ์„ฑ ์š”์†Œ๋ฅผ ๊ตฌ์„ฑ ์šฐ๋ฆฌ๊ฐ€ ์•„๋Š” ๋ชจ๋“  ๋‹จ์–ด๋Š” mental dictionary๋ฅผ ๊ฐ€์ง€๊ณ  ์žˆ๋‹ค. Pronunciation (๋ฐœ์Œ) Meaning (์˜๋ฏธ) Orthography (Spelling) - ๋งž์ถค๋ฒ• Grammatial Category (๋ฌธ๋ฒ• ๋ฒ”์ฃผ) Morphology (ํ˜•ํƒœ์†Œ) ํ˜•ํƒœ์†Œ ๋ผ๊ณ  ํ•˜๋Š” ์ž‘์€ ๋‹จ์œ„๋กœ ๋ณธ๋‹ค. ์œ ํ•œํ•œ ๋ฐ์ดํ„ฐ์—์„œ ๋งŒ๋“ค์–ด ๋‚ด์ง€๋งŒ ์œ ํ•œํ•œ ๊ทœ์น™์ด ์žˆ๋‹ค. example) ๋‚˜๋Š” ํ•™๊ต์— ๊ฐ„๋‹ค, ํ•˜๋Š˜์„ ๋‚˜๋Š” ์ƒˆ ์‹ค์ œ๋กœ Morphological Persingํ•˜๋ฉด ๋˜‘๊ฐ™์€ ๋‚˜๋Š” ์ด์ง€๋งŒ ๋‚˜ → ๋Œ€๋ช…์‚ฌ, ์กฐ์‚ฌ ์ƒ๊ฐ๋งŒ ๋‚œ๋‹ค. Normalization (ํ‘œ์ค€ํ™”) ๋ฌธ์žฅ์„ ๋‚˜๋ˆ„๋ ค๋ฉด ๋ฌธ์žฅ๋ถ€ํ˜ธ ๊ฐ€ ์žˆ์–ด์•ผ ํ•œ๋‹ค, ๋ถ€ํ˜ธ ์—†์–ด๋„ ๋‚˜๋ˆ ์•ผ ..

๐Ÿ“ NLP (์ž์—ฐ์–ด์ฒ˜๋ฆฌ)/๐Ÿ—จ๏ธ Linguistic Engineering

[Intro] Introduction to Language Engineering - ์–ธ์–ด๊ณตํ•™๊ฐœ๋ก 

1. ์–ธ์–ด๊ณตํ•™๊ฐœ๋ก  ์„œ๋ก  1) ๋ฌธ๋งฅ์˜ ์ค‘์š”์„ฑ ํ•œ๊ตญ์–ด๋Š” ํ•œ๊ตญ์–ด์˜ ํŠน์ง•, ์˜์–ด๋Š” ์˜์–ด์˜ ํŠน์ง•์ด ์žˆ๋‹ค. ํ•œ๊ตญ์–ด๋ฅผ ์˜์–ด๋กœ ํ•ด์„ํ•œ๋‹ค๊ณ  ํ•ด์„œ 1:1๋กœ ๋Œ€์‘ํ•˜์—ฌ ๋‹จ์–ด ํ•˜๋‚˜ํ•˜๋‚˜๋ฅผ ํ•ด์„ํ•˜์ง€๋Š” ์•Š์„ ๊ฒƒ์ด๋‹ค. ๋ฌธ๋งฅ์˜ ์ค‘์š”์„ฑ ์ƒํ™ฉ์ด ๋‹ฌ๋ผ์ง€๋ฉด T, F๊ฐ€ ๋‹ฌ๋ผ์งˆ ์ˆ˜ ์žˆ๋“ฏ์ด ์–ด๋– ํ•œ ๋ช…์ œ๋„ ์ฐธ์ด๋ผ๊ณ  ํ•˜๊ธฐ์—” ์–ด๋ ค์šฐ๋‚˜ ๋ณดํ†ต ๊ทธ๋Ÿฐ ๋ช…์ œ๋“ค์€ ‘์ด์‹œ๋Œ€ ๋ชจ๋“  ์‚ฌ๋žŒ๋“ค์ด ์ƒ๊ฐํ•˜๋Š” ๊ณตํ†ต์ ’๊ณผ ๊ฐ™์€ ๋งฅ๋ฝ์—์„œ ์ƒ๊ฐํ•ด์•ผํ•œ๋‹ค. ์ƒ๊ฐํ•ด์•ผํ•  ์‚ฌํ•ญ ์ธ๊ฐ„์ด ์ดํ•ดํ•˜๊ธฐ์—” ๋‹น์—ฐํ•˜๊ณ  ์‰ฌ์šด ์ผ์ด์ง€๋งŒ, ์ธ๊ฐ„์ด ์–ธ์–ด๋ฅผ ์ดํ•ดํ•  ๋•Œ ์ž์—ฐ์Šค๋Ÿฝ๊ณ  ๋‹น์—ฐํ•˜๋‹ค๊ณ  ๋Š๋ผ๋Š” ๊ฒƒ์ด ์ปดํ“จํ„ฐ์—๊ฒ ์–ด๋ ต๋‹ค. ๋”ฅ๋Ÿฌ๋‹์— ์ ์šฉํ•˜๊ธฐ์—” ์–ด๋ ค์šด ์ธ๊ฐ„์˜ ๊ทœ์น™์ด, ๋”ฅ๋Ÿฌ๋‹์„ ํ™œ์šฉํ•จ์œผ๋กœ์จ ์˜คํžˆ๋ ค ๋” ์‰ฝ๊ฒŒ ํ™œ์šฉํ•  ์ˆ˜ ์žˆ๊ธฐ๋„ ํ•˜๋‹ค. ์šฐ๋ฆฌ๊ฐ€ ์–ด๋–ป๊ฒŒ ์–ธ์–ด๋ฅผ ์ดํ•ดํ•˜๋Š”์ง€? (์ปดํ“จํ„ฐ์™€ ๋‹ค๋ฅธ ์ ) ์ปดํ“จํ„ฐ๊ฐ€ ์ธ๊ฐ„์˜ ์–ธ์–ด๋ฅผ ์ดํ•ดํ•˜๋Š” ๋ฐฉํ–ฅ..

Bigbread1129
My Dev & Research Repository