๐Ÿฆ kakaotech
  • VLM (Vision Language Model)์„ ๊ณต๋ถ€ํ•˜๋˜์ค‘ PLLaVA ๋…ผ๋ฌธ์„ ์ฝ์€ํ›„ ์ •๋ฆฌํ•œ ๋‚ด์šฉ์„ ๊ณต์œ ํ•ฉ๋‹ˆ๋‹ค.Paper Link PLLaVA : Parameter-free LLaVA Extension from Images to Videos for Video Dense CaptioningVision-language pre-training has significantly elevated performance across a wide range of image-language applications. Yet, the pre-training process for video-related tasks demands exceptionally large computational and data resources,..

    Read more
  • Q. VLM์„ ์ ์šฉํ•ด์„œ ๋ฐœํ‘œ์ž์˜ ํ–‰๋™์„ ํƒ์ง€ & ๋ถ„์„ โ†’ Prompt๋กœ ํŠน์ง•์ด ๋‚˜์˜ค๋ ค๋ฉด?1. VLM์œผ๋กœ Object Detection์„ ํ•œ ์‚ฌ๋ ˆ๋ฅผ ์•Œ์•„์•ผ ํ•œ๋‹ค.2. VLM์œผ๋กœ ์ตœ๋Œ€ ๋ช‡๋ถ„๊นŒ์ง€์˜ ์˜์ƒ ๋ถ„์„์ด ๊ฐ€๋Šฅํ•œ๊ฐ€? (max 1์‹œ๊ฐ„)3. ์‚ฌ์šฉํ• ์ˆ˜ ์žˆ๋Š” ๋ชจ๋ธ์ด ์žˆ๋Š”๊ฐ€? Fine-tuning๋ฐ ๋ชจ๋ธ ์‚ฌ์šฉ๋ฒ•์€?VLM (Vision Language Model)์„ ๊ณต๋ถ€ํ•˜๋˜์ค‘ Video-LLaMA ๋…ผ๋ฌธ์„ ์ฝ์–ด์„œ ์ •๋ฆฌํ•œ ๋‚ด์šฉ์„ ๊ณต์œ ํ•ฉ๋‹ˆ๋‹ค. Paper Link Video-LLaMA: An Instruction-tuned Audio-Visual Language Model for Video UnderstandingWe present Video-LLaMA a multi-modal framework that empowers L..

    Read more
  • [kakaotech] Pitching ๊ฐœ๋ฐœ๊ธฐ - Vision Language Model Research

    Pitching Project๋ฅผ PM & AI Tech ๋‹ด๋‹น์ž๋กœ ๊ฐœ๋ฐœํ•œ์ง€ ๋ช‡๋‹ฌ์ด ์ง€๋‚ฌ์ง€๋งŒ, ๋‹ค์‹œ ํ•œ๋ฒˆ ์ •๋ฆฌํ•˜๋Š” ๊ฐœ๋…์œผ๋กœ ์–ด๋– ํ•œ ๋‚ด์šฉ์„ ๊ฐœ๋ฐœํ–ˆ๋Š”์ง€ ์˜ฌ๋ ค๋ณด๋ ค๊ณ  ํ•ฉ๋‹ˆ๋‹ค.Pitching Github Organization Pitching-kakaotechPitching์€ "๋ชจ๋‘๊ฐ€ ํŽธํ•˜๊ฒŒ ์†Œํ†ตํ•˜๊ณ , ์ž์‹ ์žˆ๊ฒŒ ๋งํ•˜๋ฉฐ ์—ฐ๊ฒฐ๋œ ์„ธ์ƒ์„ ๋งŒ๋“ค์ž." ๋ผ๋Š” ์ƒ๊ฐ์œผ๋กœ ํƒ„์ƒํ•œ ํ”Œ๋žซํผ์ž…๋‹ˆ๋‹ค. - Pitching-kakaotechgithub.com ํŒ€์—์„œ AI๊ธฐ์ˆ ์„ ํ™œ์šฉํ•œ ์‹ค์‹œ๊ฐ„ ๋ฐœํ‘œ ํ”ผ๋“œ๋ฐฑ ๊ธฐ๋Šฅ์„ ์ œ๊ณตํ•˜๋Š” ํ”„๋กœ๋•ํŠธ๋ฅผ ๋งŒ๋“ค์–ด๋ณด์ž๊ณ  ์•„์ด๋””์–ด๊ฐ€ ๋‚˜์™€์„œ ๊ฐœ๋ฐœ์„ ํ• ๋•Œ,์ฃผ์ œ์™€ MVP & ์š”๊ตฌ์‚ฌํ•ญ ๋ช…์„ธ์„œ(SRS)๋ฅผ ์ •์˜ํ•œํ›„, ๋‚ด์šฉ์„ ํ•œ๋ฒˆ ์ •๋ฆฌํ•ด ๋ณด์•˜์Šต๋‹ˆ๋‹ค.๊ธฐ๋Šฅ ์šฐ์„ ์ˆœ์œ„ ์„ค์ •: ์šฐ์„ ์ˆœ์œ„๋Š” "P0", "P1", "P2"์œผ๋กœ ๊ตฌ๋ถ„๋˜๋ฉฐ, ์‚ฌ์šฉ์ž ..

    Pitching Project๋ฅผ PM & AI Tech ๋‹ด๋‹น์ž๋กœ ๊ฐœ๋ฐœํ•œ์ง€ ๋ช‡๋‹ฌ์ด ์ง€๋‚ฌ์ง€๋งŒ, ๋‹ค์‹œ ํ•œ๋ฒˆ ์ •๋ฆฌํ•˜๋Š” ๊ฐœ๋…์œผ๋กœ ์–ด๋– ํ•œ ๋‚ด์šฉ์„ ๊ฐœ๋ฐœํ–ˆ๋Š”์ง€ ์˜ฌ๋ ค๋ณด๋ ค๊ณ  ํ•ฉ๋‹ˆ๋‹ค.Pitching Github Organization Pitching-kakaotechPitching์€ "๋ชจ๋‘๊ฐ€ ํŽธํ•˜๊ฒŒ ์†Œํ†ตํ•˜๊ณ , ์ž์‹ ์žˆ๊ฒŒ ๋งํ•˜๋ฉฐ ์—ฐ๊ฒฐ๋œ ์„ธ์ƒ์„ ๋งŒ๋“ค์ž." ๋ผ๋Š” ์ƒ๊ฐ์œผ๋กœ ํƒ„์ƒํ•œ ํ”Œ๋žซํผ์ž…๋‹ˆ๋‹ค. - Pitching-kakaotechgithub.com ํŒ€์—์„œ AI๊ธฐ์ˆ ์„ ํ™œ์šฉํ•œ ์‹ค์‹œ๊ฐ„ ๋ฐœํ‘œ ํ”ผ๋“œ๋ฐฑ ๊ธฐ๋Šฅ์„ ์ œ๊ณตํ•˜๋Š” ํ”„๋กœ๋•ํŠธ๋ฅผ ๋งŒ๋“ค์–ด๋ณด์ž๊ณ  ์•„์ด๋””์–ด๊ฐ€ ๋‚˜์™€์„œ ๊ฐœ๋ฐœ์„ ํ• ๋•Œ,์ฃผ์ œ์™€ MVP & ์š”๊ตฌ์‚ฌํ•ญ ๋ช…์„ธ์„œ(SRS)๋ฅผ ์ •์˜ํ•œํ›„, ๋‚ด์šฉ์„ ํ•œ๋ฒˆ ์ •๋ฆฌํ•ด ๋ณด์•˜์Šต๋‹ˆ๋‹ค.๊ธฐ๋Šฅ ์šฐ์„ ์ˆœ์œ„ ์„ค์ •: ์šฐ์„ ์ˆœ์œ„๋Š” "P0", "P1", "P2"์œผ๋กœ ๊ตฌ๋ถ„๋˜๋ฉฐ, ์‚ฌ์šฉ์ž ..

    Read more