์ž์—ฐ์–ด์ฒ˜๋ฆฌ 1

[SBERT] Sentence-BERT

์ผ๋‹จ ์บก์Šคํ†ค์—์„œ SBERT๋ฅผ ์‚ฌ์šฉํ•˜์—ฌ ๋ฌธ์žฅ ์‚ฌ์ด์˜ ์œ ์‚ฌ๋„๋ฅผ ํ‰๊ฐ€ํ•˜๊ธฐ๋กœ ํ•ด์„œ SBERT ๋…ผ๋ฌธ์„ ์ฝ๊ณ  ์ •๋ฆฌํ•ด ๋ณด์•˜๋‹ค Abstract BERT์™€ RoBERTa๋Š” ์˜๋ฏธ๋ก ์  ํ…์ŠคํŠธ ์œ ์‚ฌ์„ฑ(STS)๊ณผ ๊ฐ™์€ sentence-pair regression tasks์— ๋Œ€ํ•œ ์ƒˆ๋กœ์šด ์ตœ์ฒจ๋‹จ ์„ฑ๋Šฅ์„ ๊ฐ€์ง€์ง€๋งŒ, ๋‘ ๋ฌธ์žฅ์„ ๋ชจ๋‘ ๋„คํŠธ์›Œํฌ์— ์ž…๋ ฅํ•ด์•ผ ํ•˜๋ฏ€๋กœ ๊ณ„์‚ฐ ์˜ค๋ฒ„ํ—ค๋“œ๊ฐ€ ๋งค์šฐ ํผ BERT์˜ ๊ตฌ์„ฑ์€ ํด๋Ÿฌ์Šคํ„ฐ๋ง๊ณผ ๊ฐ™์€ ๊ฐ๋…๋˜์ง€ ์•Š์€ ์ž‘์—…๋ฟ๋งŒ ์•„๋‹ˆ๋ผ ์˜๋ฏธ๋ก ์  ์œ ์‚ฌ์„ฑ ๊ฒ€์ƒ‰์—๋„ ์ ํ•ฉํ•˜์ง€ ์•Š์Œ → ์ฝ”์‚ฌ์ธ ์œ ์‚ฌ์„ฑ์„ ์‚ฌ์šฉํ•˜์—ฌ ๋น„๊ตํ•  ์ˆ˜ ์žˆ๋Š” ์˜๋ฏธ๋ก ์ ์œผ๋กœ ์˜๋ฏธ ์žˆ๋Š” ๋ฌธ์žฅ ์ž„๋ฒ ๋”ฉ์„ ๋„์ถœํ•˜๊ธฐ ์œ„ํ•ด siamese and triplet network structures๋ฅผ ์‚ฌ์šฉํ•˜๋Š” ์‚ฌ์ „ ํ›ˆ๋ จ๋œ BERT ๋„คํŠธ์›Œํฌ๋ฅผ ์ˆ˜์ •ํ•œ SBERT(Sentence-BER..