้กน็›ฎๆ–‡ไปถๅคน

ๆ–‡ไปถ
wehub-resource-sync e06fe8e8c6
Secret Leaks / trufflehog (push) Failing after 1s
Build documentation / build (push) Failing after 1s
Build documentation / build_other_lang (push) Failing after 0s
CodeQL Security Analysis / CodeQL Analysis (push) Failing after 0s
PR CI / pr-ci (push) Failing after 1s
Slow tests on important models (on Push - A10) / Get all modified files (push) Failing after 1s
Slow tests on important models (on Push - A10) / Model CI (push) Has been skipped
Self-hosted runner (benchmark) / Benchmark (aws-g5-4xlarge-cache) (push) Has been cancelled
New model PR merged notification / Notify new model (push) Has been cancelled
Update Transformers metadata / build_and_package (push) Has been cancelled
chore: import upstream snapshot with attribution
2026-07-13 11:57:37 +08:00

8.3 KiB

Auto ํด๋ž˜์Šคauto-classes

๋งŽ์€ ๊ฒฝ์šฐ, ์‚ฌ์šฉํ•˜๋ ค๋Š” ์•„ํ‚คํ…์ฒ˜๋Š” from_pretrained() ๋ฉ”์†Œ๋“œ์—์„œ ์ œ๊ณตํ•˜๋Š” ์‚ฌ์ „ ํ›ˆ๋ จ๋œ ๋ชจ๋ธ์˜ ์ด๋ฆ„์ด๋‚˜ ๊ฒฝ๋กœ๋กœ๋ถ€ํ„ฐ ์œ ์ถ”ํ•  ์ˆ˜ ์žˆ์Šต๋‹ˆ๋‹ค. AutoClasses๋Š” ์ด ์ž‘์—…์„ ์œ„ํ•ด ์กด์žฌํ•˜๋ฉฐ, ์‚ฌ์ „ ํ•™์Šต๋œ ๋ชจ๋ธ ๊ฐ€์ค‘์น˜/๊ตฌ์„ฑ/๋‹จ์–ด์‚ฌ์ „์— ๋Œ€ํ•œ ์ด๋ฆ„/๊ฒฝ๋กœ๋ฅผ ์ œ๊ณตํ•˜๋ฉด ์ž๋™์œผ๋กœ ๊ด€๋ จ ๋ชจ๋ธ์„ ๊ฐ€์ ธ์˜ค๋„๋ก ๋„์™€์ค๋‹ˆ๋‹ค.

[AutoConfig], [AutoModel], [AutoTokenizer] ์ค‘ ํ•˜๋‚˜๋ฅผ ์ธ์Šคํ„ด์Šคํ™”ํ•˜๋ฉด ํ•ด๋‹น ์•„ํ‚คํ…์ฒ˜์˜ ํด๋ž˜์Šค๋ฅผ ์ง์ ‘ ์ƒ์„ฑํ•ฉ๋‹ˆ๋‹ค. ์˜ˆ๋ฅผ ๋“ค์–ด,

model = AutoModel.from_pretrained("google-bert/bert-base-cased")

์œ„ ์ฝ”๋“œ๋Š” [BertModel]์˜ ์ธ์Šคํ„ด์Šค์ธ ๋ชจ๋ธ์„ ์ƒ์„ฑํ•ฉ๋‹ˆ๋‹ค.

๊ฐ ์ž‘์—…์— ๋Œ€ํ•ด ํ•˜๋‚˜์˜ AutoModel ํด๋ž˜์Šค๊ฐ€ ์žˆ์œผ๋ฉฐ, ๊ฐ๊ฐ์˜ ๋ฐฑ์—”๋“œ(PyTorch, TensorFlow ๋˜๋Š” Flax)์— ํ•ด๋‹นํ•˜๋Š” ํด๋ž˜์Šค๊ฐ€ ์กด์žฌํ•ฉ๋‹ˆ๋‹ค.

์ž๋™ ํด๋ž˜์Šค ํ™•์žฅextending-the-auto-classes

๊ฐ ์ž๋™ ํด๋ž˜์Šค๋Š” ์‚ฌ์šฉ์ž์˜ ์ปค์Šคํ…€ ํด๋ž˜์Šค๋กœ ํ™•์žฅ๋  ์ˆ˜ ์žˆ๋Š” ๋ฉ”์†Œ๋“œ๋ฅผ ๊ฐ€์ง€๊ณ  ์žˆ์Šต๋‹ˆ๋‹ค. ์˜ˆ๋ฅผ ๋“ค์–ด, NewModel์ด๋ผ๋Š” ์ปค์Šคํ…€ ๋ชจ๋ธ ํด๋ž˜์Šค๋ฅผ ์ •์˜ํ–ˆ๋‹ค๋ฉด, NewModelConfig๋ฅผ ์ค€๋น„ํ•œ ํ›„ ๋‹ค์Œ๊ณผ ๊ฐ™์ด ์ž๋™ ํด๋ž˜์Šค์— ์ถ”๊ฐ€ํ•  ์ˆ˜ ์žˆ์Šต๋‹ˆ๋‹ค:

from transformers import AutoConfig, AutoModel

AutoConfig.register("new-model", NewModelConfig)
AutoModel.register(NewModelConfig, NewModel)

์ดํ›„์—๋Š” ์ผ๋ฐ˜์ ์œผ๋กœ ์ž๋™ ํด๋ž˜์Šค๋ฅผ ์‚ฌ์šฉํ•˜๋Š” ๊ฒƒ์ฒ˜๋Ÿผ ์‚ฌ์šฉํ•  ์ˆ˜ ์žˆ์Šต๋‹ˆ๋‹ค!

๋งŒ์•ฝ NewModelConfig๊ฐ€ [~transformers.PreTrainedConfig]์˜ ์„œ๋ธŒํด๋ž˜์Šค๋ผ๋ฉด, ํ•ด๋‹น model_type ์†์„ฑ์ด ๋“ฑ๋กํ•  ๋•Œ ์‚ฌ์šฉํ•˜๋Š” ํ‚ค(์—ฌ๊ธฐ์„œ๋Š” "new-model")์™€ ๋™์ผํ•˜๊ฒŒ ์„ค์ •๋˜์–ด ์žˆ๋Š”์ง€ ํ™•์ธํ•˜์„ธ์š”.

๋งˆ์ฐฌ๊ฐ€์ง€๋กœ, NewModel์ด [PreTrainedModel]์˜ ์„œ๋ธŒํด๋ž˜์Šค๋ผ๋ฉด, ํ•ด๋‹น config_class ์†์„ฑ์ด ๋“ฑ๋กํ•  ๋•Œ ์‚ฌ์šฉํ•˜๋Š” ํด๋ž˜์Šค(์—ฌ๊ธฐ์„œ๋Š” NewModelConfig)์™€ ๋™์ผํ•˜๊ฒŒ ์„ค์ •๋˜์–ด ์žˆ๋Š”์ง€ ํ™•์ธํ•˜์„ธ์š”.

AutoConfigtransformers.AutoConfig

autodoc AutoConfig

AutoTokenizertransformers.AutoTokenizer

autodoc AutoTokenizer

AutoFeatureExtractortransformers.AutoFeatureExtractor

autodoc AutoFeatureExtractor

AutoImageProcessortransformers.AutoImageProcessor

autodoc AutoImageProcessor

AutoProcessortransformers.AutoProcessor

autodoc AutoProcessor

์ผ๋ฐ˜์ ์ธ ๋ชจ๋ธ ํด๋ž˜์Šคgeneric-model-classes

๋‹ค์Œ ์ž๋™ ํด๋ž˜์Šค๋“ค์€ ํŠน์ • ํ—ค๋“œ ์—†์ด ๊ธฐ๋ณธ ๋ชจ๋ธ ํด๋ž˜์Šค๋ฅผ ์ธ์Šคํ„ด์Šคํ™”ํ•˜๋Š” ๋ฐ ์‚ฌ์šฉํ•  ์ˆ˜ ์žˆ์Šต๋‹ˆ๋‹ค.

AutoModeltransformers.AutoModel

autodoc AutoModel

์ผ๋ฐ˜์ ์ธ ์‚ฌ์ „ ํ•™์Šต ํด๋ž˜์Šคgeneric-pretraining-classes

๋‹ค์Œ ์ž๋™ ํด๋ž˜์Šค๋“ค์€ ์‚ฌ์ „ ํ›ˆ๋ จ ํ—ค๋“œ๊ฐ€ ํฌํ•จ๋œ ๋ชจ๋ธ์„ ์ธ์Šคํ„ด์Šคํ™”ํ•˜๋Š” ๋ฐ ์‚ฌ์šฉํ•  ์ˆ˜ ์žˆ์Šต๋‹ˆ๋‹ค.

AutoModelForPreTrainingtransformers.AutoModelForPreTraining

autodoc AutoModelForPreTraining

์ž์—ฐ์–ด ์ฒ˜๋ฆฌnatural-language-processing

๋‹ค์Œ ์ž๋™ ํด๋ž˜์Šค๋“ค์€ ์•„๋ž˜์˜ ์ž์—ฐ์–ด ์ฒ˜๋ฆฌ ์ž‘์—…์— ์‚ฌ์šฉํ•  ์ˆ˜ ์žˆ์Šต๋‹ˆ๋‹ค.

AutoModelForCausalLMtransformers.AutoModelForCausalLM

autodoc AutoModelForCausalLM

AutoModelForMaskedLMtransformers.AutoModelForMaskedLM

autodoc AutoModelForMaskedLM

AutoModelForMaskGenerationtransformers.AutoModelForMaskGeneration

autodoc AutoModelForMaskGeneration

AutoModelForSeq2SeqLMtransformers.AutoModelForSeq2SeqLM

autodoc AutoModelForSeq2SeqLM

AutoModelForSequenceClassificationtransformers.AutoModelForSequenceClassification

autodoc AutoModelForSequenceClassification

AutoModelForMultipleChoicetransformers.AutoModelForMultipleChoice

autodoc AutoModelForMultipleChoice

AutoModelForNextSentencePredictiontransformers.AutoModelForNextSentencePrediction

autodoc AutoModelForNextSentencePrediction

AutoModelForTokenClassificationtransformers.AutoModelForTokenClassification

autodoc AutoModelForTokenClassification

AutoModelForQuestionAnsweringtransformers.AutoModelForQuestionAnswering

autodoc AutoModelForQuestionAnswering

AutoModelForTextEncodingtransformers.AutoModelForTextEncoding

autodoc AutoModelForTextEncoding

์ปดํ“จํ„ฐ ๋น„์ „computer-vision

๋‹ค์Œ ์ž๋™ ํด๋ž˜์Šค๋“ค์€ ์•„๋ž˜์˜ ์ปดํ“จํ„ฐ ๋น„์ „ ์ž‘์—…์— ์‚ฌ์šฉํ•  ์ˆ˜ ์žˆ์Šต๋‹ˆ๋‹ค.

AutoModelForDepthEstimationtransformers.AutoModelForDepthEstimation

autodoc AutoModelForDepthEstimation

AutoModelForImageClassificationtransformers.AutoModelForImageClassification

autodoc AutoModelForImageClassification

AutoModelForVideoClassificationtransformers.AutoModelForVideoClassification

autodoc AutoModelForVideoClassification

AutoModelForKeypointDetectiontransformers.AutoModelForKeypointDetection

autodoc AutoModelForKeypointDetection

AutoModelForMaskedImageModelingtransformers.AutoModelForMaskedImageModeling

autodoc AutoModelForMaskedImageModeling

AutoModelForObjectDetectiontransformers.AutoModelForObjectDetection

autodoc AutoModelForObjectDetection

AutoModelForImageSegmentationtransformers.AutoModelForImageSegmentation

autodoc AutoModelForImageSegmentation

AutoModelForImageToImagetransformers.AutoModelForImageToImage

autodoc AutoModelForImageToImage

AutoModelForSemanticSegmentationtransformers.AutoModelForSemanticSegmentation

autodoc AutoModelForSemanticSegmentation

AutoModelForInstanceSegmentationtransformers.AutoModelForInstanceSegmentation

autodoc AutoModelForInstanceSegmentation

AutoModelForUniversalSegmentationtransformers.AutoModelForUniversalSegmentation

autodoc AutoModelForUniversalSegmentation

AutoModelForZeroShotImageClassificationtransformers.AutoModelForZeroShotImageClassification

autodoc AutoModelForZeroShotImageClassification

AutoModelForZeroShotObjectDetectiontransformers.AutoModelForZeroShotObjectDetection

autodoc AutoModelForZeroShotObjectDetection

์˜ค๋””์˜คaudio

๋‹ค์Œ ์ž๋™ ํด๋ž˜์Šค๋“ค์€ ์•„๋ž˜์˜ ์˜ค๋””์˜ค ์ž‘์—…์— ์‚ฌ์šฉํ•  ์ˆ˜ ์žˆ์Šต๋‹ˆ๋‹ค.

AutoModelForAudioClassificationtransformers.AutoModelForAudioClassification

autodoc AutoModelForAudioClassification

AutoModelForAudioFrameClassificationtransformers.AutoModelForAudioFrameClassification

autodoc AutoModelForAudioFrameClassification

AutoModelForCTCtransformers.AutoModelForCTC

autodoc AutoModelForCTC

AutoModelForSpeechSeq2Seqtransformers.AutoModelForSpeechSeq2Seq

autodoc AutoModelForSpeechSeq2Seq

AutoModelForAudioXVectortransformers.AutoModelForAudioXVector

autodoc AutoModelForAudioXVector

AutoModelForTextToSpectrogramtransformers.AutoModelForTextToSpectrogram

autodoc AutoModelForTextToSpectrogram

AutoModelForTextToWaveformtransformers.AutoModelForTextToWaveform

autodoc AutoModelForTextToWaveform

๋ฉ€ํ‹ฐ๋ชจ๋‹ฌmultimodal

๋‹ค์Œ ์ž๋™ ํด๋ž˜์Šค๋“ค์€ ์•„๋ž˜์˜ ๋ฉ€ํ‹ฐ๋ชจ๋‹ฌ ์ž‘์—…์— ์‚ฌ์šฉํ•  ์ˆ˜ ์žˆ์Šต๋‹ˆ๋‹ค.

AutoModelForTableQuestionAnsweringtransformers.AutoModelForTableQuestionAnswering

autodoc AutoModelForTableQuestionAnswering

AutoModelForDocumentQuestionAnsweringtransformers.AutoModelForDocumentQuestionAnswering

autodoc AutoModelForDocumentQuestionAnswering

AutoModelForVisualQuestionAnsweringtransformers.AutoModelForVisualQuestionAnswering

autodoc AutoModelForVisualQuestionAnswering

Time Series

AutoModelForTimeSeriesPredictiontransformers.AutoModelForTimeSeriesPrediction

autodoc AutoModelForTimeSeriesPrediction