8.3 KiB
Auto ํด๋์คauto-classes
๋ง์ ๊ฒฝ์ฐ, ์ฌ์ฉํ๋ ค๋ ์ํคํ
์ฒ๋ from_pretrained() ๋ฉ์๋์์ ์ ๊ณตํ๋ ์ฌ์ ํ๋ จ๋ ๋ชจ๋ธ์ ์ด๋ฆ์ด๋ ๊ฒฝ๋ก๋ก๋ถํฐ ์ ์ถํ ์ ์์ต๋๋ค. AutoClasses๋ ์ด ์์
์ ์ํด ์กด์ฌํ๋ฉฐ, ์ฌ์ ํ์ต๋ ๋ชจ๋ธ ๊ฐ์ค์น/๊ตฌ์ฑ/๋จ์ด์ฌ์ ์ ๋ํ ์ด๋ฆ/๊ฒฝ๋ก๋ฅผ ์ ๊ณตํ๋ฉด ์๋์ผ๋ก ๊ด๋ จ ๋ชจ๋ธ์ ๊ฐ์ ธ์ค๋๋ก ๋์์ค๋๋ค.
[AutoConfig], [AutoModel], [AutoTokenizer] ์ค ํ๋๋ฅผ ์ธ์คํด์คํํ๋ฉด ํด๋น ์ํคํ
์ฒ์ ํด๋์ค๋ฅผ ์ง์ ์์ฑํฉ๋๋ค. ์๋ฅผ ๋ค์ด,
model = AutoModel.from_pretrained("google-bert/bert-base-cased")
์ ์ฝ๋๋ [BertModel]์ ์ธ์คํด์ค์ธ ๋ชจ๋ธ์ ์์ฑํฉ๋๋ค.
๊ฐ ์์
์ ๋ํด ํ๋์ AutoModel ํด๋์ค๊ฐ ์์ผ๋ฉฐ, ๊ฐ๊ฐ์ ๋ฐฑ์๋(PyTorch, TensorFlow ๋๋ Flax)์ ํด๋นํ๋ ํด๋์ค๊ฐ ์กด์ฌํฉ๋๋ค.
์๋ ํด๋์ค ํ์ฅextending-the-auto-classes
๊ฐ ์๋ ํด๋์ค๋ ์ฌ์ฉ์์ ์ปค์คํ
ํด๋์ค๋ก ํ์ฅ๋ ์ ์๋ ๋ฉ์๋๋ฅผ ๊ฐ์ง๊ณ ์์ต๋๋ค. ์๋ฅผ ๋ค์ด, NewModel์ด๋ผ๋ ์ปค์คํ
๋ชจ๋ธ ํด๋์ค๋ฅผ ์ ์ํ๋ค๋ฉด, NewModelConfig๋ฅผ ์ค๋นํ ํ ๋ค์๊ณผ ๊ฐ์ด ์๋ ํด๋์ค์ ์ถ๊ฐํ ์ ์์ต๋๋ค:
from transformers import AutoConfig, AutoModel
AutoConfig.register("new-model", NewModelConfig)
AutoModel.register(NewModelConfig, NewModel)
์ดํ์๋ ์ผ๋ฐ์ ์ผ๋ก ์๋ ํด๋์ค๋ฅผ ์ฌ์ฉํ๋ ๊ฒ์ฒ๋ผ ์ฌ์ฉํ ์ ์์ต๋๋ค!
๋ง์ฝ NewModelConfig๊ฐ [~transformers.PreTrainedConfig]์ ์๋ธํด๋์ค๋ผ๋ฉด, ํด๋น model_type ์์ฑ์ด ๋ฑ๋กํ ๋ ์ฌ์ฉํ๋ ํค(์ฌ๊ธฐ์๋ "new-model")์ ๋์ผํ๊ฒ ์ค์ ๋์ด ์๋์ง ํ์ธํ์ธ์.
๋ง์ฐฌ๊ฐ์ง๋ก, NewModel์ด [PreTrainedModel]์ ์๋ธํด๋์ค๋ผ๋ฉด, ํด๋น config_class ์์ฑ์ด ๋ฑ๋กํ ๋ ์ฌ์ฉํ๋ ํด๋์ค(์ฌ๊ธฐ์๋ NewModelConfig)์ ๋์ผํ๊ฒ ์ค์ ๋์ด ์๋์ง ํ์ธํ์ธ์.
AutoConfigtransformers.AutoConfig
autodoc AutoConfig
AutoTokenizertransformers.AutoTokenizer
autodoc AutoTokenizer
AutoFeatureExtractortransformers.AutoFeatureExtractor
autodoc AutoFeatureExtractor
AutoImageProcessortransformers.AutoImageProcessor
autodoc AutoImageProcessor
AutoProcessortransformers.AutoProcessor
autodoc AutoProcessor
์ผ๋ฐ์ ์ธ ๋ชจ๋ธ ํด๋์คgeneric-model-classes
๋ค์ ์๋ ํด๋์ค๋ค์ ํน์ ํค๋ ์์ด ๊ธฐ๋ณธ ๋ชจ๋ธ ํด๋์ค๋ฅผ ์ธ์คํด์คํํ๋ ๋ฐ ์ฌ์ฉํ ์ ์์ต๋๋ค.
AutoModeltransformers.AutoModel
autodoc AutoModel
์ผ๋ฐ์ ์ธ ์ฌ์ ํ์ต ํด๋์คgeneric-pretraining-classes
๋ค์ ์๋ ํด๋์ค๋ค์ ์ฌ์ ํ๋ จ ํค๋๊ฐ ํฌํจ๋ ๋ชจ๋ธ์ ์ธ์คํด์คํํ๋ ๋ฐ ์ฌ์ฉํ ์ ์์ต๋๋ค.
AutoModelForPreTrainingtransformers.AutoModelForPreTraining
autodoc AutoModelForPreTraining
์์ฐ์ด ์ฒ๋ฆฌnatural-language-processing
๋ค์ ์๋ ํด๋์ค๋ค์ ์๋์ ์์ฐ์ด ์ฒ๋ฆฌ ์์ ์ ์ฌ์ฉํ ์ ์์ต๋๋ค.
AutoModelForCausalLMtransformers.AutoModelForCausalLM
autodoc AutoModelForCausalLM
AutoModelForMaskedLMtransformers.AutoModelForMaskedLM
autodoc AutoModelForMaskedLM
AutoModelForMaskGenerationtransformers.AutoModelForMaskGeneration
autodoc AutoModelForMaskGeneration
AutoModelForSeq2SeqLMtransformers.AutoModelForSeq2SeqLM
autodoc AutoModelForSeq2SeqLM
AutoModelForSequenceClassificationtransformers.AutoModelForSequenceClassification
autodoc AutoModelForSequenceClassification
AutoModelForMultipleChoicetransformers.AutoModelForMultipleChoice
autodoc AutoModelForMultipleChoice
AutoModelForNextSentencePredictiontransformers.AutoModelForNextSentencePrediction
autodoc AutoModelForNextSentencePrediction
AutoModelForTokenClassificationtransformers.AutoModelForTokenClassification
autodoc AutoModelForTokenClassification
AutoModelForQuestionAnsweringtransformers.AutoModelForQuestionAnswering
autodoc AutoModelForQuestionAnswering
AutoModelForTextEncodingtransformers.AutoModelForTextEncoding
autodoc AutoModelForTextEncoding
์ปดํจํฐ ๋น์ computer-vision
๋ค์ ์๋ ํด๋์ค๋ค์ ์๋์ ์ปดํจํฐ ๋น์ ์์ ์ ์ฌ์ฉํ ์ ์์ต๋๋ค.
AutoModelForDepthEstimationtransformers.AutoModelForDepthEstimation
autodoc AutoModelForDepthEstimation
AutoModelForImageClassificationtransformers.AutoModelForImageClassification
autodoc AutoModelForImageClassification
AutoModelForVideoClassificationtransformers.AutoModelForVideoClassification
autodoc AutoModelForVideoClassification
AutoModelForKeypointDetectiontransformers.AutoModelForKeypointDetection
autodoc AutoModelForKeypointDetection
AutoModelForMaskedImageModelingtransformers.AutoModelForMaskedImageModeling
autodoc AutoModelForMaskedImageModeling
AutoModelForObjectDetectiontransformers.AutoModelForObjectDetection
autodoc AutoModelForObjectDetection
AutoModelForImageSegmentationtransformers.AutoModelForImageSegmentation
autodoc AutoModelForImageSegmentation
AutoModelForImageToImagetransformers.AutoModelForImageToImage
autodoc AutoModelForImageToImage
AutoModelForSemanticSegmentationtransformers.AutoModelForSemanticSegmentation
autodoc AutoModelForSemanticSegmentation
AutoModelForInstanceSegmentationtransformers.AutoModelForInstanceSegmentation
autodoc AutoModelForInstanceSegmentation
AutoModelForUniversalSegmentationtransformers.AutoModelForUniversalSegmentation
autodoc AutoModelForUniversalSegmentation
AutoModelForZeroShotImageClassificationtransformers.AutoModelForZeroShotImageClassification
autodoc AutoModelForZeroShotImageClassification
AutoModelForZeroShotObjectDetectiontransformers.AutoModelForZeroShotObjectDetection
autodoc AutoModelForZeroShotObjectDetection
์ค๋์คaudio
๋ค์ ์๋ ํด๋์ค๋ค์ ์๋์ ์ค๋์ค ์์ ์ ์ฌ์ฉํ ์ ์์ต๋๋ค.
AutoModelForAudioClassificationtransformers.AutoModelForAudioClassification
autodoc AutoModelForAudioClassification
AutoModelForAudioFrameClassificationtransformers.AutoModelForAudioFrameClassification
autodoc AutoModelForAudioFrameClassification
AutoModelForCTCtransformers.AutoModelForCTC
autodoc AutoModelForCTC
AutoModelForSpeechSeq2Seqtransformers.AutoModelForSpeechSeq2Seq
autodoc AutoModelForSpeechSeq2Seq
AutoModelForAudioXVectortransformers.AutoModelForAudioXVector
autodoc AutoModelForAudioXVector
AutoModelForTextToSpectrogramtransformers.AutoModelForTextToSpectrogram
autodoc AutoModelForTextToSpectrogram
AutoModelForTextToWaveformtransformers.AutoModelForTextToWaveform
autodoc AutoModelForTextToWaveform
๋ฉํฐ๋ชจ๋ฌmultimodal
๋ค์ ์๋ ํด๋์ค๋ค์ ์๋์ ๋ฉํฐ๋ชจ๋ฌ ์์ ์ ์ฌ์ฉํ ์ ์์ต๋๋ค.
AutoModelForTableQuestionAnsweringtransformers.AutoModelForTableQuestionAnswering
autodoc AutoModelForTableQuestionAnswering
AutoModelForDocumentQuestionAnsweringtransformers.AutoModelForDocumentQuestionAnswering
autodoc AutoModelForDocumentQuestionAnswering
AutoModelForVisualQuestionAnsweringtransformers.AutoModelForVisualQuestionAnswering
autodoc AutoModelForVisualQuestionAnswering
Time Series
AutoModelForTimeSeriesPredictiontransformers.AutoModelForTimeSeriesPrediction
autodoc AutoModelForTimeSeriesPrediction