LOGISTAR — Scheda Oggetto

Dati oggetto

URL

Apri

Titolo / Descrizione

Sito / Azienda

Estratto / Body

&lt;h2&gt;Using Hugging Face&amp;rsquo;s Transformers Library&lt;/h2&gt;
&lt;p&gt;&lt;strong&gt;Hugging Face&lt;/strong&gt; is a repository that provides open-source pre-trained language models ready to load and use for NLP tasks like text generation, translation, and sentiment analysis. It is powered by its centerpiece library: &lt;em&gt;Transformers&lt;/em&gt;, which offers seamless integration with popular Python libraries like PyTorch, JAX, and TensorFlow. Best of all: they are free to use and require minimal setup, making AI development accessible to everyone.&lt;/p&gt;
&lt;p&gt;Let&amp;rsquo;s start this practical tour by installing the transformers library in a new notebook of your own:&lt;/p&gt;
&lt;p&gt;&amp;nbsp;&lt;/p&gt;
&lt;div id=&quot;urvanov-syntax-highlighter-6a55007fe886a723849851&quot; class=&quot;urvanov-syntax-highlighter-syntax crayon-theme-classic urvanov-syntax-highlighter-font-monaco urvanov-syntax-highlighter-os-pc print-yes notranslate&quot; style=&quot;margin-top: 12px; margin-bottom: 12px; font-size: 12px !important; line-height: 15px !important; height: auto;&quot; data-settings=&quot; minimize scroll-mouseover disable-anim&quot;&gt;
&lt;div class=&quot;urvanov-syntax-highlighter-plain-wrap&quot;&gt;&amp;nbsp;&lt;/div&gt;
&lt;div class=&quot;urvanov-syntax-highlighter-main&quot; style=&quot;position: relative; z-index: 1; overflow: hidden;&quot;&gt;
&lt;table class=&quot;crayon-table&quot;&gt;
&lt;tbody&gt;
&lt;tr class=&quot;urvanov-syntax-highlighter-row&quot;&gt;
&lt;td class=&quot;urvanov-syntax-highlighter-code&quot;&gt;
&lt;div class=&quot;crayon-pre&quot; style=&quot;font-size: 12px !important; line-height: 15px !important; -moz-tab-size: 4; -o-tab-size: 4; -webkit-tab-size: 4; tab-size: 4;&quot;&gt;
&lt;div id=&quot;urvanov-syntax-highlighter-6a55007fe886a723849851-1&quot; class=&quot;crayon-line&quot;&gt;&lt;span class=&quot;crayon-o&quot;&gt;!&lt;/span&gt;&lt;span class=&quot;crayon-e&quot;&gt;pip &lt;/span&gt;&lt;span class=&quot;crayon-e&quot;&gt;install &lt;/span&gt;&lt;span class=&quot;crayon-v&quot;&gt;transformers&lt;/span&gt;&lt;/div&gt;
&lt;/div&gt;
&lt;/td&gt;
&lt;/tr&gt;
&lt;/tbody&gt;
&lt;/table&gt;
&lt;/div&gt;
&lt;/div&gt;
&lt;p&gt;&amp;nbsp;&lt;/p&gt;
&lt;p&gt;We will now load a model from Hugging Face, specifically GPT-2 for text generation. When loading pre-trained models, we normally need to load not only the model itself, but also a compatible tokenizer responsible for splitting text inputs into logical language units called tokens (roughly equivalent to words in most cases) before being passed to the language model for processing it and generating follow-up text.&lt;/p&gt;
&lt;p&gt;The following code imports the necessary packages and initializes the language model and tokenizer.&lt;/p&gt;
&lt;p&gt;&amp;nbsp;&lt;/p&gt;
&lt;div id=&quot;urvanov-syntax-highlighter-6a55007fe8873048112977&quot; class=&quot;urvanov-syntax-highlighter-syntax crayon-theme-classic urvanov-syntax-highlighter-font-monaco urvanov-syntax-highlighter-os-pc print-yes notranslate&quot; style=&quot;margin-top: 12px; margin-bottom: 12px; font-size: 12px !important; line-height: 15px !important; height: auto;&quot; data-settings=&quot; minimize scroll-mouseover disable-anim&quot;&gt;
&lt;div class=&quot;urvanov-syntax-highlighter-plain-wrap&quot;&gt;&amp;nbsp;&lt;/div&gt;
&lt;div class=&quot;urvanov-syntax-highlighter-main&quot; style=&quot;position: relative; z-index: 1; overflow: hidden;&quot;&gt;
&lt;table class=&quot;crayon-table&quot;&gt;
&lt;tbody&gt;
&lt;tr class=&quot;urvanov-syntax-highlighter-row&quot;&gt;
&lt;td class=&quot;urvanov-syntax-highlighter-code&quot;&gt;
&lt;div class=&quot;crayon-pre&quot; style=&quot;font-size: 12px !important; line-height: 15px !important; -moz-tab-size: 4; -o-tab-size: 4; -webkit-tab-size: 4; tab-size: 4;&quot;&gt;
&lt;div id=&quot;urvanov-syntax-highlighter-6a55007fe8873048112977-1&quot; class=&quot;crayon-line&quot;&gt;&lt;span class=&quot;crayon-e&quot;&gt;from &lt;/span&gt;&lt;span class=&quot;crayon-e&quot;&gt;transformers &lt;/span&gt;&lt;span class=&quot;crayon-e&quot;&gt;import &lt;/span&gt;&lt;span class=&quot;crayon-v&quot;&gt;GPT2LMHeadModel&lt;/span&gt;&lt;span class=&quot;crayon-sy&quot;&gt;,&lt;/span&gt;&lt;span class=&quot;crayon-e&quot;&gt;GPT2Tokenizer&lt;/span&gt;&lt;/div&gt;
&lt;div id=&quot;urvanov-syntax-highlighter-6a55007fe8873048112977-2&quot; class=&quot;crayon-line crayon-striped-line&quot;&gt;&amp;nbsp;&lt;/div&gt;
&lt;div id=&quot;urvanov-syntax-highlighter-6a55007fe8873048112977-3&quot; class=&quot;crayon-line&quot;&gt;&lt;span class=&quot;crayon-v&quot;&gt;model_name&lt;/span&gt;&lt;span class=&quot;crayon-o&quot;&gt;=&lt;/span&gt;&lt;span class=&quot;crayon-s&quot;&gt;&quot;gpt2&quot;&lt;/span&gt;&lt;/div&gt;
&lt;div id=&quot;urvanov-syntax-highlighter-6a55007fe8873048112977-4&quot; class=&quot;crayon-line crayon-striped-line&quot;&gt;&lt;span class=&quot;crayon-v&quot;&gt;model&lt;/span&gt;&lt;span class=&quot;crayon-o&quot;&gt;=&lt;/span&gt;&lt;span class=&quot;crayon-v&quot;&gt;GPT2LMHeadModel&lt;/span&gt;&lt;span class=&quot;crayon-sy&quot;&gt;.&lt;/span&gt;&lt;span class=&quot;crayon-e&quot;&gt;from_pretrained&lt;/span&gt;&lt;span class=&quot;crayon-sy&quot;&gt;(&lt;/span&gt;&lt;span class=&quot;crayon-v&quot;&gt;model_name&lt;/span&gt;&lt;span class=&quot;crayon-sy&quot;&gt;)&lt;/span&gt;&lt;/div&gt;
&lt;div id=&quot;urvanov-syntax-highlighter-6a55007fe8873048112977-5&quot; class=&quot;crayon-line&quot;&gt;&lt;span class=&quot;crayon-v&quot;&gt;tokenizer&lt;/span&gt;&lt;span class=&quot;crayon-o&quot;&gt;=&lt;/span&gt;&lt;span class=&quot;crayon-v&quot;&gt;GPT2Tokenizer&lt;/span&gt;&lt;span class=&quot;crayon-sy&quot;&gt;.&lt;/span&gt;&lt;span class=&quot;crayon-e&quot;&gt;from_pretrained&lt;/span&gt;&lt;span class=&quot;crayon-sy&quot;&gt;(&lt;/span&gt;&lt;span class=&quot;crayon-v&quot;&gt;model_name&lt;/span&gt;&lt;span class=&quot;crayon-sy&quot;&gt;)&lt;/span&gt;&lt;/div&gt;
&lt;/div&gt;
&lt;/td&gt;
&lt;/tr&gt;
&lt;/tbody&gt;
&lt;/table&gt;
&lt;/div&gt;
&lt;/div&gt;
&lt;p&gt;&amp;nbsp;&lt;/p&gt;
&lt;p&gt;Next we define a prompt for the model, which is typically a query, question, or request to which the language model will try to generate a response. Some less sophisticated models limit themselves to generating follow-up words that continue the input sequence or prompt, for instance to continue a tale that starts with &amp;ldquo;Once upon a time&amp;rdquo;. In our case, we will try asking GPT-2 what is the capital of Japan and &amp;hellip; fingers crossed.&lt;/p&gt;
&lt;p&gt;&amp;nbsp;&lt;/p&gt;
&lt;div id=&quot;urvanov-syntax-highlighter-6a55007fe8877490511473&quot; class=&quot;urvanov-syntax-highlighter-syntax crayon-theme-classic urvanov-syntax-highlighter-font-monaco urvanov-syntax-highlighter-os-pc print-yes notranslate&quot; style=&quot;margin-top: 12px; margin-bottom: 12px; font-size: 12px !important; line-height: 15px !important; height: auto;&quot; data-settings=&quot; minimize scroll-mouseover disable-anim&quot;&gt;
&lt;div class=&quot;urvanov-syntax-highlighter-plain-wrap&quot;&gt;&amp;nbsp;&lt;/div&gt;
&lt;div class=&quot;urvanov-syntax-highlighter-main&quot; style=&quot;position: relative; z-index: 1; overflow: hidden;&quot;&gt;
&lt;table class=&quot;crayon-table&quot;&gt;
&lt;tbody&gt;
&lt;tr class=&quot;urvanov-syntax-highlighter-row&quot;&gt;
&lt;td class=&quot;urvanov-syntax-highlighter-code&quot;&gt;
&lt;div class=&quot;crayon-pre&quot; style=&quot;font-size: 12px !important; line-height: 15px !important; -moz-tab-size: 4; -o-tab-size: 4; -webkit-tab-size: 4; tab-size: 4;&quot;&gt;
&lt;div id=&quot;urvanov-syntax-highlighter-6a55007fe8877490511473-1&quot; class=&quot;crayon-line&quot;&gt;&lt;span class=&quot;crayon-v&quot;&gt;prompt&lt;/span&gt;&lt;span class=&quot;crayon-o&quot;&gt;=&lt;/span&gt;&lt;span class=&quot;crayon-s&quot;&gt;&quot;What is the capital of Japan?&quot;&lt;/span&gt;&lt;/div&gt;
&lt;div id=&quot;urvanov-syntax-highlighter-6a55007fe8877490511473-2&quot; class=&quot;crayon-line crayon-striped-line&quot;&gt;&amp;nbsp;&lt;/div&gt;
&lt;div id=&quot;urvanov-syntax-highlighter-6a55007fe8877490511473-3&quot; class=&quot;crayon-line&quot;&gt;&lt;span class=&quot;crayon-v&quot;&gt;inputs&lt;/span&gt;&lt;span class=&quot;crayon-o&quot;&gt;=&lt;/span&gt;&lt;span class=&quot;crayon-v&quot;&gt;tokenizer&lt;/span&gt;&lt;span class=&quot;crayon-sy&quot;&gt;.&lt;/span&gt;&lt;span class=&quot;crayon-e&quot;&gt;encode&lt;/span&gt;&lt;span class=&quot;crayon-sy&quot;&gt;(&lt;/span&gt;&lt;span class=&quot;crayon-v&quot;&gt;prompt&lt;/span&gt;&lt;span class=&quot;crayon-sy&quot;&gt;,&lt;/span&gt;&lt;span class=&quot;crayon-v&quot;&gt;return_tensors&lt;/span&gt;&lt;span class=&quot;crayon-o&quot;&gt;=&lt;/span&gt;&lt;span class=&quot;crayon-s&quot;&gt;&quot;pt&quot;&lt;/span&gt;&lt;span class=&quot;crayon-sy&quot;&gt;)&lt;/span&gt;&lt;/div&gt;
&lt;div id=&quot;urvanov-syntax-highlighter-6a55007fe8877490511473-4&quot; class=&quot;crayon-line crayon-striped-line&quot;&gt;&lt;span class=&quot;crayon-v&quot;&gt;output&lt;/span&gt;&lt;span class=&quot;crayon-o&quot;&gt;=&lt;/span&gt;&lt;span class=&quot;crayon-v&quot;&gt;model&lt;/span&gt;&lt;span class=&quot;crayon-sy&quot;&gt;.&lt;/span&gt;&lt;span class=&quot;crayon-e&quot;&gt;generate&lt;/span&gt;&lt;span class=&quot;crayon-sy&quot;&gt;(&lt;/span&gt;&lt;span class=&quot;crayon-v&quot;&gt;inputs&lt;/span&gt;&lt;span class=&quot;crayon-sy&quot;&gt;,&lt;/span&gt;&lt;span class=&quot;crayon-v&quot;&gt;max_length&lt;/span&gt;&lt;span class=&quot;crayon-o&quot;&gt;=&lt;/span&gt;&lt;span class=&quot;crayon-cn&quot;&gt;50&lt;/span&gt;&lt;span class=&quot;crayon-sy&quot;&gt;,&lt;/span&gt;&lt;span class=&quot;crayon-v&quot;&gt;num_return_sequences&lt;/span&gt;&lt;span class=&quot;crayon-o&quot;&gt;=&lt;/span&gt;&lt;span class=&quot;crayon-cn&quot;&gt;1&lt;/span&gt;&lt;span class=&quot;crayon-sy&quot;&gt;)&lt;/span&gt;&lt;/div&gt;
&lt;div id=&quot;urvanov-syntax-highlighter-6a55007fe8877490511473-5&quot; class=&quot;crayon-line&quot;&gt;&amp;nbsp;&lt;/div&gt;
&lt;div id=&quot;urvanov-syntax-highlighter-6a55007fe8877490511473-6&quot; class=&quot;crayon-line crayon-striped-line&quot;&gt;&lt;span class=&quot;crayon-v&quot;&gt;response&lt;/span&gt;&lt;span class=&quot;crayon-o&quot;&gt;=&lt;/span&gt;&lt;span class=&quot;crayon-v&quot;&gt;tokenizer&lt;/span&gt;&lt;span class=&quot;crayon-sy&quot;&gt;.&lt;/span&gt;&lt;span class=&quot;crayon-e&quot;&gt;decode&lt;/span&gt;&lt;span class=&quot;crayon-sy&quot;&gt;(&lt;/span&gt;&lt;span class=&quot;crayon-v&quot;&gt;output&lt;/span&gt;&lt;span class=&quot;crayon-sy&quot;&gt;[&lt;/span&gt;&lt;span class=&quot;crayon-cn&quot;&gt;0&lt;/span&gt;&lt;span class=&quot;crayon-sy&quot;&gt;]&lt;/span&gt;&lt;span class=&quot;crayon-sy&quot;&gt;,&lt;/span&gt;&lt;span class=&quot;crayon-v&quot;&gt;skip_special_tokens&lt;/span&gt;&lt;span class=&quot;crayon-o&quot;&gt;=&lt;/span&gt;&lt;span class=&quot;crayon-t&quot;&gt;True&lt;/span&gt;&lt;span class=&quot;crayon-sy&quot;&gt;)&lt;/span&gt;&lt;/div&gt;
&lt;div id=&quot;urvanov-syntax-highlighter-6a55007fe8877490511473-7&quot; class=&quot;crayon-line&quot;&gt;&lt;span class=&quot;crayon-e&quot;&gt;print&lt;/span&gt;&lt;span class=&quot;crayon-sy&quot;&gt;(&lt;/span&gt;&lt;span class=&quot;crayon-v&quot;&gt;response&lt;/span&gt;&lt;span class=&quot;crayon-sy&quot;&gt;)&lt;/span&gt;&lt;/div&gt;
&lt;/div&gt;
&lt;/td&gt;
&lt;/tr&gt;
&lt;/tbody&gt;
&lt;/table&gt;
&lt;/div&gt;
&lt;/div&gt;
&lt;p&gt;&amp;nbsp;&lt;/p&gt;
&lt;p&gt;Getting technical, in the above code you may have noticed that there are two processing steps taking place: encoding and decoding. The input sequence (the prompt) must be encoded into a numerical vector representation understandable by the model, and after it generates the raw (numerical) response, it is decoded back into text to make it understandable by us.&lt;/p&gt;
&lt;p&gt;This is the decoded response:&lt;/p&gt;
&lt;p&gt;&amp;nbsp;&lt;/p&gt;
&lt;div id=&quot;urvanov-syntax-highlighter-6a55007fe887d222368509&quot; class=&quot;urvanov-syntax-highlighter-syntax crayon-theme-classic urvanov-syntax-highlighter-font-monaco urvanov-syntax-highlighter-os-pc print-yes notranslate&quot; style=&quot;margin-top: 12px; margin-bottom: 12px; font-size: 12px !important; line-height: 15px !important; height: auto;&quot; data-settings=&quot; minimize scroll-mouseover disable-anim&quot;&gt;
&lt;div class=&quot;urvanov-syntax-highlighter-plain-wrap&quot;&gt;&amp;nbsp;&lt;/div&gt;
&lt;div class=&quot;urvanov-syntax-highlighter-main&quot; style=&quot;position: relative; z-index: 1; overflow: hidden;&quot;&gt;
&lt;table class=&quot;crayon-table&quot;&gt;
&lt;tbody&gt;
&lt;tr class=&quot;urvanov-syntax-highlighter-row&quot;&gt;
&lt;td class=&quot;urvanov-syntax-highlighter-code&quot;&gt;
&lt;div class=&quot;crayon-pre&quot; style=&quot;font-size: 12px !important; line-height: 15px !important; -moz-tab-size: 4; -o-tab-size: 4; -webkit-tab-size: 4; tab-size: 4;&quot;&gt;
&lt;div id=&quot;urvanov-syntax-highlighter-6a55007fe887d222368509-1&quot; class=&quot;crayon-line&quot;&gt;&lt;span class=&quot;crayon-e&quot;&gt;The &lt;/span&gt;&lt;span class=&quot;crayon-e&quot;&gt;capital &lt;/span&gt;&lt;span class=&quot;crayon-e&quot;&gt;of &lt;/span&gt;&lt;span class=&quot;crayon-e&quot;&gt;Japan &lt;/span&gt;&lt;span class=&quot;crayon-st&quot;&gt;is&lt;/span&gt;&lt;span class=&quot;crayon-v&quot;&gt;Tokyo&lt;/span&gt;&lt;span class=&quot;crayon-sy&quot;&gt;.&lt;/span&gt;&lt;span class=&quot;crayon-e&quot;&gt;It &lt;/span&gt;&lt;span class=&quot;crayon-st&quot;&gt;is&lt;/span&gt;&lt;span class=&quot;crayon-e&quot;&gt;the &lt;/span&gt;&lt;span class=&quot;crayon-e&quot;&gt;capital &lt;/span&gt;&lt;span class=&quot;crayon-e&quot;&gt;of &lt;/span&gt;&lt;span class=&quot;crayon-v&quot;&gt;Japan&lt;/span&gt;&lt;span class=&quot;crayon-sy&quot;&gt;.&lt;/span&gt;&lt;span class=&quot;crayon-e&quot;&gt;It &lt;/span&gt;&lt;span class=&quot;crayon-st&quot;&gt;is&lt;/span&gt;&lt;span class=&quot;crayon-e&quot;&gt;the &lt;/span&gt;&lt;span class=&quot;crayon-e&quot;&gt;capital &lt;/span&gt;&lt;span class=&quot;crayon-e&quot;&gt;of &lt;/span&gt;&lt;span class=&quot;crayon-v&quot;&gt;Japan&lt;/span&gt;&lt;span class=&quot;crayon-sy&quot;&gt;.&lt;/span&gt;&lt;span class=&quot;crayon-e&quot;&gt;It &lt;/span&gt;&lt;span class=&quot;crayon-st&quot;&gt;is&lt;/span&gt;&lt;span class=&quot;crayon-e&quot;&gt;the &lt;/span&gt;&lt;span class=&quot;crayon-e&quot;&gt;capital &lt;/span&gt;&lt;span class=&quot;crayon-e&quot;&gt;of &lt;/span&gt;&lt;span class=&quot;crayon-v&quot;&gt;Japan&lt;/span&gt;&lt;span class=&quot;crayon-sy&quot;&gt;.&lt;/span&gt;&lt;span class=&quot;crayon-e&quot;&gt;It &lt;/span&gt;&lt;span class=&quot;crayon-st&quot;&gt;is&lt;/span&gt;&lt;span class=&quot;crayon-e&quot;&gt;the &lt;/span&gt;&lt;span class=&quot;crayon-e&quot;&gt;capital &lt;/span&gt;&lt;span class=&quot;crayon-e&quot;&gt;of &lt;/span&gt;&lt;span class=&quot;crayon-v&quot;&gt;Japan&lt;/span&gt;&lt;span class=&quot;crayon-sy&quot;&gt;.&lt;/span&gt;&lt;span class=&quot;crayon-e&quot;&gt;It &lt;/span&gt;&lt;span class=&quot;crayon-st&quot;&gt;is&lt;/span&gt;&lt;span class=&quot;crayon-e&quot;&gt;the &lt;/span&gt;&lt;span class=&quot;crayon-e&quot;&gt;capital &lt;/span&gt;&lt;span class=&quot;crayon-e&quot;&gt;of &lt;/span&gt;&lt;span class=&quot;crayon-v&quot;&gt;Japan&lt;/span&gt;&lt;/div&gt;
&lt;/div&gt;
&lt;/td&gt;
&lt;/tr&gt;
&lt;/tbody&gt;
&lt;/table&gt;
&lt;/div&gt;
&lt;/div&gt;
&lt;p&gt;&amp;nbsp;&lt;/p&gt;
&lt;p&gt;Well, at least it gave the right answer! These pre-trained models are comparatively smaller, more manageable for testing environments, and not as absurdly powerful and high-performing as ChatGPT ones, hence it is not surprising they might be more limited in their text generation behavior. In particular, since we specified a maximum response length of 50 tokens, the model seems to prioritize the need to provide a response that closely matches that length, rather than keeping it short, simple, and logical.&lt;/p&gt;
&lt;p&gt;Time to look at another example and introduce another framework.&lt;/p&gt;
&lt;div id=&quot;harzsgqwhvymy7ygigflny0yos73n73y0ky0y7ntb3s1&quot; class=&quot;harzsgqwhvvy73igflnyivy7 harzsgqwhvvy73igflnyiqs73n73 harzsgqwhvvy73igflnyiqs73n73yik harzsgqwhvvy73igflnyivy7yiqzt&quot; style=&quot;min-height: 250px;&quot; data-harzsgqwhvcsscznyi85ng0yify7=&quot;CNzWrr6X05UDFTTCDQkd5IwFEA&quot;&gt;&amp;nbsp;&lt;/div&gt;
&lt;p&gt;&amp;nbsp;&lt;/p&gt;

Note

Voto oggetto (1-10)

Precisione (1-10)

Immagine

Tag (5)

✎ Modifica tag 🤖 Suggerisci AI

          api:5, deep learning:5, llm:5, llm_internal:5        

api 5 deep learning 5 llm 5 llm_internal 5 wpg 5

ID: 68086 • Tipo: WPG • Reg: 2026-07-14 • Mod: 29/07/2026 20:16