{"id":140043,"date":"2025-08-06T13:17:31","date_gmt":"2025-08-06T06:17:31","guid":{"rendered":"https:\/\/phongvu.vn\/cong-nghe\/?p=140043"},"modified":"2025-10-17T11:37:11","modified_gmt":"2025-10-17T04:37:11","slug":"cach-chay-gpt-oss-20b-va-120b-tren-may-tinh","status":"publish","type":"post","link":"https:\/\/phongvu.vn\/cong-nghe\/cach-chay-gpt-oss-20b-va-120b-tren-may-tinh\/","title":{"rendered":"H\u01b0\u1edbng d\u1eabn ch\u1ea1y GPT OSS 20B v\u00e0 120B tr\u00ean m\u00e1y t\u00ednh \u0111\u01a1n gi\u1ea3n"},"content":{"rendered":"\n<p>B\u1ea1n mu\u1ed1n tr\u00f2 chuy\u1ec7n v\u1edbi m\u00f4 h\u00ecnh <a href=\"https:\/\/phongvu.vn\/cong-nghe\/tag\/tri-tue-nhan-tao-ai\/\" target=\"_blank\" rel=\"noreferrer noopener\">tr\u00ed tu\u1ec7 nh\u00e2n t\u1ea1o AI <\/a>gi\u1ed1ng ChatGPT nh\u01b0ng ch\u1ea1y ho\u00e0n to\u00e0n tr\u00ean m\u00e1y t\u00ednh c\u1ee7a b\u1ea1n, kh\u00f4ng c\u1ea7n internet hay ph\u1ee5 thu\u1ed9c v\u00e0o OpenAI? Tin vui l\u00e0 b\u1ea1n ho\u00e0n to\u00e0n c\u00f3 th\u1ec3 l\u00e0m \u0111\u01b0\u1ee3c \u0111i\u1ec1u \u0111\u00f3 v\u1edbi GPT OSS, d\u00f2ng m\u00f4 h\u00ecnh m\u00e3 ngu\u1ed3n m\u1edf do OpenAI ph\u00e1t h\u00e0nh. Trong b\u00e0i vi\u1ebft n\u00e0y, <a href=\"https:\/\/phongvu.vn\/cong-nghe\/\" target=\"_blank\" rel=\"noreferrer noopener\">Phong V\u0169 Tech News<\/a> s\u1ebd h\u01b0\u1edbng d\u1eabn b\u1ea1n t\u1eebng b\u01b0\u1edbc thi\u1ebft l\u1eadp v\u00e0 s\u1eed d\u1ee5ng GPT OSS 20B v\u00e0 120B ngay tr\u00ean m\u00e1y t\u00ednh b\u1eb1ng nh\u1eefng c\u00f4ng c\u1ee5 d\u1ec5 d\u00f9ng nh\u01b0 Ollama v\u00e0 Transformers. C\u00f9ng tham kh\u1ea3o ngay!<\/p>\n\n\n\n<div id=\"ez-toc-container\" class=\"ez-toc-v2_0_55 counter-hierarchy ez-toc-counter ez-toc-grey ez-toc-container-direction\">\n<div class=\"ez-toc-title-container\">\n<p class=\"ez-toc-title \" >M\u1ee5c l\u1ee5c<\/p>\n<span class=\"ez-toc-title-toggle\"><a href=\"#\" class=\"ez-toc-pull-right ez-toc-btn ez-toc-btn-xs ez-toc-btn-default ez-toc-toggle\" aria-label=\"Toggle Table of Content\" role=\"button\"><label for=\"item-6a1abad90b539\" ><span class=\"\"><span style=\"display:none;\">Toggle<\/span><span class=\"ez-toc-icon-toggle-span\"><svg style=\"fill: #999;color:#999\" xmlns=\"http:\/\/www.w3.org\/2000\/svg\" class=\"list-377408\" width=\"20px\" height=\"20px\" viewBox=\"0 0 24 24\" fill=\"none\"><path d=\"M6 6H4v2h2V6zm14 0H8v2h12V6zM4 11h2v2H4v-2zm16 0H8v2h12v-2zM4 16h2v2H4v-2zm16 0H8v2h12v-2z\" fill=\"currentColor\"><\/path><\/svg><svg style=\"fill: #999;color:#999\" class=\"arrow-unsorted-368013\" xmlns=\"http:\/\/www.w3.org\/2000\/svg\" width=\"10px\" height=\"10px\" viewBox=\"0 0 24 24\" version=\"1.2\" baseProfile=\"tiny\"><path d=\"M18.2 9.3l-6.2-6.3-6.2 6.3c-.2.2-.3.4-.3.7s.1.5.3.7c.2.2.4.3.7.3h11c.3 0 .5-.1.7-.3.2-.2.3-.5.3-.7s-.1-.5-.3-.7zM5.8 14.7l6.2 6.3 6.2-6.3c.2-.2.3-.5.3-.7s-.1-.5-.3-.7c-.2-.2-.4-.3-.7-.3h-11c-.3 0-.5.1-.7.3-.2.2-.3.5-.3.7s.1.5.3.7z\"\/><\/svg><\/span><\/span><\/label><input aria-label=\"Toggle\" aria-label=\"item-6a1abad90b539\"  type=\"checkbox\" id=\"item-6a1abad90b539\"><\/a><\/span><\/div>\n<nav><ul class='ez-toc-list ez-toc-list-level-1 ' ><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-1\" href=\"https:\/\/phongvu.vn\/cong-nghe\/cach-chay-gpt-oss-20b-va-120b-tren-may-tinh\/#I_GPT_OSS_la_gi\" title=\"I. GPT OSS l\u00e0 g\u00ec?\">I. GPT OSS l\u00e0 g\u00ec?<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-2\" href=\"https:\/\/phongvu.vn\/cong-nghe\/cach-chay-gpt-oss-20b-va-120b-tren-may-tinh\/#II_Thiet_lap_nhanh_chong_voi_Ollama_Lua_chon_don_gian_nhat\" title=\"II. Thi\u1ebft l\u1eadp nhanh ch\u00f3ng v\u1edbi Ollama: L\u1ef1a ch\u1ecdn \u0111\u01a1n gi\u1ea3n nh\u1ea5t\">II. Thi\u1ebft l\u1eadp nhanh ch\u00f3ng v\u1edbi Ollama: L\u1ef1a ch\u1ecdn \u0111\u01a1n gi\u1ea3n nh\u1ea5t<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-3\" href=\"https:\/\/phongvu.vn\/cong-nghe\/cach-chay-gpt-oss-20b-va-120b-tren-may-tinh\/#III_Thiet_lap_nang_cao_voi_thu_vien_Hugging_Face_Transformers\" title=\"III. Thi\u1ebft l\u1eadp n\u00e2ng cao v\u1edbi th\u01b0 vi\u1ec7n Hugging Face Transformers\">III. Thi\u1ebft l\u1eadp n\u00e2ng cao v\u1edbi th\u01b0 vi\u1ec7n Hugging Face Transformers<\/a><ul class='ez-toc-list-level-3'><li class='ez-toc-heading-level-3'><a class=\"ez-toc-link ez-toc-heading-4\" href=\"https:\/\/phongvu.vn\/cong-nghe\/cach-chay-gpt-oss-20b-va-120b-tren-may-tinh\/#Buoc_1_Chuan_bi_moi_truong_Python\" title=\"B\u01b0\u1edbc 1: Chu\u1ea9n b\u1ecb m\u00f4i tr\u01b0\u1eddng Python\">B\u01b0\u1edbc 1: Chu\u1ea9n b\u1ecb m\u00f4i tr\u01b0\u1eddng Python<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-3'><a class=\"ez-toc-link ez-toc-heading-5\" href=\"https:\/\/phongvu.vn\/cong-nghe\/cach-chay-gpt-oss-20b-va-120b-tren-may-tinh\/#Buoc_2_Chay_may_chu_API\" title=\"B\u01b0\u1edbc 2: Ch\u1ea1y m\u00e1y ch\u1ee7 API\">B\u01b0\u1edbc 2: Ch\u1ea1y m\u00e1y ch\u1ee7 API<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-3'><a class=\"ez-toc-link ez-toc-heading-6\" href=\"https:\/\/phongvu.vn\/cong-nghe\/cach-chay-gpt-oss-20b-va-120b-tren-may-tinh\/#Buoc_3_Suy_luan_nhanh_voi_Pipeline\" title=\"B\u01b0\u1edbc 3: Suy lu\u1eadn nhanh v\u1edbi Pipeline\">B\u01b0\u1edbc 3: Suy lu\u1eadn nhanh v\u1edbi Pipeline<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-3'><a class=\"ez-toc-link ez-toc-heading-7\" href=\"https:\/\/phongvu.vn\/cong-nghe\/cach-chay-gpt-oss-20b-va-120b-tren-may-tinh\/#Buoc_4_Suy_luan_nang_cao_voi_generate\" title=\"B\u01b0\u1edbc 4: Suy lu\u1eadn n\u00e2ng cao v\u1edbi .generate()\">B\u01b0\u1edbc 4: Suy lu\u1eadn n\u00e2ng cao v\u1edbi .generate()<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-3'><a class=\"ez-toc-link ez-toc-heading-8\" href=\"https:\/\/phongvu.vn\/cong-nghe\/cach-chay-gpt-oss-20b-va-120b-tren-may-tinh\/#Buoc_5_Su_dung_mau_tro_chuyen_va_goi_cong_cu\" title=\"B\u01b0\u1edbc 5: S\u1eed d\u1ee5ng m\u1eabu tr\u00f2 chuy\u1ec7n v\u00e0 g\u1ecdi c\u00f4ng c\u1ee5\">B\u01b0\u1edbc 5: S\u1eed d\u1ee5ng m\u1eabu tr\u00f2 chuy\u1ec7n v\u00e0 g\u1ecdi c\u00f4ng c\u1ee5<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-3'><a class=\"ez-toc-link ez-toc-heading-9\" href=\"https:\/\/phongvu.vn\/cong-nghe\/cach-chay-gpt-oss-20b-va-120b-tren-may-tinh\/#Buoc_6_Suy_luan_da_GPU_chi_danh_cho_mo_hinh_120B\" title=\"B\u01b0\u1edbc 6: Suy lu\u1eadn \u0111a GPU (ch\u1ec9 d\u00e0nh cho m\u00f4 h\u00ecnh 120B)\">B\u01b0\u1edbc 6: Suy lu\u1eadn \u0111a GPU (ch\u1ec9 d\u00e0nh cho m\u00f4 h\u00ecnh 120B)<\/a><\/li><\/ul><\/li><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-10\" href=\"https:\/\/phongvu.vn\/cong-nghe\/cach-chay-gpt-oss-20b-va-120b-tren-may-tinh\/#IV_Dung_GPT_OSS_voi_SDK_cua_OpenAI_Agents\" title=\"IV. D\u00f9ng GPT OSS v\u1edbi SDK c\u1ee7a OpenAI Agents\">IV. D\u00f9ng GPT OSS v\u1edbi SDK c\u1ee7a OpenAI Agents<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-11\" href=\"https:\/\/phongvu.vn\/cong-nghe\/cach-chay-gpt-oss-20b-va-120b-tren-may-tinh\/#V_Mot_so_luu_y_ve_phan_cung_khi_chay_GPT_OSS_20B_va_120B_tren_may_tinh\" title=\"V. M\u1ed9t s\u1ed1 l\u01b0u \u00fd v\u1ec1 ph\u1ea7n c\u1ee9ng khi ch\u1ea1y GPT OSS 20B v\u00e0 120B tr\u00ean m\u00e1y t\u00ednh\">V. M\u1ed9t s\u1ed1 l\u01b0u \u00fd v\u1ec1 ph\u1ea7n c\u1ee9ng khi ch\u1ea1y GPT OSS 20B v\u00e0 120B tr\u00ean m\u00e1y t\u00ednh<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-12\" href=\"https:\/\/phongvu.vn\/cong-nghe\/cach-chay-gpt-oss-20b-va-120b-tren-may-tinh\/#VI_Tong_ket\" title=\"VI. T\u1ed5ng k\u1ebft\">VI. T\u1ed5ng k\u1ebft<\/a><\/li><\/ul><\/nav><\/div>\n<h2><span class=\"ez-toc-section\" id=\"I_GPT_OSS_la_gi\"><\/span><strong>I. GPT OSS l\u00e0 g\u00ec?<\/strong><span class=\"ez-toc-section-end\"><\/span><\/h2>\n\n\n\n<p>GPT OSS l\u00e0 t\u00ean vi\u1ebft t\u1eaft c\u1ee7a &#8220;GPT Open Source Series&#8221; \u2013 m\u1ed9t d\u00f2ng m\u00f4 h\u00ecnh ng\u00f4n ng\u1eef gi\u1ed1ng ChatGPT nh\u01b0ng \u0111\u01b0\u1ee3c ph\u00e1t h\u00e0nh d\u01b0\u1edbi d\u1ea1ng m\u00e3 ngu\u1ed3n m\u1edf. B\u1ea1n c\u00f3 th\u1ec3 t\u1ea3i v\u1ec1 v\u00e0 ch\u1ea1y tr\u1ef1c ti\u1ebfp tr\u00ean m\u00e1y c\u1ee7a m\u00ecnh (ch\u1eb3ng h\u1ea1n nh\u01b0 <a href=\"https:\/\/phongvu.vn\/c\/laptop\" target=\"_blank\" rel=\"noreferrer noopener\">laptop x\u00e1ch tay<\/a>) m\u00e0 kh\u00f4ng c\u1ea7n g\u1ecdi \u0111\u1ebfn m\u00e1y ch\u1ee7 OpenAI. GPT-OSS c\u00f3 hai phi\u00ean b\u1ea3n ch\u00ednh v\u1edbi y\u00eau c\u1ea7u ph\u1ea7n c\u1ee9ng kh\u00e1c nhau, c\u1ee5 th\u1ec3:<\/p>\n\n\n\n<figure class=\"wp-block-table\"><table><tbody><tr><td><strong>M\u00f4 h\u00ecnh<\/strong><\/td><td><strong>GPT OSS 20B<\/strong><\/td><td><strong>GPT OSS 120B<\/strong><\/td><\/tr><tr><td><strong>Dung l\u01b0\u1ee3ng<\/strong><\/td><td>~20 t\u1ef7 tham s\u1ed1<\/td><td>~120 t\u1ef7 tham s\u1ed1<\/td><\/tr><tr><td><strong>VRAM c\u1ea7n thi\u1ebft<\/strong><\/td><td>\u226516GB<\/td><td>\u226560GB ho\u1eb7c nhi\u1ec1u GPU<\/td><\/tr><tr><td><strong>Ph\u00f9 h\u1ee3p<\/strong><\/td><td>M\u00e1y t\u00ednh c\u00f3 card \u0111\u1ed3 h\u1ecda m\u1ea1nh nh\u01b0 RTX 3090\/4090 ho\u1eb7c Mac M2\/M3<\/td><td>M\u00e1y tr\u1ea1m, m\u00e1y ch\u1ee7 chuy\u00ean d\u1ee5ng<\/td><\/tr><\/tbody><\/table><\/figure>\n\n\n\n<p><strong><em>L\u01b0u \u00fd:<\/em><\/strong><em> Hai m\u00f4 h\u00ecnh n\u00e0y \u0111\u01b0\u1ee3c n\u00e9n l\u1ea1i theo \u0111\u1ecbnh d\u1ea1ng MXFP4 \u0111\u1ec3 ti\u1ebft ki\u1ec7m b\u1ed9 nh\u1edb, nh\u01b0ng ch\u1ec9 ho\u1ea1t \u0111\u1ed9ng t\u1ed1t v\u1edbi c\u00e1c d\u00f2ng card \u0111\u1ed3 h\u1ecda \u0111\u1eddi m\u1edbi nh\u01b0 RTX 50xx ho\u1eb7c NVIDIA H100.<\/em><\/p>\n\n\n\n<figure class=\"wp-block-image size-full\"><img decoding=\"async\" loading=\"lazy\" width=\"1440\" height=\"900\" src=\"https:\/\/phongvu.vn\/cong-nghe\/wp-content\/uploads\/2025\/08\/huong-dan-chay-gpt-oss-2.jpg\" alt=\"M\u00f4 h\u00ecnh GPT OSS\" class=\"wp-image-140052\" srcset=\"https:\/\/phongvu.vn\/cong-nghe\/wp-content\/uploads\/2025\/08\/huong-dan-chay-gpt-oss-2.jpg 1440w, https:\/\/phongvu.vn\/cong-nghe\/wp-content\/uploads\/2025\/08\/huong-dan-chay-gpt-oss-2-300x188.jpg 300w, https:\/\/phongvu.vn\/cong-nghe\/wp-content\/uploads\/2025\/08\/huong-dan-chay-gpt-oss-2-768x480.jpg 768w, https:\/\/phongvu.vn\/cong-nghe\/wp-content\/uploads\/2025\/08\/huong-dan-chay-gpt-oss-2-150x94.jpg 150w, https:\/\/phongvu.vn\/cong-nghe\/wp-content\/uploads\/2025\/08\/huong-dan-chay-gpt-oss-2-600x375.jpg 600w, https:\/\/phongvu.vn\/cong-nghe\/wp-content\/uploads\/2025\/08\/huong-dan-chay-gpt-oss-2-696x435.jpg 696w, https:\/\/phongvu.vn\/cong-nghe\/wp-content\/uploads\/2025\/08\/huong-dan-chay-gpt-oss-2-1392x870.jpg 1392w, https:\/\/phongvu.vn\/cong-nghe\/wp-content\/uploads\/2025\/08\/huong-dan-chay-gpt-oss-2-1068x668.jpg 1068w, https:\/\/phongvu.vn\/cong-nghe\/wp-content\/uploads\/2025\/08\/huong-dan-chay-gpt-oss-2-672x420.jpg 672w, https:\/\/phongvu.vn\/cong-nghe\/wp-content\/uploads\/2025\/08\/huong-dan-chay-gpt-oss-2-1344x840.jpg 1344w\" sizes=\"(max-width: 1440px) 100vw, 1440px\" title=\"\"><figcaption class=\"wp-element-caption\">M\u00f4 h\u00ecnh GPT OSS (Ngu\u1ed3n: Internet)<\/figcaption><\/figure>\n\n\n\n<h2><span class=\"ez-toc-section\" id=\"II_Thiet_lap_nhanh_chong_voi_Ollama_Lua_chon_don_gian_nhat\"><\/span><strong>II. Thi\u1ebft l\u1eadp nhanh ch\u00f3ng v\u1edbi Ollama: L\u1ef1a ch\u1ecdn \u0111\u01a1n gi\u1ea3n nh\u1ea5t<\/strong><span class=\"ez-toc-section-end\"><\/span><\/h2>\n\n\n\n<p>N\u1ebfu b\u1ea1n mu\u1ed1n m\u1ed9t c\u00e1ch nhanh g\u1ecdn l\u1eb9, kh\u00f4ng c\u1ea7n ph\u1ea3i \u0111au \u0111\u1ea7u v\u1edbi code v\u00e0 c\u00e1c th\u01b0 vi\u1ec7n ph\u1ee9c t\u1ea1p, <strong>Ollama<\/strong> ch\u00ednh l\u00e0 gi\u1ea3i ph\u00e1p d\u00e0nh cho b\u1ea1n. Ollama l\u00e0 m\u1ed9t n\u1ec1n t\u1ea3ng tuy\u1ec7t v\u1eddi gi\u00fap b\u1ea1n ch\u1ea1y c\u00e1c LLM m\u00e3 ngu\u1ed3n m\u1edf m\u1ed9t c\u00e1ch d\u1ec5 d\u00e0ng.<\/p>\n\n\n\n<p><strong>B\u01b0\u1edbc 1: C\u00e0i \u0111\u1eb7t Ollama: <\/strong>Truy c\u1eadp trang ch\u1ee7 c\u1ee7a Ollama theo \u0111\u01b0\u1eddng link: https:\/\/ollama.com\/download \u0111\u1ec3 t\u1ea3i v\u1ec1 v\u00e0 c\u00e0i \u0111\u1eb7t. Ollama h\u1ed7 tr\u1ee3 c\u1ea3 Windows, macOS v\u00e0 Linux.<\/p>\n\n\n\n<figure class=\"wp-block-image size-full\"><img decoding=\"async\" loading=\"lazy\" width=\"1440\" height=\"900\" src=\"https:\/\/phongvu.vn\/cong-nghe\/wp-content\/uploads\/2025\/08\/huong-dan-chay-gpt-oss-3.jpg\" alt=\"C\u00e0i \u0111\u1eb7t Ollama\" class=\"wp-image-140053\" srcset=\"https:\/\/phongvu.vn\/cong-nghe\/wp-content\/uploads\/2025\/08\/huong-dan-chay-gpt-oss-3.jpg 1440w, https:\/\/phongvu.vn\/cong-nghe\/wp-content\/uploads\/2025\/08\/huong-dan-chay-gpt-oss-3-300x188.jpg 300w, https:\/\/phongvu.vn\/cong-nghe\/wp-content\/uploads\/2025\/08\/huong-dan-chay-gpt-oss-3-768x480.jpg 768w, https:\/\/phongvu.vn\/cong-nghe\/wp-content\/uploads\/2025\/08\/huong-dan-chay-gpt-oss-3-150x94.jpg 150w, https:\/\/phongvu.vn\/cong-nghe\/wp-content\/uploads\/2025\/08\/huong-dan-chay-gpt-oss-3-600x375.jpg 600w, https:\/\/phongvu.vn\/cong-nghe\/wp-content\/uploads\/2025\/08\/huong-dan-chay-gpt-oss-3-696x435.jpg 696w, https:\/\/phongvu.vn\/cong-nghe\/wp-content\/uploads\/2025\/08\/huong-dan-chay-gpt-oss-3-1392x870.jpg 1392w, https:\/\/phongvu.vn\/cong-nghe\/wp-content\/uploads\/2025\/08\/huong-dan-chay-gpt-oss-3-1068x668.jpg 1068w, https:\/\/phongvu.vn\/cong-nghe\/wp-content\/uploads\/2025\/08\/huong-dan-chay-gpt-oss-3-672x420.jpg 672w, https:\/\/phongvu.vn\/cong-nghe\/wp-content\/uploads\/2025\/08\/huong-dan-chay-gpt-oss-3-1344x840.jpg 1344w\" sizes=\"(max-width: 1440px) 100vw, 1440px\" title=\"\"><figcaption class=\"wp-element-caption\">C\u00e0i \u0111\u1eb7t Ollama (Ngu\u1ed3n: Internet)<\/figcaption><\/figure>\n\n\n\n<p><strong>B\u01b0\u1edbc 2: K\u00e9o m\u00f4 h\u00ecnh v\u1ec1 m\u00e1y: <\/strong>Sau khi c\u00e0i \u0111\u1eb7t xong, b\u1ea1n m\u1edf Terminal (tr\u00ean macOS\/Linux) ho\u1eb7c Command Prompt\/PowerShell (tr\u00ean Windows) v\u00e0 ch\u1ea1y l\u1ec7nh sau \u0111\u1ec3 t\u1ea3i m\u00f4 h\u00ecnh v\u1ec1:<\/p>\n\n\n\n<ul>\n<li><strong>V\u1edbi m\u00f4 h\u00ecnh 20B ch\u1ea1y l\u1ec7nh: <\/strong>ollama pull gpt-oss:20b<\/li>\n\n\n\n<li><strong>V\u1edbi m\u00f4 h\u00ecnh 120B&nbsp; ch\u1ea1y l\u1ec7nh:<\/strong> ollama pull gpt-oss:120b<\/li>\n<\/ul>\n\n\n\n<p>Trong qu\u00e1 tr\u00ecnh t\u1ea3i, h\u00e3y ki\u00ean nh\u1eabn m\u1ed9t ch\u00fat v\u00ec dung l\u01b0\u1ee3ng c\u1ee7a c\u00e1c m\u00f4 h\u00ecnh n\u00e0y kh\u00e1 l\u1edbn n\u00ean th\u1eddi gian th\u1ef1c hi\u1ec7n s\u1ebd m\u1ea5t kho\u1ea3ng v\u00e0i ph\u00fat. Sau khi t\u1ea3i xong, m\u00f4 h\u00ecnh s\u1ebd \u0111\u01b0\u1ee3c l\u01b0u tr\u1eef c\u1ee5c b\u1ed9 tr\u00ean m\u00e1y t\u00ednh c\u1ee7a b\u1ea1n.<\/p>\n\n\n\n<p><strong>B\u01b0\u1edbc 3: Tr\u00f2 chuy\u1ec7n ngo\u1ea1i tuy\u1ebfn: <\/strong>Sau khi th\u00e0nh c\u00f4ng t\u1ea3i m\u00f4 h\u00ecnh v\u1ec1 thi\u1ebft b\u1ecb, gi\u1edd \u0111\u00e2y b\u1ea1n \u0111\u00e3 c\u00f3 th\u1ec3 tr\u00f2 chuy\u1ec7n v\u1edbi m\u00f4 h\u00ecnh m\u00e0 kh\u00f4ng c\u1ea7n k\u1ebft n\u1ed1i internet. Ch\u1ec9 c\u1ea7n ch\u1ea1y l\u1ec7nh sau:\u00a0<\/p>\n\n\n\n<p>ollama run gpt-oss:20b<\/p>\n\n\n\n<p>Ti\u1ebfp \u0111\u00f3, Ollama s\u1ebd t\u1ef1 \u0111\u1ed9ng \u00e1p d\u1ee5ng c\u00e1c m\u1eabu tr\u00f2 chuy\u1ec7n, cho ph\u00e9p b\u1ea1n t\u01b0\u01a1ng t\u00e1c tr\u1ef1c ti\u1ebfp qua c\u1eeda s\u1ed5 d\u00f2ng l\u1ec7nh.<\/p>\n\n\n\n<p><strong>B\u01b0\u1edbc 4: T\u1eadn d\u1ee5ng API: <\/strong>\u0110i\u1ec1u th\u00fa v\u1ecb l\u00e0 Ollama cung c\u1ea5p m\u1ed9t API t\u01b0\u01a1ng th\u00edch v\u1edbi API c\u1ee7a OpenAI. \u0110i\u1ec1u n\u00e0y c\u00f3 ngh\u0129a l\u00e0 b\u1ea1n c\u00f3 th\u1ec3 s\u1eed d\u1ee5ng c\u00e1c th\u01b0 vi\u1ec7n v\u00e0 code \u0111\u00e3 quen thu\u1ed9c m\u00e0 kh\u00f4ng c\u1ea7n thay \u0111\u1ed5i nhi\u1ec1u. D\u01b0\u1edbi \u0111\u00e2y l\u00e0 m\u1ed9t v\u00ed d\u1ee5 b\u1eb1ng Python:<\/p>\n\n\n\n<figure class=\"wp-block-image size-full\"><img decoding=\"async\" loading=\"lazy\" width=\"1440\" height=\"900\" src=\"https:\/\/phongvu.vn\/cong-nghe\/wp-content\/uploads\/2025\/08\/huong-dan-chay-gpt-oss-4.jpg\" alt=\"Ollama cung c\u1ea5p m\u1ed9t API t\u01b0\u01a1ng th\u00edch v\u1edbi API c\u1ee7a OpenAI\" class=\"wp-image-140054\" srcset=\"https:\/\/phongvu.vn\/cong-nghe\/wp-content\/uploads\/2025\/08\/huong-dan-chay-gpt-oss-4.jpg 1440w, https:\/\/phongvu.vn\/cong-nghe\/wp-content\/uploads\/2025\/08\/huong-dan-chay-gpt-oss-4-300x188.jpg 300w, https:\/\/phongvu.vn\/cong-nghe\/wp-content\/uploads\/2025\/08\/huong-dan-chay-gpt-oss-4-768x480.jpg 768w, https:\/\/phongvu.vn\/cong-nghe\/wp-content\/uploads\/2025\/08\/huong-dan-chay-gpt-oss-4-150x94.jpg 150w, https:\/\/phongvu.vn\/cong-nghe\/wp-content\/uploads\/2025\/08\/huong-dan-chay-gpt-oss-4-600x375.jpg 600w, https:\/\/phongvu.vn\/cong-nghe\/wp-content\/uploads\/2025\/08\/huong-dan-chay-gpt-oss-4-696x435.jpg 696w, https:\/\/phongvu.vn\/cong-nghe\/wp-content\/uploads\/2025\/08\/huong-dan-chay-gpt-oss-4-1392x870.jpg 1392w, https:\/\/phongvu.vn\/cong-nghe\/wp-content\/uploads\/2025\/08\/huong-dan-chay-gpt-oss-4-1068x668.jpg 1068w, https:\/\/phongvu.vn\/cong-nghe\/wp-content\/uploads\/2025\/08\/huong-dan-chay-gpt-oss-4-672x420.jpg 672w, https:\/\/phongvu.vn\/cong-nghe\/wp-content\/uploads\/2025\/08\/huong-dan-chay-gpt-oss-4-1344x840.jpg 1344w\" sizes=\"(max-width: 1440px) 100vw, 1440px\" title=\"\"><figcaption class=\"wp-element-caption\">Ollama cung c\u1ea5p m\u1ed9t API t\u01b0\u01a1ng th\u00edch v\u1edbi API c\u1ee7a OpenAI (Ngu\u1ed3n: Internet)<\/figcaption><\/figure>\n\n\n\n<p>B\u1ea1n c\u00f3 th\u1ec3 th\u1ea5y, \u0111o\u1ea1n code n\u00e0y g\u1ea7n nh\u01b0 gi\u1ed1ng h\u1ec7t v\u1edbi c\u00e1ch s\u1eed d\u1ee5ng API c\u1ee7a OpenAI. \u0110i\u1ec1u n\u00e0y gi\u00fap b\u1ea1n d\u1ec5 d\u00e0ng t\u00edch h\u1ee3p GPT-OSS v\u00e0o c\u00e1c \u1ee9ng d\u1ee5ng hi\u1ec7n c\u00f3 c\u1ee7a m\u00ecnh.<\/p>\n\n\n\n<p><strong>B\u01b0\u1edbc 5: S\u1eed d\u1ee5ng c\u00f4ng c\u1ee5 (Function Calling): <\/strong>M\u1ed9t t\u00ednh n\u0103ng m\u1ea1nh m\u1ebd kh\u00e1c c\u1ee7a GPT-OSS l\u00e0 kh\u1ea3 n\u0103ng g\u1ecdi h\u00e0m (function calling). Ollama c\u0169ng h\u1ed7 tr\u1ee3 \u0111i\u1ec1u n\u00e0y. V\u00ed d\u1ee5, b\u1ea1n c\u00f3 th\u1ec3 t\u1ea1o m\u1ed9t c\u00f4ng c\u1ee5 \u0111\u1ec3 l\u1ea5y th\u00f4ng tin th\u1eddi ti\u1ebft v\u00e0 m\u00f4 h\u00ecnh s\u1ebd bi\u1ebft c\u00e1ch s\u1eed d\u1ee5ng n\u00f3 khi b\u1ea1n h\u1ecfi v\u1ec1 th\u1eddi ti\u1ebft c\u1ee7a m\u1ed9t th\u00e0nh ph\u1ed1.<\/p>\n\n\n\n<figure class=\"wp-block-image size-full\"><img decoding=\"async\" loading=\"lazy\" width=\"1440\" height=\"900\" src=\"https:\/\/phongvu.vn\/cong-nghe\/wp-content\/uploads\/2025\/08\/huong-dan-chay-gpt-oss-5.jpg\" alt=\"L\u1ec7nh t\u1ea1o c\u00f4ng c\u1ee5 thu th\u1eadp th\u00f4ng tin th\u1eddi ti\u1ebft\" class=\"wp-image-140055\" srcset=\"https:\/\/phongvu.vn\/cong-nghe\/wp-content\/uploads\/2025\/08\/huong-dan-chay-gpt-oss-5.jpg 1440w, https:\/\/phongvu.vn\/cong-nghe\/wp-content\/uploads\/2025\/08\/huong-dan-chay-gpt-oss-5-300x188.jpg 300w, https:\/\/phongvu.vn\/cong-nghe\/wp-content\/uploads\/2025\/08\/huong-dan-chay-gpt-oss-5-768x480.jpg 768w, https:\/\/phongvu.vn\/cong-nghe\/wp-content\/uploads\/2025\/08\/huong-dan-chay-gpt-oss-5-150x94.jpg 150w, https:\/\/phongvu.vn\/cong-nghe\/wp-content\/uploads\/2025\/08\/huong-dan-chay-gpt-oss-5-600x375.jpg 600w, https:\/\/phongvu.vn\/cong-nghe\/wp-content\/uploads\/2025\/08\/huong-dan-chay-gpt-oss-5-696x435.jpg 696w, https:\/\/phongvu.vn\/cong-nghe\/wp-content\/uploads\/2025\/08\/huong-dan-chay-gpt-oss-5-1392x870.jpg 1392w, https:\/\/phongvu.vn\/cong-nghe\/wp-content\/uploads\/2025\/08\/huong-dan-chay-gpt-oss-5-1068x668.jpg 1068w, https:\/\/phongvu.vn\/cong-nghe\/wp-content\/uploads\/2025\/08\/huong-dan-chay-gpt-oss-5-672x420.jpg 672w, https:\/\/phongvu.vn\/cong-nghe\/wp-content\/uploads\/2025\/08\/huong-dan-chay-gpt-oss-5-1344x840.jpg 1344w\" sizes=\"(max-width: 1440px) 100vw, 1440px\" title=\"\"><figcaption class=\"wp-element-caption\">L\u1ec7nh t\u1ea1o c\u00f4ng c\u1ee5 thu th\u1eadp th\u00f4ng tin th\u1eddi ti\u1ebft (Ngu\u1ed3n: Internet)<\/figcaption><\/figure>\n\n\n\n<p>M\u00f4 h\u00ecnh s\u1ebd kh\u00f4ng t\u1ef1 tr\u1ea3 l\u1eddi m\u00e0 s\u1ebd \u0111\u01b0a ra m\u1ed9t &#8220;l\u1ec7nh&#8221; \u0111\u1ec3 g\u1ecdi h\u00e0m get_weather v\u1edbi tham s\u1ed1 l\u00e0 Berlin. B\u1ea1n ch\u1ec9 c\u1ea7n th\u1ef1c thi l\u1ec7nh \u0111\u00f3 v\u00e0 \u0111\u01b0a k\u1ebft qu\u1ea3 tr\u1edf l\u1ea1i cho m\u00f4 h\u00ecnh \u0111\u1ec3 n\u00f3 \u0111\u01b0a ra c\u00e2u tr\u1ea3 l\u1eddi cu\u1ed1i c\u00f9ng.<\/p>\n\n\n\n<h2><span class=\"ez-toc-section\" id=\"III_Thiet_lap_nang_cao_voi_thu_vien_Hugging_Face_Transformers\"><\/span><strong>III. Thi\u1ebft l\u1eadp n\u00e2ng cao v\u1edbi th\u01b0 vi\u1ec7n Hugging Face Transformers<\/strong><span class=\"ez-toc-section-end\"><\/span><\/h2>\n\n\n\n<p>N\u1ebfu b\u1ea1n l\u00e0 m\u1ed9t l\u1eadp tr\u00ecnh vi\u00ean ho\u1eb7c mu\u1ed1n c\u00f3 to\u00e0n quy\u1ec1n ki\u1ec3m so\u00e1t, vi\u1ec7c s\u1eed d\u1ee5ng tr\u1ef1c ti\u1ebfp c\u00e1c th\u01b0 vi\u1ec7n nh\u01b0 Hugging Face Transformers l\u00e0 l\u1ef1a ch\u1ecdn t\u1ed1t nh\u1ea5t. C\u00e1c b\u01b0\u1edbc th\u1ef1c hi\u1ec7n c\u1ee5 th\u1ec3 nh\u01b0 sau:<\/p>\n\n\n\n<h3><span class=\"ez-toc-section\" id=\"Buoc_1_Chuan_bi_moi_truong_Python\"><\/span><strong>B\u01b0\u1edbc 1: Chu\u1ea9n b\u1ecb m\u00f4i tr\u01b0\u1eddng Python<\/strong><span class=\"ez-toc-section-end\"><\/span><\/h3>\n\n\n\n<p>\u0110\u1ec3 tr\u00e1nh xung \u0111\u1ed9t th\u01b0 vi\u1ec7n, b\u1ea1n n\u00ean t\u1ea1o m\u1ed9t m\u00f4i tr\u01b0\u1eddng Python \u1ea3o m\u1edbi. Sau \u0111\u00f3, c\u00e0i \u0111\u1eb7t c\u00e1c g\u00f3i c\u1ea7n thi\u1ebft:<\/p>\n\n\n\n<p>pip install -U transformers accelerate torch triton kernels<\/p>\n\n\n\n<p>pip install git+https:\/\/github.com\/triton-lang\/triton.git@main#subdirectory=python\/triton_kernels<\/p>\n\n\n\n<p>Trong \u0111\u00f3:<\/p>\n\n\n\n<ul>\n<li><strong>transformers<\/strong>: Th\u01b0 vi\u1ec7n ch\u00ednh \u0111\u1ec3 l\u00e0m vi\u1ec7c v\u1edbi c\u00e1c m\u00f4 h\u00ecnh LLM.<\/li>\n\n\n\n<li><strong>accelerate<\/strong>: Gi\u00fap t\u1ef1 \u0111\u1ed9ng h\u00f3a vi\u1ec7c ph\u00e2n b\u1ed5 m\u00f4 h\u00ecnh tr\u00ean nhi\u1ec1u GPU ho\u1eb7c CPU.<\/li>\n\n\n\n<li><strong>torch<\/strong>: N\u1ec1n t\u1ea3ng Pytorch \u0111\u1ec3 t\u00ednh to\u00e1n tensor.<\/li>\n\n\n\n<li><strong>triton kernels<\/strong>: C\u1ea7n thi\u1ebft cho vi\u1ec7c t\u01b0\u01a1ng th\u00edch v\u1edbi \u0111\u1ecbnh d\u1ea1ng l\u01b0\u1ee3ng t\u1eed h\u00f3a MXFP4.<\/li>\n<\/ul>\n\n\n\n<h3><span class=\"ez-toc-section\" id=\"Buoc_2_Chay_may_chu_API\"><\/span><strong>B\u01b0\u1edbc 2: Ch\u1ea1y m\u00e1y ch\u1ee7 API<\/strong><span class=\"ez-toc-section-end\"><\/span><\/h3>\n\n\n\n<p>B\u1ea1n c\u00f3 th\u1ec3 bi\u1ebfn m\u00e1y t\u00ednh c\u1ee7a m\u00ecnh th\u00e0nh m\u1ed9t m\u00e1y ch\u1ee7 API nh\u1ecf g\u1ecdn ch\u1ec9 b\u1eb1ng m\u1ed9t l\u1ec7nh \u0111\u01a1n gi\u1ea3n: transformers serve<\/p>\n\n\n\n<p>Sau \u0111\u00f3, b\u1ea1n c\u00f3 th\u1ec3 t\u01b0\u01a1ng t\u00e1c v\u1edbi n\u00f3 qua CLI ho\u1eb7c g\u1eedi c\u00e1c y\u00eau c\u1ea7u HTTP.<\/p>\n\n\n\n<ul>\n<li><strong>V\u1edbi CLI: <\/strong>transformers chat localhost:8000 &#8211;model-name-or-path openai\/gpt-oss-20b<\/li>\n\n\n\n<li><strong>V\u1edbi cURL:<\/strong><strong> <\/strong>curl -X POST http:\/\/localhost:8000\/v1\/responses -H &#8220;Content-Type: application\/json&#8221; -d &#8216;{&#8220;messages&#8221;: [{&#8220;role&#8221;: &#8220;system&#8221;, &#8220;content&#8221;: &#8220;hello&#8221;}], &#8220;temperature&#8221;: 0.9, &#8220;max_tokens&#8221;: 1000, &#8220;stream&#8221;: true, &#8220;model&#8221;: &#8220;openai\/gpt-oss-20b&#8221;}&#8217;<\/li>\n<\/ul>\n\n\n\n<p>C\u00e1ch n\u00e0y r\u1ea5t ti\u1ec7n l\u1ee3i n\u1ebfu b\u1ea1n mu\u1ed1n t\u00edch h\u1ee3p m\u00f4 h\u00ecnh v\u00e0o c\u00e1c \u1ee9ng d\u1ee5ng kh\u00e1c.<\/p>\n\n\n\n<h3><span class=\"ez-toc-section\" id=\"Buoc_3_Suy_luan_nhanh_voi_Pipeline\"><\/span><strong>B\u01b0\u1edbc 3: Suy lu\u1eadn nhanh v\u1edbi Pipeline<\/strong><span class=\"ez-toc-section-end\"><\/span><\/h3>\n\n\n\n<p>C\u00e1ch \u0111\u01a1n gi\u1ea3n nh\u1ea5t \u0111\u1ec3 ch\u1ea1y m\u00f4 h\u00ecnh GPT-OSS trong code Python l\u00e0 s\u1eed d\u1ee5ng <strong>pipeline<\/strong> c\u1ee7a Transformers. N\u00f3 t\u1ef1 \u0111\u1ed9ng x\u1eed l\u00fd m\u1ecdi th\u1ee9 t\u1eeb t\u1ea3i m\u00f4 h\u00ecnh, tokenizer cho \u0111\u1ebfn qu\u00e1 tr\u00ecnh t\u1ea1o v\u0103n b\u1ea3n.<\/p>\n\n\n\n<figure class=\"wp-block-image size-full\"><img decoding=\"async\" loading=\"lazy\" width=\"1440\" height=\"900\" src=\"https:\/\/phongvu.vn\/cong-nghe\/wp-content\/uploads\/2025\/08\/huong-dan-chay-gpt-oss-6.jpg\" alt=\"T\u1ea1o l\u1ec7nh suy lu\u1eadn nhanh v\u1edbi Pipeline\" class=\"wp-image-140056\" srcset=\"https:\/\/phongvu.vn\/cong-nghe\/wp-content\/uploads\/2025\/08\/huong-dan-chay-gpt-oss-6.jpg 1440w, https:\/\/phongvu.vn\/cong-nghe\/wp-content\/uploads\/2025\/08\/huong-dan-chay-gpt-oss-6-300x188.jpg 300w, https:\/\/phongvu.vn\/cong-nghe\/wp-content\/uploads\/2025\/08\/huong-dan-chay-gpt-oss-6-768x480.jpg 768w, https:\/\/phongvu.vn\/cong-nghe\/wp-content\/uploads\/2025\/08\/huong-dan-chay-gpt-oss-6-150x94.jpg 150w, https:\/\/phongvu.vn\/cong-nghe\/wp-content\/uploads\/2025\/08\/huong-dan-chay-gpt-oss-6-600x375.jpg 600w, https:\/\/phongvu.vn\/cong-nghe\/wp-content\/uploads\/2025\/08\/huong-dan-chay-gpt-oss-6-696x435.jpg 696w, https:\/\/phongvu.vn\/cong-nghe\/wp-content\/uploads\/2025\/08\/huong-dan-chay-gpt-oss-6-1392x870.jpg 1392w, https:\/\/phongvu.vn\/cong-nghe\/wp-content\/uploads\/2025\/08\/huong-dan-chay-gpt-oss-6-1068x668.jpg 1068w, https:\/\/phongvu.vn\/cong-nghe\/wp-content\/uploads\/2025\/08\/huong-dan-chay-gpt-oss-6-672x420.jpg 672w, https:\/\/phongvu.vn\/cong-nghe\/wp-content\/uploads\/2025\/08\/huong-dan-chay-gpt-oss-6-1344x840.jpg 1344w\" sizes=\"(max-width: 1440px) 100vw, 1440px\" title=\"\"><figcaption class=\"wp-element-caption\">T\u1ea1o l\u1ec7nh suy lu\u1eadn nhanh v\u1edbi Pipeline (Ngu\u1ed3n: Internet)<\/figcaption><\/figure>\n\n\n\n<p>B\u1ea1n ch\u1ec9 c\u1ea7n cung c\u1ea5p c\u00e1c tin nh\u1eafn v\u00e0 m\u00f4 h\u00ecnh s\u1ebd t\u1ea1o ra c\u00e2u tr\u1ea3 l\u1eddi. Tham s\u1ed1 device_map=&#8221;auto&#8221; s\u1ebd gi\u00fap b\u1ea1n t\u1eadn d\u1ee5ng t\u1ed1i \u0111a GPU c\u1ee7a m\u00ecnh.<\/p>\n\n\n\n<h3><span class=\"ez-toc-section\" id=\"Buoc_4_Suy_luan_nang_cao_voi_generate\"><\/span><strong>B\u01b0\u1edbc 4: Suy lu\u1eadn n\u00e2ng cao v\u1edbi <\/strong><strong>.generate()<\/strong><span class=\"ez-toc-section-end\"><\/span><\/h3>\n\n\n\n<p>N\u1ebfu b\u1ea1n c\u1ea7n ki\u1ec3m so\u00e1t chi ti\u1ebft h\u01a1n, b\u1ea1n c\u00f3 th\u1ec3 t\u1ea3i m\u00f4 h\u00ecnh v\u00e0 tokenizer ri\u00eang, sau \u0111\u00f3 tri\u1ec3n khai ph\u01b0\u01a1ng th\u1ee9c .generate() theo l\u1ec7nh nh\u01b0 sau:<\/p>\n\n\n\n<figure class=\"wp-block-image size-full\"><img decoding=\"async\" loading=\"lazy\" width=\"1440\" height=\"900\" src=\"https:\/\/phongvu.vn\/cong-nghe\/wp-content\/uploads\/2025\/08\/huong-dan-chay-gpt-oss-7.jpg\" alt=\"L\u1ec7nh tri\u1ec3n khai ph\u01b0\u01a1ng th\u1ee9c .generate()\" class=\"wp-image-140057\" srcset=\"https:\/\/phongvu.vn\/cong-nghe\/wp-content\/uploads\/2025\/08\/huong-dan-chay-gpt-oss-7.jpg 1440w, https:\/\/phongvu.vn\/cong-nghe\/wp-content\/uploads\/2025\/08\/huong-dan-chay-gpt-oss-7-300x188.jpg 300w, https:\/\/phongvu.vn\/cong-nghe\/wp-content\/uploads\/2025\/08\/huong-dan-chay-gpt-oss-7-768x480.jpg 768w, https:\/\/phongvu.vn\/cong-nghe\/wp-content\/uploads\/2025\/08\/huong-dan-chay-gpt-oss-7-150x94.jpg 150w, https:\/\/phongvu.vn\/cong-nghe\/wp-content\/uploads\/2025\/08\/huong-dan-chay-gpt-oss-7-600x375.jpg 600w, https:\/\/phongvu.vn\/cong-nghe\/wp-content\/uploads\/2025\/08\/huong-dan-chay-gpt-oss-7-696x435.jpg 696w, https:\/\/phongvu.vn\/cong-nghe\/wp-content\/uploads\/2025\/08\/huong-dan-chay-gpt-oss-7-1392x870.jpg 1392w, https:\/\/phongvu.vn\/cong-nghe\/wp-content\/uploads\/2025\/08\/huong-dan-chay-gpt-oss-7-1068x668.jpg 1068w, https:\/\/phongvu.vn\/cong-nghe\/wp-content\/uploads\/2025\/08\/huong-dan-chay-gpt-oss-7-672x420.jpg 672w, https:\/\/phongvu.vn\/cong-nghe\/wp-content\/uploads\/2025\/08\/huong-dan-chay-gpt-oss-7-1344x840.jpg 1344w\" sizes=\"(max-width: 1440px) 100vw, 1440px\" title=\"\"><figcaption class=\"wp-element-caption\">L\u1ec7nh tri\u1ec3n khai ph\u01b0\u01a1ng th\u1ee9c .generate() (Ngu\u1ed3n: Internet)<\/figcaption><\/figure>\n\n\n\n<p>C\u00e1ch n\u00e0y cho ph\u00e9p b\u1ea1n t\u00f9y ch\u1ec9nh chi ti\u1ebft c\u00e1c tham s\u1ed1 c\u1ee7a qu\u00e1 tr\u00ecnh t\u1ea1o v\u0103n b\u1ea3n nh\u01b0 max_new_tokens, temperature, v\u00e0 nhi\u1ec1u h\u01a1n n\u1eefa.<\/p>\n\n\n\n<h3><span class=\"ez-toc-section\" id=\"Buoc_5_Su_dung_mau_tro_chuyen_va_goi_cong_cu\"><\/span><strong>B\u01b0\u1edbc 5: S\u1eed d\u1ee5ng m\u1eabu tr\u00f2 chuy\u1ec7n v\u00e0 g\u1ecdi c\u00f4ng c\u1ee5<\/strong><span class=\"ez-toc-section-end\"><\/span><\/h3>\n\n\n\n<p>C\u00e1c m\u00f4 h\u00ecnh GPT-OSS c\u1ee7a OpenAI s\u1eed d\u1ee5ng \u0111\u1ecbnh d\u1ea1ng ph\u1ea3n h\u1ed3i c\u00f3 c\u1ea5u tr\u00fac. B\u1ea1n c\u00f3 th\u1ec3 s\u1eed d\u1ee5ng m\u1eabu tr\u00f2 chuy\u1ec7n t\u00edch h\u1ee3p s\u1eb5n c\u1ee7a Transformers ho\u1eb7c th\u01b0 vi\u1ec7n openai-harmony \u0111\u1ec3 x\u00e2y d\u1ef1ng c\u00e1c l\u1eddi nh\u1eafc ph\u1ee9c t\u1ea1p h\u01a1n. C\u1ee5 th\u1ec3:<\/p>\n\n\n\n<ul>\n<li><strong>V\u1edbi m\u1eabu tr\u00f2 chuy\u1ec7n t\u00edch h\u1ee3p: <\/strong>B\u1ea1n c\u00f3 th\u1ec3 \u0111\u1ecbnh ngh\u0129a c\u00e1c vai tr\u00f2 nh\u01b0 system, user v\u00e0 assistant \u0111\u1ec3 h\u01b0\u1edbng d\u1eabn m\u00f4 h\u00ecnh.<\/li>\n\n\n\n<li><strong>V\u1edbi th\u01b0 vi\u1ec7n openai-harmony:<\/strong> \u0110\u00e2y l\u00e0 th\u01b0 vi\u1ec7n \u0111\u01b0\u1ee3c OpenAI ph\u00e1t tri\u1ec3n, cung c\u1ea5p c\u00e1c c\u1ea5u tr\u00fac d\u1eef li\u1ec7u v\u00e0 c\u00f4ng c\u1ee5 m\u1ea1nh m\u1ebd \u0111\u1ec3 x\u1eed l\u00fd c\u00e1c l\u1eddi nh\u1eafc v\u00e0 ph\u1ea3n h\u1ed3i c\u1ee7a m\u00f4 h\u00ecnh. Tuy nhi\u00ean, n\u00f3 y\u00eau c\u1ea7u c\u00e0i \u0111\u1eb7t th\u00eam v\u00e0 c\u00f3 th\u1ec3 ph\u1ee9c t\u1ea1p h\u01a1n m\u1ed9t ch\u00fat.<\/li>\n<\/ul>\n\n\n\n<figure class=\"wp-block-image size-full\"><img decoding=\"async\" loading=\"lazy\" width=\"1440\" height=\"900\" src=\"https:\/\/phongvu.vn\/cong-nghe\/wp-content\/uploads\/2025\/08\/huong-dan-chay-gpt-oss-9.jpg\" alt=\"Tr\u00f2 chuy\u1ec7n tr\u00ean GPT OSS\" class=\"wp-image-140059\" srcset=\"https:\/\/phongvu.vn\/cong-nghe\/wp-content\/uploads\/2025\/08\/huong-dan-chay-gpt-oss-9.jpg 1440w, https:\/\/phongvu.vn\/cong-nghe\/wp-content\/uploads\/2025\/08\/huong-dan-chay-gpt-oss-9-300x188.jpg 300w, https:\/\/phongvu.vn\/cong-nghe\/wp-content\/uploads\/2025\/08\/huong-dan-chay-gpt-oss-9-768x480.jpg 768w, https:\/\/phongvu.vn\/cong-nghe\/wp-content\/uploads\/2025\/08\/huong-dan-chay-gpt-oss-9-150x94.jpg 150w, https:\/\/phongvu.vn\/cong-nghe\/wp-content\/uploads\/2025\/08\/huong-dan-chay-gpt-oss-9-600x375.jpg 600w, https:\/\/phongvu.vn\/cong-nghe\/wp-content\/uploads\/2025\/08\/huong-dan-chay-gpt-oss-9-696x435.jpg 696w, https:\/\/phongvu.vn\/cong-nghe\/wp-content\/uploads\/2025\/08\/huong-dan-chay-gpt-oss-9-1392x870.jpg 1392w, https:\/\/phongvu.vn\/cong-nghe\/wp-content\/uploads\/2025\/08\/huong-dan-chay-gpt-oss-9-1068x668.jpg 1068w, https:\/\/phongvu.vn\/cong-nghe\/wp-content\/uploads\/2025\/08\/huong-dan-chay-gpt-oss-9-672x420.jpg 672w, https:\/\/phongvu.vn\/cong-nghe\/wp-content\/uploads\/2025\/08\/huong-dan-chay-gpt-oss-9-1344x840.jpg 1344w\" sizes=\"(max-width: 1440px) 100vw, 1440px\" title=\"\"><figcaption class=\"wp-element-caption\">Tr\u00f2 chuy\u1ec7n tr\u00ean GPT OSS (Ngu\u1ed3n: Internet)<\/figcaption><\/figure>\n\n\n\n<h3><span class=\"ez-toc-section\" id=\"Buoc_6_Suy_luan_da_GPU_chi_danh_cho_mo_hinh_120B\"><\/span><strong>B\u01b0\u1edbc 6: Suy lu\u1eadn \u0111a GPU (ch\u1ec9 d\u00e0nh cho m\u00f4 h\u00ecnh 120B)<\/strong><span class=\"ez-toc-section-end\"><\/span><\/h3>\n\n\n\n<p>\u0110\u1ed1i v\u1edbi m\u00f4 h\u00ecnh 120B, n\u1ebfu b\u1ea1n mu\u1ed1n ch\u1ea1y n\u00f3 tr\u00ean nhi\u1ec1u GPU, Transformers cung c\u1ea5p c\u00e1c t\u00f9y ch\u1ecdn nh\u01b0 tp_plan=&#8221;auto&#8221; \u0111\u1ec3 t\u1ef1 \u0111\u1ed9ng ph\u00e2n chia m\u00f4 h\u00ecnh. B\u1ea1n c\u0169ng c\u00f3 th\u1ec3 s\u1eed d\u1ee5ng accelerate launch ho\u1eb7c torchrun \u0111\u1ec3 kh\u1edfi ch\u1ea1y c\u00e1c thi\u1ebft l\u1eadp ph\u00e2n t\u00e1n.<\/p>\n\n\n\n<figure class=\"wp-block-image size-full\"><img decoding=\"async\" loading=\"lazy\" width=\"1440\" height=\"900\" src=\"https:\/\/phongvu.vn\/cong-nghe\/wp-content\/uploads\/2025\/08\/huong-dan-chay-gpt-oss-8.jpg\" alt=\"M\u00f4 h\u00ecnh GPT OSS sau khi kh\u1edfi t\u1ea1o th\u00e0nh c\u00f4ng\" class=\"wp-image-140058\" srcset=\"https:\/\/phongvu.vn\/cong-nghe\/wp-content\/uploads\/2025\/08\/huong-dan-chay-gpt-oss-8.jpg 1440w, https:\/\/phongvu.vn\/cong-nghe\/wp-content\/uploads\/2025\/08\/huong-dan-chay-gpt-oss-8-300x188.jpg 300w, https:\/\/phongvu.vn\/cong-nghe\/wp-content\/uploads\/2025\/08\/huong-dan-chay-gpt-oss-8-768x480.jpg 768w, https:\/\/phongvu.vn\/cong-nghe\/wp-content\/uploads\/2025\/08\/huong-dan-chay-gpt-oss-8-150x94.jpg 150w, https:\/\/phongvu.vn\/cong-nghe\/wp-content\/uploads\/2025\/08\/huong-dan-chay-gpt-oss-8-600x375.jpg 600w, https:\/\/phongvu.vn\/cong-nghe\/wp-content\/uploads\/2025\/08\/huong-dan-chay-gpt-oss-8-696x435.jpg 696w, https:\/\/phongvu.vn\/cong-nghe\/wp-content\/uploads\/2025\/08\/huong-dan-chay-gpt-oss-8-1392x870.jpg 1392w, https:\/\/phongvu.vn\/cong-nghe\/wp-content\/uploads\/2025\/08\/huong-dan-chay-gpt-oss-8-1068x668.jpg 1068w, https:\/\/phongvu.vn\/cong-nghe\/wp-content\/uploads\/2025\/08\/huong-dan-chay-gpt-oss-8-672x420.jpg 672w, https:\/\/phongvu.vn\/cong-nghe\/wp-content\/uploads\/2025\/08\/huong-dan-chay-gpt-oss-8-1344x840.jpg 1344w\" sizes=\"(max-width: 1440px) 100vw, 1440px\" title=\"\"><figcaption class=\"wp-element-caption\">M\u00f4 h\u00ecnh GPT OSS sau khi kh\u1edfi t\u1ea1o th\u00e0nh c\u00f4ng (Ngu\u1ed3n: Internet)<\/figcaption><\/figure>\n\n\n\n<h2><span class=\"ez-toc-section\" id=\"IV_Dung_GPT_OSS_voi_SDK_cua_OpenAI_Agents\"><\/span><strong>IV. D\u00f9ng GPT OSS v\u1edbi SDK c\u1ee7a OpenAI Agents<\/strong><span class=\"ez-toc-section-end\"><\/span><\/h2>\n\n\n\n<p>N\u1ebfu b\u1ea1n \u0111ang ph\u00e1t tri\u1ec3n ph\u1ea7n m\u1ec1m AI d\u00f9ng OpenAI Agents SDK (Python ho\u1eb7c TypeScript), b\u1ea1n c\u00f3 th\u1ec3 chuy\u1ec3n qua GPT OSS d\u1ec5 d\u00e0ng b\u1eb1ng c\u00e1ch:<\/p>\n\n\n\n<ul>\n<li>D\u00f9ng LiteLLM \u0111\u1ec3 t\u1ea1o proxy cho m\u00f4 h\u00ecnh GPT OSS<\/li>\n\n\n\n<li>Ho\u1eb7c d\u00f9ng Responses.js \u0111\u1ec3 t\u01b0\u01a1ng th\u00edch \u0111\u1ecbnh d\u1ea1ng API<\/li>\n<\/ul>\n\n\n\n<h2><span class=\"ez-toc-section\" id=\"V_Mot_so_luu_y_ve_phan_cung_khi_chay_GPT_OSS_20B_va_120B_tren_may_tinh\"><\/span><strong>V. M\u1ed9t s\u1ed1 l\u01b0u \u00fd v\u1ec1 ph\u1ea7n c\u1ee9ng khi ch\u1ea1y GPT OSS 20B v\u00e0 120B tr\u00ean m\u00e1y t\u00ednh<\/strong><span class=\"ez-toc-section-end\"><\/span><\/h2>\n\n\n\n<p>Trong qu\u00e1 tr\u00ecnh ch\u1ea1y GPT OSS 20B v\u00e0 120B, b\u1ea1n c\u1ea7n \u0111\u1eb7c bi\u1ec7t l\u01b0u \u00fd nh\u1eefng v\u1ea5n \u0111\u1ec1 li\u00ean quan \u0111\u1ebfn VRAM, c\u1ee5 th\u1ec3 nh\u01b0 sau:<\/p>\n\n\n\n<figure class=\"wp-block-table\"><table><tbody><tr><td><strong>M\u00f4 h\u00ecnh<\/strong><\/td><td><strong>VRAM c\u1ea7n thi\u1ebft<\/strong><\/td><td><strong>Ph\u00f9 h\u1ee3p v\u1edbi<\/strong><\/td><\/tr><tr><td><strong>GPT OSS 20B<\/strong><\/td><td>\u226516GB (MXFP4)<\/td><td>GPU ti\u00eau d\u00f9ng cao c\u1ea5p ho\u1eb7c Mac M2\/M3<\/td><\/tr><tr><td><strong>GPT OSS 120B<\/strong><\/td><td>\u226560GB (MXFP4)<\/td><td>Multi-GPU \/ H100 \/ m\u00e1y tr\u1ea1m m\u1ea1nh<\/td><\/tr><\/tbody><\/table><\/figure>\n\n\n\n<p><strong><em>L\u01b0u \u00fd:<\/em><\/strong><em> N\u1ebfu thi\u1ebfu VRAM, c\u00f3 th\u1ec3 chuy\u1ec3n sang CPU, nh\u01b0ng t\u1ed1c \u0111\u1ed9 s\u1ebd r\u1ea5t ch\u1eadm.<\/em><\/p>\n\n\n\n<figure class=\"wp-block-image size-full\"><img decoding=\"async\" loading=\"lazy\" width=\"1440\" height=\"900\" src=\"https:\/\/phongvu.vn\/cong-nghe\/wp-content\/uploads\/2025\/08\/huong-dan-chay-gpt-oss-10.jpg\" alt=\"M\u00f4 h\u00ecnh GPT OSS 120B v\u00e0 20B\" class=\"wp-image-140060\" srcset=\"https:\/\/phongvu.vn\/cong-nghe\/wp-content\/uploads\/2025\/08\/huong-dan-chay-gpt-oss-10.jpg 1440w, https:\/\/phongvu.vn\/cong-nghe\/wp-content\/uploads\/2025\/08\/huong-dan-chay-gpt-oss-10-300x188.jpg 300w, https:\/\/phongvu.vn\/cong-nghe\/wp-content\/uploads\/2025\/08\/huong-dan-chay-gpt-oss-10-768x480.jpg 768w, https:\/\/phongvu.vn\/cong-nghe\/wp-content\/uploads\/2025\/08\/huong-dan-chay-gpt-oss-10-150x94.jpg 150w, https:\/\/phongvu.vn\/cong-nghe\/wp-content\/uploads\/2025\/08\/huong-dan-chay-gpt-oss-10-600x375.jpg 600w, https:\/\/phongvu.vn\/cong-nghe\/wp-content\/uploads\/2025\/08\/huong-dan-chay-gpt-oss-10-696x435.jpg 696w, https:\/\/phongvu.vn\/cong-nghe\/wp-content\/uploads\/2025\/08\/huong-dan-chay-gpt-oss-10-1392x870.jpg 1392w, https:\/\/phongvu.vn\/cong-nghe\/wp-content\/uploads\/2025\/08\/huong-dan-chay-gpt-oss-10-1068x668.jpg 1068w, https:\/\/phongvu.vn\/cong-nghe\/wp-content\/uploads\/2025\/08\/huong-dan-chay-gpt-oss-10-672x420.jpg 672w, https:\/\/phongvu.vn\/cong-nghe\/wp-content\/uploads\/2025\/08\/huong-dan-chay-gpt-oss-10-1344x840.jpg 1344w\" sizes=\"(max-width: 1440px) 100vw, 1440px\" title=\"\"><figcaption class=\"wp-element-caption\">M\u00f4 h\u00ecnh GPT OSS 120B v\u00e0 20B (Ngu\u1ed3n: Internet)<\/figcaption><\/figure>\n\n\n\n<h2><span class=\"ez-toc-section\" id=\"VI_Tong_ket\"><\/span><strong>VI. T\u1ed5ng k\u1ebft<\/strong><span class=\"ez-toc-section-end\"><\/span><\/h2>\n\n\n\n<p>V\u1edbi GPT OSS 20B v\u00e0 120B, b\u1ea1n ho\u00e0n to\u00e0n c\u00f3 th\u1ec3 ch\u1ea1y m\u00f4 h\u00ecnh AI gi\u1ed1ng ChatGPT ngay tr\u00ean m\u00e1y t\u00ednh c\u1ee7a m\u00ecnh m\u00e0 kh\u00f4ng c\u1ea7n internet. D\u00f9 b\u1ea1n l\u00e0 ng\u01b0\u1eddi d\u00f9ng chuy\u00ean nghi\u1ec7p hay c\u01a1 b\u1ea3n, vi\u1ec7c c\u00e0i \u0111\u1eb7t v\u00e0 s\u1eed d\u1ee5ng qua Ollama ho\u1eb7c Transformers \u0111\u1ec1u r\u1ea5t \u0111\u01a1n gi\u1ea3n. Ch\u1ec9 c\u1ea7n m\u00e1y \u0111\u1ee7 m\u1ea1nh, b\u1ea1n s\u1ebd c\u00f3 c\u01a1 h\u1ed9i s\u1edf h\u1eefu m\u1ed9t tr\u1ee3 l\u00fd AI m\u1ea1nh m\u1ebd ho\u1ea1t \u0111\u1ed9ng ho\u00e0n to\u00e0n ngo\u1ea1i tuy\u1ebfn, d\u1ec5 t\u00edch h\u1ee3p v\u00e0 t\u00f9y bi\u1ebfn theo nhu c\u1ea7u.<\/p>\n\n\n\n<p><strong>B\u00e0i vi\u1ebft li\u00ean quan:<\/strong><\/p>\n\n\n\n<ul>\n<li><a href=\"https:\/\/phongvu.vn\/cong-nghe\/chatgpt-tang-mien-phi-model-ai-gpt-oss\/\" target=\"_blank\" rel=\"noreferrer noopener\">ChatGPT t\u1eb7ng mi\u1ec5n ph\u00ed model AI GPT OSS, s\u1ee9c m\u1ea1nh ngang ng\u1eeda GPT-4o<\/a><\/li>\n\n\n\n<li><a href=\"https:\/\/phongvu.vn\/cong-nghe\/cach-nhan-perplexity-ai-pro-mien-phi\/\" target=\"_blank\" rel=\"noreferrer noopener\">C\u00e1ch nh\u1eadn Perplexity AI Pro mi\u1ec5n ph\u00ed, nhanh nh\u1ea5t 2025<\/a><\/li>\n\n\n\n<li><a href=\"https:\/\/phongvu.vn\/cong-nghe\/chatgpt-ghi-nhan-25-ty-truy-van-ngay\/\" target=\"_blank\" rel=\"noreferrer noopener\">ChatGPT ghi nh\u1eadn 2,5 t\u1ef7 truy v\u1ea5n\/ng\u00e0y, Google s\u1eafp \u201ch\u1ebft th\u1eddi\u201d?<\/a><\/li>\n<\/ul>\n","protected":false},"excerpt":{"rendered":"<p>B\u1ea1n mu\u1ed1n tr\u00f2 chuy\u1ec7n v\u1edbi m\u00f4 h\u00ecnh tr\u00ed tu\u1ec7 nh\u00e2n t\u1ea1o AI gi\u1ed1ng ChatGPT nh\u01b0ng ch\u1ea1y ho\u00e0n to\u00e0n tr\u00ean m\u00e1y t\u00ednh c\u1ee7a b\u1ea1n, kh\u00f4ng c\u1ea7n internet hay ph\u1ee5 thu\u1ed9c v\u00e0o OpenAI? Tin vui l\u00e0 b\u1ea1n ho\u00e0n to\u00e0n c\u00f3 th\u1ec3 l\u00e0m \u0111\u01b0\u1ee3c \u0111i\u1ec1u \u0111\u00f3 v\u1edbi GPT OSS, d\u00f2ng m\u00f4 h\u00ecnh m\u00e3 ngu\u1ed3n m\u1edf do OpenAI ph\u00e1t [&hellip;]<\/p>\n","protected":false},"author":28,"featured_media":140051,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"inline_featured_image":false},"categories":[24,4372],"tags":[],"_links":{"self":[{"href":"https:\/\/phongvu.vn\/cong-nghe\/wp-json\/wp\/v2\/posts\/140043"}],"collection":[{"href":"https:\/\/phongvu.vn\/cong-nghe\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/phongvu.vn\/cong-nghe\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/phongvu.vn\/cong-nghe\/wp-json\/wp\/v2\/users\/28"}],"replies":[{"embeddable":true,"href":"https:\/\/phongvu.vn\/cong-nghe\/wp-json\/wp\/v2\/comments?post=140043"}],"version-history":[{"count":5,"href":"https:\/\/phongvu.vn\/cong-nghe\/wp-json\/wp\/v2\/posts\/140043\/revisions"}],"predecessor-version":[{"id":152443,"href":"https:\/\/phongvu.vn\/cong-nghe\/wp-json\/wp\/v2\/posts\/140043\/revisions\/152443"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/phongvu.vn\/cong-nghe\/wp-json\/wp\/v2\/media\/140051"}],"wp:attachment":[{"href":"https:\/\/phongvu.vn\/cong-nghe\/wp-json\/wp\/v2\/media?parent=140043"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/phongvu.vn\/cong-nghe\/wp-json\/wp\/v2\/categories?post=140043"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/phongvu.vn\/cong-nghe\/wp-json\/wp\/v2\/tags?post=140043"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}