{"product_id":"build-a-large-language-model-from-scratch-by-sebastian-raschka","title":"Build a Large Language Model (From Scratch) by Sebastian Raschka","description":"\u003cdiv class=\"a-expander-content a-expander-partial-collapse-content a-expander-content-expanded\"\u003e\n\u003cspan class=\"a-text-italic\"\u003eBuild a Large Language Model (from Scratch)\u003c\/span\u003e\u003cspan\u003e teaches you how to:\u003c\/span\u003e\n\u003cul class=\"a-unordered-list a-vertical\"\u003e\n\u003cli\u003e\u003cspan class=\"a-list-item\"\u003e\u003cspan\u003ePlan and code all the parts of an LLM\u003c\/span\u003e\u003c\/span\u003e\u003c\/li\u003e\n\u003cli\u003e\u003cspan class=\"a-list-item\"\u003e\u003cspan\u003ePrepare a dataset suitable for LLM training\u003c\/span\u003e\u003c\/span\u003e\u003c\/li\u003e\n\u003cli\u003e\u003cspan class=\"a-list-item\"\u003e\u003cspan\u003eFine-tune LLMs for text classification and with your own data\u003c\/span\u003e\u003c\/span\u003e\u003c\/li\u003e\n\u003cli\u003e\u003cspan class=\"a-list-item\"\u003e\u003cspan\u003eUse human feedback to ensure your LLM follows instructions\u003c\/span\u003e\u003c\/span\u003e\u003c\/li\u003e\n\u003cli\u003e\u003cspan class=\"a-list-item\"\u003e\u003cspan\u003eLoad pretrained weights into an LLM\u003c\/span\u003e\u003c\/span\u003e\u003c\/li\u003e\n\u003c\/ul\u003e\n\u003cspan\u003e\u003cbr\u003e\u003c\/span\u003e\u003cspan class=\"a-text-italic\"\u003eBuild a Large Language Model (from Scratch)\u003c\/span\u003e\u003cspan\u003e takes you inside the AI black box to tinker with the internal systems that power generative AI. As you work through each key stage of LLM creation, you’ll develop an in-depth understanding of how LLMs work, their limitations, and their customization methods. Your LLM can be developed on an ordinary laptop, and used as your own personal assistant.\u003cbr\u003e\u003cbr\u003e\u003c\/span\u003e\u003cspan class=\"a-text-bold\"\u003eAbout the technology\u003c\/span\u003e\u003cspan\u003e\u003cbr\u003e\u003cbr\u003ePhysicist Richard P. Feynman reportedly said, “I don’t understand anything I can’t build.” Based on this same powerful principle, bestselling author Sebastian Raschka guides you step by step as you build a GPT-style LLM that you can run on your laptop. This is an engaging book that covers each stage of the process, from planning and coding to training and fine-tuning.\u003cbr\u003e\u003cbr\u003e\u003c\/span\u003e\u003cspan class=\"a-text-bold\"\u003eAbout the book\u003c\/span\u003e\u003cspan\u003e\u003cbr\u003e\u003cbr\u003e\u003c\/span\u003e\u003cspan class=\"a-text-italic\"\u003eBuild a Large Language Model (From Scratch)\u003c\/span\u003e\u003cspan\u003e is a practical and eminently-satisfying hands-on journey into the foundations of generative AI. Without relying on any existing LLM libraries, you’ll code a base model, evolve it into a text classifier, and ultimately create a chatbot that can follow your conversational instructions. And you’ll really understand it because you built it yourself!\u003cbr\u003e\u003cbr\u003e\u003c\/span\u003e\u003cspan class=\"a-text-bold\"\u003eWhat's inside\u003c\/span\u003e\n\u003cul class=\"a-unordered-list a-vertical\"\u003e\n\u003cli\u003e\u003cspan class=\"a-list-item\"\u003e\u003cspan\u003ePlan and code an LLM comparable to GPT-2\u003c\/span\u003e\u003c\/span\u003e\u003c\/li\u003e\n\u003cli\u003e\u003cspan class=\"a-list-item\"\u003e\u003cspan\u003eLoad pretrained weights\u003c\/span\u003e\u003c\/span\u003e\u003c\/li\u003e\n\u003cli\u003e\u003cspan class=\"a-list-item\"\u003e\u003cspan\u003eConstruct a complete training pipeline\u003c\/span\u003e\u003c\/span\u003e\u003c\/li\u003e\n\u003cli\u003e\u003cspan class=\"a-list-item\"\u003e\u003cspan\u003eFine-tune your LLM for text classification\u003c\/span\u003e\u003c\/span\u003e\u003c\/li\u003e\n\u003cli\u003e\u003cspan class=\"a-list-item\"\u003e\u003cspan\u003eDevelop LLMs that follow human instructions\u003c\/span\u003e\u003c\/span\u003e\u003c\/li\u003e\n\u003c\/ul\u003e\n\u003cspan\u003e\u003cbr\u003e\u003c\/span\u003e\u003cspan class=\"a-text-bold\"\u003eAbout the reader\u003c\/span\u003e\u003cspan\u003e\u003cbr\u003e\u003cbr\u003eReaders need intermediate Python skills and some knowledge of machine learning. The LLM you create will run on any modern laptop and can optionally utilize GPUs.\u003cbr\u003e\u003cbr\u003e\u003c\/span\u003e\u003cspan class=\"a-text-bold\"\u003eAbout the author\u003c\/span\u003e\u003cspan\u003e\u003cbr\u003e\u003cbr\u003e\u003c\/span\u003e\u003cspan class=\"a-text-bold\"\u003eSebastian Raschka\u003c\/span\u003e\u003cspan\u003e is a Staff Research Engineer at Lightning AI, where he works on LLM research and develops open-source software.\u003cbr\u003e\u003cbr\u003eThe technical editor on this book was \u003c\/span\u003e\u003cspan class=\"a-text-bold\"\u003eDavid Caswell\u003c\/span\u003e\u003cspan\u003e.\u003cbr\u003e\u003cbr\u003e\u003c\/span\u003e\u003cspan class=\"a-text-bold\"\u003eTable of Contents\u003c\/span\u003e\u003cspan\u003e\u003cbr\u003e\u003cbr\u003e1 Understanding large language models\u003cbr\u003e2 Working with text data\u003cbr\u003e3 Coding attention mechanisms\u003cbr\u003e4 Implementing a GPT model from scratch to generate text\u003cbr\u003e5 Pretraining on unlabeled data\u003cbr\u003e6 Fine-tuning for classification\u003cbr\u003e7 Fine-tuning to follow instructions\u003cbr\u003eA Introduction to PyTorch\u003cbr\u003eB References and further reading\u003cbr\u003eC Exercise solutions\u003cbr\u003eD Adding bells and whistles to the training loop\u003cbr\u003eE Parameter-efficient fine-tuning with LoRA\u003c\/span\u003e\n\u003c\/div\u003e\n\u003cdiv class=\"a-expander-header a-expander-partial-collapse-header\"\u003e\u003c\/div\u003e","brand":"Booksdomain","offers":[{"title":"Default Title","offer_id":54099556663407,"sku":null,"price":490.0,"currency_code":"MAD","in_stock":true}],"thumbnail_url":"\/\/cdn.shopify.com\/s\/files\/1\/0742\/6696\/8175\/files\/71eljkULtwL._SY466.jpg?v=1787512982","url":"https:\/\/domainbooksma.com\/products\/build-a-large-language-model-from-scratch-by-sebastian-raschka","provider":"Booksdomain","version":"1.0","type":"link"}