Local LLMs with llamafile
About this Course
In this 1-hour project-based course, you will learn to: * Package open-source AI models into portable llamafile executables * Deploy llamafiles locally across Windows, macOS and Linux * Monitor system metrics like GPU usage when running models * Query llamafile APIs with Python to process generated text * Experience real-time inference through hands-on examplesCreated by: Duke University
Related Online Courses
This course is ideal for individuals who currently work in or are targeting opportunities in consulting and strategy, industrial sales and buying, marketing management, entrepreneurship and... more
\"Time, Change, and Decisions for Marketing\" shows how advanced analytics can be used to adapt and optimize marketing strategies in response to evolving market conditions. Unique to this course is... more
This course arms you with basic utility industry safety knowledge. You will be educated about personal protective equipment, fire safety, hazardous materials and their symbols. You will gain... more
In this course, you will learn how to apply financial principles and analyses to make strategic decisions that drive business growth, enhance operational efficiency, and maximize shareholder value.... more
This course introduces the technologies behind web and search engines, including document indexing, searching and ranking. You will also learn different performance metrics for evaluating search... more
Powered by
