A Beginner’s Guide to LLM Fine-Tuning

The growing interest in Large Language Models (LLMs) has led to a surge in tools and wrappers designed to streamline their training process. Popular options include FastChat from LMSYS (used to train Vicuna) and Hugging Face’s transformers/trl libraries (used in my previous article). In addition, each big LLM project, like WizardLM, tends to have its own training script, inspired by the original Alpaca implementation. In this article, we will use Axolotl, a tool created by the OpenAccess AI Collective. We […]

Read more

ExLlamaV2: The Fastest Library to Run LLMs

Quantizing Large Language Models (LLMs) is the most popular approach to reduce the size of these models and speed up inference. Among these techniques, GPTQ delivers amazing performance on GPUs. Compared to unquantized models, this method uses almost 3 times less VRAM while providing a similar level of accuracy and faster generation. It became so popular that it has recently been directly integrated into the transformers library. ExLlamaV2 is a library designed to squeeze even more performance out of GPTQ. […]

Read more

Future of OTT: Exploring AI’s Impact on Streaming

Video streaming platforms are embracing artificial intelligence (AI) tools to enhance content recommendations, tailoring the viewing experience for individual users and simplifying content discovery. Industry experts anticipate AI’s expansion into scripting, dubbing, and even allowing users to participate directly in content streaming. Manish Kalra, Chief Business Officer at ZEE5 India, highlights the active use of AI in content recommendation, personalization, cross-device compatibility, and audience analytics across over-the-top (OTT) platforms. AI’s impact extends to social media marketing through creative content and […]

Read more

Using Python for Data Analysis

Data analysis is a broad term that covers a wide range of techniques that enable you to reveal any insights and relationships that may exist within raw data. As you might expect, Python lends itself readily to data analysis. Once Python has analyzed your data, you can then use your findings to make good business decisions, improve procedures, and even make informed predictions based on what you’ve discovered. Before you start, you should familiarize yourself with Jupyter Notebook, a popular […]

Read more

IMF Analysis Warns: Artificial Intelligence to Impact 40% of Jobs

The International Monetary Fund (IMF) has released a new analysis predicting that artificial intelligence (AI) is poised to influence almost 40% of all jobs globally. Kristalina Georgieva, the Managing Director of the IMF, emphasizes that, in most scenarios, AI is likely to exacerbate overall inequality. Ms. Georgieva calls for proactive measures from policymakers to address this “troubling trend” and prevent technology from intensifying social tensions. According to the IMF report, advanced economies will experience a higher impact, with AI affecting […]

Read more

Create a Tic-Tac-Toe Python Game Engine With an AI Player

A classic childhood game is tic-tac-toe, also known as naughts and crosses. It’s simple and enjoyable, and coding a version of it with Python is an exciting project for a budding programmer. Now, adding some artificial intelligence (AI) using Python can make an old favorite even more thrilling. In this comprehensive tutorial, you’ll construct a flexible game engine. This engine will include an unbeatable computer player that employs the minimax algorithm to play tic-tac-toe flawlessly. Throughout the tutorial, you’ll explore […]

Read more

GHDDI and Microsoft Research use AI technology to achieve significant progress in discovering new drugs to treat global infectious diseases

The Global Health Drug Discovery Institute (GHDDI) (opens in new tab) and Microsoft Research recently achieved significant progress in accelerating drug discovery for the treatment of global infectious diseases. Working in close collaboration, the joint team successfully used generative AI and foundation models to design several small molecule inhibitors for essential target proteins of Mycobacterium tuberculosis and coronaviruses. These new inhibitors  

Read more
1 97 98 99 100 101 973