November 21, 2023 Uncategorized Leave a comment

Orca 2: Teaching Small Language Models How to Reason

A few months ago, we introduced Orca, a 13-billion language model that demonstrated strong reasoning abilities by imitating the step-by-step reasoning traces of more capable LLMs. Orca 2 is the latest step in our efforts to explore the capabilities of smaller LMs (on the order of 10 billion parameters or less). With Orca 2, we continue to show that improved training signals and methods can empower smaller language models to achieve enhanced reasoning abilities, which are typically found only in […]

November 20, 2023 Uncategorized Leave a comment

Lifelong model editing in large language models: Balancing low-cost targeted edits and catastrophic forgetting

Large language models (LLMs) are profoundly useful for a vast array of difficult tasks. But they sometimes make unpredictable

November 20, 2023 Uncategorized Leave a comment

Abstracts: November 20, 2023

ZOË HITZIG: Great to be here. HUIZINGA: Shrey, let’s start out with you. What problem does this research address, what made you care about it, and why should we care about it, too? JAIN: Yeah, so right now, there’s a lot of discussion as towards what the impacts of generative AI is on communication, and there’s been a lot of different terms being thrown around amongst AI policy researchers or news organizations, such as disinformation, misinformation, copyright, fair use, social […]

November 17, 2023 Uncategorized Leave a comment

Skeleton-of-Thought: Parallel decoding speeds up and improves LLM output

Large language models (LLMs) such as LLaMA and OpenAI’s GPT-4 are revolutionizing technology. However, one

November 16, 2023 Uncategorized Leave a comment

Samsung Unveils Revolutionary Generative AI Model, Samsung Gauss, at AI Forum

We and our partners use cookies to Store and/or access information on a device. We and our partners use data for Personalised ads and content, ad and content measurement, audience insights and product development. An example of data being processed may be a unique identifier stored in a cookie. Some of our partners may process your data as a part of their legitimate business interest without asking for consent. To view the purposes they believe they have legitimate interest for, […]

November 16, 2023 Uncategorized Leave a comment

What’s Your Story: Desney Tan

DESNEY TAN: Born and raised in Singapore. Dad was an architect. Mom did everything, um, to run the family. When I turned 13, Mom and Dad came to me and they said, “Hey, would you like to try something new?” I said sure. You know, I had no idea what they, they were thinking. Two weeks later, they sent me to the US to study. Um, looking back, sometimes I flippantly claim I was just eating too much at home […]

November 15, 2023 Uncategorized Leave a comment