Skip to content

MSN Technology

Tech Solutions for a Smarter World

Menu
  • About MSN Technology
  • Contact Us
  • Write for Us
Menu
GettyImages 1479183112 1152x648

Why do LLMs make stuff up? New research peers under the hood.

Posted on March 28, 2025

OK toning helps reduce this problem, guides the model to work as a helper, and refuses to complete the hint when the training data is reduced. This fine toning process develops a separate set of synthetic neurons that researchers can see when the cloud is called “known entity” (such as, “Michael Jordan”) or “Unnamed Name” (eg, “Michael Batkin”).


Screenshot 2025 03 28 at 5.51.49%E2%80%AFPM

An easy graph that shows how different features and circuits indicate sports stars, real and fake.

An easy graph that shows how different features and circuits indicate sports stars, real and fake.


Credit:

Anthropic


Activating the “unfamiliar name” feature between LLM neurons cannot respond to the model “internal” in the model, “researchers write, and encourages that” I apologize, but I cannot … “In fact, the researchers did not think that the model was answered. The characteristics in its nerve trap shows that it should be.

Researchers write that when the model faces a well -known term like “Michael Jordan”, it occurs, and as a result the “known entity” feature is activated and results in the “answer not” in the circuit “to be inactive or more vibrant,” researchers write. Once this happens, the model can Deep dive in her graph of features related to Michael Jordan To answer this question to the best guessing it like “What game does Michael Jordan play?”

Identity vs. Remember

Anthropic research has shown that artificial weight gain in the “known response” feature can force the neuron to halvaste with confidence in fully -made players like “Michael Batkin”. Such a result attracts researchers to suggest that the “minimum” circuit’s “misunderstanding” of the cloud’s “can not respond” is a situation where the “known entity” feature (or other) is activated even when the token is not well represented in training.

Source link

Leave a Reply Cancel reply

Your email address will not be published. Required fields are marked *

Recent Posts

  • FTC delays enforcement of click-to-cancel rule
  • Week in Review: Instacart CEO heads to OpenAI
  • Google will pay Texas $1.4 billion to settle privacy lawsuits
  • The near joy of biking with Ray-Ban Meta glasses
  • A timeline of the U.S. semiconductor market in 2025

Recent Comments

  1. How to Make a Smart Kitchen: The Ultimate Guide - INSCMagazine on Top Smart Cooking Appliances in 2025: Revolutionizing Your Kitchen
  2. Top Smart Cooking Appliances in 2025: Revolutionizing Your Kitchen – MSN Technology on Can I Control Smart Cooking Appliances with My Smartphone?
  3. Venn Alternatives for Remote Work: Enhancing Productivity and Collaboration – MSN Technology on Top 9 AI Tools for Data Analytics in 2025
  4. 10 Small Business Trends for 2025 – MSN Technology on How To Extending Your Business Trip for Personal Enjoyment: A Guide

Archives

  • May 2025
  • April 2025
  • March 2025
  • February 2025
  • January 2025
  • December 2024
  • November 2024
  • October 2024

Categories

  • Business
  • Education
  • Fashion
  • Home Improvements
  • Sports
  • Technology
  • Travel
  • Uncategorized
©2025 MSN Technology | Design: Newspaperly WordPress Theme
Go to mobile version