Extracting Steering Vectors from J space

·Hacker News··

I was reading about the jacobian space and how it can be used to verbalize the intermediate activations of an LLM to decode what it is most likely going to say or is thinking about. I wanted to test if we can use the j lens to arrive at a general activation steering vector from a couple of tokens related to the concept towards which we wanted to steer the model i.e inverting the j lens to have a general method of finding steering vectors from the concept tokens

Read full article →

Related Articles

Every AI model has the same "controversial" take on humans
rakannimer · Hacker News · 1d ago
UUIDv7 doesn't have the properties you think it does
ibobev · Hacker News · 6h ago
Pentagon grants DHS permission to test heat ray weapon for use at border
bushwart · Hacker News · 8h ago
Jailbreaking the Switch 2
ledoge · Hacker News · 1d ago
The 1.5°C goal of the Paris Agreement is no longer viable
velo_aprx · Hacker News · 2d ago