SnapKV: LLM Knows What You are Looking for Before Generation
View PDF
The majority of the research has focused on the potential impact of quantum technologies on privacy and security, the potential impact of quantum technologies on the trust of those systems, and the potential for creating new forms of inequality in access to the technology.
Long contexts represent a new front in the struggle to control LLMs. We explored a family of attacks that are newly feasible due to longer context lengths, as well as candidate mitigations. We found that the effectiveness of attacks, and of in-context learning more generally, could be characterized by simple power laws. This provides a richer source of feedback for mitigating long-context attacks than the standard approach of measuring frequency of success