AI Summary: A bug in the `TransformerBridge` for audio models causes a crash when using the `start_at_layer` functionality. Instead of a clear error, the residual stream is incorrectly routed, leading to an internal shape mismatch within Hugging Face's `Conv1d`. The fix involves adding an explicit check for audio models at the beginning of the `_setup_start_at_layer` method to raise a `NotImplementedError`.
A library for mechanistic interpretability of GPT-style language models