This struck me as well. Is the entire model being loaded before the deltas are a...

		progman32 on April 3, 2023 \| parent \| context \| favorite \| on: State-of-the-art open-source chatbot, Vicuna-13B, ... This struck me as well. Is the entire model being loaded before the deltas are applied? Would it be possible to apply the delta blockwise?