← Chen, Ho Yiing — Research Records

Cross-Model Dimensional Preservation in qwen2.5: 49 Hot Coordinates Survive Across 3B and 7B

Chen, Ho Yiing · 2026-05-21 · Zenodo

doi:10.5281/zenodo.20346626 · PDF

Abstract

© Copyright 2026 Chen, Ho Yiing (ORCID: 0009-0006-6816-9891), Independent researcher, charenix.com. All rights reserved by the author. This work is licensed under the Creative Commons Attribution 4.0. Two members of the qwen2.5 family share an output-side grammar at the per-coordinate level. Aggregating activation heat at block L -1 for qwen2.5:7B (D_7=3584) and qwen2.5:3B (D_3=2048) on ten multilingual prompts via Mercury, I take each network's hottest hidden-state indices: 200 for the larger member, a proportionally scaled 114 for the smaller. The two top-K sets share 49 indices inside the s

Chen, Ho Yiing (norika) · Independent Researcher, Taiwan · ORCID 0009-0006-6816-9891