Zyphra Hierarchical Attention summarizes keys into a tree and searches query-relevant regions while retaining the original keys and values. Selective traversal aims to reduce long-context costs compared with comparing every token. The company also describes adapting pretrained models through distillation. Large-context speedups are projections from a performance model, however. Search thresholds, hardware effects and accuracy preservation require evaluation on real workloads.