The Raw Hybrid Score-Scale Collapse
Initial experiments combining dense vector embeddings and BM25 sparse keywords resulted in an alarming performance collapse: Recall@10 dropped from 0.8567 down to 0.7033 (-15.34%).
Because raw BM25 scores overpowered vector scores by ~3×, keyword matching completely dominated ranking. By introducing independent Min-Max normalization followed by an 80% vector / 20% keyword weighted fusion over an expanded 100+100 candidate pool, Recall@10 rose to a peak 0.8600 with 0.7302 nDCG@10. Reciprocal Rank Fusion (RRF) was evaluated and discarded after underperforming at 0.8267.
