Scale-Sensitive Mamba Decoding for Tiny Lesion Segmentation in Medical Imagery

Authors

  • Yu Cai Department of Computer Science, College of Computing, City University of Hong Kong, Hong Kong, Hong Kong SAR, China
  • Man-Kit Tso Department of Computer Science, College of Computing, City University of Hong Kong, Hong Kong, Hong Kong SAR, China
  • Sze-Ling Chiu School of Computing and Information Sciences, Saint Francis University, Hong Kong, Hong Kong SAR, China

Keywords:

Medical Image Segmentation, State Space Models, Tiny Lesions, Scale-Sensitive Decoding

Abstract

The accurate segmentation of tiny lesions in medical imagery remains a persistent challenge in computational pathology and radiology. Traditional convolutional neural networks and vision transformers often struggle with highly localized, small-scale pathological manifestations due to the inherent loss of fine-grained spatial resolution during hierarchical downsampling and the quadratic computational complexity associated with global attention mechanisms. Recently, State Space Models, particularly the Mamba architecture, have emerged as a promising alternative for modeling long-range dependencies with linear computational complexity. However, standard Mamba formulations are fundamentally sequence-oriented and tend to smooth over the high-frequency spatial details required to isolate tiny lesions. To address this limitation, this paper introduces a scale-sensitive Mamba decoding framework designed specifically for the nuanced segmentation of micro-lesions. By integrating a novel multi-scale state space projection mechanism within the decoding trajectory, our approach dynamically modulates the state transitions based on local feature variations across different resolution hierarchies. This ensures that the high-frequency structural anomalies characteristic of tiny lesions are preserved and amplified during the reconstruction phase. Comprehensive empirical evaluations across multiple imaging modalities demonstrate that the proposed architecture not only achieves superior segmentation accuracy and boundary delineation but also maintains the linear scaling efficiency characteristic of State Space Models.

References

Yu, T., Ekbote, C., Morozov, N., Herrera, A., Fan, J., Dominguez Mantes, A., Novello, S., Lashuel, H. A., Frossard, P., d’Ascoli, S., La Manno, G., & Brbić, M. (2025). Tissue reassembly with generative AI [Preprint]. bioRxiv. https://doi.org/10.1101/2025.02.13.638045

Simonyan, K., & Zisserman, A. (2015). Very deep convolutional networks for large-scale image recognition. In Proceedings of ICLR.

Li, Y., Wang, S., & Tan, G. (2025). ID-NeRF: Indirect diffusion-guided neural radiance fields for generalizable view synthesis. Expert Systems with Applications, 266, 126068.

Qu, W., Shao, Y., Meng, L., Huang, X., & Xiao, L. (2024, June). A conditional denoising diffusion probabilistic model for point cloud upsampling. In 2024 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) (pp. 20786-20795). IEEE.

Sha, L., Wang, Y., Meng, P., Deng, Y., Chen, T., Zhang, X., ... & Xu, Q. (2025). Pharmacological inhibition of PSPH reduces serine levels and epileptic seizures. Nature Chemical Biology, 21(11), 1742-1753.

Yang, D., Ai, H., Liu, J., & He, B. (2022). Absolute scale estimation for underwater monocular visual odometry based on 2-D imaging sonar. Measurement, 190, 110665.

Long, J., Shelhamer, E., & Darrell, T. (2015). Fully convolutional networks for semantic segmentation. In Proceedings of CVPR.

Guo, H., Gao, S., Tsui, K. L., & Niu, T. (2017). Simulation optimization for medical staff configuration at emergency department in Hong Kong. IEEE Transactions on Automation Science and Engineering, 14(4), 1655-1665.

Z. Wang, R. Yuan, Z. Geng, H. Li, X. Qu, X. Li, S. Chen,

H. Fu, R. B. Dannenberg, and K. Zhang, ‘‘Singing timbre popularity

assessment based on multimodal large foundation model,’’ in Proc.

33rd ACM Int. Conf. Multimedia, Oct. 2025, pp. 12227–12236, doi:

10.1145/3746027.3758148.

Kabra M, Shahi P K, Wang Y, et al. Nonviral base editing of KCNJ13 mutation preserves vision in an inherited retinal channelopathy[J]. bioRxiv, 2022: 2022.07. 12.499808.

Dosovitskiy, A., Beyer, L., Kolesnikov, A., Weissenborn, D., Zhai, X., Unterthiner, T., et al. (2021). An image is worth 16x16 words: Transformers for image recognition at scale. In Proceedings of ICLR.

Li, Y., Wang, S., Guo, M., Huang, J., Ding, T., Hu, M., ... & Tan, G. (2025). ReCamDriving: LiDAR-Free Camera-Controlled Novel Trajectory Video Generation. arXiv preprint arXiv:2512.03621.

Yang, Z., Liang, B., & Ji, W. (2021). An intelligent end–edge–cloud architecture for visual IoT-assisted healthcare systems. IEEE internet of things journal, 8(23), 16779-16786.

Hao, Y., Xu, M., Ye, C., Qin, J., Lu, S., Qin, Y., & Han, X. (2026). LoFA: Learning to Predict Personalized Prior for Fast Adaptation of Visual Generative Models. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (pp. 21986-21996).

Wang, G., Ren, J., Shen, L., Cheah, W. P., & Qu, R. (2026). M-MambaS: Multimodal Mamba for small lesion segmentation. Pattern Recognition, 113923.

Yang, Z., Hu, D., Guo, Q., Zuo, L., & Ji, W. (2023). Visual E 2 C: AI-driven visual end-edge-cloud architecture for 6G in low-carbon smart cities. IEEE Wireless Communications, 30(3), 204-210.

Lyu, S., Mao, S., & Ma, Y. (2025). Unified Long Video Inpainting and Outpainting via Overlapping High-Order Co-Denoising. arXiv preprint arXiv:2511.03272.

Wang, J., Xu, Y., Li, Y., Khargonekar, P., & Faruque, M. A. A. (2026). CRUISE: Vision-Language Model-Guided Uncertainty-Aware Cross-Modal Sensor Fusion for Robust Autonomous Driving. arXiv preprint arXiv:2608.09202.

Meng, X., & Lin, J. (2026). CARTN: Counterfactual Audit and Repair for Trust-Aware Multi-Signal Streaming LiDAR Segmentation. Information Fusion, 104809.

Qu, W., Wang, J., Gong, Y., Huang, X., & Xiao, L. (2025, June). An end-to-end robust point cloud semantic segmentation network with single-step conditional diffusion models. In 2025 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) (pp. 27325-27335). IEEE.

Zhang, J., Shi, Y., Ma, Y., Xu, L., Yu, J., & Wang, J. (2023, June). Ikol: Inverse kinematics optimization layer for 3d human pose and shape estimation via gauss-newton differentiation. In Proceedings of the AAAI conference on artificial intelligence (Vol. 37, No. 3, pp. 3454-3462).

Wang, Y., Li, F. W., & Wang, J. (2026, May). Motion-Guided Semantic Alignment with Negative Prompts for Zero-Shot Video Action Recognition. In ICASSP 2026-2026 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) (pp. 10712-10716). IEEE.

H. Wang et al., “Search Beyond What Can Be Taught: Evolving the Knowledge Boundary in Agentic Visual Generation,” arXiv preprint arXiv:2607.05382, 2026.

Fang, S., Shen, I., Wang, Y., Tsai, Y. H., Yang, Y., Zhou, S., ... & Yang, M. H. (2025). Meshllm: Empowering large language models to progressively understand and generate 3d mesh. In Proceedings of the IEEE/CVF international conference on computer vision (pp. 14061-14072).

Yang, Y., & Zhang, S. (2025). Pixel-wise calibration for a multi-focus microscopic 3D imaging system.Optics and Lasers in Engineering,194, 109127.

Jiaxing, Z., & Hao, T. (2025). Sam2 for image and video segmentation: A comprehensive survey.

Zhao, Y., Bian, H., Mu, M., Uddin, M. R., Li, Z., Li, X., ... & Xu, M. (2024, October). Cryosam: Training-free cryoet tomogram segmentation with foundation models. In International Conference on Medical Image Computing and Computer-Assisted Intervention (pp. 124-134). Cham: Springer Nature Switzerland.

Wang, G., Li, Y., Chen, W., Ding, M., Cheah, W. P., Qu, R., ... & Shen, L. (2025, April). S³-mamba: Small-size-sensitive mamba for lesion segmentation. In Proceedings of the AAAI Conference on Artificial Intelligence (Vol. 39, No. 7, pp. 7655-7664).

Cong, P., Xu, Y., Ren, Y., Zhang, J., Xu, L., Wang, J., ... & Ma, Y. (2023, June). Weakly supervised 3d multi-person pose estimation for large-scale scenes based on monocular camera and single lidar. In Proceedings of the AAAI Conference on Artificial Intelligence (Vol. 37, No. 1, pp. 461-469).

Su, H., Huang, T., Wan, Z., Wu, X., & Zuo, W. (2026). S $^ 2$ AM3D: Scale-controllable Part Segmentation of 3D Point Clouds. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (pp. 14357-14366).

Lan, Z., Zhang, X., Cai, X., Pan, W., Li, W., Sun, Y., ... & Meng, J. (2025). Metabolite profiling and ‘dryness’-like effect analysis of ‘Chenpi’plant tea (Citri Reticulatae Pericarpium peel) with and without steaming peocessing. Food Research International, 206, 116089.

Yang, Z., Ji, W., Guo, Q., & Wang, Z. (2023, October). Javp: Joint-aware video processing with edge-cloud collaboration for dnn inference. In Proceedings of the 31st ACM International Conference on Multimedia (pp. 9152-9160).

Zhang, W., Huang, M., Zhou, Y., Zhang, J., Yu, J., Wang, J., & Xu, L. (2024). Both2hands: Inferring 3d hands from both text prompts and body dynamics. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (pp. 2393-2404).

Zhang, B., Wang, S., Jiang, Y., Sui, D., Tu, Z., & Chu, D. (2025, July). Ask and Retrieve Knowledge: Towards Proactive Asking with Imperfect Information in Medical Multi-turn Dialogues. In Proceedings of the 48th International ACM SIGIR Conference on Research and Development in Information Retrieval (pp. 1055-1065).

Du, J., Gao, S., & Chen, C. H. (2024). A contextual ranking and selection method for personalized medicine. Manufacturing & Service Operations Management, 26(1), 167-181.

Liu, Y., Cai, Q., Wang, C., Yang, J., Fan, H., Dong, J., & Chen, S. (2024). Geometry-enhanced attentive multi-view stereo for challenging matching scenarios. IEEE Transactions on Circuits and Systems for Video Technology, 34(8), 7401-7416.

Downloads

Published

2026-09-26