The DOI matches its Crossref record; 50 of the 50 references it cites were found in a registry or an index.
Crowd Counting With Deep Structured Scale Integration Network
Open accessAbstract
Automatic estimation of the number of people in unconstrained crowded scenes is a challenging task and one major difficulty stems from the huge scale variation of people. In this paper, we propose a novel Deep Structured Scale Integration Network (DSSINet) for crowd counting, which addresses the scale variation of people by using structured feature representation learning and hierarchically structured loss function optimization. Unlike conventional methods which directly fuse multiple features with weighted average or concatenation, we first introduce a Structured Feature Enhancement Module based on conditional random fields (CRFs) to refine multiscale features mutually with a message passing mechanism. Specifically, each scale-specific feature is considered as a continuous random variable and passes complementary information to refine the features at other scales. Second, we utilize a Dilated Multiscale Structural Similarity loss to enforce our DSSINet to learn the local correlation of people's scales within regions of various size, thus yielding high-quality density maps. Extensive experiments on four challenging benchmarks well demonstrate the effectiveness of our method. In particular, our DSSINet achieves improvements of 9.5% error reduction on Shanghaitech dataset and 24.9% on UCF-QNRF dataset against the state-of-the-art methods.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Deep Residual Learning for Image Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.90 · Cited by 235,474
Very Deep Convolutional Networks for Large-Scale Image Recognition
Simonyan, K., & Zisserman, A. (2014) · arXiv · doi:10.48550/arxiv.1409.1556 · Cited by 114,148
Adam: A Method for Stochastic Optimization
Kingma, D. P., & Ba, J. (2014) · arXiv · doi:10.48550/arxiv.1412.6980 · Cited by 98,946
Image quality assessment: from error visibility to structural similarity
Wang, Z., Bovik, A. C., Sheikh, H. R., & Simoncelli, E. P. (2004) · IEEE Transactions on Image Processing · doi:10.1109/tip.2003.819861 · Cited by 57,892
Densely Connected Convolutional Networks
Huang, G., Liu, Z., Van Der Maaten, L., & Weinberger, K. Q. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.243 · Cited by 48,566
Feature Pyramid Networks for Object Detection
Lin, T.-Y., Dollar, P., Girshick, R., He, K., Hariharan, B., & Belongie, S. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.106 · Cited by 30,939
Chen, L.-C., Papandreou, G., Kokkinos, I., Murphy, K., & Yuille, A. L. (2016) · arXiv · doi:10.48550/arxiv.1606.00915 · Cited by 22,392
Chen, L.-C., Papandreou, G., Kokkinos, I., Murphy, K., & Yuille, A. L. (2018) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2017.2699184 · Cited by 22,392
SegNet: A Deep Convolutional Encoder-Decoder Architecture for Image Segmentation
Badrinarayanan, V., Kendall, A., & Cipolla, R. (2017) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2016.2644615 · Cited by 19,631
Conditional Random Fields: Probabilistic Models for Segmenting and Labeling Sequence Data
Lafferty, J., McCallum, A., & Pereira, F. C. N. (2001) · ScholarlyCommons (University of Pennsylvania) · Cited by 12,935
(2017) · Cited by 11,625
Multiscale structural similarity for image quality assessment
Wang, Z., Simoncelli, E. P., & Bovik, A. C. (2004) · The Thrity-Seventh Asilomar Conference on Signals, Systems & Computers, 2003 · doi:10.1109/acssc.2003.1292216 · Cited by 6,253 · cited 4×
“We ameliorate the original MS-SSIM [39] with dilation operations to enlarge the diversity of the sizes of local regions and force our network to capture the local correlation within regions of different sizes.”
BackgroundMethodInfluentialEfficient Inference in Fully Connected CRFs with Gaussian Edge Potentials
Krähenbühl, P., & Koltun, V. (2012) · arXiv · doi:10.48550/arxiv.1210.5644 · Cited by 2,908
Loss Functions for Image Restoration With Neural Networks
Zhao, H., Gallo, O., Frosio, I., & Kautz, J. (2017) · IEEE Transactions on Computational Imaging · doi:10.1109/tci.2016.2644865 · Cited by 2,641
Conditional Random Fields as Recurrent Neural Networks
Zheng, S., Jayasumana, S., Romera-Paredes, B., Vineet, V., Su, Z., Du, D., Huang, C., & Torr, P. H. S. (2015) · 2015 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.179 · Cited by 2,386 · cited 1×
“[49] used CRFs to refine the semantic segmentation maps of CNN by modeling the relationship among pixels.”
MethodSingle-Image Crowd Counting via Multi-Column Convolutional Neural Network
Zhang, Y., Zhou, D., Chen, S., Gao, S., & Ma, Y. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.70 · Cited by 2,241
CSRNet: Dilated Convolutional Neural Networks for Understanding the Highly Congested Scenes
Li, Y., Zhang, X., & Chen, D. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00120 · Cited by 1,698
Cross-scene crowd counting via deep convolutional neural networks
Zhang, C., Li, H., Wang, X., & Yang, X. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298684 · Cited by 1,121
Multi-source Multi-scale Counting in Extremely Dense Crowd Images
Idrees, H., Saleemi, I., Seibert, C., & Shah, M. (2013) · 2013 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2013.329 · Cited by 1,031
Switching Convolutional Neural Network for Crowd Counting
Sam, D. B., Surya, S., & Babu, R. V. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.429 · Cited by 967
Composition Loss for Counting, Density Map Estimation and Localization in Dense Crowds
Idrees, H., Tayyab, M., Athrey, K., Zhang, D., Al-Maadeed, S., Rajpoot, N., & Shah, M. (2018) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-01216-8_33 · Cited by 851
Liu, W., Salzmann, M., & Fua, P. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00524 · Cited by 736
Scale Aggregation Network for Accurate and Efficient Crowd Counting
Cao, X., Wang, Z., Zhao, Y., & Su, F. (2018) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-01228-1_45 · Cited by 733
Generating High-Quality Crowd Density Maps Using Contextual Pyramid CNNs
Sindagi, V. A., & Patel, V. M. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.206 · Cited by 700
Towards Perspective-Free Object Counting with Deep Learning
Oñoro-Rubio, D., & López-Sastre, R. J. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-46478-7_38 · Cited by 641
CNN-Based cascaded multi-task learning of high-level prior and density estimation for crowd counting
Sindagi, V. A., & Patel, V. M. (2017) · 2017 14th IEEE International Conference on Advanced Video and Signal Based Surveillance (AVSS) · doi:10.1109/avss.2017.8078491 · Cited by 536
CrowdNet: A Deep Convolutional Network for Dense Crowd Counting
Boominathan, L., Kruthiventi, S. S. S., & Babu, R. V. (2016) · Proceedings of the 24th ACM international conference on Multimedia · doi:10.1145/2964284.2967300 · Cited by 503
A Bi-Directional Message Passing Model for Salient Object Detection
Zhang, L., Dai, J., Lu, H., He, Y., & Wang, G. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00187 · Cited by 484
DecideNet: Counting Varying Density Crowds Through Attention Guided Detection and Density Estimation
Liu, J., Gao, C., Meng, D., & Hauptmann, A. G. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00545 · Cited by 416
Crowd Counting via Adversarial Cross-Scale Consistency Pursuit
Shen, Z., Xu, Y., Ni, B., Wang, M., Hu, J., & Yang, X. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00550 · Cited by 364
ADCrowdNet: An Attention-Injective Deformable Convolutional Network for Crowd Understanding
Liu, N., Long, Y., Zou, C., Niu, Q., Pan, L., & Wu, H. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00334 · Cited by 350
Ranjan, V., Le, H., & Hoai, M. (2018) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-01234-2_17 · Cited by 297
Learning to Count with CNN Boosting
Walach, E., & Wolf, L. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-46475-6_41 · Cited by 294
PCC Net: Perspective Crowd Counting via Spatial Convolutional Network
Gao, J., Wang, Q., & Li, X. (2020) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2019.2919139 · Cited by 284
Crowd Counting with Deep Negative Correlation Learning
Shi, Z., Zhang, L., Liu, Y., Cao, X., Ye, Y., Cheng, M.-M., & Zheng, G. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00564 · Cited by 283
Crowd Counting via Scale-Adaptive Convolutional Neural Network
Zhang, L., Shi, M., & Chen, Q. (2018) · 2018 IEEE Winter Conference on Applications of Computer Vision (WACV) · doi:10.1109/wacv.2018.00127 · Cited by 273
Marked point processes for crowd counting
Ge, W., & Collins, R. T. (2009) · 2009 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2009.5206621 · Cited by 253
Divide and Grow: Capturing Huge Diversity in Crowd Images with Incrementally Growing CNN
Sam, D. B., Sajjan, N. N., Babu, R. V., & Srinivasan, M. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00381 · Cited by 244
Multi-scale convolutional neural networks for crowd counting
Zeng, L., Xu, X., Cai, B., Qiu, S., & Zhang, T. (2017) · 2017 IEEE International Conference on Image Processing (ICIP) · doi:10.1109/icip.2017.8296324 · Cited by 220
Crowd Counting using Deep Recurrent Spatial-Aware Network
Liu, L., Wang, H., Li, G., Ouyang, W., & Lin, L. (2018) · Proceedings of the Twenty-Seventh International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2018/118 · Cited by 198
Self-citationSpatiotemporal Modeling for Crowd Counting in Videos
Xiong, F., Shi, X., & Yeung, D.-Y. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.551 · Cited by 186
Understanding Traffic Density from Large-Scale Web Camera Data
Zhang, S., Wu, G., Costeira, J. P., & Moura, J. M. F. (2017) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2017.454 · Cited by 178
Learning Deep Structured Multi-Scale Features using Attention-Gated CRFs for Contour PredictionPreprint
Xu, D., Ouyang, W., Alameda-Pineda, X., Ricci, E., Wang, X., & Sebe, N. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1801.00524 · Cited by 123
Self-citationCrowd Counting by Adaptively Fusing Predictions from an Image PyramidPreprint
Kang, D., & Chan, A. B. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1805.06115 · Cited by 111
Dividing and Aggregating Network for Multi-view Action Recognition
Wang, D., Ouyang, W., Li, W., & Xu, D. (2018) · Lecture notes in computer science · doi:10.1007/978-3-030-01240-3_28 · Cited by 80
Self-citationLiu, L., Zhang, R., Peng, J., Li, G., Du, B., & Lin, L. (2018) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/3240508.3240681 · Cited by 75
Self-citationGeometric and Physical Constraints for Drone-Based Head Plane Crowd Density Estimation
Liu, W., Lis, K., Salzmann, M., & Fua, P. (2019) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros40897.2019.8967852 · Cited by 66
CRF-CNN: Modeling Structured Information in Human Pose EstimationPreprint
Chu, X., Ouyang, W., Li, H., & Wang, X. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1611.00468 · Cited by 61
Self-citationContinuous Conditional Random Fields for Efficient Regression in Large Fully Connected Graphs
Ristovski, K., Radosavljević, V., Vučetić, S., & Zoran Obradovic, A. (2013) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v27i1.8685 · Cited by 58
Crowd Counting via Multi-view Scale Aggregation Networks
Qiu, Z., Liu, L., Li, G., Wang, Q., Xiao, N., & Lin, L. (2019) · IEEE International Conference on Multimedia and Expo (ICME) · doi:10.1109/icme.2019.00259 · Cited by 29
Self-citation
Cited by
NWPU-Crowd: A Large-Scale Benchmark for Crowd Counting and Localization
Wang, Q., Gao, J., Lin, W., & Li, X. (2021) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2020.3013269 · Cited by 510
Attention Scaling for Crowd Counting
Jiang, X., Zhang, L., Xu, M., Zhang, T., Lv, P., Zhou, B., Yang, X., & Pang, Y. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00476 · Cited by 325
TransCrowd: weakly-supervised crowd counting with transformers
Liang, D., Chen, X., Xu, W., Zhou, Y., & Bai, X. (2022) · Science China Information Sciences · doi:10.1007/s11432-021-3445-y · Cited by 268
Decoupled Two-Stage Crowd Counting and Beyond
Cheng, J., Xiong, H., Cao, Z., & Lu, H. (2021) · IEEE Transactions on Image Processing · doi:10.1109/tip.2021.3055631 · Cited by 103
Metadata
- Authors
- Liu, L., Qiu, Z., Li, G., Liu, S., Ouyang, W., & Lin, L.
- Venue
- 2019 IEEE/CVF International Conference on Computer Vision (ICCV)
- Publisher
- IEEE
- Published
- 2019-10
- Pages
- 1774-1783
- OpenAlex
- W2982007926
- Cited by
- 290
- References
- 50
- FWCI
- 15.86
- Type
- conference paper
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.