CoChat
Sign Up
PreprintCited by 338Advanced Graph Neural NetworksGraph Theory and AlgorithmsRecommender Systems and Techniques

Representation learning for dynamic graphs: A survey

Open access
Kazemi, Seyed Mehran, Goel, Rishab, Jain, Kshitij, Kobyzev, Ivan, Sethi, Akshay, Forsyth, Peter, Poupart, Pascal·2019·arXiv
DOI 10.48550/arxiv.1905.11485arXiv 1905.11485
Open this paper in CoChat — free accountOpen PDF

Abstract

Graphs arise naturally in many real-world applications including social networks, recommender systems, ontologies, biology, and computational finance. Traditionally, machine learning models for graphs have been mostly designed for static graphs. However, many applications involve evolving graphs. This introduces important challenges for learning and inference since nodes, attributes, and edges change over time. In this survey, we review the recent advances in representation learning for dynamic graphs, including dynamic knowledge graphs. We describe existing models from an encoder-decoder perspective, categorize these encoders and decoders based on the techniques they employ, and analyze the approaches in each category. We also review several prominent applications and widely used datasets and highlight directions for future research.

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

DataCite · 10.48550/arxiv.1905.11485

Cites

9 of 9 references verified0 citation errors · 0 not checkable

Statistics

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

  • The size and complexity of the collected dataset is comparable to existing benchmark datasets for dynamic (knowledge) graphs, such as social network graphs commonly used for link prediction tasks.

    “The size and complexity of the collected dataset is comparable to existing benchmark datasets for dynamic (knowledge) graphs [55], such as social network graphs commonly used for link prediction tasks.”

    From Toward Context-Aware Anomaly Detection for AIOps in Microservices Using Dynamic Knowledge Graphs (2026) · cites this paper as [55]

    Section 7.2 (p. 45) surveys datasets used in dynamic (knowledge) graph research and says Table 2 summarizes their node and edge counts and temporal granularity. Section 7.2.1 (p. 47) gives examples including a temporal subreddit network. The survey provides benchmarks for comparison, but it does not assess the citing authors’ collected dataset or establish that its size and complexity are comparable. (LLM, conf=0.84)

    Experimental — accuracy not yet measured

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Cites

Flagged first, then by citations

Research works printed but not linked: 257

  1. Charu Aggarwal and Karthik Subbian. Evolutionary network analysis: A survey. ACM Computing Surveys (CSUR) , 47(1):10, 2014.
  2. Hirotugu Akaike. Fitting autoregressive models for prediction. Annals of the institute of Statistical Mathematics , 21(1):243-247, 1969.
  3. Mohammad Al Hasan and Mohammed J Zaki. A survey of link prediction in social networks. In Social network Data Analytics , pages 243-275. Springer, 2011.
  4. L´ aszl´ o Babai and Ludik Kucera. Canonical labelling of graphs in linear average time. In 20th Annual Symposium on Foundations of Computer Science (sfcs 1979) , pages 39-46. IEEE, 1979.
  5. Dzmitry Bahdanau, Kyunghyun Cho, and Yoshua Bengio. Neural machine translation by jointly learning to align and translate. arXiv preprint arXiv:1409.0473 , 2014. · arXiv
  6. Song Bai, Feihu Zhang, and Philip HS Torr. Hypergraph convolution and hypergraph attention. arXiv preprint arXiv:1901.08150 , 2019. · arXiv
  7. Ivana Balazevic, Carl Allen, and Timothy M Hospedales. Hypernetwork knowledge graph embeddings. arXiv preprint arXiv:1808.07018 , 2018. · arXiv
  8. Ivana Balaˇ zevi´ c, Carl Allen, and Timothy M Hospedales. Tucker: Tensor factorization for knowledge graph completion. In ICML Workshop on Adaptive & Multitask Learning: Algorithms & Systems , 2019.
  9. Robert Bamler and Stephan Mandt. Dynamic word embeddings. In ICML , pages 380-389, 2017.
  10. Nikolaos Bastas, Theodoros Semertzidis, Apostolos Axenopoulos, and Petros Daras. evolve2vec: Learning network representations using temporal unfolding. In International Conference on Multimedia Modeling , pages 447-458. Springer, 2019.
  11. Mikhail Belkin and Partha Niyogi. Laplacian eigenmaps and spectral techniques for embedding and clustering. In Advances in Neural Information Processing Systems (NeurIPS) , pages 585-591, 2001.
  12. Alex Beutel, Paul Covington, Sagar Jain, Can Xu, Jia Li, Vince Gatto, and Ed H Chi. Latent cross: Making use of context in recurrent recommender systems. In Eleventh ACM International Conference on Web Search and Data Mining , pages 46-54. ACM, 2018.
  13. Ranran Bian, Yun Sing Koh, Gillian Dobbie, and Anna Divoli. Network embedding and change modeling in dynamic heterogeneous networks. In Proceedings of the 42nd International ACM SIGIR Conference on Research and Development in Information Retrieval , pages 861-864. ACM, 2019.
  14. Cemal Cagatay Bilgin and B¨ ulent Yener. Dynamic network evolution: Models, clustering, anomaly detection. IEEE Networks , 2006.
  15. Stephen Bonner, John Brennan, Ibad Kureshi, Georgios Theodoropoulos, Andrew Stephen McGough, and Boguslaw Obara. Temporal graph offset reconstruction: Towards temporally robust graph representation learning. In 2018 IEEE International Conference on Big Data (Big Data) , pages 3737-3746. IEEE, 2018.
  16. Antoine Bordes, Nicolas Usunier, Alberto Garcia-Duran, Jason Weston, and Oksana Yakhnenko. Translating embeddings for modeling multi-relational data. In Advances in Neural Information Processing Systems (NeurIPS) , pages 2787-2795, 2013.
  17. George EP Box, Gwilym M Jenkins, Gregory C Reinsel, and Greta M Ljung. Time series analysis: forecasting and control . John Wiley & Sons, 2015.
  18. Matthew Brand. Fast low-rank modifications of the thin singular value decomposition. Linear Algebra and its Applications , 415(1):20-30, 2006.
  19. William Brendel and Sinisa Todorovic. Learning spatiotemporal graphs of human activities. In Thirteenth International Conference on Computer Vision (ICCV) , pages 778-785. IEEE, 2011.
  20. Hung Hai Bui, Tuyen N Huynh, and Sebastian Riedel. Automorphism groups of graphical models and lifted variational inference. In Proceedings of the Twenty-Ninth Conference on Uncertainty in Artificial Intelligence (UAI) , 2013.
  21. Hongyun Cai, Vincent W Zheng, and Kevin Chen-Chuan Chang. A comprehensive survey of graph embedding: Problems, techniques, and applications. IEEE Transactions on Knowledge and Data Engineering , 30(9):1616-1637, 2018.
  22. Jin-Yi Cai, Martin F¨ urer, and Neil Immerman. An optimal lower bound on the number of variables for graph identification. Combinatorica , 12(4):389-410, 1992.
  23. Shaosheng Cao, Wei Lu, and Qiongkai Xu. Deep neural networks for learning graph representations. In Thirtieth AAAI Conference on Artificial Intelligence , 2016.
  24. Andrew Carlson, Justin Betteridge, Bryan Kisiel, Burr Settles, Estevam R Hruschka, and Tom M Mitchell. Toward an architecture for never-ending language learning. In TwentyFourth AAAI Conference on Artificial Intelligence , 2010.
  25. Augustin Chaintreau, Pan Hui, Jon Crowcroft, Christophe Diot, Richard Gass, and James Scott. Impact of human mobility on opportunistic forwarding algorithms. IEEE Transactions on Mobile Computing , pages 606-620, 2007.
  26. Deepayan Chakrabarti, Ravi Kumar, and Andrew Tomkins. Evolutionary clustering. In Twelfth ACM SIGKDD International Conference on Knowledge Discovery and Data Mining , pages 554-560. ACM, 2006.
  27. Benjamin Paul Chamberlain, James Clough, and Marc Peter Deisenroth. Neural embeddings of graphs in hyperbolic space. arXiv preprint arXiv:1705.10359 , 2017. · arXiv
  28. Chris Chatfield and Mohammad Yar. Holt-winters forecasting: Some practical issues. Journal of the Royal Statistical Society. Series D (The Statistician) , 37(2), 1988.
  29. Melisachew Wudage Chekol and Heiner Stuckenschmidt. Rule based temporal inference. In Technical Communications of the 33rd International Conference on Logic Programming (ICLP 2017) . Schloss Dagstuhl-Leibniz-Zentrum fuer Informatik, 2018.
  30. Melisachew Wudage Chekol, Giuseppe Pirr` o, Joerg Schoenfisch, and Heiner Stuckenschmidt. Marrying uncertainty and time in knowledge graphs. In Thirty-First AAAI Conference on Artificial Intelligence , 2017.
  31. Chen Chen and Hanghang Tong. Fast eigen-functions tracking on dynamic graphs. Society for Industrial and Applied Mathematics Publications , pages 559-567, 2015.
  32. Jinyin Chen, Xuanheng Xu, Yangyang Wu, and Haibin Zheng. GC-LSTM: Graph convolution embedded LSTM for dynamic link prediction. arXiv preprint arXiv:1812.04206 , 2018a. · arXiv
  33. Jinyin Chen, Jian Zhang, Xuanheng Xu, Chengbo Fu, Dan Zhang, Qingpeng Zhang, and Qi Xuan. E-LSTM-D: A deep learning framework for dynamic network link prediction. arXiv preprint arXiv:1902.08329 , 2019a. · arXiv
  34. Tian Qi Chen, Yulia Rubanova, Jesse Bettencourt, and David K Duvenaud. Neural ordinary differential equations. In Advances in Neural Information Processing Systems (NeurIPS) , pages 6572-6583, 2018b.
  35. Tianqi Chen, Ian Goodfellow, and Jonathon Shlens. Net2net: Accelerating learning via knowledge transfer. arXiv preprint arXiv:1511.05641 , 2015a. · arXiv
  36. Tianqi Chen, Mu Li, Yutian Li, Min Lin, Naiyan Wang, Minjie Wang, Tianjun Xiao, Bing Xu, Chiyuan Zhang, and Zheng Zhang. Mxnet: A flexible and efficient machine learning library for heterogeneous distributed systems. arXiv preprint arXiv:1512.01274 , 2015b. · arXiv
  37. Ting Chen and Yizhou Sun. Task-guided and path-augmented heterogeneous network embedding for author identification. In Proceedings of the Tenth ACM International Conference on Web Search and Data Mining , pages 295-304. ACM, 2017.
  38. Zhengdao Chen, Lisha Li, and Joan Bruna. Supervised community detection with line graph neural networks. In International Conference on Learning Representations (ICLR) , 2019b.
  39. Zhengdao Chen, Soledad Villar, Lei Chen, and Joan Bruna. On the equivalence between graph isomorphism testing and function approximation with GNNs. In Advances in Neural Information Processing Systems (NeurIPS) , 2019c.
  40. Yun Chi, Xiaodan Song, Dengyong Zhou, Koji Hino, and Belle L Tseng. On evolutionary spectral clustering. ACM Transactions on Knowledge Discovery from Data (TKDD) , 3 (4):17, 2009.
  41. Kyunghyun Cho, Bart Van Merri¨ enboer, Caglar Gulcehre, Dzmitry Bahdanau, Fethi Bougares, Holger Schwenk, and Yoshua Bengio. Learning phrase representations using RNN encoder-decoder for statistical machine translation. arXiv preprint arXiv:1406.1078 , 2014. · arXiv
  42. Edward Choi, Mohammad Taha Bahadori, Andy Schuetz, Walter F Stewart, and Jimeng Sun. Doctor AI: Predicting clinical events via recurrent neural networks. In Machine Learning for Healthcare Conference , pages 301-318, 2016.
  43. James S Coleman and James Samuel Coleman. Foundations of social theory . Harvard University Press, 1994.
  44. David R Cox and Peter Adrian Walter Lewis. Multivariate point processes. In Sixth Berkeley Symposium on Mathematical Statistics and Probability , volume 3, pages 401-448, 1972.
  45. Joseph Crawford and Tijana Milenkovi´ c. Cluenet: Clustering a temporal network based on topological similarity rather than denseness. PloS one , 13(5):e0195993, 2018.
  46. Peng Cui, Xiao Wang, Jian Pei, and Wenwu Zhu. A survey on network embedding. IEEE Transactions on Knowledge and Data Engineering , 2018.
  47. Paulo Ricardo da Silva Soares and Ricardo Bastos Cavalcante Prudˆ encio. Time series based link prediction. In International Joint Conference on Neural Networks (IJCNN) , pages 1-7. IEEE, 2012.
  48. Hanjun Dai, Yichen Wang, Rakshit Trivedi, and Le Song. Deep coevolutionary network: Embedding user and item features for recommendation. arXiv preprint arXiv:1609.03675 , 2016. · arXiv
  49. Hanjun Dai, Zornitsa Kozareva, Bo Dai, Alex Smola, and Le Song. Learning steady-states of iterative algorithms over graphs. In International Conference on Machine Learning (ICML) , pages 1114-1122, 2018.
  50. Rajarshi Das, Shehzaad Dhuliawala, Manzil Zaheer, Luke Vilnis, Ishan Durugkar, Akshay Krishnamurthy, Alex Smola, and Andrew McCallum. Go for a walk and arrive at the answer: Reasoning over paths in knowledge bases using reinforcement learning. In International Conference on Learning Representations (ICLR) , 2018a.
  51. Rajarshi Das, Tsendsuren Munkhdalai, Xingdi Yuan, Adam Trischler, and Andrew McCallum. Building dynamic knowledge graphs from text using machine reading comprehension. arXiv preprint arXiv:1810.05682 , 2018b. · arXiv
  52. Shib Sankar Dasgupta, Swayambhu Nath Ray, and Partha Talukdar. Hyte: Hyperplanebased temporally aware knowledge graph embedding. In Empirical Methods in Natural Language Processing (EMNLP) , pages 2001-2011, 2018.
  53. Chandler Davis and W. M. Kahan. The rotation of eigenvectors by a perturbation. iii. SIAM Journal of Numerical Analysis , 7:1-46, 1970.
  54. Luc De Raedt, Angelika Kimmig, and Hannu Toivonen. Problog: A probabilistic prolog and its application in link discovery. In Twentieth International Joint Conference on Artificial Intelligence (IJCAI) , volume 7, pages 2462-2467. Hyderabad, 2007.
  55. Sam De Winter, Tim Decuypere, Sandra Mitrovi´ c, Bart Baesens, and Jochen De Weerdt. Combining temporal aspects of dynamic networks with node2vec for a more efficient dynamic link prediction. In 2018 IEEE/ACM International Conference on Advances in Social Networks Analysis and Mining (ASONAM) , pages 1234-1241. IEEE, 2018.
  56. Micha¨ el Defferrard, Xavier Bresson, and Pierre Vandergheynst. Convolutional neural networks on graphs with fast localized spectral filtering. In Advances in Neural Information Processing Systems (NeurIPS) , pages 3844-3852, 2016.
  57. Mostafa Dehghani, Stephan Gouws, Oriol Vinyals, Jakob Uszkoreit, and glyph[suppress] Lukasz Kaiser. Universal transformers. arXiv preprint arXiv:1807.03819 , 2018. · arXiv
  58. Tim Dettmers, Pasquale Minervini, Pontus Stenetorp, and Sebastian Riedel. Convolutional 2d knowledge graph embeddings. In Thirty-Second AAAI Conference on Artificial Intelligence , 2018.
  59. Paul D Dobson and Andrew J Doig. Distinguishing enzyme structures from non-enzymes without alignments. Journal of Molecular Biology , 330(4):771-783, 2003.
  60. Xin Dong, Evgeniy Gabrilovich, Geremy Heitz, Wilko Horn, Ni Lao, Kevin Murphy, Thomas Strohmann, Shaohua Sun, and Wei Zhang. Knowledge vault: A web-scale approach to probabilistic knowledge fusion. In Twentieth ACM SIGKDD International Conference on Knowledge Discovery and Data Mining , pages 601-610. ACM, 2014.
  61. Yuxiao Dong, Nitesh V Chawla, and Ananthram Swami. metapath2vec: Scalable representation learning for heterogeneous networks. In Proceedings of the 23rd ACM SIGKDD international conference on knowledge discovery and data mining , pages 135-144. ACM, 2017.
  62. Lun Du, Yun Wang, Guojie Song, Zhicong Lu, and Junshan Wang. Dynamic network embedding: An extended approach for skip-gram based network embedding. In TwentySeventh International Joint Conference on Artificial Intelligence (IJCAI) , pages 2086-2092, 2018.
  63. Nan Du, Hanjun Dai, Rakshit Trivedi, Utkarsh Upadhyay, Manuel Gomez-Rodriguez, and Le Song. Recurrent marked temporal point processes: Embedding event history to vector. In Twenty-Second ACM SIGKDD International Conference on Knowledge Discovery and Data Mining , pages 1555-1564. ACM, 2016.
  64. Daniel M Dunlavy, Tamara G Kolda, and Evrim Acar. Temporal link prediction using matrix and tensor factorizations. ACM Transactions on Knowledge Discovery from Data (TKDD) , 5(2):10, 2011.
  65. David K Duvenaud, Dougal Maclaurin, Jorge Iparraguirre, Rafael Bombarell, Timothy Hirzel, Al´ an Aspuru-Guzik, and Ryan P Adams. Convolutional networks on graphs for learning molecular fingerprints. In Advances in Neural Information Processing Systems (NeurIPS) , pages 2224-2232, 2015.
  66. Maximilian Dylla, Iris Miliaraki, and Martin Theobald. A temporal-probabilistic database model for information extraction. Very Large Data Bases (VLDB) , 6(14):1810-1821, 2013.
  67. Carl Eckart and Gale Young. The approximation of one matrix by another of lower rank. Psychometrika , 1(211), 1936.
  68. Jeffrey L Elman. Finding structure in time. Cognitive Science , 14(2):179-211, 1990.
  69. Robert F Engle and Jeffrey R Russell. Autoregressive conditional duration: a new model for irregularly spaced transaction data. Econometrica , pages 1127-1162, 1998.
  70. Crist´ obal Esteban, Volker Tresp, Yinchong Yang, Stephan Baier, and Denis Krompaß. Predicting the co-evolution of event and knowledge graphs. In 2016 19th International Conference on Information Fusion (FUSION) , pages 98-105. IEEE, 2016.
  71. Bahare Fatemi, Siamak Ravanbakhsh, and David Poole. Improved knowledge graph embedding using background taxonomic information. In Proceedings of the AAAI Conference on Artificial Intelligence , volume 33, pages 3526-3533, 2019a.
  72. Bahare Fatemi, Perouz Taslakian, David Vazquez, and David Poole. Knowledge hypergraphs: Prediction beyond binary relations. arXiv preprint arXiv:1906.00137 , 2019b. · arXiv
  73. Yifan Feng, Haoxuan You, Zizhao Zhang, Rongrong Ji, and Yue Gao. Hypergraph neural networks. arXiv preprint arXiv:1809.09401 , 2018b. · arXiv
  74. Matthias Fey and Jan E. Lenssen. Fast graph representation learning with PyTorch Geometric. CoRR , abs/1903.02428, 2019. · arXiv
  75. Dov M Gabbay, Christopher John Hogger, and John Alan Robinson. Handbook of Logic in Artificial Intelligence and Logic Programming: Volume 5: Logic Programming . Clarendon Press, 1998.
  76. Alberto Garc´ ıa-Dur´ an, Sebastijan Dumanˇ ci´ c, and Mathias Niepert. Learning sequence encoders for temporal knowledge graph completion. arXiv preprint arXiv:1809.03202 , 2018. · arXiv
  77. Johannes Gehrke, Paul Ginsparg, and Jon Kleinberg. Overview of the 2003 kdd cup. ACM SIGKDD Explorations Newsletter , 5(2):149-151, 2003.
  78. Pallabi Ghosh, Yi Yao, Larry S Davis, and Ajay Divakaran. Stacked spatio-temporal graph convolutional networks for action segmentation. arXiv preprint arXiv:1811.10575 , 2018. · arXiv
  79. Justin Gilmer, Samuel S Schoenholz, Patrick F Riley, Oriol Vinyals, and George E Dahl. Neural message passing for quantum chemistry. In International Conference on Machine Learning (ICML) , pages 1263-1272. JMLR. org, 2017.
  80. Rishab Goel, Seyed Mehran Kazemi, Marcus Brubaker, and Pascal Poupart. Diachronic embedding for temporal knowledge graph completion. In Thirty-Fourth AAAI Conference on Artificial Intelligence , 2020.
  81. Palash Goyal, Nitin Kamra, Xinran He, and Yan Liu. Dyngem: Deep embedding method for dynamic graphs. In IJCAI International Workshop on Representation Learning for Graphs , 2017.
  82. Palash Goyal, Sujit Rokka Chhetri, and Arquimedes Canedo. dyngraph2vec: Capturing network dynamics using dynamic graph representation learning. arXiv preprint arXiv:1809.02657 , 2018. · arXiv
  83. Ekta Gujral, Ravdeep Pasricha, and Evangelos E Papalexakis. SamBaTen: Sampling-based batch incremental tensor decomposition. In SIAM International Conference on Data Mining , pages 387-395. SIAM, 2018.
  84. ˙ Ismail G¨ une¸ s, S ¸ule G¨ und¨ uz- ¨ O˘ g¨ ud¨ uc¨ u, and Zehra C ¸ataltepe. Link prediction using time series of neighborhood-based node similarity scores. Data Mining and Knowledge Discovery , 30 (1):147-180, 2016.
  85. Manish Gupta, Charu C Aggarwal, Jiawei Han, and Yizhou Sun. Evolutionary clustering and analysis of bibliographic networks. In 2011 International Conference on Advances in Social Networks Analysis and Mining , pages 63-70. IEEE, 2011.
  86. Will Hamilton, Zhitao Ying, and Jure Leskovec. Inductive representation learning on large graphs. In Advances in Neural Information Processing Systems (NeurIPS) , pages 1024-1034, 2017a.
  87. Will Hamilton, Payal Bajaj, Marinka Zitnik, Dan Jurafsky, and Jure Leskovec. Embedding logical queries on knowledge graphs. In Advances in Neural Information Processing Systems (NeurIPS) , pages 2026-2037, 2018.
  88. William L Hamilton, Jure Leskovec, and Dan Jurafsky. Diachronic word embeddings reveal statistical laws of semantic change. In Association for Computational Linguistics (ACL) , 2016.
  89. William L Hamilton, Rex Ying, and Jure Leskovec. Representation learning on graphs: Methods and applications. IEEE Data Engineering Bulletin , 40(3):52-74, 2017b.
  90. F Maxwell Harper and Joseph A Konstan. The movielens datasets: History and context. ACM Transactions on Interactive Intelligent Systems (TIIS) , 5(4):19, 2016.
  91. Alan G Hawkes. Spectra of some self-exciting and mutually exciting point processes. Biometrika , 58(1):83-90, 1971.
  92. Katsuhiko Hayashi and Masashi Shimbo. On the equivalence of holographic and complex embeddings for link prediction. arXiv preprint arXiv:1702.05563 , 2017. · arXiv
  93. Karl Moritz Hermann, Tomas Kocisky, Edward Grefenstette, Lasse Espeholt, Will Kay, Mustafa Suleyman, and Phil Blunsom. Teaching machines to read and comprehend. In Advances in Neural Information Processing Systems (NeurIPS) , pages 1693-1701, 2015.
  94. Herbert W Hethcote. The mathematics of infectious diseases. SIAM review , 42(4):599-653, 2000.
  95. Geoffrey E Hinton and Ruslan R Salakhutdinov. Reducing the dimensionality of data with neural networks. Science , 313(5786):504-507, 2006.
  96. Ryohei Hisano. Semi-supervised graph embedding approach to dynamic link prediction. In International Workshop on Complex Networks , pages 109-121. Springer, 2018.
  97. Frank L Hitchcock. The expression of a tensor or a polyadic as a sum of products. Journal of Mathematics and Physics , 6(1-4):164-189, 1927.
  98. Sepp Hochreiter and J¨ urgen Schmidhuber. Long short-term memory. Neural Computation , 9(8):1735-1780, 1997.
  99. Hao Hu and Guo-Jun Qi. State-frequency memory recurrent neural networks. In International Conference on Machine Learning (ICML) , pages 1568-1577, 2017.
  100. Hong Huang, Jie Tang, Lu Liu, JarDer Luo, and Xiaoming Fu. Triadic closure pattern analysis and prediction in social networks. IEEE Transactions on Knowledge and Data Engineering , 27(12):3374-3389, 2015a.
  101. Zan Huang and Dennis KJ Lin. The time-series link prediction problem with applications in communication surveillance. INFORMS Journal on Computing , 21(2):286-303, 2009.
  102. Zhiheng Huang, Wei Xu, and Kai Yu. Bidirectional LSTM-CRF models for sequence tagging. arXiv preprint arXiv:1508.01991 , 2015b. · arXiv
  103. Jakob Huber, Christian Meilicke, and Heiner Stuckenschmidt. Applying markov logic for debugging probabilistic temporal knowledge bases. In Fourth Workshop on Automated Knowledge Base Construction (AKBC) , 2014.
  104. Nahla Mohamed Ahmed Ibrahim and Ling Chen. Link prediction in dynamic social networks by integrating different types of information. Applied Intelligence , 42(4):738-750, 2015.
  105. Lorenzo Isella, Juliette Stehl´ e, Alain Barrat, Ciro Cattuto, Jean-Fran¸ cois Pinton, and Wouter Van den Broeck. What's in a crowd? analysis of face-to-face behavioral networks. Journal of Theoretical Biology , 271(1):166-180, 2011.
  106. Valerie Isham and Mark Westcott. A self-correcting point process. Stochastic Processes and Their Applications , 8(3):335-347, 1979.
  107. Ashesh Jain, Amir R Zamir, Silvio Savarese, and Ashutosh Saxena. Structural-RNN: Deep learning on spatio-temporal graphs. In IEEE Conference on Computer Vision and Pattern Recognition , pages 5308-5317, 2016.
  108. Zhen Jia, Abdalghani Abujabal, Rishiraj Saha Roy, Jannik Str¨ otgen, and Gerhard Weikum. Tequila: Temporal question answering over knowledge bases. In Twenty-Seventh ACM International Conference on Information and Knowledge Management , pages 1807-1810. ACM, 2018.
  109. Tingsong Jiang, Tianyu Liu, Tao Ge, Lei Sha, Baobao Chang, Sujian Li, and Zhifang Sui. Towards time-aware knowledge graph completion. In Twenty-Sixth International Conference on Computational Linguistics: Technical Papers , pages 1715-1724, 2016.
  110. Woojeong Jin, Changlin Zhang, Pedro Szekely, and Xiang Ren. Recurrent event network for reasoning over temporal knowledge graphs. arXiv preprint arXiv:1904.05530 , 2019. · arXiv
  111. Marius Kaminskas and Derek Bridge. Diversity, serendipity, novelty, and coverage: A survey and empirical analysis of beyond-accuracy objectives in recommender systems. ACM Transactions on Interactive Intelligent Systems (TiiS) , 7(1):2, 2017.
  112. Seyed Mehran Kazemi. Representing and learning relations and properties under uncertainty . PhD thesis, University of British Columbia, 2018.
  113. Seyed Mehran Kazemi and David Poole. RelNN: A deep neural model for relational learning. In Thirty-Second AAAI Conference on Artificial Intelligence , 2018b.
  114. Seyed Mehran Kazemi and David Poole. SimplE embedding for link prediction in knowledge graphs. In Advances in Neural Information Processing Systems (NeurIPS) , pages 42894300, 2018c.
  115. Seyed Mehran Kazemi, David Buchman, Kristian Kersting, Sriraam Natarajan, and David Poole. Relational logistic regression. In Fourteenth International Conference on the Principles of Knowledge Representation and Reasoning , 2014.
  116. Seyed Mehran Kazemi, Angelika Kimmig, Guy Van den Broeck, and David Poole. New liftable classes for first-order probabilistic inference. In Advances in Neural Information Processing Systems , pages 3117-3125, 2016.
  117. Seyed Mehran Kazemi, Rishab Goel, Sepehr Eghbali, Janahan Ramanan, Jaspreet Sahota, Sanjay Thakur, Stella Wu, Cathal Smyth, Pascal Poupart, and Marcus Brubaker. Time2vec: Learning a vector representation of time. arXiv preprint arXiv:1907.05321 , 2019. · arXiv
  118. Nicolas Keriven and Gabriel Peyr´ e. Universal invariant and equivariant graph neural networks. In Advances in Neural Information Processing Systems (NeurIPS) , 2019.
  119. Kristian Kersting, Babak Ahmadi, and Sriraam Natarajan. Counting belief propagation. In Proceedings of the Twenty-Fifth Conference on Uncertainty in Artificial Intelligence (UAI) , pages 277-284. AUAI Press, 2009.
  120. Min-Soo Kim and Jiawei Han. A particle-and-density based evolutionary clustering method for dynamic networks. Very Large Data Bases (VLDB) , 2(1):622-633, 2009.
  121. Angelika Kimmig, Stephen H Bach, Matthias Broecheler, Bert Huang, and Lise Getoor. A short introduction to probabilistic soft logic. In NeurIPS Workshop on Probabilistic Programming: Foundations and Applications , volume 1, page 3, 2012.
  122. Thomas N. Kipf and Max Welling. Semi-supervised classification with graph convolutional networks. In International Conference on Learning Representations (ICLR) , 2017.
  123. Daphne Koller, Nir Friedman, Saˇ so Dˇ zeroski, Charles Sutton, Andrew McCallum, Avi Pfeffer, Pieter Abbeel, Ming-Fai Wong, David Heckerman, Chris Meek, et al. Introduction to statistical relational learning . MIT press, 2007.
  124. Jacob Krantz and Jugal Kalita. Abstractive summarization using attentive neural techniques. arXiv preprint arXiv:1810.08838 , 2018. · arXiv
  125. Srijan Kumar, William L Hamilton, Jure Leskovec, and Dan Jurafsky. Community interaction and conflict on the web. In World Wide Web Conference on World Wide Web , pages 933-943. International World Wide Web Conferences Steering Committee, 2018a.
  126. Srijan Kumar, Xikun Zhang, and Jure Leskovec. Learning dynamic embedding from temporal interaction networks. arXiv preprint arXiv:1812.02289 , 2018b. · arXiv
  127. J´ erˆ ome Kunegis. Konect: The koblenz network collection. In Twenty-Second International Conference on World Wide Web , WWW '13 Companion, pages 1343-1350, New York, NY, USA, 2013. ACM. ISBN 978-1-4503-2038-2. doi: 10.1145/2487788.2488173. URL http://doi.acm.org/10.1145/2487788.2488173 . · DOI
  128. Timoth´ ee Lacroix, Nicolas Usunier, and Guillaume Obozinski. Canonical tensor decomposition for knowledge base completion. In International Conference on Machine Learning (ICML) , 2018.
  129. Ni Lao and William W Cohen. Relational retrieval using a combination of path-constrained random walks. Machine Learning , 81(1):53-67, 2010.
  130. Ni Lao, Tom Mitchell, and William W Cohen. Random walk inference and learning in a large scale knowledge base. In Empirical Methods in Natural Language Processing (EMNLP) , pages 529-539. Association for Computational Linguistics, 2011.
  131. Julien Leblay and Melisachew Wudage Chekol. Deriving validity time in knowledge graph. In Companion of the The Web Conference 2018 on The Web Conference 2018 , pages 1771-1776. International World Wide Web Conferences Steering Committee, 2018.
  132. Kalev Leetaru and Philip A Schrodt. Gdelt: Global data on events, location, and tone, 1979-2012. In ISA Annual Convention , volume 2, pages 1-49. Citeseer, 2013.
  133. Adam Lerer, Ledell Wu, Jiajun Shen, Timothee Lacroix, Luca Wehrstedt, Abhijit Bose, and Alex Peysakhovich. Pytorch-biggraph: Alarge-scale graph embedding system. arXiv preprint arXiv:1903.12287 , 2019. · arXiv
  134. Pierre-David Letourneau, Muthu Baskaran, Tom Henretty, James Ezick, and Richard Lethin. Computationally efficient cp tensor decomposition update framework for emerging component discovery in streaming data. In 2018 IEEE High Performance extreme Computing Conference (HPEC) , pages 1-8, 09 2018. doi: 10.1109/HPEC.2018.8547700. · DOI
  135. Ron Levie, Federico Monti, Xavier Bresson, and Michael M Bronstein. Cayleynets: Graph convolutional neural networks with complex rational spectral filters. IEEE Transactions on Signal Processing , 67(1):97-109, 2017.
  136. Keith Levin, Farbod Roosta-Khorasani, Michael W Mahoney, and Carey E Priebe. Out-ofsample extension of graph adjacency spectral embedding. arXiv preprint arXiv:1802.06307 , 2018. · arXiv
  137. Chaolong Li, Zhen Cui, Wenming Zheng, Chunyan Xu, and Jian Yang. Spatio-temporal graph convolution for skeleton based action recognition. In Thirty-Second AAAI Conference on Artificial Intelligence , 2018.
  138. Jundong Li, Harsh Dani, Xia Hu, Jiliang Tang, Yi Chang, and Huan Liu. Attributed network embedding for learning in a dynamic environment. In Conference on Information and Knowledge Management (CIKM) , pages 387-396. ACM, 2017a.
  139. Yaguang Li, Rose Yu, Cyrus Shahabi, and Yan Liu. Diffusion convolutional recurrent neural network: Data-driven traffic forecasting. arXiv preprint arXiv:1707.01926 , 2017b. · arXiv
  140. Yang Li, Nan Du, and Samy Bengio. Time-dependent representation for neural event sequence prediction. arXiv preprint arXiv:1708.00065 , 2017c. · arXiv
  141. Yujia Li, Daniel Tarlow, Marc Brockschmidt, and Richard Zemel. Gated graph sequence neural networks. arXiv preprint arXiv:1511.05493 , 2015. · arXiv
  142. Renjie Liao, Zhizhen Zhao, Raquel Urtasun, and Richard S Zemel. Lanczosnet: Multi-scale deep graph convolutional networks. arXiv preprint arXiv:1901.01484 , 2019. · arXiv
  143. David Liben-Nowell and Jon Kleinberg. The link-prediction problem for social networks. Journal of the American Society for Information Science and Technology , 58(7):1019-1031, 2007.
  144. Yankai Lin, Zhiyuan Liu, Maosong Sun, Yang Liu, and Xuan Zhu. Learning entity and relation embeddings for knowledge graph completion. In Twenty-ninth AAAI conference on artificial intelligence , 2015.
  145. Hanxiao Liu, Yuexin Wu, and Yiming Yang. Analogical inference for multi-relational embeddings. In International Conference on Machine Learning (ICML) , pages 2168-2178. JMLR. org, 2017.
  146. Xi Liu, Ping-Chun Hsieh, Nick Duffield, Rui Chen, Muhe Xie, and Xidao Wen. Real-time streaming graph embedding through local actions. In Companion Proceedings of the 2019 World Wide Web Conference (WWW '19 Companion) , 2019.
  147. Jianxin Ma, Peng Cui, and Wenwu Zhu. Depthlgp: learning embeddings of out-of-sample nodes in dynamic networks. In Thirty-Second AAAI Conference on Artificial Intelligence , 2018a.
  148. Yao Ma, Ziyi Guo, Zhaochun Ren, Eric Zhao, Jiliang Tang, and Dawei Yin. Streaming graph neural networks. arXiv preprint arXiv:1810.10627 , 2018b. · arXiv
  149. Yunpu Ma, Volker Tresp, and Erik A Daxberger. Embedding models for episodic knowledge graphs. Journal of Web Semantics , 2018c.
  150. Anmol Madan, Manuel Cebrian, Sai Moturu, Katayoun Farrahi, et al. Sensing the' health state' of a community. IEEE Pervasive Computing , 11(4):36-45, 2012.
  151. Sedigheh Mahdavi, Shima Khoshraftar, and Aijun An. dynnode2vec: Scalable dynamic network embedding. In 2018 IEEE International Conference on Big Data (Big Data) , pages 3762-3765. IEEE, 2018.
  152. Franco Manessi, Alessandro Rozza, and Mario Manzo. Dynamic graph convolutional networks. arXiv preprint arXiv:1704.06199 , 2017. · arXiv
  153. Harry Markowitz. Portfolio selection. The journal of finance , 7(1):77-91, 1952.
  154. Haggai Maron, Ethan Fetaya, Nimrod Segol, and Yaron Lipman. On the universality of invariant networks. In ICML , 2019.
  155. Hongyuan Mei and Jason M Eisner. The neural hawkes process: A neurally self-modulating multivariate point process. In Advances in Neural Information Processing Systems (NeurIPS) , pages 6754-6764, 2017.
  156. Gr´ egoire Mesnil, Yann Dauphin, Kaisheng Yao, Yoshua Bengio, Li Deng, Dilek Hakkani-Tur, Xiaodong He, Larry Heck, Gokhan Tur, Dong Yu, et al. Using recurrent neural networks for slot filling in spoken language understanding. IEEE/ACM Transactions on Audio, Speech, and Language Processing , 23(3):530-539, 2015.
  157. Tomas Mikolov, Ilya Sutskever, Kai Chen, Greg S Corrado, and Jeff Dean. Distributed representations of words and phrases and their compositionality. In Advances in Neural Information Processing Systems (NeurIPS) , pages 3111-3119, 2013.
  158. Amin Milani Fard, Ebrahim Bagheri, and Ke Wang. Relationship prediction in dynamic heterogeneous information networks. In European Conference on Information Retrieval , pages 19-34. Springer, 2019.
  159. Sudatta Mohanty and Alexey Pozdnukhov. Graph CNN+LSTM framework for dynamic macroscopic traffic congestion prediction. In International Workshop on Mining and Learning with Graphs , 2018.
  160. Christopher Morris, Martin Ritzert, Matthias Fey, William L Hamilton, Jan Eric Lenssen, Gaurav Rattan, and Martin Grohe. Weisfeiler and leman go neural: Higher-order graph neural networks. In Thirty-Third AAAI Conference on Artificial Intelligence , 2019.
  161. Apurva Narayan and Peter HO'N Roe. Learning graph dynamics using deep neural networks. IFAC-PapersOnLine , 51(2):433-438, 2018.
  162. Deepak Nathani, Jatin Chauhan, Charu Sharma, and Manohar Kaul. Learning attentionbased embeddings for relation prediction in knowledge graphs. arXiv preprint arXiv:1906.01195 , 2019. · arXiv
  163. Daniel Neil, Michael Pfeiffer, and Shih-Chii Liu. Phased LSTM: Accelerating recurrent network training for long or event-based sequences. In Advances in Neural Information Processing Systems (NeurIPS) , pages 3882-3890, 2016.
  164. Giang H Nguyen, John Boaz Lee, Ryan A Rossi, Nesreen K Ahmed, Eunyee Koh, and Sungchul Kim. Dynamic network embeddings: From random walks to temporal random walks. In 2018 IEEE International Conference on Big Data (Big Data) , pages 1085-1092. IEEE, 2018a.
  165. Giang Hoang Nguyen, John Boaz Lee, Ryan A Rossi, Nesreen K Ahmed, Eunyee Koh, and Sungchul Kim. Continuous-time dynamic network embeddings. In Companion of the The Web Conference 2018 on The Web Conference 2018 , pages 969-976. International World Wide Web Conferences Steering Committee, 2018b.
  166. Maximilian Nickel, Volker Tresp, and Hans-Peter Kriegel. A three-way model for collective learning on multi-relational data. In International Conference on Machine Learning (ICML) , volume 11, pages 809-816, 2011.
  167. Maximilian Nickel, Kevin Murphy, Volker Tresp, and Evgeniy Gabrilovich. A review of relational machine learning for knowledge graphs. IEEE , 104(1):11-33, 2016a.
  168. Maximilian Nickel, Lorenzo Rosasco, and Tomaso Poggio. Holographic embeddings of knowledge graphs. In Thirtieth AAAI conference on artificial intelligence , 2016b.
  169. Mathias Niepert, Mohamed Ahmed, and Konstantin Kutzkov. Learning convolutional neural networks for graphs. In International Conference on Machine Learning (ICML) , pages 2014-2023, 2016.
  170. Mingdong Ou, Peng Cui, Jian Pei, Ziwei Zhang, and Wenwu Zhu. Asymmetric transitivity preserving graph embedding. In Twenty-Second ACM SIGKDD Conderence on Knowledge Discovery and Data Mining , 2016.
  171. Supriya Pandhre, Himangi Mittal, Manish Gupta, and Vineeth N Balasubramanian. Stwalk: learning trajectory representations in temporal graphs. In ACM India Joint International Conference on Data Science and Management of Data , pages 210-219. ACM, 2018.
  172. Tivadar Papai, Henry Kautz, and Daniel Stefankovic. Slice normalized dynamic markov logic networks. In Advances in Neural Information Processing Systems (NeurIPS) , pages 1907-1915, 2012.
  173. Aldo Pareja, Giacomo Domeniconi, Jie Chen, Tengfei Ma, Toyotaro Suzumura, Hiroki Kanezashi, Tim Kaler, and Charles E Leisersen. Evolvegcn: Evolving graph convolutional networks for dynamic graphs. arXiv preprint arXiv:1902.10191 , 2019. · arXiv
  174. Adam Paszke, Sam Gross, Soumith Chintala, Gregory Chanan, Edward Yang, Zachary DeVito, Zeming Lin, Alban Desmaison, Luca Antiga, and Adam Lerer. Automatic differentiation in pytorch. In NeurIPS 2017 Autodiff Workshop: The Future of Gradientbased Machine Learning Software and Techniques , 2017.
  175. Yulong Pei, Jianpeng Zhang, GH Fletcher, and Mykola Pechenizkiy. Node classification in dynamic social networks. Proceedings of AALTD , page 54, 2016.
  176. Jeffrey Pennington, Richard Socher, and Christopher Manning. Glove: Global vectors for word representation. In Empirical Methods in Natural Language Processing (EMNLP) , pages 1532-1543, 2014.
  177. Bryan Perozzi, Rami Al-Rfou, and Steven Skiena. Deepwalk: Online learning of social representations. In Twentieth ACM SIGKDD International Conference on Knowledge Discovery and Data Mining , pages 701-710. ACM, 2014.
  178. Bryan Perozzi, Vivek Kulkarni, and Steven Skiena. Walklets: Multiscale graph embeddings for interpretable network classification. arXiv preprint arXiv:1605.02115 , 2016. · arXiv
  179. Nataˇ sa Prˇ zulj. Biological network comparison using graphlet degree distribution. Bioinformatics , 23(2):e177-e183, 2007.
  180. Nataˇ sa Prˇ zulj, Derek G Corneil, and Igor Jurisica. Modeling interactome: scale-free or geometric? Bioinformatics , 20(18):3508-3515, 2004.
  181. Stephan Rabanser, Oleksandr Shchur, and Stephan G¨ unnemann. Introduction to tensor decompositions and their applications in machine learning. arXiv preprint arXiv:1711.10781 , 2017. · arXiv
  182. Lawrence R Rabiner and Biing-Hwang Juang. An introduction to hidden markov models. ieee assp magazine , 3(1):4-16, 1986.
  183. Luc De Raedt, Kristian Kersting, Sriraam Natarajan, and David Poole. Statistical relational artificial intelligence: Logic, probability, and computation. Synthesis Lectures on Artificial Intelligence and Machine Learning , 10(2):1-189, 2016.
  184. Mahmudur Rahman and Mohammad Al Hasan. Link prediction in dynamic networks using graphlet. In Joint European Conference on Machine Learning and Knowledge Discovery in Databases , pages 394-409. Springer, 2016.
  185. Matthew Richardson and Pedro Domingos. Markov logic networks. Machine Learning , 62 (1-2):107-136, 2006.
  186. Petar Ristoski and Heiko Paulheim. Rdf2vec: Rdf graph embeddings for data mining. In International Semantic Web Conference , pages 498-514. Springer, 2016.
  187. Ryan A. Rossi and Nesreen K. Ahmed. The network data repository with interactive graph analytics and visualization. In Twenty-Ninth AAAI Conference on Artificial Intelligence , 2015. URL http://networkrepository.com .
  188. Adam Sadilek and Henry Kautz. Recognizing multi-agent activities from gps data. In Twenty-Fourth AAAI Conference on Artificial Intelligence , 2010.
  189. Hooman Peiro Sajjad, Andrew Docherty, and Yuriy Tyshetskiy. Efficient representation learning using random walks for dynamic graphs. arXiv preprint arXiv:1901.01346 , 2019. · arXiv
  190. Aravind Sankar, Yanhong Wu, Liang Gou, Wei Zhang, and Hao Yang. Dynamic graph representation learning via self-attention networks. arXiv preprint arXiv:1812.09430 , 2018. · arXiv
  191. Adam Santoro, David Raposo, David G Barrett, Mateusz Malinowski, Razvan Pascanu, Peter Battaglia, and Timothy Lillicrap. A simple neural network module for relational reasoning. In Advances in Neural Information Processing Systems (NeurIPS) , pages 4967-4976, 2017.
  192. Purnamrita Sarkar, Sajid M Siddiqi, and Geogrey J Gordon. A latent space approach to dynamic embedding of co-occurrence data. In Artificial Intelligence and Statistics , pages 420-427, 2007.
  193. Michael Schlichtkrull, Thomas N Kipf, Peter Bloem, Rianne Van Den Berg, Ivan Titov, and Max Welling. Modeling relational data with graph convolutional networks. In European Semantic Web Conference , pages 593-607. Springer, 2018.
  194. Minjoon Seo, Aniruddha Kembhavi, Ali Farhadi, and Hannaneh Hajishirzi. Bidirectional attention flow for machine comprehension. arXiv preprint arXiv:1611.01603 , 2016. · arXiv
  195. Youngjoo Seo, Micha¨ el Defferrard, Pierre Vandergheynst, and Xavier Bresson. Structured sequence modeling with graph convolutional recurrent networks. In International Conference on Neural Information Processing , pages 362-373. Springer, 2018.
  196. Umang Sharan and Jennifer Neville. Temporal-relational classifiers for prediction in evolving domains. In 2008 Eighth IEEE International Conference on Data Mining , pages 540-549. IEEE, 2008.
  197. Peter Shaw, Jakob Uszkoreit, and Ashish Vaswani. Self-attention with relative position representations. In Annual Conference of the North American Chapter of the Association for Computational Linguistics , 2018.
  198. Chuan Shi, Yitong Li, Jiawei Zhang, Yizhou Sun, and S Yu Philip. A survey of heterogeneous information network analysis. IEEE Transactions on Knowledge and Data Engineering , 29(1):17-37, 2016.
  199. Chuan Shi, Binbin Hu, Wayne Xin Zhao, and S Yu Philip. Heterogeneous information network embedding for recommendation. IEEE Transactions on Knowledge and Data Engineering , 31(2):357-370, 2018.
  200. Martin Simonovsky and Nikos Komodakis. Dynamic edge-conditioned filters in convolutional neural networks on graphs. In IEEE conference on computer vision and pattern recognition , pages 3693-3702, 2017.

200 of 257 shown

Cited by

Sorted by citations

Authors
Kazemi, S. M., Goel, R., Jain, K., Kobyzev, I., Sethi, A., Forsyth, P., & Poupart, P.
ORCID
Venue
arXiv
Publisher
arXiv
Published
2019
ISSN
2331-8422 (ISSN-L)
DOI
10.48550/arxiv.1905.11485
arXiv
1905.11485
OpenAlex
W3019863187
Cited by
338
References
9
Citations by year
2026: 1 · 2025: 58 · 2024: 63 · 2023: 89 · 2022: 66 · 2021: 51 · 2020: 8 · 2019: 2
Type
posted content
Language
en
Open access
Licence
creativecommons.org/licenses/by-nc-sa/4.0/legalcode
Locations
  • arXiv (Cornell University) (submittedVersion)
  • arXiv (Cornell University)
Topics
  • Physical Sciences › Computer Science › Artificial Intelligence › Advanced Graph Neural Networks
  • Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Graph Theory and Algorithms
  • Physical Sciences › Computer Science › Information Systems › Recommender Systems and Techniques
Keywords
dynamic graphs, graph representation learning, evolving graphs, dynamic knowledge graphs, encoder-decoder architecture, graph neural networks

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review