Cited by 262Information Retrieval and Search BehaviorAlgorithms and Data CompressionTopic Modeling

The DOI matches its Crossref record; 159 of the 166 references it cites were found in a registry or an index; 7 of the 137 sources its claims cite were checked for support.

Survey of Temporal Information Retrieval and Related Applications

Open access
Campos, Ricardo, Dias, Gaël, Jorge, Alípio M., Jatowt, Adam·2015·ACM Computing Surveys

Abstract

Temporal information retrieval has been a topic of great interest in recent years. Its purpose is to improve the effectiveness of information retrieval methods by exploiting temporal information in documents and queries. In this article, we present a survey of the existing literature on temporal information retrieval. In addition to giving an overview of the field, we categorize the relevant research, describe the main contributions, and compare different approaches. We organize existing research to provide a coherent view, discuss several open issues, and point out some possible future research directions in this area. Despite significant advances, the area lacks a systematic arrangement of prior efforts and an overview of state-of-the-art approaches. Moreover, an effective end-to-end temporal retrieval system that exploits temporal information to improve the quality of the presented results remains undeveloped.

Overview

AI snapshot

Written from the paper’s full text.

TL;DR

This survey reviews temporal information retrieval (T-IR), organizing prior work on temporal annotation, extraction from web resources, and temporal web IR tasks such as crawling, indexing, query processing, ranking, clustering, classification, search engines, and future-related retrieval. It concludes that despite advances, the area lacks a systematic overview and an effective end-to-end temporal retrieval system remains undeveloped.

Key findings

  • T-IR combines traditional document relevance with temporal relevance; timeliness/currency is treated as one of five key aspects of document quality, alongside relevance, accuracy, objectivity, and coverage.
  • Explicit temporal queries are rare: about 1.5% of all queries [Nunes et al. 2008], reduced to 1.21% after accounting for false positives [Campos et al. 2011b]. Implicit temporal query studies report varying profiles: 54% atemporal and 46% temporally ambiguous [Jones and Diaz 2007]; only 7% implicit temporal [Metzler et al. 2009]; 10% never spiked, 47% spiked once, and 43% spiked multiple times [Kulkarni et al. 2011]; 75% atemporal and 25% implicit temporal [Campos et al. 2011c].
  • Temporal tagger evaluations: GUTime achieved F1 0.85 for recognition and 0.82 for normalization on TERN 2004; in TempEval-2, SuTime achieved the best extraction F1 of 0.92 versus HeidelTime’s 0.86, while HeidelTime achieved the best normalization F1 of 0.85 versus SuTime’s 0.82.
  • Web temporal evidence: among 62,842 web snippets, roughly 10% contain explicit temporal information; among 508 web snippets, 82.48% of future dates relate to the near future and 17.52% to a further future. The Internet Archive reportedly grows at 100 terabytes per month and has over 350 billion archived web pages, later cited as more than 357 billion.

Methods

  • Design: literature survey of existing T-IR research; it categorizes relevant research, describes main contributions, compares approaches, organizes existing research, and discusses open issues and future directions.
  • Data/sample: no primary dataset or experiment; it synthesizes prior literature and references datasets/collections such as TimeBank, TimeML, the New York Times Annotated Corpus, ClueWeb09/12, web query logs, web snippets, news archives, and Twitter.
  • Analysis: qualitative narrative synthesis and taxonomy across temporal annotation, temporal information extraction, web temporal feature extraction (metadata, content, usage), and temporal web IR stages including crawling, indexing, query processing, ranking, clustering, classification, search engines, and future-related retrieval.

Limitations

  • Stated in the paper: the area lacks a systematic arrangement of prior efforts and an overview of state-of-the-art approaches; an effective end-to-end temporal retrieval system that exploits temporal information to improve result quality remains undeveloped.
  • Stated in the paper: evaluation is difficult because the community often lacks a gold standard; most research has a rather specific scope; query log access outside industry is impeded by privacy/legal concerns; temporal taggers are often language- and domain-specific; metadata timestamps are often unavailable or unreliable and may differ from focus time.
  • Evident from the text: as a survey, it presents no new empirical experiments or primary validation; its findings and numbers are drawn from cited studies, so coverage and conclusions depend on the selected literature.

Model-written summary. Check it against the paper before relying on it.

Integrity signals

Registry

Crossref · 10.1145/2619088

Cites

159 of 159 references verified0 citation errors · 0 not checkable

Statistics

Nothing to recompute.

Verification

Claims the paper makes

7 of 137 cited sources checked · 4 supported · 0 flagged · accuracy not yet measured

  • Premisecitation

    Berberich et al. 2005 introduced T-Rank Light and T-Rank, based on link analysis, taking into account freshness and activity of pages and links to retrieve recent documents.

    “[Berberich et al. 2005] introduced two approaches based on link analysis, T-Rank Light and T-Rank, taking into account both the freshness (i.e., the timestamps of the most recent updates) and the activity (i.e., update rates) of pages as well as links to retrieve recent documents.”
    Quote in the paperNot a substantial claim1 of 1 sources checked
    • cites Berberich et al. 2005 source
  • Premisecitation

    Campos et al. 2012b, 2014 identified relevant temporal expressions extracted from web snippets by clustering documents sharing a common relevant year, using GTE.

    “[Campos et al. 2012b, Campos et al. 2014] who identified the relevant temporal expressions extracted from web snippets by clustering in which documents were grouped into the same cluster if they share a common relevant year.”
    Quote in the paperNot a substantial claim1 of 2 sources checked
    • cites Campos et al. 2012b

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

    • cites Campos et al. 2014 source
  • Premisecitation

    Inagaki et al. 2010 proposed temporal click features and query reformulation chains to improve machine learning recency-sensitive ranking.

    “[Inagaki et al. 2010] also proposed a set of novel temporal click features and query reformulation chains to improve the machine learning recency-sensitive ranking”
    Quote in the paperNot a substantial claim1 of 1 sources checked
    • cites Inagaki et al. 2010 source

      The Introduction says the authors propose temporal click features to improve machine-learned recency ranking and leverage query chains to smooth those features. It describes query reformulation chains as an existing concept, rather than something the authors proposed. (LLM, conf=0.87)

      Experimental — accuracy not yet measured
  • Premisecitation

    Styskin et al. 2011 relied on a recency-sensitive query classifier to apply result diversification by combining ordinary search results with fresh documents.

    “[Styskin et al. 2011] who relied on a recencysensitive query classifier to apply result diversification by combining ordinary search results with fresh documents.”
    Quote in the paperNot a substantial claim1 of 1 sources checked
    • cites Styskin et al. 2011 source
  • Findingnone given

    Few tackled the problem of determining the document focus time, especially in the case of lack or scarcity of temporal expressions.

    “While some methods determine a document's timestamp, few tackled the problem of determining the document focus time, especially in the case of the lack or the scarcity of temporal expressions within the document content.”
    Quote in the paperSubstantial claim
  • Probably not a substantial claim. 151
  • It may state two separate claims as one. 32
  • Probably not a substantial claim. The paper’s conclusions may not depend on it.

    Premisecitation

    GUTime extends the capabilities of TempEx by adding TIMEX3 tags.

    “Another temporal tagger is GUTime which extends the capabilities of TempEx [Mani and Wilson 2000] by adding TIMEX3 tags.”
    Quote in the paperNot a substantial claim1 of 1 sources checked
    • cites Mani and Wilson 2000 source

      The Overall Architecture section describes a temporal tagger that identifies and resolves time expressions, supporting the reference to an earlier tagger. But the copy does not name it TempEx or say that GUTime extends it by adding TIMEX3 tags (searched: GUTime, TempEx, TIMEX3). (LLM, conf=0.85)

      Experimental — accuracy not yet measured
  • Probably not a substantial claim. The paper’s conclusions may not depend on it.

    Premisecitation

    Relative temporal expressions depend on the document publication date or another date near in the context.

    “Relative temporal expressions, which were referenced for the first time in 1998 during MUC-7 [Setzer and Gaizauskas 2000], depend on the document publication date or another date near in the context.”
    Quote in the paperNot a substantial claim1 of 1 sources checked
    • cites Setzer and Gaizauskas 2000 source

      The Introduction reports that MUC-7 (1998) extended the named-entity task to relative time expressions, and §3.1.2 says such expressions can be relative to the document date. Section 3.1.2 also discusses using context to interpret a date, but our copy does not specifically say that the reference is another nearby date. Page numbers are unavailable in our copy. (LLM, conf=0.84)

      Experimental — accuracy not yet measured
  • Probably not a substantial claim. The paper’s conclusions may not depend on it.

    Premisecitation

    Zhang et al. 2009 described a re-ranking score adjustment to give a ranking boost to fresh documents.

    “Next [Zhang et al. 2009] described a re-ranking score adjustment to give a ranking boost to fresh documents.”
    Quote in the paperNot a substantial claim1 of 1 sources checked
    • cites Zhang et al. 2009 source
  • Probably not a substantial claim. The paper’s conclusions may not depend on it. The paper may give no reason why it holds.

    Findingnone given

    To the best of our knowledge, there are only a limited number of prototypes in this field.

    “To the best of our knowledge, there are only a limited number of prototypes in this field.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim. The paper’s conclusions may not depend on it.

    Findingnone given

    With the growth of research in temporal information retrieval, search engines have started to exploit time to improve their search processes.

    “With the growth of research in temporal information retrieval, search engines have started to exploit time to improve their search processes.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim. The paper’s conclusions may not depend on it. The paper may give no reason why it holds.

    Findingnone given

    It is necessary to wade through more than 60 web pages in the Google engine search results to find the first reference to the 1950 event.

    “Indeed, it is necessary to wade through more than 60 web pages in the Google engine search results to find the first reference to the 1950 event.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim. The paper’s conclusions may not depend on it.

    Findingnone given

    Works on temporal ranking can be broadly divided into two classes: recency-sensitive ranking and time-sensitive ranking.

    “several works have been proposed that can be broadly divided into two classes: (1) those favoring more recent documents (recency-sensitive ranking) and (2) those that target documents from different time periods (time-sensitive ranking).”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim. The paper’s conclusions may not depend on it.

    Findingreasoning

    Researchers have started to address the problem of returning documents that are not only topically relevant but also from the most important time periods.

    “researchers have started to address the problem of returning documents that are not only topically relevant but that are also from the most important time periods.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim. The paper’s conclusions may not depend on it. It may state two separate claims as one.

    Findingnone given

    Several research works have been proposed, leading to the emergence of a number of search engine temporal applications.

    “To tackle this problem several research works have been proposed, leading to the emergence of a number of search engine temporal applications.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim. The paper’s conclusions may not depend on it.

    Findingreasoning

    Both classes of temporal ranking are closely related to the categories defined in the query processing section.

    “Both classes are closely related to the categories defined in the query processing section”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim. The paper’s conclusions may not depend on it. The paper may give no reason why it holds.

    Findingnone given

    To the best of our knowledge, only three studies have been proposed on temporal clustering of web page results.

    “To the best of our knowledge, only three studies have been proposed.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim. The paper may give no reason why it holds.

    Findingnone given

    Most popular search engines do not explicitly consider the use of temporal information extracted from web pages.

    “However, most popular search engines do not explicitly consider the use of the temporal information extracted from web pages”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim. The paper’s conclusions may not depend on it. The paper may give no reason why it holds.

    Findingreasoning

    The construction of an effective end-to-end temporal system remains proposed.

    “and the construction of an effective end-to-end temporal system remain proposed.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim. The paper’s conclusions may not depend on it. The paper may give no reason why it holds.

    Findingnone given

    The temporal visualization of documents is still underexploited by internet users.

    “This issue remains unanswered as the temporal visualization of documents is still underexploited by internet users.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim. The paper’s conclusions may not depend on it.

    Findingcitation

    For trending queries, displaying new temporal content can be quite useful for users.

    “Their results suggest that for trending queries, displaying new temporal content can be quite useful for users.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Svore et al. 2012 source
  • Probably not a substantial claim. The paper’s conclusions may not depend on it.

    Findingcitation

    Wikipedia tends to lag about two hours behind Twitter in terms of page tweets and page views related to the same real-world events.

    “They also discovered that Wikipedia tends to lag about two hours behind Twitter in terms of page tweets and page views related to the same realworld events.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Osborne et al. 2012

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

  • Probably not a substantial claim. The paper’s conclusions may not depend on it. The paper may give no reason why it holds. It may state two separate claims as one.

    Findingnone given

    Step (2) of temporal image retrieval has been well studied so far, and many successful methods have been proposed.

    “Step (2) has been well studied so far, and many successful methods have been proposed.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim. The paper may give no reason why it holds.

    Findingnone given

    Systems continue to adopt a simplistic approach that reduces temporal expressions to a single point in time rather than to a time span.

    “systems continue to adopt a simplistic approach that reduces temporal expressions to a single point in time rather than to a time span.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim. The paper’s conclusions may not depend on it.

    Premisecitation

    Explicit temporal queries represent about 1.5% of all queries.

    “Such queries represent about 1.5% of all queries [Nunes et al. 2008].”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Nunes et al. 2008

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

  • Probably not a substantial claim. The paper’s conclusions may not depend on it.

    Premisenone given

    These knowledge bases provide countless factual relations among entities, such as people or locations.

    “These knowledge bases provide countless factual relations among entities, such as people or locations.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim. It may be too vague to check against evidence. The paper may give no reason why it holds.

    Interpretationnone given

    It is not easy to retrieve web documents so that their temporal dimension will meet the user temporal intent underlying the query.

    “Third, it is not easy to retrieve web documents so that their temporal dimension will meet the user temporal intent underlying the query.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim. The paper’s conclusions may not depend on it.

    Premisecitation

    The greatest difficulty in developing an automatic system for detecting temporal expressions is the large diversity of ways in which time can be expressed.

    “The greatest difficulty in developing an automatic system for detecting temporal expressions is the large diversity of ways in which time can be expressed [Mazur 2012].”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Mazur 2012

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

  • Probably not a substantial claim.

    Interpretationreasoning

    One consequence of ignoring the temporal dimension is the inconsistency of information, since some facts might only have been true for a particular time.

    “One consequence is the inconsistency of information, since some facts might only have been true for a particular time (e.g., the relation [Bill Clinton, president of the USA] is only valid from 1993 to 2001).”
    Quote in the paperSubstantial claim
  • Probably not a substantial claim. The paper’s conclusions may not depend on it.

    Interpretationcitation

    The creation of annotation standard corpora like TimeBank, annotation schemas such as TimeML, and the development of temporal taggers indicate T-IR's importance.

    “In addition, note the creation of annotation standard corpora like the TimeBank [Pustejovsky et al. 2006], annotation schemas such as TimeML 10 [Pustejovsky et al. 2003], and the development of temporal taggers [Strötgen and Gertz 2010a].”
    Quote in the paperNot a substantial claim0 of 3 sources checked
    • cites Pustejovsky et al. 2006

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

    • cites Pustejovsky et al. 2003
    • cites Strötgen and Gertz 2010a

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

  • Probably not a substantial claim. The paper’s conclusions may not depend on it.

    Premisecitation

    Label propagation, a semi-supervised learning algorithm, computes the confidence scores of the candidate facts.

    “Then label propagation, a semi-supervised learning algorithm, computes the confidence scores of the candidate facts.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Wang et al. 2011 source
  • Probably not a substantial claim. The paper may give no reason why it holds.

    Interpretationnone given

    Leveraging temporal information enables researchers to create knowledgeable retrieval mechanisms that support entity-level temporal queries instead of keyword-based ones.

    “Leveraging such temporal information enables researchers to create knowledgeable retrieval mechanisms that support entity-level temporal queries instead of keyword-based ones.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim. The paper’s conclusions may not depend on it. The paper may give no reason why it holds.

    Interpretationnone given

    The lack of an extensive collection of texts annotated with temporal information covering different languages forms an additional problem.

    “Moreover, the lack of an extensive collection of texts annotated with temporal information covering different languages forms an additional problem.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim. The paper’s conclusions may not depend on it.

    Premisecitation

    75% of implicit temporal queries based on web snippets are atemporal.

    “In contrast to the above studies, [Campos et al. 2011c] addressed the profile of implicit temporal queries based on a collection of web snippets and found that 75% are atemporal and 25% have an implicit temporal nature.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Campos et al. 2011c

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

  • Probably not a substantial claim. The paper’s conclusions may not depend on it.

    Interpretationreasoning

    Extracting metadata from document content demands a rule definition for each different case or language, which may be quite unfeasible for real-world applications.

    “This procedure demands a rule definition for each different case or language, which may be quite unfeasible for real-world applications.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim. The paper’s conclusions may not depend on it.

    Premisecitation

    Only 7% of queries have an implicit temporal nature.

    “[Metzler et al. 2009] in turn, relied on web query logs to infer the implicit temporal values of queries based on similar explicit temporal queries, concluding that only 7% have an implicit temporal nature.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Metzler et al. 2009 source
  • Probably not a substantial claim. The paper’s conclusions may not depend on it.

    Premisecitation

    Annie was developed in 2002 as part of the GATE distribution.

    “Annie was also developed in 2002 as part of the GATE 18 distribution [Cunningham et al. 2002].”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Cunningham et al. 2002

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

  • It may state two separate claims as one.

    Interpretationreasoning

    T-YAGO's restriction to the football domain and its inability to support extraction of information from free text corpora limits its scope.

    “Although an interesting first approach, its restriction to the football domain and the fact that it does not support the extraction of information from free text corpora limits its scope.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim. The paper’s conclusions may not depend on it.

    Premisecitation

    43% of queries spiked multiple times (temporal ambiguous queries).

    “A more recent study [Kulkarni et al. 2011] explored query intent changes over 10-week time spans and found that 10% of the queries never spiked (atemporal queries), 47% spiked once (temporal unambiguous queries), and 43% spiked multiple times (temporal ambiguous queries).”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Kulkarni et al. 2011 source
  • Probably not a substantial claim. The paper’s conclusions may not depend on it.

    Premisecitation

    Research on extracting relational facts from text corpora has led to the emergence of large knowledge bases, such as DBpedia, YAGO, Freebase, and Wolfram Alpha.

    “There has also been research on extracting relational facts (e.g., Barack Obama is the president of the USA) from text corpora, which has led to the emergence of large knowledge bases, such as DBpedia 19 [Auer et al. 2007], YAGO 20 [Suchanek et al. 2007] as well as commercial ones, such as Freebase 21 [Bollacker et al. 2007] and Wolfram Alpha 22 .”
    Quote in the paperNot a substantial claim0 of 3 sources checked
    • cites Auer et al. 2007 source

      Checked before — its earlier verdict is held back until a new check runs.

    • cites Suchanek et al. 2007 source
    • cites Bollacker et al. 2007

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

  • Probably not a substantial claim. It may be too vague to check against evidence. The paper’s conclusions may not depend on it. The paper may give no reason why it holds. It may state two separate claims as one.

    Interpretationreasoning

    All of these large-scale projects clearly suggest T-IR's high interest to the public and that it constitutes a promising new research area.

    “All of these large-scale projects clearly suggest T-IR's high interest to the public and that it constitutes a promising new research area.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim. The paper’s conclusions may not depend on it. The paper may give no reason why it holds. It may state two separate claims as one.

    Interpretationnone given

    While temporal taggers play an important role in temporal information processing, some works simply use straightforward regular expressions to look for temporal instances.

    “While temporal taggers play an important role in temporal information processing, some works simply use straightforward regular expressions to look for temporal instances.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim. The paper’s conclusions may not depend on it.

    Premisecitation

    Shaparenko et al. correlated topic events with texts used in a document collection to provide an overview of how topics evolve over time.

    “[Shaparenko et al. 2005] correlated topic events with texts used in a document collection to provide an overview of how topics evolve over time.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Shaparenko et al. 2005

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

  • Probably not a substantial claim. The paper’s conclusions may not depend on it. The paper may give no reason why it holds.

    Interpretationnone given

    Most user information needs are implicit by nature.

    “Even though some user information needs may be explicitly expressed, most are implicit by nature.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim. The paper’s conclusions may not depend on it.

    Interpretationnone given

    Researchers also approached the problem of determining various temporal dimensions of documents and queries.

    “They also approached the problem of determining various temporal dimensions of documents and queries.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim. The paper’s conclusions may not depend on it.

    Premisecitation

    46% of TREC ad hoc queries belong to the temporally ambiguous class.

    “[Jones and Diaz 2007] asked a few annotators to classify 51 TREC ad hoc queries using TREC topic descriptions and concluded that 54% of the queries belong to the atemporal class and 46% belong to the temporally ambiguous one.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Jones and Diaz 2007 source
  • Probably not a substantial claim.

    Interpretationnone given

    A clear understanding of the temporal nature of queries is difficult due to query ambiguity, different temporal characteristics of queries or unknown users' expectations towards the temporality of search results.

    “Second, a clear understanding of the temporal nature of queries is difficult due to query ambiguity, different temporal characteristics of queries or even unknown users' expectations towards the temporality of search results.”
    Quote in the paperSubstantial claim
  • Probably not a substantial claim. It may be too vague to check against evidence. The paper’s conclusions may not depend on it. The paper may give no reason why it holds. It may state two separate claims as one.

    Interpretationnone given

    These contributions can greatly benefit the process of indexing documents, as well as the ranking of web search results or the clustering of documents.

    “These contributions can greatly benefit the process of indexing documents, as well as the ranking of web search results or the clustering of documents.”
    Quote in the paperNot a substantial claim
  • It may state two separate claims as one.

    Premisecitation

    Kuzey and Weikum 2012 harvests temporal facts and events from Wikipedia, especially from infoboxes of articles devoted to named events, and also extracts temporal facts from free text, namely from the full content of Wikipedia articles.

    “As well as harvesting temporal facts and events from Wikipedia, especially from the infoboxes of articles devoted to named events (e.g., historical events, conferences, etc), it also extracts temporal facts from free text, namely, from the full content of Wikipedia articles.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Kuzey and Weikum 2012 source
  • Probably not a substantial claim.

    Interpretationreasoning

    Finding the document timestamp or related explicit temporal expressions is important so that a relative temporal expression can be mapped directly on the timeline as an explicit expression.

    “As such, finding the document timestamp or related explicit temporal expressions is important, so that the expression can be mapped directly on the timeline as an explicit expression.”
    Quote in the paperSubstantial claim
  • It may state two separate claims as one.

    Premisenone given

    HeidelTime achieved the best performance for the normalization process with an F1-measure of 0.85 as opposed to SuTime which achieved a score of 0.82.

    “In contrast, HeidelTime achieved the best performance for the normalization process with an F 1 -measure of 0.85 as opposed SuTime which achieved a score of 0.82.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim. The paper’s conclusions may not depend on it. The paper may give no reason why it holds. It may state two separate claims as one.

    Interpretationnone given

    The overall T-IE process is usually conducted by temporal taggers, which follow rule-based approaches based on regular expressions or local grammar-based techniques and usually involve hard work by experts.

    “The overall T-IE process is usually conducted by temporal taggers, which follow rulebased approaches that are based on regular expressions or local grammar-based techniques and usually involve hard work by experts.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim. It may be too vague to check against evidence. The paper’s conclusions may not depend on it.

    Interpretationreasoning

    Since a web page can refer to different points in time, its focus time is better represented by a set of time intervals delimited by the document's oldest and newest temporal references rather than as a single point in time.

    “Naturally, since a web page can refer to different points in time, its focus time is better represented by a set of time intervals delimited by the document's oldest and newest temporal references rather than as a single point in time.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim. It may be too vague to check against evidence. The paper’s conclusions may not depend on it. The paper may give no reason why it holds. It may state two separate claims as one.

    Interpretationnone given

    Since the web is heterogeneous, multi-lingual, multi-cultural, and highly multi-domain, ambiguity is common.

    “Since the web is heterogeneous, multi-lingual, multi-cultural, and highly multi-domain, ambiguity is common.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim. The paper’s conclusions may not depend on it.

    Premisecitation

    CoTS temporally scopes relational facts based on change detection in a time series of the number of facts from the Google Books Ngram and Gigaword datasets.

    “In contrast, CoTS [Talukdar et al. 2012] temporally scopes relational facts based on change detection in a time series of the number of facts from the Google Books Ngram [Michel et al. 2011] and Gigaword [Graff et al. 2003] datasets.”
    Quote in the paperNot a substantial claim0 of 3 sources checked
    • cites Talukdar et al. 2012 source
    • cites Michel et al. 2011

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

    • cites Graff et al. 2003

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

  • Probably not a substantial claim. The paper’s conclusions may not depend on it.

    Premisecitation

    The goal of the TDT project is the exploration of techniques that identify the occurrence of new events to follow their track over time.

    “The goal of the TDT project, which was one of the first important research initiatives related to news management, is the exploration of techniques that identify the occurrence of new events to follow their track over time.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Allan et al. 1998

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

  • It may state two separate claims as one.

    Interpretationcitation

    Overall, the results show that the web is constantly changing mainly due to the creation of more and more new pages and, to a lesser extent, the modification of the content of existing ones.

    “Overall, the results show that the web is constantly changing mainly due to the creation of more and more new pages and, to a lesser extent, the modification of the content of existing ones.”
    Quote in the paperNot a substantial claim0 of 3 sources checked
    • cites Baeza-Yates et al. 2002 source
    • cites Cho and Garcia-Molina 2003 source
    • cites Fetterly et al. 2003 source
  • Probably not a substantial claim. The paper’s conclusions may not depend on it. The paper may give no reason why it holds.

    Premisenone given

    Since 2004, after the introduction of the TERN task as part of the ACE program, Temporal Information Extraction has become an independent task.

    “However, since 2004, after the introduction of the TERN task as part of the ACE program, Temporal Information Extraction (T-IE) has become an independent task.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim. The paper’s conclusions may not depend on it.

    Premisecitation

    Makkonen and Ahonen-Myka suggested an alternative solution by comparing one document with another through a temporal similarity measure.

    “[Makkonen and Ahonen-Myka 2003] suggested an alternative solution by comparing one document with another through a temporal similarity measure.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Makkonen and Ahonen-Myka 2003 source
  • Probably not a substantial claim. The paper’s conclusions may not depend on it. It may state two separate claims as one.

    Premisenone given

    SuTime is optimized for English texts and HeidelTime is a multi-lingual temporal tagger (English, German, and Dutch) that is adapted not only to the news domain but also to narrative documents.

    “SuTime is optimized for English texts and HeidelTime is a multi-lingual temporal tagger (English, German, and Dutch) that is adapted not only to the news domain but also to narrative documents.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim. The paper’s conclusions may not depend on it.

    Interpretationnone given

    The T-IE process consists of three main tasks: Extraction or Recognition of temporal expressions, Normalization, and Temporal Annotation.

    “It consists of three main tasks.The first is the Extraction or Recognition of temporal expressions.The second is Normalization to unify the different ways in which temporal expressions can be expressed.Finally, the last task called Temporal Annotation expresses temporal expressions in a standard format.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim. The paper’s conclusions may not depend on it. It may state two separate claims as one.

    Interpretationreasoning

    One reason for missing comprehensive search is that the process is treated as an inherent part of document processing, when in fact it should be an independent task supported by a two-layered index framework.

    “One reason is that this process is treated as an inherent part of document processing, when in fact it should be an independent task, supported by a two-layered index framework, where both document and temporal features are considered.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim. The paper’s conclusions may not depend on it. The paper may give no reason why it holds.

    Interpretationreasoning

    With the advent of the web, a huge amount of temporal data has become available.

    “With the advent of the web, the world's largest collection of data, a huge amount of temporal data has become available.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim. The paper’s conclusions may not depend on it. The paper may give no reason why it holds.

    Interpretationnone given

    The huge volume of the web makes temporal information retrieval a difficult task.

    “The huge volume of the web, however, makes T-IR a difficult task.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim. It may be too vague to check against evidence. The paper’s conclusions may not depend on it. The paper may give no reason why it holds.

    Interpretationnone given

    For certain applications there may be no need to use temporal taggers since they may require very specific information, such as year mentions in texts.

    “Indeed, for certain applications there may be no need to use temporal taggers since they may require very specific information, such as year mentions in texts.”
    Quote in the paperNot a substantial claim
  • It may state two separate claims as one.

    Interpretationreasoning

    None of the publicly provided search query collections includes a wide range of explicit temporal queries, so the process of inferring the temporal nature of implicitly formulated queries is hampered.

    “Since none of these collections includes a wide range of explicit temporal queries, the process of inferring the temporal nature of queries implicitly formulated is hampered.”
    Quote in the paperSubstantial claim
  • Probably not a substantial claim. The paper’s conclusions may not depend on it.

    Premisecitation

    Time is inherently associated with events.

    “Time is inherently associated with events [Setzer and Gaizauskas 2000].”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Setzer and Gaizauskas 2000 source

      Checked before — its earlier verdict is held back until a new check runs.

  • Probably not a substantial claim. The paper’s conclusions may not depend on it.

    Premisenone given

    TempEx is a rule-based model that extracts temporal information, particularly explicit and relative temporal expressions, and labels them with TIMEX2 tags.

    “It is a rule-based model that extracts temporal information, particularly explicit (e.g., December 24, 2009) and relative temporal expressions (e.g., Monday), and labels them with TIMEX2 tags.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim. The paper’s conclusions may not depend on it. The paper may give no reason why it holds.

    Interpretationnone given

    Identification of temporal information is a non-trivial task that requires the preprocessing stage of a document that usually involves four steps.

    “The identification of temporal information is a non-trivial task that requires the preprocessing stage of a document that usually involves four steps.”
    Quote in the paperNot a substantial claim
  • It may state two separate claims as one.

    Premiseown data

    Both SuTime and HeidelTime have been evaluated in the TempEval-2 challenge and achieved competitive results.

    “Both have been evaluated in the TempEval-2 challenge and achieved competitive results.”
    Quote in the paperNot a substantial claim
  • It may state two separate claims as one.

    Interpretationnone given

    These knowledge bases often ignore the temporal dimension and mostly focus on identifying the most salient facts.

    “However, they often ignore the temporal dimension (e.g., Barack Obama has been the president of the USA since 2008) and mostly focus on identifying the most salient facts.”
    Quote in the paperSubstantial claim
  • Probably not a substantial claim. The paper’s conclusions may not depend on it.

    Premisecitation

    Swan and Allan proposed a classical hypothesis test to discover time-dependent features that identify the important topics in text documents.

    “[Swan andAllan 1999, Swan andJensen 2000] proposed a classical hypothesis test to discover time-dependent features that identify the important topics in text documents.”
    Quote in the paperNot a substantial claim0 of 2 sources checked
    • cites Swan andAllan 1999

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

    • cites Swan andJensen 2000

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

  • It may state two separate claims as one.

    Interpretationnone given

    Even though document timestamp information is usually available in news documents, it is particularly difficult to locate within web documents.

    “Even though such information is usually available in news documents, it is particularly difficult to locate within web documents, as we discuss in Section 3.1.1.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim. The paper’s conclusions may not depend on it.

    Premisecitation

    Nearly half of the 110 respondents stated that the information for which they search is related to the present.

    “In their survey, nearly half of the 110 respondents stated that the information for which they search is related to the present (information on the same day); yet a significant fraction also searches for future-related or past-related information.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Joho et al. 2013 source
  • Probably not a substantial claim. The paper’s conclusions may not depend on it.

    Premisecitation

    When addressing the time issue within database research areas, two types of time are usually distinguished: valid and transaction.

    “When addressing the time issue within the realm of database research areas, two types of time are usually distinguished: valid and transaction [Snodgrass and Ahn 1985].”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Snodgrass and Ahn 1985 source
  • Probably not a substantial claim. The paper’s conclusions may not depend on it. The paper may give no reason why it holds.

    Interpretationnone given

    This temporal information can be found within a number of different web sources, from web query logs to collections of web pages or social networks such as Twitter.

    “This information can be found within a number of different web sources, from web query logs to collections of web pages or social networks such as Twitter.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim. The paper’s conclusions may not depend on it.

    Premisecitation

    47% of queries spiked once (temporal unambiguous queries).

    “A more recent study [Kulkarni et al. 2011] explored query intent changes over 10-week time spans and found that 10% of the queries never spiked (atemporal queries), 47% spiked once (temporal unambiguous queries), and 43% spiked multiple times (temporal ambiguous queries).”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Kulkarni et al. 2011 source
  • It may state two separate claims as one.

    Interpretationreasoning

    Extracting temporal information from web query logs implies that some versions of the query have already been issued, thus contributing to query-dependency.

    “A further challenge is that, contrary to the extraction of information within metadata or web contents, which simply requires a set of web search results, extracting temporal information from web query logs implies that some versions of the query have already been issued, thus contributing to query-dependency.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim. The paper’s conclusions may not depend on it.

    Interpretationreasoning

    The content approach implies an increased level of difficulty compared to metadata approaches because it usually involves linguistic analysis of texts.

    “Unlike metadata approaches, the content approach implies an increased level of difficulty since it usually involves linguistic analysis of texts, as discussed in Section 2.5.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim. The paper’s conclusions may not depend on it.

    Premisecitation

    25% of implicit temporal queries based on web snippets have an implicit temporal nature.

    “In contrast to the above studies, [Campos et al. 2011c] addressed the profile of implicit temporal queries based on a collection of web snippets and found that 75% are atemporal and 25% have an implicit temporal nature.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Campos et al. 2011c

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

  • Probably not a substantial claim. The paper’s conclusions may not depend on it.

    Premisecitation

    10% of queries never spiked (atemporal queries).

    “A more recent study [Kulkarni et al. 2011] explored query intent changes over 10-week time spans and found that 10% of the queries never spiked (atemporal queries), 47% spiked once (temporal unambiguous queries), and 43% spiked multiple times (temporal ambiguous queries).”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Kulkarni et al. 2011 source
  • Probably not a substantial claim. The paper’s conclusions may not depend on it.

    Premisecitation

    The multitude of different forms in which human language allows temporal information to be conveyed as well as language intricacy and ambiguity complicate the task of tagging temporal information in texts more than simply finding the part-of-speech functions of words.

    “Additionally, the multitude of different forms in which human language allows temporal information to be conveyed [Mazur 2012] as well as language intricacy and ambiguity complicate the task of tagging temporal information in texts more than simply finding the part-of-speech functions of words.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Mazur 2012

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

  • Probably not a substantial claim. The paper’s conclusions may not depend on it.

    Premisecitation

    PRAVDA uses a pattern-based approach to extract the temporal candidates of facts.

    “It uses a patternbased approach to extract the temporal candidates of facts.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Wang et al. 2011 source
  • Probably not a substantial claim. The paper’s conclusions may not depend on it.

    Premisecitation

    A significant fraction of the 110 respondents also searches for future-related or past-related information.

    “In their survey, nearly half of the 110 respondents stated that the information for which they search is related to the present (information on the same day); yet a significant fraction also searches for future-related or past-related information.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Joho et al. 2013 source
  • It may state two separate claims as one.

    Premisenone given

    For the extraction process, SuTime achieved the best performance with a score of 0.92 in terms of F1-measure, while HeidelTime obtained 0.86.

    “For the extraction process, SuTime achieved the best performance with a score of 0.92 in terms of F 1 -measure, while HeidelTime obtained 0.86.”
    Quote in the paperNot a substantial claim
  • It may state two separate claims as one.

    Premisecitation

    Wang et al. 2010 developed the T-YAGO knowledge base, which is an extension of YAGO.

    “One of the first works addressing this problem was developed by [Wang et al. 2010] with the T-YAGO knowledge base, which is an extension of YAGO [Suchanek et al. 2007].”
    Quote in the paperNot a substantial claim0 of 2 sources checked
    • cites Wang et al. 2010 source
    • cites Suchanek et al. 2007 source
  • Probably not a substantial claim. The paper’s conclusions may not depend on it.

    Interpretationnone given

    An increasing number of contests and workshops focus on the temporal aspects of information.

    “Another indication of T-IR's importance is the realization of an increasing number of contests and workshops that focus on the temporal aspects of information.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim. The paper’s conclusions may not depend on it.

    Interpretationnone given

    The WayBack Machine still does not allow a free text query search.

    “Unfortunately, the system still does not allow a free text query search.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim. The paper’s conclusions may not depend on it.

    Interpretationreasoning

    Most available temporal taggers are useful for only one language (typically English) and for one domain (usually the news domain).

    “Hence, most available temporal taggers are useful for only one language (typically English) and for one domain (usually, the news domain).”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim. The paper’s conclusions may not depend on it.

    Interpretationnone given

    Researchers started to address the problem of retrieving web pages that are not only topically relevant but also created during (or that refer to) the most relevant time periods.

    “Nevertheless, researchers started to address the problem of retrieving web pages that are not only topically relevant but also created during (or that refer to) the most relevant time periods.”
    Quote in the paperNot a substantial claim
  • It may state two separate claims as one.

    Premisecitation

    Other challenges involve determining the document creation time, delimiting, classifying, and normalizing temporal expressions, recognizing events or determining their temporal order.

    “Other challenges involve determining the document creation time, delimiting, classifying, and normalizing temporal expressions, recognizing events or determining their temporal order [Costa 2013].”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Costa 2013
  • Probably not a substantial claim. The paper’s conclusions may not depend on it.

    Premisenone given

    SuTime and HeidelTime have been developed based on a rule-based system to extract and normalize temporal expressions.

    “More recently, SuTime and HeidelTime have been developed based on a rule-based system to extract and normalize temporal expressions.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim. The paper’s conclusions may not depend on it.

    Premisecitation

    Kumaran and Allan detected new stories by measuring the degree overlap of one story with those that occurred in the past.

    “[Kumaran and Allan 2004], on the other hand, detected new stories by measuring the degree overlap of one story with those that occurred in the past.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Kumaran and Allan 2004 source
  • Probably not a substantial claim. The paper’s conclusions may not depend on it. The paper may give no reason why it holds.

    Premisenone given

    TempEx was the first temporal expression tagger to be developed.

    “TempEx was the first temporal expression tagger to be developed.”
    Quote in the paperNot a substantial claim
  • It may state two separate claims as one.

    Interpretationreasoning

    Since the web is constantly changing, it is becoming more difficult for search engines to maintain up-to-date indexes, which threatens the effectiveness of the search process and the usefulness of search results.

    “Since the web is constantly changing, it is also becoming more difficult for search engines to maintain up-to-date indexes, which threatens the effectiveness of the search process and the usefulness of search results.”
    Quote in the paperSubstantial claim
  • Probably not a substantial claim. The paper’s conclusions may not depend on it. It may state two separate claims as one.

    Premisecitation

    An integer linear program incorporating temporal constraints temporally scopes the correlated facts and guarantees their temporal consistency.

    “As done above, an integer linear program incorporating temporal constraints temporally scopes the correlated facts and guarantees their temporal consistency.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Talukdar et al. 2012 source
  • Probably not a substantial claim. The paper may give no reason why it holds.

    Interpretationnone given

    Since the web is constantly changing, maintaining up-to-date indexes is becoming more and more difficult.

    “First, since the web is constantly changing, maintaining up-to-date indexes is becoming more and more difficult.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim. The paper’s conclusions may not depend on it. It may state two separate claims as one.

    Premisenone given

    GUTime has been evaluated on the TERN 2004 training corpus and achieved F1-measure scores of 0.85 and 0.82 for temporal expression recognition and normalization, respectively.

    “GUTime has been evaluated on the TERN 2004 training corpus and achieved F 1 -measure scores of 0.85 and 0.82 for temporal expression recognition and normalization, respectively.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim.

    Interpretationreasoning

    Detecting whether a query requires special treatment in terms of recency analysis is difficult, given that user search intents are usually underspecified.

    “Detecting whether a query requires special treatment in terms of recency analysis is difficult, given that user search intents are usually underspecified.”
    Quote in the paperSubstantial claim
  • Probably not a substantial claim. The paper’s conclusions may not depend on it.

    Premisecitation

    Implicit temporal expressions require that at least a year appears somewhere close in the text to establish accurate temporal values.

    “Therefore, as observed by [Alonso et al. 2009b], these expressions require that at least a year appears somewhere close in the text to establish accurate temporal values.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Alonso et al. 2009b

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

  • Probably not a substantial claim. The paper’s conclusions may not depend on it.

    Premisecitation

    54% of TREC ad hoc queries belong to the atemporal class.

    “[Jones and Diaz 2007] asked a few annotators to classify 51 TREC ad hoc queries using TREC topic descriptions and concluded that 54% of the queries belong to the atemporal class and 46% belong to the temporally ambiguous one.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Jones and Diaz 2007 source
  • Probably not a substantial claim. The paper’s conclusions may not depend on it.

    Premisecitation

    Information science researchers tend to consider timeliness or currency as one of the five key aspects that determine a document's quality; the others are relevance, accuracy, objectivity, and coverage.

    “Information science researchers [Metzger 2007] tend to consider timeliness or currency as one of the five key aspects that determine a document's quality; the others are relevance, accuracy, objectivity, and coverage.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Metzger 2007

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

  • Probably not a substantial claim. The paper’s conclusions may not depend on it. The paper may give no reason why it holds.

    Interpretationnone given

    Despite the importance of time for information retrieval, research on time-sensitive fact extraction has only recently been addressed.

    “Despite the importance of time for information retrieval, research on time-sensitive fact extraction has only recently been addressed.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim. It may be too vague to check against evidence. The paper may give no reason why it holds.

    Interpretationnone given

    The process of searching for information is inherently temporal.

    “The process of searching for information is inherently temporal.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim. The paper’s conclusions may not depend on it. The paper may give no reason why it holds.

    Premisenone given

    Commercial search engines have adopted this solution.

    “Over the years, commercial search engines have adopted this solution.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim. The paper may give no reason why it holds.

    Interpretationnone given

    Such information (creation date) is not available in many documents.

    “Moreover, such information is not available in many documents.”
    Quote in the paperNot a substantial claim
  • It may state two separate claims as one.

    Interpretationnone given

    All metadata-based approaches for identifying relevant query time periods rely on the creation date of documents as correct temporal signals, which are far from credible in most cases.

    “Unfortunately, all of these approaches rely on the creation date of documents as correct temporal signals, which are far from credible in most cases.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim. The paper’s conclusions may not depend on it.

    Premisecitation

    Holzmann et al. 2012 developed fokas, a search engine that offers user query suggestion terms based on named entity evolution.

    “[Holzmann et al. 2012] developed fokas, which is a search engine that offers user query suggestion terms of the original query based on a named entity evolution procedure.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Holzmann et al. 2012
  • Probably not a substantial claim. The paper’s conclusions may not depend on it.

    Premisenone given

    Other problems are related to the gap that exists between the document timestamp and the time to which the document contents refer.

    “Other problems, as discussed in Section 3.1, are related to the gap that exists between the document timestamp and the time to which the document contents refer”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim. The paper’s conclusions may not depend on it.

    Premisecitation

    Alonso et al. 2007a presented an exploratory search interface that uses timelines to explain and explore search results.

    “[Alonso et al. 2007a] presented an exploratory search interface that uses timelines to explain and explore search results.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Alonso et al. 2007a

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

  • Probably not a substantial claim. The paper’s conclusions may not depend on it.

    Premisecitation

    The process of determining a document's time dimension can be divided into two categories: determining a document's timestamp and determining its focus time.

    “this process can be divided into two categories: (1) determining a document's timestamp, i.e., the time when the document was created, published or lastmodified and (2) determining its focus time, i.e., the time to which its contents refer.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Kanhabua and Nørvåg 2008 source
  • Probably not a substantial claim. The paper’s conclusions may not depend on it.

    Premisecitation

    YAGO2 provided a search interface to seek temporal and spatial knowledge facts in knowledge bases.

    “YAGO2 [Hoffart et al. 2011] provided a search interface to seek temporal and spatial knowledge facts in knowledge bases.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Hoffart et al. 2011

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

  • Probably not a substantial claim. The paper’s conclusions may not depend on it.

    Premisecitation

    Dong et al. 2010b incorporated fresh URLs extracted from Twitter into a general web search system.

    “[Dong et al. 2010b] incorporated fresh URLs extracted from Twitter into a general web search system.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Dong et al. 2010b

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

  • Probably not a substantial claim. The paper’s conclusions may not depend on it.

    Premisecitation

    Kanhabua et al. 2011 proposed a ranking model for future predictions using a learning-to-rank algorithm.

    “[Kanhabua et al. 2011] also proposed a ranking model for future predictions using a learning-to-rank algorithm”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Kanhabua et al. 2011 source
  • Probably not a substantial claim. The paper’s conclusions may not depend on it.

    Premisecitation

    Garcia Fernandez et al. 2011 proposed a system to automatically determine the publication date of French historical documents based on unsupervised and supervised algorithms.

    “[Garcia Fernandez et al. 2011] proposed a system to automatically determine the publication date of French historical documents based on unsupervised and supervised algorithms.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Garcia Fernandez et al. 2011 source
  • Probably not a substantial claim. The paper’s conclusions may not depend on it.

    Premisenone given

    Google has a time feature that allowed users to filter their search results.

    “For example, Google has a time feature that allowed users to filter their search results.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim. The paper’s conclusions may not depend on it.

    Premisecitation

    Campos et al. 2012b presented GTE-Cluster, an online temporal search interface.

    “[Campos et al. 2012b] presented GTE-Cluster, an online temporal search interface”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Campos et al. 2012b

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

  • Probably not a substantial claim. The paper’s conclusions may not depend on it. The paper may give no reason why it holds.

    Interpretationreasoning

    When an event is very likely to happen, usually the date and the time mentioned in news articles are more exact (finer granularity).

    “When an event is very likely to happen, usually the date and the time mentioned in news articles are more exact (finer granularity).”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim. The paper’s conclusions may not depend on it.

    Premisecitation

    Alonso et al. 2009a introduced TCluster, an overlapping clustering algorithm.

    “[Alonso et al. 2009a] introduced TCluster, an overlapping clustering algorithm”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Alonso et al. 2009a

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

  • Probably not a substantial claim. The paper’s conclusions may not depend on it.

    Premisecitation

    Alonso et al. 2009a proposed a measure to rank documents within a cluster based on the number of times a query occurs in a sentence with temporal expressions.

    “[Alonso et al. 2009a] proposed a measure to rank documents within a cluster based on the number of times a query occurs in a sentence with explicit, implicit, and relative temporal expressions.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Alonso et al. 2009a

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

  • Probably not a substantial claim. The paper’s conclusions may not depend on it.

    Premisecitation

    Alonso and Gertz 2006 described a prototype that provides users with an alternative presentation of results by a hit list of documents clustered by temporal attributes.

    “[Alonso and Gertz 2006] described a prototype that provides users with an alternative presentation of the results by a hit list of documents clustered by temporal attributes.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Alonso and Gertz 2006 source
  • Probably not a substantial claim. It may be too vague to check against evidence. The paper may give no reason why it holds.

    Interpretationnone given

    Future-related information is inherently uncertain in contrast to past-related information.

    “Particularly, future-related information is inherently uncertain in contrast to past-related information.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim. The paper’s conclusions may not depend on it.

    Premisecitation

    Shaparenko et al. 2005 tracked events over time by clustering.

    “[Shaparenko et al. 2005] tracked events over time by clustering.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Shaparenko et al. 2005

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

  • Probably not a substantial claim. The paper may give no reason why it holds.

    Interpretationnone given

    Most applications over digitalized archives fail to exploit the inherent temporal issue of historical collections.

    “However, most fail to exploit the inherent temporal issue of historical collections.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim. The paper’s conclusions may not depend on it. It may state two separate claims as one.

    Interpretationreasoning

    This solution may be very effective to filter in more detail recently published documents, but it may prove inefficient when the user is seeking timely information about a given topic.

    “Although this solution may be very effective to filter in more detail recently published documents, it may prove inefficient when the user is seeking timely information about a given topic.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim. It may be too vague to check against evidence. The paper’s conclusions may not depend on it. The paper may give no reason why it holds.

    Interpretationnone given

    Future information retrieval is a promising T-IR trend that offers many advantages.

    “Indeed, future information retrieval is a promising T-IR trend that offers many advantages”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim. The paper’s conclusions may not depend on it. The paper may give no reason why it holds.

    Interpretationnone given

    The uncertainty of a future event influences the precision of temporal expressions in news articles.

    “The uncertainty of a future event influences the precision of temporal expressions in news articles.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim. The paper’s conclusions may not depend on it.

    Premisecitation

    Strötgen and Gertz 2010b presented TimeTrails for extraction, querying, storage, and exploration of spatio-temporal information.

    “[Strötgen and Gertz 2010b], for example, presented a prototype system called TimeTrails for the extraction, querying, storage, and exploration of the spatio-temporal information stored in text documents.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Strötgen and Gertz 2010b

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

  • Probably not a substantial claim. The paper’s conclusions may not depend on it. It may state two separate claims as one.

    Premisecitation

    Such an approach is limited by two main constraints: the need to have a huge set of external documents and the requirement that last-modified dates exist in a set of external sources.

    “Such an approach is limited however by two main constraints: (1) the need to have a huge set of external documents and (2) the requirement that the last-modified dates exist in a set of external sources”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Nunes et al. 2007 source
  • Probably not a substantial claim. The paper’s conclusions may not depend on it.

    Premisecitation

    Jin et al. 2008 proposed a new ranking algorithm applying linear interpolation of text similarity, temporal information, and page importance.

    “[Jin et al. 2008] proposed a new ranking algorithm to sort results by applying a linear interpolation of three factors: text similarity, temporal information, and page importance.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Jin et al. 2008 source
  • Probably not a substantial claim. The paper’s conclusions may not depend on it.

    Premisecitation

    Matthews et al. 2010 proposed Time Explorer, a timeline search tool.

    “[Matthews et al. 2010] proposed Time Explorer, a timeline search tool”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Matthews et al. 2010

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

  • Probably not a substantial claim. The paper’s conclusions may not depend on it.

    Premisecitation

    Alonso et al. 2009a outlined a prototype implementation as a web interface where users can explore results by clusters.

    “Another work [Alonso et al. 2009a] outlined a prototype implementation as a web interface where users can explore results by clusters returned in response to a query.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Alonso et al. 2009a

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

  • Probably not a substantial claim. The paper’s conclusions may not depend on it. It may state two separate claims as one.

    Premisecitation

    Dai and Davison 2010 estimated web page authority by determining variation of page and in-link freshness over time and incorporated this into T-Fresh.

    “[Dai and Davison 2010] estimated the web page authority by determining the variation of page and in-link freshness over time and incorporated this information into a temporal ranking probabilistic model called T-Fresh.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Dai and Davison 2010 source
  • Probably not a substantial claim. The paper may give no reason why it holds.

    Interpretationnone given

    Estimating the relevance of a document can greatly benefit from the introduction of temporal aspects into ranking models.

    “Estimating the relevance of a document can greatly benefit from the introduction of temporal aspects into ranking models.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim. The paper’s conclusions may not depend on it.

    Premisecitation

    Predicting the popularity of queries by time series analysis and periodicity estimation is more reliable than straightforwardly using information on past query popularity derived from web query logs.

    “Their results show that predicting the popularity of queries by time series analysis and periodicity estimation is more reliable than straightforwardly using information on past query popularity derived from web query logs.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Shokouhi and Radinsky 2012 source
  • It may state two separate claims as one.

    Premisecitation

    Alonso et al. 2009a and Campos et al. 2012b introduced the notion of temporal clusters, which can be used to associate each document with a given time span.

    “the works of [Alonso et al. 2009a] and [Campos et al. 2012b] introduced the notion of temporal clusters, which can also be used to associate each document with a given time span.”
    Quote in the paperNot a substantial claim0 of 2 sources checked
    • cites Alonso et al. 2009a

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

    • cites Campos et al. 2012b

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

  • Probably not a substantial claim. The paper’s conclusions may not depend on it.

    Premisecitation

    Jatowt et al. 2007 proposed using web archives to compare current and past versions of a web page to estimate approximate age of content elements.

    “[Jatowt et al. 2007] proposed using web archives to compare the content of the current version of a web page with its past versions in order to estimate approximate age of different content elements on the page.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Jatowt et al. 2007 source
  • Probably not a substantial claim. It may be too vague to check against evidence. The paper’s conclusions may not depend on it.

    Interpretationnone given

    The fact that the user has to specify a given time period naturally represents a shortcoming in terms of user experience.

    “Moreover, the fact that the user has to specify a given time period naturally represents a shortcoming in terms of the user experience.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim. The paper’s conclusions may not depend on it.

    Interpretationreasoning

    The validity of future-related information is a problem arising from the gap between the timestamp (e.g., creation time) and its reading time.

    “One problem is the validity of future-related information, which arises from the gap between the timestamp (e.g., creation time) and its reading time.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim. The paper’s conclusions may not depend on it.

    Premisecitation

    Pasca 2008 proposed a temporal question answering system which defines regular expressions to detect dates that meet certain requirements.

    “[Pasca 2008] proposed a temporal question answering system which defines regular expressions to detect dates that meet certain requirements.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Pasca 2008 source
  • Probably not a substantial claim. The paper’s conclusions may not depend on it.

    Interpretationreasoning

    The probability of one event may be dependent on the probabilities of other related events.

    “In other words, the probability of one event may be dependent on the probabilities of other related events.”
    Quote in the paperNot a substantial claim
    • Rests on an assumption: Events are not totally independent from one another.
  • Probably not a substantial claim. The paper’s conclusions may not depend on it.

    Premisecitation

    Kawai et al. 2010 proposed ChronoSeeker, an on-demand search engine.

    “[Kawai et al. 2010] proposed an on-demand search engine called ChronoSeeker”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Kawai et al. 2010 source
  • Probably not a substantial claim. The paper’s conclusions may not depend on it.

    Premisecitation

    Efron 2012 proposed survival analysis to incorporate recency information into document ranking.

    “[Efron 2012] proposed survival analysis 40 to incorporate recency information into document ranking”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Efron 2012

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

  • Probably not a substantial claim. The paper’s conclusions may not depend on it.

    Premisenone given

    This approach is usually used by traditional search engines such as Google, Yahoo, and Bing in news domains or with spike phenomena.

    “This approach is usually used by traditional search engines such as Google, Yahoo, and Bing in news domains or with spike phenomena”
    Quote in the paperNot a substantial claim
  • It may state two separate claims as one.

    Premisecitation

    Toyoda and Kitsuregawa 2006 and Nunes et al. 2007 used neighboring pages to estimate the document creation date or last-modified date.

    “Both used neighboring pages to estimate the document creation date or the last-modified date”
    Quote in the paperNot a substantial claim0 of 2 sources checked
    • cites Toyoda and Kitsuregawa 2006 source
    • cites Nunes et al. 2007 source
  • Probably not a substantial claim. It may be too vague to check against evidence. The paper’s conclusions may not depend on it. The paper may give no reason why it holds.

    Interpretationnone given

    Users will greatly benefit if a search engine system can explore the temporal information within web pages.

    “Obviously, users will greatly benefit if a search engine system can explore the temporal information within web pages.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim. The paper’s conclusions may not depend on it.

    Premisecitation

    Jatowt and Yeung 2011 proposed a clustering algorithm to detect future events based on information extracted from a reference text corpus.

    “[Jatowt and Yeung 2011] proposed a clustering algorithm to detect future events based on the information extracted from a reference text corpus.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Jatowt and Yeung 2011 source
  • Probably not a substantial claim. The paper’s conclusions may not depend on it. It may state two separate claims as one.

    Interpretationcitation

    The used documents must be timestamped and cover the time period of the queries.

    “In particular, the used documents must be timestamped and cover the time period of the queries.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim. The paper’s conclusions may not depend on it.

    Premisecitation

    Nunes et al. 2007 employed link structure analysis by considering three types of features: incoming links, outgoing links, and HTML src attributes.

    “[Nunes et al. 2007] employed link structure analysis by considering three types of features derived from the web, incoming links, outgoing links, and HTML src attributes”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Nunes et al. 2007 source
  • Probably not a substantial claim. The paper’s conclusions may not depend on it.

    Interpretationnone given

    A clear understanding of the query temporal nature offers search engines the chance to decide whether to return more historical or more recent information to provide the most relevant results.

    “A clear understanding of the query temporal nature offers search engines the chance to decide whether to return more historical or more recent information to provide the most relevant results.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim. The paper’s conclusions may not depend on it. The paper may give no reason why it holds.

    Interpretationreasoning

    This is particularly evident for implicit temporal queries.

    “This is particularly evident for implicit temporal queries”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim. The paper’s conclusions may not depend on it.

    Premisenone given

    A more elaborate mechanism gives users the possibility to specify a point-in-time or a temporal interval of their interest to filter out results outside that time period.

    “A more elaborate mechanism gives users the possibility to specify a point-in-time or a temporal interval of their interest to filter out results outside that time period.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim. The paper’s conclusions may not depend on it.

    Premisecitation

    Jin et al. 2008 introduced TISE, a temporal search engine that supports content time retrieval for Chinese web pages.

    “[Jin et al. 2008] introduced TISE, a temporal search engine that supports content time retrieval for Chinese web pages.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Jin et al. 2008 source
  • Probably not a substantial claim. The paper’s conclusions may not depend on it.

    Premisecitation

    Jatowt et al. 2009 introduced a clustering approach to summarize future-related information using text content, content dates, and timestamps of future predictions.

    “[Jatowt et al. 2009] introduced a clustering approach to summarize futurerelated information using text content, the content dates, and the timestamps of future predictions.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Jatowt et al. 2009 source
  • Probably not a substantial claim. The paper’s conclusions may not depend on it.

    Premisenone given

    Yahoo has been experimenting with basic temporal refinement in their web search engine to filter results by publication time.

    “Yahoo, on the other hand, has been experimenting with basic temporal refinement in their web search engine to filter results by the publication time of the document”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim. It may be too vague to check against evidence.

    Interpretationreasoning

    Text similarity cannot rely on words but rather on concepts.

    “showing that text similarity cannot rely on words but rather on concepts.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim. The paper’s conclusions may not depend on it. The paper may give no reason why it holds.

    Interpretationnone given

    A further problem is the difficulty of evaluating research proposals, since the community still lacks a gold standard to which most approaches can be compared.

    “A further problem is related to the difficulty of evaluating research proposals, since in many cases the community still lacks a gold standard to which most of the approaches can be compared.”
    Quote in the paperNot a substantial claim
    • Rests on an assumption: The community still lacks a gold standard to which most approaches can be compared.
  • Probably not a substantial claim. The paper’s conclusions may not depend on it.

    Interpretationnone given

    The availability of trustworthy temporal data allows posts to be arranged from the latest to the oldest.

    “An important aspect of this is the availability of trustworthy temporal data that allows posts to be arranged from the latest to the oldest.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim. The paper’s conclusions may not depend on it.

    Premisenone given

    Popular social networks like Facebook or Twitter include temporal evidence in their timelines and message posts.

    “Popular social networks like Facebook or Twitter also include temporal evidence in their timelines and message posts.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim. The paper’s conclusions may not depend on it.

    Premisenone given

    There is much research on using temporal information for exploration and search purposes.

    “There is also much research on using temporal information for exploration and search purposes.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim. The paper’s conclusions may not depend on it. The paper may give no reason why it holds.

    Premisenone given

    A temporal query can be used to obtain images of past or future objects.

    “A temporal query can be used to obtain images of past or future objects (e.g., car).”
    Quote in the paperNot a substantial claim
  • It may state two separate claims as one.

    Premisereasoning

    Both TempSum and KBA are constrained to the information on a given past event or entity and focus on a particular type of information, such as event attributes or event relations.

    “Both TempSum and KBA are constrained to the information on a given past event or entity and focus on a particular type of information, such as event attributes or event relations.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim. The paper’s conclusions may not depend on it.

    Interpretationreasoning

    Both subtasks of the TREC Temporal Summarization task have clear temporal characteristics because the discovered updates have to be timely and relevant.

    “Both subtasks have clear temporal characteristics because the discovered updates have to be timely and relevant.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim. The paper’s conclusions may not depend on it. The paper may give no reason why it holds.

    Premisenone given

    A relatively large research focus has been put on using temporal information for exploration and search purposes.

    “A relatively large research focus has been put on using temporal information for exploration and search purposes, as previously stated in Section 1.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim. The paper’s conclusions may not depend on it.

    Premisenone given

    Recent development of research projects addresses the archiving, the analysis, and the access to the temporal web.

    “Further evidence is the recent development of research projects that address the archiving, the analysis, and the access to the temporal web.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim. The paper’s conclusions may not depend on it.

    Interpretationreasoning

    The extraction of time references from Twitter messages can be a particularly difficult task mostly due to its informal communication style and short message length.

    “The extraction of time references from twitter messages, however, can be a particularly difficult task mostly due to its informal communication style nature and short message length (e.g.,”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim. The paper’s conclusions may not depend on it. The paper may give no reason why it holds.

    Interpretationnone given

    Similar to the Temporal Summarization Task, the recency of information is critical.

    “Similar to the Temporal Summarization Task, the recency of information is critical.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim. The paper may give no reason why it holds.

    Interpretationnone given

    In recent years, time has been gaining increased importance in information retrieval and in a large number of its sub-areas.

    “In recent years, time has been gaining increased importance in information retrieval and in a large number of its sub-areas.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim. The paper’s conclusions may not depend on it.

    Interpretationnone given

    Microblog collections pose new problems, mostly due to their short message length.

    “This new type of data poses, however, some new problems, mostly due to its short message length.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim. It may be too vague to check against evidence. The paper’s conclusions may not depend on it.

    Interpretationreasoning

    The highly dynamic characteristic of tweets can be better assessed to promote tweets with high informational value at given time points.

    “In this way, the highly dynamic characteristic of tweets can be better assessed to promote tweets with high informational value at given time points.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim. It may be too vague to check against evidence.

    Interpretationreasoning

    A number of significant advances must be made before search engines can entirely understand the temporality of a query and correctly reflect it in their returned results.

    “Thus, a number of significant advances must be made before search engines can entirely understand the temporality of a query and correctly reflect it in their returned results.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim. The paper’s conclusions may not depend on it.

    Premisenone given

    In the area of temporal IR and temporal information extraction, several research challenges have been proposed.

    “Likewise, in the area of temporal IR and temporal information extraction, several research challenges have been proposed.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim. The paper’s conclusions may not depend on it.

    Premisereasoning

    Research in information retrieval and extraction is often fostered through the availability of standardized, open test collections and the proposals of task challenges.

    “Research in information retrieval and extraction is often fostered through the availability of standardized, open test collections and the proposals of task challenges, thanks to which research communities can compare diverse approaches to the same problems.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim. It may be too vague to check against evidence.

    Interpretationreasoning

    This recent research trend is still without immediate or at least visible effects for average users since most of the researches developed so far have a rather specific scope.

    “Despite the growing importance of the area, this recent research trend is still without immediate or at least visible effects for average users since most of the researches developed so far have a rather specific scope.”
    Quote in the paperNot a substantial claim
    • Rests on an assumption: Most researches developed so far have a rather specific scope.
168 of 168
  • The paper relies on this without support.

    The area lacks a systematic arrangement of prior efforts and an overview of state-of-the-art approaches.

    “Despite significant advances, the area lacks a systematic arrangement of prior efforts and an overview of state-of-the-art approaches.”
  • The paper relies on this without support.

    An effective end-to-end temporal retrieval system that exploits temporal information to improve the quality of presented results remains undeveloped.

    “Moreover, an effective end-to-end temporal retrieval system that exploits temporal information to improve the quality of the presented results remain undeveloped.”
  • The paper relies on this without support.

    The value of information and its quality are intrinsically time-dependent.

    “The value of information and its quality are intrinsically time-dependent.”
  • The authors state this as an assumption.

    In web search scenarios, a document's reading time is the same as the time a search query was issued.

    “In web search scenarios, a document's reading time is assumed to be the same as the time a search query was issued since users often access search results immediately after performing a search.”
  • The paper relies on this without support.

    Events are not totally independent from one another.

    “Often events are not totally independent from one another.”
  • The paper relies on this without support.

    Newer information is more reliable than old information.

    “In addition, paying attention to the timestamp of predictions is critical because newer information is more reliable than old information.”
  • The paper relies on this without support.

    Microblog collections like tweets or Facebook posts usually include temporal information.

    “Also important is the emergence of microblog collections, like tweets or Facebook posts that usually include temporal information.”
  • The paper relies on this without support.

    Documents are full of temporal expressions and many have strong temporal characteristics.

    “However, despite the fact that documents are full of temporal expressions and many have strong temporal characteristics, current IR systems still do not sufficiently exploit this information.”
  • The paper relies on this without support.

    Traditional IR systems continue to treat temporal expressions as normal text terms.

    “As an example, when a user's information quest includes temporal aspects, traditional IR systems may fail because they continue to treat temporal expressions as normal text terms.”
  • The paper relies on this without support.

    Most researches developed so far have a rather specific scope.

    “Despite the growing importance of the area, this recent research trend is still without immediate or at least visible effects for average users since most of the researches developed so far have a rather specific scope.”
  • The paper relies on this without support.

    The community still lacks a gold standard to which most approaches can be compared.

    “A further problem is related to the difficulty of evaluating research proposals, since in many cases the community still lacks a gold standard to which most of the approaches can be compared.”
  • The paper relies on this without support.

    Image retrieval queries may sometimes have an explicit or implicit temporal intent.

    “Like in document retrieval, image retrieval queries may sometimes have an explicit or implicit temporal intent.”
  • The paper relies on this without support.

    In unstructured collections such as the web, many images do not contain explicit metadata that can be easily retrieved.

    “However, in unstructured collections such as the web, many images do not contain explicit metadata that can be easily retrieved.”
  • The paper relies on this without support.

    Predicting a query's temporal intent is a critical step to decide appropriate ranking.

    “Predicting a query's temporal intent is a critical step to decide appropriate ranking.”
14 of 14

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

Each contradiction between two passages listed here was confirmed by an independent check.

  • Section 4.2 names different preprocessing steps from Section 2.5

    Minor

    Section 4.2 says Section 2.5 already described tokenization, stopping, stemming, and information extraction. Section 2.5 instead lists tokenization, sentence extraction, part-of-speech tagging, and named-entity recognition as its four preprocessing steps.

  • YAGO2 citation year differs from its reference

    Minor

    The text cites the Hoffart et al. YAGO2 work as 2011, but the matching YAGO2 entry in the references is dated 2013.

  • Reinanda citation year differs from its reference

    Minor

    The text cites Reinanda et al. as 2013, while the listed reference for Reinanda et al. is dated 2012.

3 of 3

Citations

Cites

Flagged first, then by citations

7 of the 166 references couldn’t be matched to a known paper.

Research works printed but not linked: 19

  1. Advanced Research Projects Agency . 1993 . Software and intelligent systems technology office . In Proceedings of the 5th Conference on Message Understanding. Morgan Kaufmann. Advanced Research Projects Agency. 1993. Software and intelligent systems technology office. In Proceedings of the 5th Conference on Message Understanding. Morgan Kaufmann.
  2. O. Alonso , R. Baeza-Yates , and M. Gertz . 2007a. Exploratory search using timelines . In Proceedings of the Workshop on Exploratory Search and Computer Human Interaction Associated to CHI'07: SIGCHI. ACM. O. Alonso, R. Baeza-Yates, and M. Gertz. 2007a. Exploratory search using timelines. In Proceedings of the Workshop on Exploratory Search and Computer Human Interaction Associated to CHI'07: SIGCHI. ACM.
  3. O. Alonso , R. Baeza-Yates , and M. Gertz . 2009b. Effectiveness of temporal snippets . In Proceedings of the WSRSP'09 Workshop associated to WWW'09 . ACM. O. Alonso, R. Baeza-Yates, and M. Gertz. 2009b. Effectiveness of temporal snippets. In Proceedings of the WSRSP'09 Workshop associated to WWW'09. ACM.
  4. R. Baeza-Yates . 2005 . Searching the future . In Proceedings of the Mathematical/Formal Methods in Information Retrieval Workshop Associated to SIGIR'05 . ACM. R. Baeza-Yates. 2005. Searching the future. In Proceedings of the Mathematical/Formal Methods in Information Retrieval Workshop Associated to SIGIR'05. ACM.
  5. K. Bollacker , P. Tufts , T. Pierce , and R. Cook . 2007. A platform for scalable, collaborative, structured information integration . In Proceedings of the IIWeb'07 Workshop Associated to AAAI'07 . AAAI Press, 22--27. K. Bollacker, P. Tufts, T. Pierce, and R. Cook. 2007. A platform for scalable, collaborative, structured information integration. In Proceedings of the IIWeb'07 Workshop Associated to AAAI'07. AAAI Press, 22--27.
  6. 10.5555/297805.297827 · DOI
  7. H. Cunningham , D. Maynard , K. Bontcheva , and V. Tablan . 2002. GATE: A framework and graphical development environment for robust NLP tools and applications . In Proceedings of ACL'02 . Association for Computational Linguistics, 168--175. H. Cunningham, D. Maynard, K. Bontcheva, and V. Tablan. 2002. GATE: A framework and graphical development environment for robust NLP tools and applications. In Proceedings of ACL'02. Association for Computational Linguistics, 168--175.
  8. M. Efron . 2012 . Query-specific recency ranking: Survival analysis for improved microblog retrieval . In Proceedings of the TAIA'12 Workshop associated to SIGIR'12 . M. Efron. 2012. Query-specific recency ranking: Survival analysis for improved microblog retrieval. In Proceedings of the TAIA'12 Workshop associated to SIGIR'12.
  9. N. Kanhabua , C. Niederee , and W. Siberski . 2013. Towards concise preservation by managed forgetting: Research issues and case study . In Proceedings of the iPRES'13 . N. Kanhabua, C. Niederee, and W. Siberski. 2013. Towards concise preservation by managed forgetting: Research issues and case study. In Proceedings of the iPRES'13.
  10. H. Li , G. Xu , W. B. Croft , M. Bendersky , Z. Wang , and E. Viegas . 2012. A public dataset for promoting query representation and understanding research . In Proceedings of the WSCD'12 . H. Li, G. Xu, W. B. Croft, M. Bendersky, Z. Wang, and E. Viegas. 2012. A public dataset for promoting query representation and understanding research. In Proceedings of the WSCD'12.
  11. M. Matthews , P. Tolchinsky , R. Blanco , J. Atserias , P. Mika , and H. Zaragoza . 2010. Searching through time in the New York Times . In Proceedings of the HCIR'10 Workshop. 41--44 . M. Matthews, P. Tolchinsky, R. Blanco, J. Atserias, P. Mika, and H. Zaragoza. 2010. Searching through time in the New York Times. In Proceedings of the HCIR'10 Workshop. 41--44.
  12. 10.1002/asi.v58:13 · DOI
  13. S. Nunes , C. Ribeiro , and G. David . 2008. Use of temporal expressions in web search . In Proceedings of the ECIR'08 . Springer-Verlag. 580--584. S. Nunes, C. Ribeiro, and G. David. 2008. Use of temporal expressions in web search. In Proceedings of the ECIR'08. Springer-Verlag. 580--584.
  14. D. Odijk , G. Santucci , M. de Rijke , M. Angelini , and G. Granato . 2012. Exploring word meaning through time . In Proceedings of the TAIA'12 Workshop Associated to SIGIR'12 . D. Odijk, G. Santucci, M. de Rijke, M. Angelini, and G. Granato. 2012. Exploring word meaning through time. In Proceedings of the TAIA'12 Workshop Associated to SIGIR'12.
  15. M. Osborne , S. Petrovic , R. McCreadie , C. Macdonald , and I. Ounis . 2012. Bieber no more: First story detection using Twitter and Wikipedia . In Proceedings of the TAIA'12 Workshop Associated to SIGIR'12 . M. Osborne, S. Petrovic, R. McCreadie, C. Macdonald, and I. Ounis. 2012. Bieber no more: First story detection using Twitter and Wikipedia. In Proceedings of the TAIA'12 Workshop Associated to SIGIR'12.
  16. J. Pustejovsky , M. Verhagen , R. Sauri , J. Littman , R. J. Gaizauskas , G. Katz , I. Mani , R. Knippen , and A. Setzer . 2006. TimeBank 1.2 . In Proceedings of the Linguistic Data Consortium. J. Pustejovsky, M. Verhagen, R. Sauri, J. Littman, R. J. Gaizauskas, G. Katz, I. Mani, R. Knippen, and A. Setzer. 2006. TimeBank 1.2. In Proceedings of the Linguistic Data Consortium.
  17. B. Shaparenko , R. Caruana , J. Gehrke , and T. Joachims . 2005. Identifying temporal patterns and key players in document collections . In Proceedings of the TDM'05 Workshop Associated to ICDM'05 . IEEE Computer Society Press, 165--174. B. Shaparenko, R. Caruana, J. Gehrke, and T. Joachims. 2005. Identifying temporal patterns and key players in document collections. In Proceedings of the TDM'05 Workshop Associated to ICDM'05. IEEE Computer Society Press, 165--174.
  18. 10.1145/318898.318921 · DOI
  19. 10.5555/1620853.1620899 · DOI

Cited by

Sorted by citations

Metadata

Authors
Campos, R., Dias, G., Jorge, A. M., & Jatowt, A.
Affiliations
  • University of Beira Interior (PT)
  • GREYC (FR)
  • LIAAD -- INESC TEC, DCC-FCUP, University of Porto, Porto, Portugal
  • Kyoto University (JP)
Venue
ACM Computing Surveys
Published
2014-08-25
Volume
47
Issue
2
Pages
1-41
ISSN
  • 0360-0300 (ISSN-L)
  • 1557-7341
OpenAlex
W2039297031
Cited by
262
References
166
Citations by year
2026: 16 · 2025: 12 · 2024: 30 · 2023: 17 · 2022: 12 · 2021: 23 · 2020: 16 · 2019: 21 · 2018: 25 · 2017: 35 · 2016: 38 · 2015: 15 · 2014: 2
FWCI
51.88
Type
journal article
Language
en
Open access
Locations
  • ACM Computing Surveys (publishedVersion)
  • Portuguese National Funding Agency for Science, Research and Technology (RCAAP Project by FCT) (submittedVersion, other-oa)
  • HAL (submittedVersion)
Funders
  • European Regional Development Fund (ERDF)
  • Center of Mathematics, University of Beira Interior, within project PEst-OE/MAT/UI0212/2014
  • Project NORTE-07-0124-FEDER-000059
  • JST research promotion program Presto
  • National Strategic Reference Framework (NSRF)
  • MEXT Grant-in-Aid for Young Scientists B (#22700096)
  • North Portugal Regional Operational Programme (ON.2 -- O Novo Norte)
  • National Funds through the FCT within project FCOMP-01-0124-FEDER-037281
  • Portuguese funding agency (FCT)
  • ERDF through the COMPETE Programme (operational programme for competitiveness)
Topics
  • Physical Sciences › Computer Science › Information Systems › Information Retrieval and Search Behavior
  • Physical Sciences › Mathematics › Theoretical Computer Science › Algorithms and Data Compression
  • Physical Sciences › Computer Science › Artificial Intelligence › Topic Modeling
Keywords
temporal information retrieval, temporal queries, research categorization

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

A language model drew the claims from the paper on 2026-11-09, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).

A second model labelled each claim on 2026-11-09 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).

Cited sources are checked with a language model’s help (gpt-6-sol).

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review