Cited by 74Stock Market Forecasting MethodsFinancial Markets and Investment StrategiesFinancial Analysis and Corporate Governance

A Multimodal Foundation Agent for Financial Trading: Tool-Augmented, Diversified, and Generalist

Open access
Zhang, Wentao, Zhao, Lingxuan, Xia, Haochong, Sun, Shuo, Sun, Jiaze, Qin, Molei, Li, Xinyi, Zhao, Yuqing +5 more·2024·Proceedings of the 30th ACM SIGKDD Conference on Knowledge Discovery and Data Mining

Abstract

Financial trading is a crucial component of the markets, informed by a multimodal information landscape encompassing news, prices, and Kline charts, and encompasses diverse tasks such as quantitative trading and high-frequency trading with various assets. While advanced AI techniques like deep learning and reinforcement learning are extensively utilized in finance, their application in financial trading tasks often faces challenges due to inadequate handling of multimodal data and limited generalizability across various tasks. To address these challenges, we present FinAgent, a multimodal foundational agent with tool augmentation for financial trading. FinAgent's market intelligence module processes a diverse range of data-numerical, textual, and visual-to accurately analyze the financial market. Its unique dual-level reflection module not only enables rapid adaptation to market dynamics but also incorporates a diversified memory retrieval system, enhancing the agent's ability to learn from historical data and improve decision-making processes. The agent's emphasis on reasoning for actions fosters trust in its financial decisions. Moreover, FinAgent integrates established trading strategies and expert insights, ensuring that its trading approaches are both data-driven and rooted in sound financial principles. With comprehensive experiments on 6 financial datasets, including stocks and Crypto, FinAgent significantly outperforms 12 state-of-the-art baselines in terms of 6 financial metrics with over 36% average improvement on profit. Specifically, a 92.27% return (a 84.39% relative improvement) is achieved on one dataset. Notably, FinAgent is the first advanced multimodal foundation agent designed for financial trading tasks.

Integrity signals

Registry

Crossref · 10.1145/3637528.3671801

Cites

57 of 57 references verified0 citation errors · 0 not checkable

Statistics

Nothing to recompute.

Claims the paper makes

3 of 7 cited sources checked · 1 supported · 0 flagged · accuracy not yet measured

  • Premisecitation

    The full capabilities of LLMs as comprehensive autonomous trading systems remain underexplored, particularly in their ability to interpret multimodal data and utilize diverse tools.

    “Although FinMEM [56] is an LLM trading agent with a humanaligned memory mechanism and character design, the full capabilities of LLMs as comprehensive autonomous trading systems remain underexplored, particularly in their ability to interpret multimodal data and utilize diverse tools.”
    Quote in the paperSubstantial claim1 of 1 sources checked
    • cites [56] 56. Yangyang Yu, Haohang Li, Zhi Chen, Yuechen Jiang, Yang Li, Denghui Zhang, Rong Liu, Jordan W. Suchow, and Khaldoun Khashanah. 2023. FinMem: A performance-enhanced LLM trading agent with layered memory and character design. arXiv:2311.13743 [q-fin.CP] source

      The Introduction and §2.2 discuss multimodal LLM agents, visual interpretation, and tool use in smartphone and other non-trading tasks. Our copy does not address whether comprehensive autonomous trading systems remain underexplored; searches for trading, financial markets, and that specific research gap found no relevant passage. (LLM, conf=0.76)

      Experimental — accuracy not yet measured
  • Findingown data

    FinAgent achieves a 92.27% return (a 84.39% relative improvement) on one dataset.

    “Specifically, a 92.27% return (a 84.39% relative improvement) is achieved on one dataset.”
    • Also stated in: § Data · plain
      “Specifically, a 92.27% return (a 84.39% relative improvement) is achieved on one dataset.”
    Quote in the paperNot a substantial claim
  • Findingown data

    The improvement from high-level reflection comes with a 7% rise in MDD% for TSLA.

    “This improvement comes with a minor trade-off: a slight 7% rise in MDD% for TSLA.”
    Quote in the paperNot a substantial claim
  • Findingown data

    Across all datasets, FinAgent is the only method that consistently outperforms the broader market in terms of profitability.

    “Across all datasets, FinAgent is the only method that consistently outperforms the broader market in terms of profitability.”
    Quote in the paperSubstantial claim
  • Findingown data

    FinAgent's performance surpasses other methods regarding cumulative returns, particularly on the TSLA dataset.

    “Figure 4 illustrates that FinAgent's performance surpasses other methods regarding cumulative returns, particularly on the TSLA dataset.”
    Quote in the paperSubstantial claim
  • Classified as probably not a substantial claim. 27
  • May combine two claims. 24
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation

    LLMs have demonstrated remarkable capabilities in analyzing and interpreting financial data, as evidenced by developments like BloombergGPT and FinGPT.

    “LLMs have demonstrated remarkable capabilities in analyzing and interpreting financial data, as evidenced by developments like BloombergGPT [48], and FinGPT [50].”
    Quote in the paperNot a substantial claim1 of 2 sources checked
    • cites [48] 48. Shijie Wu, Ozan Irsoy, Steven Lu, Vadim Dabravolski, Mark Dredze, Sebas- tian Gehrmann, Prabhanjan Kambadur, David Rosenberg, and Gideon Mann. 2023. Bloomberggpt: A large language model for finance. arXiv preprint arXiv:2303.17564 (2023).
    • cites [50] 50. Hongyang Yang, Xiao-Yang Liu, and Christina Dan Wang. 2023. FinGPT: Open- Source Financial Large Language Models. arXiv preprint arXiv:2306.06031 (2023). source
  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Premisecitation

    FinMEM is an LLM trading agent with a human-aligned memory mechanism and character design.

    “Although FinMEM [56] is an LLM trading agent with a humanaligned memory mechanism and character design, the full capabilities of LLMs as comprehensive autonomous trading systems remain underexplored, particularly in their ability to interpret multimodal data and utilize diverse tools.”
    Quote in the paperNot a substantial claim1 of 1 sources checked
    • cites [56] 56. Yangyang Yu, Haohang Li, Zhi Chen, Yuechen Jiang, Yang Li, Denghui Zhang, Rong Liu, Jordan W. Suchow, and Khaldoun Khashanah. 2023. FinMem: A performance-enhanced LLM trading agent with layered memory and character design. arXiv:2311.13743 [q-fin.CP] source

      Section 2.2 discusses LLM agents generally, while Section 3.2 describes an agent that operates smartphone apps. Searches for FinMEM, trading, and the claimed memory mechanism and character design found no passage addressing the claim in our copy. (LLM, conf=0.76)

      Experimental — accuracy not yet measured
  • May combine two claims.

    Findingown data

    FinAgent significantly outperforms 12 state-of-the-art baselines on 6 financial datasets (including stocks and Crypto) across 6 financial metrics, with over 36% average improvement on profit.

    “With comprehensive experiments on 6 financial datasets, including stocks and Crypto, FinAgent significantly outperforms 12 state-of-the-art baselines in terms of 6 financial metrics with over 36% average improvement on profit.”
    • Also stated in: § Data · plain
      “With comprehensive experiments on 6 financial datasets, including stocks and Crypto, FinAgent significantly outperforms 12 stateof-the-art baselines in terms of 6 financial metrics with over 36% average improvement on profit.”
    Quote in the paperSubstantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Findingown data

    The dataset includes 398 days of asset price data with open, high, low, close, and adjusted close.

    “Asset Price | | 398 × (open, high, low, close, adj_close)”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Findingown data

    The dataset includes 398 days of visual data with Kline Chart and Trading Chart.

    “Visual Data | | 398 × (Kline Chart, Trading Chart)”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Findingreasoning

    By taking a short position, FinAgent hedged against potential trading losses and generated high returns.

    “By taking a short position, it can effectively hedge against potential trading losses and generate high returns.”
    Quote in the paperSubstantial claim
  • May combine two claims.

    Findingown data

    LLM extracted embeddings show a clear distinction between different retrieval types, proving the effectiveness of diversified retrieval.

    “We perform t-SNE visualization of its LLM extracted embedding, and we can find that the LLM extracted embedding has a clear distinction between different retrieval types, which proves the effectiveness of our method.”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Findingown data

    Adding low-level reflection to M+ML increases ARR% by 45% to 101% for TSLA and ETHUSD, and cuts risk by 14% to 44%.

    “When compared to using solely M and ML, the integration of the low-level reflection module leads to an impressive increase in ARR% by 45% to 101% for TSLA, and ETHUSD, and cutting risk by 14% to 44%.”
    Quote in the paperSubstantial claim
  • May combine two claims.

    Findingown data

    The solely T method has 16% ARR% versus B&H's 29% ARR% in ETHUSD.

    “As shown in Table 4 and Table 5, the 16% ARR% for solely T method starkly contrasts with the 29% ARR% of B&H in ETHUSD, highlighting the inefficacy of the stock-specific rule-based methods for cryptocurrencies and demonstrating that introducing to FinAgent significantly affects performance.”
    Quote in the paperSubstantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Findingown data

    Employing a generalized auxiliary agent for cryptocurrency could potentially increase returns to 54%, compared to the current 44%.

    “Further insights from the ablation study section for FinAgent reveal that employing a generalized auxiliary agent for cryptocurrency could potentially increase returns to 54%, compared to the current 44%.”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Findingown data

    FinAgent significantly outperforms existing baselines in profitability, setting a new benchmark in the field.

    “Table 4 and Figure 4 demonstrate our method significantly outperforms existing baselines, especially remarkable improvements in profitability, and setting a new benchmark in the field.”
    Quote in the paperSubstantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Findingown data

    The dataset covers 398 trading days from 2022-06-01 to 2024-01-01.

    “Trading Date | From 2022-06-01 to 2024-01-01 (398 trading days)”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Findingown data

    On the TSLA dataset, FinAgent achieves 84% and 118% improvement in ARR% and SR, respectively, over baselines.

    “Notably, its performance on the TSLA dataset stands out even more, achieving 84% and 118% improvement, significantly outperforming all other baselines.”
    Quote in the paperSubstantial claim
  • May combine two claims.

    Findingown data

    Adding high-level reflection to ML significantly enhances ARR% and SR and reduces risk.

    “When comparing the ML and MLH, the addition of the high-level reflection module significantly enhances the ARR% and SR, while notably reducing risk.”
    Quote in the paperSubstantial claim
  • May combine two claims.

    Findingown data

    On the five stocks, FinAgent's ARR% and SR improvements are at least 10% and 19% over the best-performing baseline, respectively.

    “FinAgent's performance on the five stocks, as measured by ARR% and SR, with enhancements of at least 10% and 19%, compared to the best-performing baseline, respectively.”
    Quote in the paperSubstantial claim
  • May combine two claims.

    Findingown data

    FinMem's ARR% on the AMZN dataset is 40%, underperforming the market's Buy & Hold (B&H) strategy at 42%.

    “In contrast, FinMem falls short on the AMZN dataset, where its ARR% is 40%, underperforming the market's Buy & Hold (B&H) strategy at 42%.”
    Quote in the paperSubstantial claim
  • May combine two claims.

    Findingreasoning

    Rule-based methods are optimal in controlling risk but not outstanding in capturing returns.

    “We can also observe that rule-based methods are optimal in controlling risk, but not outstanding in capturing returns.”
    Quote in the paperSubstantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing), S4 (based).

    Interpretationnone given

    FinAgent is the first advanced multimodal foundation agent designed for financial trading tasks.

    “Notably, FinAgent is the first advanced multimodal foundation agent designed for financial trading tasks.”
    • Also stated in: § Data · plain
      “Notably, FinAgent is the first advanced multimodal foundation agent designed for financial trading tasks.”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Interpretationreasoning

    FinAgent effectively identifies correlations between current market conditions and past market patterns and trends and integrates market information to make final and effective decisions.

    “With its multi-perspective and diverse retrieval approach, FinAgent effectively identifies correlations between current market conditions and past market patterns and trends and integrates market information to make final and effective decisions.”
    Quote in the paperSubstantial claim
  • Classified as probably not a substantial claim. May combine two claims.

    Interpretationreasoning

    FinAgent's high-level reflection module assesses each trading decision's correctness and recommends improvements or corrective actions.

    “The initial phase assesses each trading decision's correctness, identifying successes and mistakes.Subsequently, the module recommends improvements or corrective actions tailored to each identified mistake or success, fostering a continuous learning process.”
    Quote in the paperSubstantial claim
  • Probably not a substantial claim: may not pass S4 (based).

    Interpretationnone given

    FinAgent's dual-level reflection module incorporates a diversified memory retrieval system that enhances the agent's ability to learn from historical data and improve decision-making.

    “Its unique dual-level reflection module not only enables rapid adaptation to market dynamics but also incorporates a diversified memory retrieval system, enhancing the agent's ability to learn from historical data and improve decision-making processes.”
    Quote in the paperNot a substantial claim
    • Rests on an assumption: Imprecise information retrieval is a challenge for financial trading.
  • Classified as probably not a substantial claim. May combine two claims.

    Interpretationreasoning

    Rule-based methods are robust to outliers and noise in the data, reducing decision risk.

    “This is because rule-based model methods are robust to outliers and noise in the data and thus can reduce decision risk.”
    Quote in the paperSubstantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Interpretationreasoning

    FinAgent's low-level reflection module generates detailed analysis for short-term, medium-term, and long-term perspectives.

    “After taking in the price change data, the module generates detailed analysis for varying temporal horizons, spanning shortterm, medium-term to long-term perspectives.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing), S4 (based).

    Interpretationnone given

    FinAgent's low-level reflection module establishes the inherent correlation between market intelligence and price changes.

    “The low-level reflection module ( §4.3) establishes the inherent correlation between market intelligence and price changes.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S4 (based).

    Interpretationnone given

    FinAgent's dual-level reflection module enables rapid adaptation to market dynamics.

    “Its unique dual-level reflection module not only enables rapid adaptation to market dynamics but also incorporates a diversified memory retrieval system, enhancing the agent's ability to learn from historical data and improve decision-making processes.”
    Quote in the paperNot a substantial claim
    • Rests on an assumption: Adaptability in rapidly evolving markets is a challenge for financial trading.
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Interpretationreasoning

    FinAgent's high-level reflection module reflects on market conditions, price changes, and past trading decisions to derive insights and identify potential improvements in profitability.

    “And the high-level reflection module ( §4.3) involves reflecting on market conditions, price changes, and other factors in the context of outcomes from past trading decisions, which aims to derive insights from previous experiences and identify potential improvement in profitability by assessing the efficacy of historical decisions and offering recommendations for future decision-making processes.”
    Quote in the paperNot a substantial claim
  • Classified as probably not a substantial claim.

    Interpretationreasoning

    FinAgent's diversified memory retrieval system separates trading and retrieval tasks to enhance focus on their specific functions and minimize noise in results.

    “FinAgent introduces a diversified memory retrieval system for the market intelligence and reflection modules, separating trading and retrieval tasks to enhance focus on their specific functions and minimize noise in the results (Ch3).”
    Quote in the paperSubstantial claim
    • Rests on an assumption: Imprecise information retrieval is a challenge for financial trading.
  • May combine two claims.

    Premisecitation

    Reinforcement learning-based systems demonstrate enhanced adaptability but encounter substantial obstacles, such as the need for extensive training data and the inexplainability of decision-making processes.

    “Reinforcement learningbased systems [2] demonstrate enhanced adaptability but encounter substantial obstacles, such as the need for extensive training data and the inexplainability of decision-making processes.”
    Quote in the paperSubstantial claim0 of 1 sources checked
    • cites [2] 2. Bo An, Shuo Sun, and Rundong Wang. 2022. Deep reinforcement learning for quantitative trading: Challenges and opportunities. IEEE Intelligent Systems 37, 2 (2022), 23-26. source
  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Interpretationnone given

    FinAgent generates summaries for trading tasks and provides query fields for retrieval tasks, with query texts including different retrieval types tailored for focused retrieval.

    “We not only generate summaries for trading tasks but also provide query fields for retrieval tasks.These query texts include different retrieval types, tailored to enable focused retrieval of specific types of information.”
    Quote in the paperNot a substantial claim
    • Rests on an assumption: Imprecise information retrieval is a challenge for financial trading.
  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Premisecitation

    FMP API provides data about stock historical price and news, company financial statements, and cryptocurrencies.

    “FMP API provides data about stock historical price and news, company financial statements, and cryptocurrencies.Entry is https://site.financialmodelingprep.com.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites https://site.financialmodelingprep.com

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

  • May combine two claims.

    Interpretationreasoning

    FinAgent has superior stability and robustness compared to other baselines.

    “This underscores the superior stability and robustness of FinAgent compared to other baselines.”
    Quote in the paperSubstantial claim
  • Classified as probably not a substantial claim.

    Interpretationreasoning

    FinAgent's tool-augmented decision-making module integrates information, augmented tools, and trader preferences to make final investment decisions with comprehensive analysis.

    “The tool-augmented decision-making module ( §4.4) integrates the aforementioned information, along with augmented tools and trader preferences, to make final investment decisions with a comprehensive analysis.”
    Quote in the paperSubstantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing), S4 (based). May combine two claims.

    Interpretationnone given

    FinAgent integrates established trading strategies and expert insights, ensuring its trading approaches are data-driven and rooted in sound financial principles.

    “Moreover, FinAgent integrates established trading strategies and expert insights, ensuring that its trading approaches are both data-driven and rooted in sound financial principles.”
    Quote in the paperNot a substantial claim
    • Rests on an assumption: Integration of domain knowledge is a challenge for financial trading.
  • May combine two claims.

    Interpretationnone given

    FinAgent exhibits high reasoning ability and generalizability.

    “This paper introduces FinAgent, a financial trading agent powered by LLM that exhibits high reasoning ability and generalizability.”
    Quote in the paperNot a substantial claim
    • Rests on an assumption: The selected five stocks and Ethereum are representative of diverse financial environments and provide a robust basis for assessing FinAgent's generalization capabilities.
  • Classified as probably not a substantial claim.

    Study design and conductnone given

    All benchmarks are conducted within the same RL environment for both training and evaluation to ensure equitable comparison.

    “To ensure equitable comparison, all benchmarks are conducted within the same RL environment for both training and evaluation.”
    Quote in the paperSubstantial claim
  • Classified as probably not a substantial claim.

    Interpretationnone given

    FinAgent's market intelligence module processes multimodal data to provide precise analysis of financial market trends, offering insights for future trading tasks.

    “Specifically, FinAgent's market intelligence module processes multimodal data, such as numerical, textual, and visual, to provide precise analysis of financial market trends, offering insights for future trading tasks (Ch1).”
    Quote in the paperSubstantial claim
    • Rests on an assumption: Insufficient multimodal data processing ability is a challenge for financial trading.
  • Classified as probably not a substantial claim.

    Interpretationreasoning

    The risk compromise relates to the chosen investor preference of an aggressive trader.

    “This result relates to our chosen investor preference of an aggressive trader.”
    Quote in the paperSubstantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Interpretationnone given

    FinAgent's memory module supports the market intelligence, low-level reflection, and high-level reflection modules by offering storage capabilities and vector retrieve functions.

    “The primary role of the memory module ( §4.2) is to support the aforementioned three modules by offering storage capabilities and vector retrieve functions.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S4 (based). May combine two claims.

    Interpretationnone given

    FinAgent's dual-level reflection module is capable of rapidly adapting to market dynamics and enhancing the agent's ability to learn from historical data and improve its decision-making process.

    “A uniquely designed dual-level reflection module is developed, capable of not only rapidly adapting to market dynamics but also enhancing the agent's ability to learn from historical data and improve its decision-making process (Ch2).”
    Quote in the paperNot a substantial claim
    • Rests on an assumption: Adaptability in rapidly evolving markets is a challenge for financial trading.
  • Probably not a substantial claim: may not pass S4 (based).

    Interpretationnone given

    FinAgent's market intelligence module processes numerical, textual, and visual data to accurately analyze the financial market.

    “FinAgent's market intelligence module processes a diverse range of data-numerical, textual, and visual-to accurately analyze the financial market.”
    Quote in the paperNot a substantial claim
    • Rests on an assumption: Insufficient multimodal data processing ability is a challenge for financial trading.
  • Classified as probably not a substantial claim. May combine two claims.

    Study design and conductnone given

    Past and future asset price increases and decreases are visible during training, but only past trends are visible during testing to prevent data leakage.

    “It is important to note that past and future asset price increases and decreases are visible during the training phase, but only past trends are visible during the testing phase to prevent data leakage.”
    Quote in the paperSubstantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Interpretationnone given

    FinAgent's dual-level reflection module combines low-level reflection that analyzes market price movement for insights and high-level reflection that assesses past trading decisions for improvement.

    “Our duel-level reflection module combines a low-level reflection that analyzes market price movement for insights, while the highlevel reflection assesses past trading decisions for improvement, emulating the learning process in decision-making.”
    Quote in the paperNot a substantial claim
    • Rests on an assumption: Adaptability in rapidly evolving markets is a challenge for financial trading.
42 of 42
  • The paper relies on this without support.

    Advanced AI techniques in financial trading often face challenges due to inadequate handling of multimodal data and limited generalizability across various tasks.

    “While advanced AI techniques like deep learning and reinforcement learning are extensively utilized in finance, their application in financial trading tasks often faces challenges due to inadequate handling of multimodal data and limited generalizability across various tasks.”
  • The paper relies on this without support.

    Rule-based trading systems are rigid and struggle to adapt to market volatility, often resulting in underperformance in evolving markets.

    “Rule-based trading systems are rigid and struggle to adapt to market volatility, often resulting in underperformance in evolving markets.”
  • The paper relies on this without support.

    Reinforcement learning-based systems struggle with generalizing across diverse market conditions, are sensitive to market noise, and often fail to integrate multimodal market intelligence like news and reports into their analysis.

    “Additionally, they struggle with generalizing across diverse market conditions, are sensitive to market noise, and often fail to integrate multimodal market intelligence like news and reports into their analysis.”
  • The paper relies on this without support.

    There is a natural gap between QA tasks and sequential decision-making in trading.

    “However, there is a natural gap between QA tasks and sequential decision-making in trading.”
  • The paper relies on this without support.

    Insufficient multimodal data processing ability is a challenge for financial trading.

    “• Ch1: Insufficient Multimodal Data Processing Ability.Processing numerical, textual, and visual market intelligence data significantly requires advanced analytical methods to extract key insights and predict market trends.”
  • The paper relies on this without support.

    Imprecise information retrieval is a challenge for financial trading.

    “• Ch2: Imprecise information retrieval.Mixing retrieval with main tasks and relying on brief summaries causes imprecise searches, introducing irrelevant data and reducing performance.”
  • The paper relies on this without support.

    Adaptability in rapidly evolving markets is a challenge for financial trading.

    “• Ch3: Adaptability in Rapidly Evolving Markets.Financial trading requires the ability to quickly adapt to fluctuating market conditions.Traditional methods often fall short, highlighting the necessity for models capable of responding to real-time data and adjusting strategies according to historical market trends.”
  • The paper relies on this without support.

    Integration of domain knowledge is a challenge for financial trading.

    “• Ch4: Integration of Domain Knowledge.Current models often struggle to integrate established methods such as expert guidance and advanced trading tools effectively, leading to a decline in both the effectiveness and depth of market analysis.”
  • The paper relies on this without support.

    Reasoning for actions is a challenge for financial trading.

    “• Ch5.Reasoning for Actions.The black-box nature of many sophisticated AI models, directly giving results of decisions without providing the reasoning process.”
  • The paper relies on this without support.

    High returns often come with high risks.

    “It is worth noting that high returns often come with high risks.”
  • The paper relies on this without support.

    Cryptocurrencies have higher trading frequency than stocks.

    “not for cryptocurrencies with higher trading frequency.”
  • The paper relies on this without support.

    The selected five stocks and Ethereum are representative of diverse financial environments and provide a robust basis for assessing FinAgent's generalization capabilities.

    “Chosen for their extensive news coverage and representation of different market sectors, these data provide a robust basis for assessing FinAgent's generalization capabilities across diverse financial environments.”
  • The paper relies on this without support.

    Market intelligence can be categorized as positive, negative, or neutral based on its impact on market perceptions and potential outcomes.

    “Market intelligence can be categorized as positive, negative, or neutral based on its impact on market perceptions and potential outcomes.”
  • The paper relies on this without support.

    Some news articles report the percentage increase or decrease in a company's stock price after an event occurs.

    “Some news will detail the percentage increase or decrease in a company's stock price after some event occurs.”
14 of 14

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

  • In [31, 53, 57], rule based strategies such as 'Buy and Hold', 'Mean Reversion' and 'ShortTerm Reversal' are used as baseline.

    “In [31, 53, 57], rule based strategy such as”

    From Large Language Model Agent in Financial Trading: A Survey (2026) · cites this paper as [57]

    Section 5.3 (Baselines; page unavailable) says the paper uses rule-based trading strategies as baselines and explicitly names Buy-and-Hold. It lists MACD, KDJ&RSI, and ZMR as the other strategies; our copy does not identify Mean Reversion or ShortTerm Reversal as baselines. (LLM, conf=0.85)

    Experimental — accuracy not yet measured
  • FinAgent is the first multimodal agent with layered memory and layered reflection design, with an additional multimodal module that takes in numeric, text and image data.

    “FinAgent[57] proposed the first multimodal agent with similar layered memory and layered reflection design, with an additional multimodal module that takes in numeric, text and image data.”

    From Large Language Model Agent in Financial Trading: A Survey (2026) · cites this paper as [57]

    The Data section describes FinAgent’s numerical, textual, and visual inputs and its dual-level reflection; §4.2 describes three memory components. The paper’s first-of-its-kind claim is narrower: it calls FinAgent the first advanced multimodal foundation agent designed for financial trading, not the first multimodal agent generally. It describes distinct memory components, but does not clearly characterize their design as layered. (LLM, conf=0.87)

    Experimental — accuracy not yet measured
  • FinAgent demonstrated significant trading performance improvements over FinMem, which uses a similar architecture but without visual input.

    “It demonstrated significant trading performance improvements over FinMem which uses a similar architecture but without visual input.”

    From Large Language Model Agent in Financial Trading: A Survey (2026) · cites this paper as [57]

    The Experimental Results section reports that FinAgent significantly outperformed the baselines, including FinMem, on the tested stocks. It also says FinAgent had slightly lower returns than FinMem on ETH. The Related Work and Baselines sections describe FinMem as an LLM trading agent, but do not establish that it has a similar architecture or lacks visual input. (LLM, conf=0.85)

    Experimental — accuracy not yet measured
  • FinAgent demonstrated superior performance in backtesting compared to other agents including FinMem.

    “This framework has demonstrated superior performance in backtesting compared to other agents including FinMem.”

    From Large Language Model Agent in Financial Trading: A Survey (2026) · cites this paper as [57]

  • Robust memory is essential for practical applications such as personalized chatbots and financial analysis, and as a key enabler toward AGI.

    “Robust memory is essential not only for practical applications such as personalized chatbots (Li et al., 2025a) and financial analysis (Zhang et al., 2024), but also as a key enabler toward Artificial General Intelligence (AGI) (Fang et al., 2025a).”

    From RealMem: Benchmarking LLMs in Real-World Memory-Driven Interaction (2026) · cites this paper as Zhang et al., 2024

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

Each contradiction between two passages listed here was confirmed by an independent check.

  • Baseline count changes from twelve to nine

    Minor

    The methods section specifies four rule-based strategies and eight advanced algorithms, totaling twelve baselines, but the results section says it compares against nine.

  • Appendix adds an unlisted seventh asset

    Minor

    The main dataset description identifies six assets-five stocks and Ethereum-but the appendix also says the portfolio contains a foreign exchange pair.

2 of 2

Cites

Flagged first, then by citations

Research works printed but not linked: 2

  1. Guolin Ke, Qi Meng, Thomas Finley, Taifeng Wang, Wei Chen, Weidong Ma, Qiwei Ye, and Tie-Yan Liu. 2017. Lightgbm: A highly efficient gradient boosting decision tree. Advances in neural information processing systems, Vol. 30 (2017).
  2. Shuo Sun, Molei Qin, Xinrun Wang, and Bo An. 2023. PRUDEX-Compass: Towards systematic evaluation of reinforcement learning in financial markets. Transactions on Machine Learning Research (2023).

Cited by

Sorted by citations

Authors
Zhang, W., Zhao, L., Xia, H., Sun, S., Sun, J., Qin, M., Li, X., Zhao, Y., Zhao, Y., Cai, X., Zheng, L., Wang, X., & An, B.
Affiliations
  • Nanyang Technological University (SG)
  • National Technological University, Singapore, Singapore
  • National University of Singapore (SG)
Venue
Proceedings of the 30th ACM SIGKDD Conference on Knowledge Discovery and Data Mining
Publisher
ACM
Published
2024-08-24
Pages
4314-4325
OpenAlex
W4401863645
Cited by
74
References
25
Citations by year
2026: 32 · 2025: 38 · 2024: 4
FWCI
50.60
Type
conference paper
Language
en
Open access
Locations
  • ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) (publishedVersion)
  • DR-NTU (Nanyang Technological University) (publishedVersion)
  • RePEc: Research Papers in Economics (submittedVersion)
  • arXiv (Cornell University) (submittedVersion, cc-by)
  • Singapore Management University Institutional Knowledge (InK) (Singapore Management University) (submittedVersion, cc-by-nc-nd)
  • arXiv (Cornell University) (cc-by)
Funders
  • National Research Foundation
  • National Research Foundation Singapore
Topics
  • Social Sciences › Decision Sciences › Management Science and Operations Research › Stock Market Forecasting Methods
  • Social Sciences › Economics, Econometrics and Finance › Finance › Financial Markets and Investment Strategies
  • Social Sciences › Business, Management and Accounting › Accounting › Financial Analysis and Corporate Governance
Keywords
financial trading, market intelligence, memory retrieval, trading decision-making, high-frequency trading, quantitative trading, business news

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Claims read by deepseek-v4.1-flash under definition version 3 (extract-v3) on 2026-10-11.

Classified by jev-1.13-20260917 (gold-guideline-v0.2) on 2026-10-11.

Cited sources are checked by gpt-6-sol.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review