ALFFLLM·FINANCE

The List / Trading, Investment, and Portfolio Management / paper

Can ChatGPT Plan Your Retirement?: Generative AI and Financial Advice

Andrew W. Lo; Jillian Ross

2024Special Issue 5: Grappling With the Generative AI Revolutioncites 32P1DOI ↗Semantic Scholar ↗Source ↗

Abstract

We identify some of the most pressing issues facing the adoption of large language models (LLMs) in practical settings, and propose a research agenda to reach the next technological inflection point in generative AI. We focus on three challenges facing most LLM applications: domain-specific expertise and the ability to tailor that expertise to a user’s unique situation, trustworthiness and adherence to the user’s moral and ethical standards, and conformity to regulatory guidelines and oversight. These challenges apply to virtually all industries and endeavors in which LLMs can be applied, such as medicine, law, accounting, education, psychotherapy, marketing, and corporate strategy. For concreteness, we focus on the narrow context of financial advice, which serves as an ideal test bed both for determining the possible shortcomings of current LLMs and for exploring ways to overcome them. Our goal is not to provide solutions to these challenges—which will likely take years to develop—but to propose a framework and road map for solving them as part of a larger research agenda for improving generative AI in any application.

In one sentence

This conceptual paper proposes a research agenda for deploying large language models in financial advice, identifying domain expertise, trustworthiness, and regulatory compliance as critical challenges that must be addressed before LLMs can safely replace or augment human financial advisors.

Summary

The paper addresses the gap between the rapid advancement of general-purpose large language models and their safe, effective deployment in high-stakes, regulated domains like financial planning. The authors argue that while LLMs offer the potential to democratize access to financial advice, current models lack the necessary domain-specific expertise, ethical alignment, and regulatory adherence required for fiduciary duties. The research problem centers on defining the specific technical and governance hurdles that prevent LLMs from serving as trusted copilots for retirement planning, asset allocation, and tax optimization, rather than offering generic, potentially misleading information. The methodology is conceptual and framework-based, drawing on the authors' prior work in adaptive markets and financial engineering. The paper analyzes the evolution of LLM technology (algorithms, data, compute) and contrasts it with the coevolution of finance and technology. It uses illustrative examples, such as prompt injection attacks and hallucinated citations, to demonstrate the opacity and unpredictability of current models. The authors propose a roadmap for developing finance-specific LLMs, emphasizing the need for specialized training data, ensemble models, and rigorous auditing mechanisms to ensure reliability and explainability. Key findings include the identification of three core challenges: tailoring domain expertise to individual user situations, ensuring trustworthiness and ethical standards, and conforming to regulatory oversight. The paper concludes that scaling general models is insufficient; future progress requires specialization, curated financial datasets, and new chip architectures optimized for LLM workloads. Limitations include the current inability of LLMs to handle the heterogeneity of investor circumstances and the risk of hallucinations leading to significant financial losses. The paper serves as a call to action for interdisciplinary collaboration between computer scientists, financial researchers, and policymakers to develop safe and effective generative AI tools for wealth management.

Research problem

The paper identifies the critical barriers to deploying large language models (LLMs) in the financial advisory sector, specifically focusing on the inability of current general-purpose models to provide trustworthy, personalized, and legally compliant financial advice. It highlights the risks of hallucinations, bias, and lack of domain-specific expertise in high-stakes contexts like retirement planning. The core problem is defining the research agenda needed to transform LLMs from generic text generators into reliable, fiduciary-compliant financial advisors.

Core contributions

  • Proposes a comprehensive research agenda for integrating LLMs into financial advice, focusing on three key challenges: domain expertise, trustworthiness, and regulatory compliance.
  • Analyzes the coevolution of finance and technology, drawing parallels between the development of LLMs and historical financial innovations.
  • Identifies specific limitations of current LLMs, including opacity, hallucinations, and vulnerability to prompt injection, using concrete examples.
  • Advocates for the development of specialized, finance-specific LLMs rather than relying on scaled general-purpose models.
  • Outlines a roadmap for overcoming data scarcity, computational inefficiency, and ethical alignment issues in financial AI.

Method

  • Literature review of LLM technology, including algorithms (transformers), data sources, and compute hardware.
  • Analysis of the adaptive markets hypothesis to contextualize financial innovation and technology adoption.
  • Case study analysis of LLM limitations using specific examples from ChatGPT (e.g., mean reversion explanation, prompt injection).
  • Evaluation of regulatory and ethical frameworks (SEC, FINRA, CFP Code of Ethics) against LLM capabilities.
  • Proposal of a roadmap for developing specialized financial LLMs, including data curation and model architecture.

Results & findings

  • Current LLMs lack the domain-specific expertise and personalization required for effective financial advice.
  • Trustworthiness and ethical alignment are major hurdles, as LLMs may not adhere to fiduciary duties or user moral standards.
  • Regulatory compliance is a significant challenge, as current models are not designed to meet legal oversight requirements.
  • Scaling general models is insufficient; specialized, smaller, and more explainable models are needed for finance.
  • Data scarcity and quality are major bottlenecks for training finance-specific LLMs, unlike the abundance of general web text.
  • Prompt injection and hallucinations pose serious risks, potentially leading to financial losses and legal liability.
  • The paper calls for interdisciplinary collaboration to develop safe, effective, and compliant generative AI for finance.

Data & experiments

  • Conceptual analysis of LLM technology evolution (algorithms, data, compute) and its application to finance.
  • Illustrative examples of LLM limitations, including hallucinated citations and prompt injection vulnerabilities.
  • Review of existing financial advisory landscape, including robo-advisors and human advisors, to contextualize the need for AI.
  • Discussion of regulatory frameworks (SEC, FINRA) and ethical standards (CFP Code of Ethics) relevant to AI deployment.
  • No empirical experiments or quantitative benchmarks are conducted; the paper is a theoretical framework and research proposal.

Limitations & caveats

  • The paper is conceptual and does not provide empirical evidence or quantitative results.
  • The proposed solutions are long-term and may take years to develop and implement.
  • The analysis relies on illustrative examples rather than systematic evaluation of LLM performance.
  • The paper does not address the technical details of model training or fine-tuning in depth.
  • The regulatory landscape is complex and evolving, making some recommendations potentially outdated.

Curator notes

Discovery status: regtech_compliance_focus_promoted. Source links: Responsible Innovation: A Strategic Framework for Financial LLM Integration