Why Trustworthy AI is Needed More Than Ever

In Yesterday’s Legal Innovation Club session, Julia Klingberg, co-founder of Kindred, was joined by Aagam Bakliwal, Cornell Tech graduate and co-founder of Kindred, for a discussion on trustworthy AI, explainability, verification systems, and the future of AI in regulated industries.

Klingberg opened the conversation by introducing Bakliwal’s background in AI systems and startup building, highlighting his previous startup exit and Kindred’s recent startup award win. Bakliwal reflected on his journey between India and the US during the rise of the AI boom, explaining how this shaped his belief that “trust is the new compute”. While AI adoption is accelerating rapidly, he argued that organisations increasingly need defensible and explainable AI systems rather than simply fast outputs.

Defining Trustworthy AI

Bakliwal explained that trustworthy AI means systems that are explainable, auditable, and defensible. In regulated industries such as law, finance, and healthcare, hallucinations and inaccuracies can create significant liability. Unlike low-risk AI use cases such as email drafting, legal and regulatory workflows require systems where every decision can be traced and verified.

The discussion then turned to the differences between building in legal tech versus other sectors. Drawing comparisons with his previous recruitment startup, Bakliwal noted that speed and experimentation matter less in legal environments than accuracy and accountability. In legal tech, trust matters more than growth velocity, because every decision must be explainable and defensible from the outset.

From Black Box to Glass Box

Klingberg asked how lawyers and firms can determine whether an AI product is genuinely trustworthy, given that most vendors market themselves as such. Bakliwal described this as both a technical and organisational challenge. He explained that trustworthy AI starts with reducing uncertainty and moving systems away from “black box” behaviour towards “glass box” transparency. Organisations should not blindly trust AI outputs; instead, systems should provide citations, explain reasoning processes, and make decisions auditable.

Bakliwal elaborated on the “black box” problem in AI, where models produce answers without clearly explaining how they arrived at them. This creates serious challenges in legal and regulated industries where accountability is essential. To address this, he stressed the importance of retrieval and verification systems that connect AI models to trusted external sources such as regulations, case law, and internal policies.

The Three Core AI System Approaches

The session explored three common AI system approaches currently used in enterprise environments:

  • Pure LLM systems, which are flexible and fast but prone to hallucinations.
  • Retrieval-Augmented Generation (RAG) systems, which connect AI to external documents and sources to improve grounding and citations.
  • Deterministic or reasoning-based systems, which introduce structured workflows and verification layers to improve explainability and auditability.

Bakliwal argued that the future of legal AI lies not in replacing LLMs, but in combining them intelligently with RAG and deterministic reasoning systems. He used Kindred’s own workflow as an example, explaining how the platform retrieves relevant case law using RAG before applying deterministic verification systems to validate compliance and documentation requirements.

The Rise of Agentic AI

The conversation also explored the rise of agentic AI systems. Bakliwal described agentic systems as AI capable of taking actions autonomously rather than simply answering questions. While these systems could automate large portions of legal workflows such as research, drafting, and verification, he stressed that human oversight would remain essential. In his view, purely autonomous legal AI systems are unlikely to be acceptable because accountability ultimately requires human responsibility.

Ethical AI and Accountability

Klingberg then shifted the discussion towards ethical AI. Bakliwal argued that ethical AI begins with accountable AI. If nobody can understand or verify how a decision was reached, responsibility cannot be properly assigned. He suggested that accountability in AI systems should be shared across the stack: vendors are responsible for reliable systems, firms are responsible for governance and oversight, and lawyers remain responsible for final decisions.

As the discussion broadened to the legal tech industry more generally, Bakliwal emphasised that the sector must move from persuasive AI towards verifiable AI. He argued that explainability, source verification, traceability, auditability, and human oversight must be embedded into products from day one. In his view, “the technology is not the product — trust is the product”.

Industry Adoption and Verification

Audience members then joined the conversation to discuss adoption challenges, verification workflows, and emerging business models. Ron questioned how distribution differs in legal tech compared to other sectors. Bakliwal explained that adoption in legal and regulated industries is heavily trust-driven rather than growth-driven. Credibility, partnerships, and successful pilots play a much greater role than rapid scaling tactics.

The discussion also explored whether a new AI verification industry could emerge. Bakliwal predicted that verification and reasoning layers will become part of every AI vertical, representing the next major evolution beyond content generation. He suggested that independent AI verification companies may emerge in a similar way to external auditors today, though AI-assisted verification will likely remain integrated into broader workflows.

Building Verification Infrastructure

Klingberg and Bakliwal also shared examples of Kindred’s verification infrastructure, including a reasoning engine capable of identifying relevant regulations, validating compliance requirements, and providing source traceability with cited reasoning. They described how legal experts were used to annotate and break down complex medical device regulations, creating proprietary datasets capable of improving auditability and compliance verification.

Conclusion

The session concluded with reflections on how trust, rather than efficiency alone, will determine success in legal AI adoption. Both speakers agreed that while AI can significantly improve legal workflows, verification, accountability, and human oversight will remain central to the future of trustworthy AI.

Related

How could a $2 Billion Firm collapse? And could it happen to yours?

The October Legal AI Roundup

Why Should Anyone Choose the Law Firm You Are Chairing?

Agents, Rule of Law, and “Human Values”

The Cost of Arbitration: Is It Worth It?

Related

How could a $2 Billion Firm collapse? And could it happen to yours?

The October Legal AI Roundup

Why Should Anyone Choose the Law Firm You Are Chairing?

Agents, Rule of Law, and “Human Values”

The Cost of Arbitration: Is It Worth It?

Behavioural Change in Law

AI in Legal Practice: Strategic Implications for 2027

Pilot to Rollout: Getting Legal Tech into Practice

What does it take for agents to work in Legal?

How to Avoid Jail When You’re a Managing Partner

Emergency Arbitration: How Urgent Is Urgent?

Bespoke AI Compliance Programs: Building In-House

Leveraging Live Events to Promote Your Practice

Building the Business Case for Legal Tech

Why Legal Research Remains Core to Good Lawyering and How Tools Can Help?

September Legal AI Roundup

Become a Legal Podcaster

AI in Practice: Delivering Results in Legal Marketing & BD

AI Lawyer 2.0

AI Compliance in the EU: Foundations & Challenges

Choosing the Right Legal Tech: Where Do You Start?

International Referral Management in the Digital Age

Private Equity Investment in Law Firms: The Enemy at the Gate?

The Race for Your Ranking!

The Monthly Legal AI Roundup

SME Law Firms – What Tech is Best for You?

How to Become an AI Governance Officer?

AI Adoption in Law Firms: The BD Perspective

Intro to EU AI Legislation: What to Track?

New Careers in Legal Today

The Multidisciplinary Aspects of ALSPs and Why That Matters!

Career Development in an AI World

Is This a New Age for Alternative Legal Service Providers?

Theory vs. Traction: Real-World Impacts of the EU AI Act & Digital Omnibus

The Legal AI Monthly Roundup

Rethinking Rainmakers

Why Research Still Matters for Lawyers and How to AI-Enable It

BD for Associates: Skills for the Next Generation

The AI Spend Trap: What Legal Teams Should Buy, Build and Stop Paying For

The Analogue Summer Challenge Part 2: Who You Are When You Switch Off

A Comparative Analysis of US and EU Regulation in the Field of AI

Law Firm Partner Compensation: How to Build Fair, High-Performing Firms

The Geopolitical Challenges of Integrating AI in Your Law Firm

The Most Difficult Decision for Law Firm Leaders Regarding Business Development Today

The Analogue Summer Challenge – Part 1: How to Switch Off

Why an Open Source AI Legal Platform Might Be The Best for Your Firm

The Legal AI Monthly Round Up

Turning Data into Strategy: Preparing Your IBA Annual Showcase

Simulations as a New Source of Learning

Bespoke Compliance: Designing a Sustainable Framework

Is Contract the New Treaty? International Law Before Arbitral Tribunals

Latest in Legal Tech from Legora

How Law Firms Can Grow In 2026

From Law Firm to Fractional General Counsel

The Legal AI Monthly Round-Up

Get early access
to our community

Shape the future of legal

Apply as a moderator by filling and submitting this form.
We will use the information you provide on this form to be in touch with you. You can change your choice at any time by using the Manage consent link in this widget or by contacting us. For more information about our privacy practices please visit our website. By clicking below, you agree that we may process your information in accordance with our Terms.

Get Early Access to our app

We will use the information you provide on this form to be in touch with you. You can change your choice at any time by using the Manage consent link in this widget or by contacting us. For more information about our privacy practices please visit our website. By clicking below, you agree that we may process your information in accordance with our Terms.

Please fill out your details

We'll get back to you within 5 working days