Why Trustworthy AI is Needed More Than Ever

In Yesterday’s Legal Innovation Club session, Julia Klingberg, co-founder of Kindred, was joined by Aagam Bakliwal, Cornell Tech graduate and co-founder of Kindred, for a discussion on trustworthy AI, explainability, verification systems, and the future of AI in regulated industries.

Klingberg opened the conversation by introducing Bakliwal’s background in AI systems and startup building, highlighting his previous startup exit and Kindred’s recent startup award win. Bakliwal reflected on his journey between India and the US during the rise of the AI boom, explaining how this shaped his belief that “trust is the new compute”. While AI adoption is accelerating rapidly, he argued that organisations increasingly need defensible and explainable AI systems rather than simply fast outputs.

Defining Trustworthy AI

Bakliwal explained that trustworthy AI means systems that are explainable, auditable, and defensible. In regulated industries such as law, finance, and healthcare, hallucinations and inaccuracies can create significant liability. Unlike low-risk AI use cases such as email drafting, legal and regulatory workflows require systems where every decision can be traced and verified.

The discussion then turned to the differences between building in legal tech versus other sectors. Drawing comparisons with his previous recruitment startup, Bakliwal noted that speed and experimentation matter less in legal environments than accuracy and accountability. In legal tech, trust matters more than growth velocity, because every decision must be explainable and defensible from the outset.

From Black Box to Glass Box

Klingberg asked how lawyers and firms can determine whether an AI product is genuinely trustworthy, given that most vendors market themselves as such. Bakliwal described this as both a technical and organisational challenge. He explained that trustworthy AI starts with reducing uncertainty and moving systems away from “black box” behaviour towards “glass box” transparency. Organisations should not blindly trust AI outputs; instead, systems should provide citations, explain reasoning processes, and make decisions auditable.

Bakliwal elaborated on the “black box” problem in AI, where models produce answers without clearly explaining how they arrived at them. This creates serious challenges in legal and regulated industries where accountability is essential. To address this, he stressed the importance of retrieval and verification systems that connect AI models to trusted external sources such as regulations, case law, and internal policies.

The Three Core AI System Approaches

The session explored three common AI system approaches currently used in enterprise environments:

  • Pure LLM systems, which are flexible and fast but prone to hallucinations.
  • Retrieval-Augmented Generation (RAG) systems, which connect AI to external documents and sources to improve grounding and citations.
  • Deterministic or reasoning-based systems, which introduce structured workflows and verification layers to improve explainability and auditability.

Bakliwal argued that the future of legal AI lies not in replacing LLMs, but in combining them intelligently with RAG and deterministic reasoning systems. He used Kindred’s own workflow as an example, explaining how the platform retrieves relevant case law using RAG before applying deterministic verification systems to validate compliance and documentation requirements.

The Rise of Agentic AI

The conversation also explored the rise of agentic AI systems. Bakliwal described agentic systems as AI capable of taking actions autonomously rather than simply answering questions. While these systems could automate large portions of legal workflows such as research, drafting, and verification, he stressed that human oversight would remain essential. In his view, purely autonomous legal AI systems are unlikely to be acceptable because accountability ultimately requires human responsibility.

Ethical AI and Accountability

Klingberg then shifted the discussion towards ethical AI. Bakliwal argued that ethical AI begins with accountable AI. If nobody can understand or verify how a decision was reached, responsibility cannot be properly assigned. He suggested that accountability in AI systems should be shared across the stack: vendors are responsible for reliable systems, firms are responsible for governance and oversight, and lawyers remain responsible for final decisions.

As the discussion broadened to the legal tech industry more generally, Bakliwal emphasised that the sector must move from persuasive AI towards verifiable AI. He argued that explainability, source verification, traceability, auditability, and human oversight must be embedded into products from day one. In his view, “the technology is not the product — trust is the product”.

Industry Adoption and Verification

Audience members then joined the conversation to discuss adoption challenges, verification workflows, and emerging business models. Ron questioned how distribution differs in legal tech compared to other sectors. Bakliwal explained that adoption in legal and regulated industries is heavily trust-driven rather than growth-driven. Credibility, partnerships, and successful pilots play a much greater role than rapid scaling tactics.

The discussion also explored whether a new AI verification industry could emerge. Bakliwal predicted that verification and reasoning layers will become part of every AI vertical, representing the next major evolution beyond content generation. He suggested that independent AI verification companies may emerge in a similar way to external auditors today, though AI-assisted verification will likely remain integrated into broader workflows.

Building Verification Infrastructure

Klingberg and Bakliwal also shared examples of Kindred’s verification infrastructure, including a reasoning engine capable of identifying relevant regulations, validating compliance requirements, and providing source traceability with cited reasoning. They described how legal experts were used to annotate and break down complex medical device regulations, creating proprietary datasets capable of improving auditability and compliance verification.

Conclusion

The session concluded with reflections on how trust, rather than efficiency alone, will determine success in legal AI adoption. Both speakers agreed that while AI can significantly improve legal workflows, verification, accountability, and human oversight will remain central to the future of trustworthy AI.

Related

Why Trustworthy AI is Needed More Than Ever

How Tech Can Enhance Your BD Efforts

Current Status of European AI Regulations

The Wellbeing Forum

Lawyers and Non-Lawyers in International Arbitration: Discovering Diminishing Diversity

Related

Why Trustworthy AI is Needed More Than Ever

How Tech Can Enhance Your BD Efforts

Current Status of European AI Regulations

The Wellbeing Forum

Lawyers and Non-Lawyers in International Arbitration: Discovering Diminishing Diversity

The Legal AI Monthly Round-Up

The AI Litigation Associate: Drafting Motions, Claim Charts & Discovery in Minutes

Showcasing Best Practice in Law Firm Business Development

Alternative Thinking when Dispute Resolution is Under the Spell of New Technologies

Why Pitch Management Needs Its Own System

Identifying the Blindspots When Advising Entrepreneurs

Introducing the Fractional General Counsel

How Can Lawyers Survive in the AI Era?

How Vibe Coding Helps Resolve Legal Tech Solutions

What Does the Future BD Team Look Like?

The Sharpest People in Legal Aren’t Networking – They’re Building Rooms

Judging vs Arbitrating: An Inside Perspective

Is AI Increasing Transaction Time?

The New Era of Submissions Management

New Skillsets & Mindsets for AI Lawyers of the Future

The EU AI Act – Ethics at the Core?

AI & the Future of Law: What Students Should Be Learning Now

Why Lawyers Need to Understand Business

Private Practice vs In-House: Choosing the Right Legal Career Path

Beyond Big Law: Exploring Different Legal Career Paths

Breaking Into Law: Early Careers at Kingsley Napley

Does a Master’s Degree Improve Your Career Prospects?

SQE Smart: Preparing for the SQE and Legal Interviews

The Legal CV Blueprint & Cover Letters that Convert

Early Careers – The Mishcon Perspective

From Application to Offer: How to Win a Training Contract

Introducing the Legal Business Analyst

Investment Arbitration’s Tightrope

Managing Borders On Autopilot: Showcasing A Vertical AI For Global Immigration

How Your Firm Can Support Your Personal Brand

How to Achieve Your Best Rankings Yet

How to Get the Best Out of Your Legal Tech Providers

Legal Tech Solutions For Your Practice

Why Digital Transformation Is a People Problem: Confidence, Incentives and Culture Beat Tools

Can You Afford to Arbitrate? Impecuniosity and Arbitral Agreements

How AI Is Rewriting Legal Business Development

The Elevator Pitch

Legal Technology and the Underserved Aspects of Legal Research: A Patent Law Perspective

Digital Transformation in Big Law

The Copyright Dilemma with Claude

Bulking Up Your Practice: 5 Ways To Make Yourself Indispensable As A Lawyer

The Legal AI Monthly Round-Up

Why Global Collaboration is Key to Building Your Arbitration Practice

What Makes A Firm AI Native?

Ai Is Not About Tech, Its About Jobs!

Transitioning From Lawyer to BD Professional

How Lawyers Can Effectively Serve Start Ups?

The Impact of Coaching from the Wolf Theiss Perspective

How the EU AI Act Regulates High Risk AI

Ai Heavyweight Anthrophic Takes Aim at Legal?

Get early access
to our community

Shape the future of legal

Apply as a moderator by filling and submitting this form.
We will use the information you provide on this form to be in touch with you. You can change your choice at any time by using the Manage consent link in this widget or by contacting us. For more information about our privacy practices please visit our website. By clicking below, you agree that we may process your information in accordance with our Terms.

Get Early Access to our app

We will use the information you provide on this form to be in touch with you. You can change your choice at any time by using the Manage consent link in this widget or by contacting us. For more information about our privacy practices please visit our website. By clicking below, you agree that we may process your information in accordance with our Terms.

Please fill out your details

We'll get back to you within 5 working days