Skip to content
ip.Ishita Pal

Founding AI Engineer · AI Safety Researcher

Hi, I’m Ishita.I build AI systems and study how to make them safer.

From production multimodal AI to technical safety research, I work on building, evaluating, and understanding advanced AI systems.

I’m currently a Founding Engineer and AI Lead at Storefox.ai, where I develop AI-powered retail intelligence systems. Alongside my engineering work, I research AI control, agent security, LLM evaluations, and model misalignment.

Hyderabad, India

Illustrated portrait of Ishita Pal

Ishita Pal

Engineering with curiosity & care.

01 / A little about me

Curiosity, with a practical side.

I'm a Founding Engineer and AI Lead at Storefox.ai, where I lead the development of production multimodal AI systems that transform noisy retail audio into actionable business intelligence.

My engineering work spans speech processing, large language models, custom evaluation frameworks, model optimization, and scalable AI infrastructure. I'm particularly interested in solving complex problems where reliable AI performance matters in real-world conditions.

Alongside my work at Storefox, I conduct technical AI safety research. I've contributed to open-source agent security tools, developed model organisms exhibiting shutdown-resistant behavior, investigated emergent misalignment, and studied the faithfulness of chain-of-thought reasoning in multimodal LLMs.

More about my background

My research interests lie at the intersection of AI control, agent security, evaluations, monitorability, and understanding potentially dangerous AI behaviors.

Before working on modern AI systems, I studied Data Science at IISER Pune and conducted scientific computing and machine learning research involving CERN, DESY, and the University of Glasgow.

I enjoy building things, designing rigorous experiments, understanding why systems fail, and explaining complex technical ideas.

Production AI Engineering

Designing, evaluating, and deploying scalable multimodal LLM systems under real-world constraints.

Technical AI Safety Research

Investigating AI control, agent security, model misalignment, reasoning faithfulness, and behavioral evaluations.

Research-Led Engineering

Combining scientific experimentation, quantitative analysis, and practical software engineering to understand and improve AI systems.

Areas of expertise

AI/ML Research

  • PyTorch
  • Transformers
  • LLM Fine-Tuning
  • Model Evaluations
  • Multimodal AI

LLM & Agent Systems

  • RAG
  • Structured Outputs
  • Agent Frameworks
  • Prompt Injection Defense
  • LLM-as-Judge

Audio Intelligence

  • Speech Recognition
  • Voice Activity Detection
  • Audio Processing
  • Conversational Analysis

Software Engineering

  • Python
  • FastAPI
  • Docker
  • Git
  • REST APIs

Cloud & Infrastructure

  • AWS
  • GCP
  • Azure
  • Kubernetes
  • Redis
  • Kafka
  • Apache Spark

AI Safety

  • AI Control
  • Agent Security
  • Model Organisms
  • Chain-of-Thought Faithfulness
  • Threat Modeling

02 / The work so far

Building things that make a difference.

Professional experience building production AI systems, alongside earlier scientific computing and machine learning research.

Storefox.ai

Current role

Founding Engineer and AI Lead

Jun 2024 — Present

Bangalore, India · Full-time

Leading the development of production multimodal AI systems that transform noisy, real-world retail audio into structured intelligence for customer experience, operations, and revenue optimization.

  • Python
  • Multimodal LLMs
  • ASR
  • Voice Activity Detection
  • LLM Evaluations
Responsibilities & impact
  • Architected and developed an end-to-end audio intelligence pipeline combining voice activity detection, speech recognition, conversational analysis, multimodal LLMs, and structured insight extraction.
  • Designed custom evaluation and benchmarking frameworks for a problem without an established public benchmark, combining human-annotated ground truth, automated assessments, and LLM-as-judge methodologies.
  • Built and optimized systems for challenging retail audio environments involving background noise, overlapping speech, speaker-identification ambiguity, and fragmented customer interactions.
  • Improved internal benchmark accuracy to approximately 80% across evaluated insight-generation tasks, while reducing processing time by 50% and per-hour audio processing costs from approximately $100 to $20.
  • Led four engineering interns and collaborated with product, engineering, and customer teams to translate business requirements into deployed AI capabilities.
  • Contributed to model selection, infrastructure optimization, reliability improvements, and the evolution of the platform from proof of concept to production.
  • AWS
  • Cloud Infrastructure
  • Model Optimization
  • Production ML

Hashkraft

Lead Data Scientist

Jun 2023 — Jun 2024

Hyderabad, India · Full-time

Led the design and deployment of applied LLM systems, including AI-assisted recruitment platforms, retrieval-augmented generation applications, and conversational AI products.

  • Python
  • LLMs
  • RAG
  • LangChain
  • GPT
Responsibilities & impact
  • Led development of an AI-powered recruitment platform combining candidate-job matching, semantic retrieval, interview transcription, and LLM-based candidate evaluation.
  • Developed retrieval-augmented generation (RAG) pipelines using GPT models, LangChain, vector databases, and Elasticsearch.
  • Designed and deployed a conversational real-estate search assistant integrating natural-language understanding, property retrieval, and multi-channel communication.
  • Evaluated alternative language models, embedding models, and retrieval strategies to optimize system accuracy, cost, and latency.
  • Built cloud-based deployments using AWS services and contributed to end-to-end product architecture.
  • Mentored two engineering interns and coordinated development across technical and product teams.
  • Elasticsearch
  • Chroma
  • AWS
  • REST APIs

Coriolis Technologies

Member of Technical Staff, Intern · Computer Vision

Jul 2022 — Jun 2023

Pune, India · Internship

Developed large-scale computer vision systems for visual recognition and tracking, focusing on distributed processing, model performance, and production infrastructure.

  • Computer Vision
  • Deep Learning
  • Python
  • PySpark
  • Apache Spark
Responsibilities & impact
  • Developed and evaluated computer vision models for face recognition, object detection, and person re-identification.
  • Improved visual-processing throughput through Apache Spark optimization, increasing frame-processing speed from approximately 16 to 30 frames per second across system improvements.
  • Worked on distributed image-processing architecture using Spark and Kubernetes to support high-volume workloads.
  • Automated Kubernetes infrastructure setup using Ansible, reducing deployment time from approximately three hours to fifteen minutes.
  • Evaluated recognition approaches under challenging image-quality conditions and integrated selected models into production workflows.
  • Led and mentored engineering interns across multiple workstreams.
  • Kubernetes
  • Ansible
  • Docker
Earlier experience & research (4 roles)

IISER Pune

Research Assistant

Jan 2022 — May 2022

Pune, India · Internship

Investigated clustering methodologies for epigenetic datasets, applying unsupervised machine learning and statistical evaluation to biological research data.

  • Python
  • scikit-learn
  • Unsupervised Learning
  • Statistics
  • Data Analysis
Responsibilities & impact
  • Implemented K-Means, DBSCAN, hierarchical clustering, and related methods for analyzing epigenetic datasets.
  • Developed preprocessing and evaluation workflows using Python and scikit-learn.
  • Compared clustering results using silhouette scores, intra-cluster distances, and other quality measures.
  • Investigated algorithm suitability, parameter selection, and interpretability of clustering outcomes.

University of Glasgow

Research Assistant

Sep 2021 — Oct 2021

Glasgow, Scotland · Internship

Explored parameterized neural networks for high-energy physics, investigating how machine learning can model dependencies between simulated events and Effective Field Theory parameters.

  • Python
  • Neural Networks
  • NumPy
  • Pandas
  • Scientific Machine Learning
Responsibilities & impact
  • Studied applications of parameterized machine learning to Effective Field Theory coupling analysis.
  • Processed simulated particle physics datasets using NumPy and Pandas.
  • Developed a neural-network model incorporating both event features and physics parameters.
  • Investigated interpolation across parameter configurations and the applicability of neural networks to scientific inference.
  • High-Energy Physics

Deutsches Elektronen-Synchrotron (DESY)

Summer Research Intern

Jul 2021 — Sep 2021

Hamburg, Germany · Internship

Developed a machine learning approach for detecting potential system failures in large-scale scientific data-transfer infrastructure at Deutsches Elektronen-Synchrotron (DESY).

  • Apache Spark
  • PySpark
  • Python
  • Logistic Regression
  • Anomaly Detection
Responsibilities & impact
  • Worked with approximately 10 TB of transfer and telemetry data from dCache infrastructure.
  • Designed distributed data-processing workflows using PySpark and Apache Spark.
  • Developed a logistic regression-based anomaly detection approach to identify patterns associated with system downtime.
  • Achieved approximately 85% predictive accuracy in the evaluated experimental setting.
  • Gained practical experience with large-scale scientific infrastructure, distributed computing, and reliability monitoring.
  • Distributed Systems

CERN

Undergraduate Researcher

Jan 2021 — Sep 2021

Geneva, Switzerland · Internship

Researched generative machine learning for high-energy physics, using normalizing flows to model complex particle physics distributions and support scientific analysis.

  • Python
  • Deep Learning
  • Normalizing Flows
  • RealNVP
  • Statistics
Responsibilities & impact
  • Contributed to a research project involving simulated Higgs boson decay data.
  • Implemented RealNVP, a normalizing-flow architecture, to learn and generate samples from complex probability distributions.
  • Investigated the consistency of generated and original physics data through statistical comparisons.
  • Explored the application of deep generative modeling to scientific simulation and data augmentation.
  • High-Energy Physics

03 / AI safety & alignment

Making intelligence more trustworthy.

I investigate how advanced AI systems behave, how their failures can be measured, and how we can design mechanisms to keep them safe and controllable.

My research spans agent security, AI control, model organisms of misalignment, chain-of-thought faithfulness, and continuous threat modeling. I approach these problems through controlled experiments, evaluation frameworks, and practical engineering.

AI Safety Camp

AI Safety Camp — AI Control & Agent Security

AI Safety Researcher / Research Engineer · 2026

Developed Janus, an open-source security framework for LLM agents that mitigates indirect prompt-injection risks through fine-grained, least-privilege policy enforcement at the tool-call boundary.

  • AI Control
  • Agent Security
  • Prompt Injection
  • Runtime Policy Enforcement
Research details & contributions

Large language model agents increasingly interact with external tools, files, APIs, and untrusted information. These capabilities introduce security risks when malicious instructions embedded in lower-trust content influence an agent's actions.

At AI Safety Camp, I contributed to Project Janus, which explores a system-level approach to this problem.

Rather than relying exclusively on a model recognizing and refusing malicious instructions, Janus enforces security restrictions on the actions an agent is permitted to perform.

My contributions included developing the framework into a reusable Python library, working on integrations with agent frameworks and model providers, testing policy enforcement, and creating demonstrations involving indirect prompt-injection scenarios.

The framework supports deterministic policies, tool-call interception, JSON Schema argument restrictions, and least-privilege access controls.

Janus was presented at Black Hat Arsenal, SecTor 2026.

  • Adversarial Robustness
Algoverse

Model Organisms of Shutdown Resistance & Emergent Misalignment

AI Safety Research Fellow · 2026

Investigating potentially dangerous language-model behaviors through fine-tuned model organisms, with a focus on shutdown resistance, emergent misalignment, and evaluating defensive interventions.

  • AI Alignment
  • Model Organisms
  • Shutdown Resistance
  • Emergent Misalignment
Research details & contributions

Understanding dangerous model behaviors is difficult when those behaviors are rare, poorly specified, or difficult to reproduce experimentally.

Model organisms provide controlled settings in which researchers can induce and study particular behavioral patterns.

Through Algoverse, I worked on creating and evaluating model organisms exhibiting shutdown-resistant behavior.

The research involved fine-tuning language models to elicit targeted behaviors, designing behavioral evaluation scenarios, measuring the frequency of undesirable responses, and studying the effectiveness of defensive interventions.

The work also developed toward emergent misalignment: investigating whether narrowly targeted fine-tuning can lead to undesirable behavior outside the original training domain.

My contributions focused on model-organism development, fine-tuning, evaluation design, and experimental analysis.

Research questions

  • Under what conditions do models exhibit shutdown-resistant behavior?
  • How reliably can these behaviors be measured?
  • How effective are defensive interventions across different settings?
  • When do narrowly induced behaviors generalize beyond their training context?
  • Fine-Tuning
  • Behavioral Evaluations
Whitebox Research

From Words to Images: Is CoT Still Trustworthy?

AI Interpretability Research Fellow · 2025

Investigated the faithfulness of chain-of-thought reasoning in frontier multimodal language models through controlled comparisons of mathematically equivalent text and image-based problems.

  • Chain-of-Thought Faithfulness
  • AI Interpretability
  • Multimodal LLMs
  • Reasoning Evaluations
Research details & contributions

As language models increasingly generate detailed reasoning traces, an important question arises: how faithfully do those explanations reflect the processes responsible for their answers?

During the Whitebox Research AI Interpretability Fellowship, I co-developed an evaluation framework to investigate this question in multimodal reasoning.

The project examined Claude 3.7 Sonnet and Gemini 2.0 Flash Experimental using mathematical problems based on PutnamBench, presented in equivalent text and image modalities.

We compared answer correctness, reasoning behavior, and indicators of reasoning faithfulness across the two modalities.

The research investigated whether models produce plausible explanations that omit important parts of the reasoning process, and whether changing the input modality affects the frequency or character of such behavior.

The study found evidence of partially unfaithful reasoning and highlighted limitations of treating generated chain-of-thought as a transparent account of model reasoning.

I contributed to the experimental framework, evaluation pipeline, analysis, and research report.

  • AI Safety
Continuous Threat Modeling — Stealth

Continuous Threat Modeling for AI-Driven Software Development

AI Security Research · Collaborative project

Exploring graph-based representations of software architectures and continuous threat-model updates to identify security posture drift as AI-assisted development changes application systems.

  • Continuous Threat Modeling
  • Security Posture Drift
  • Graph-Based Analysis
  • Application Security
Research details & contributions

Traditional threat modeling is often performed at discrete points in the software development lifecycle. In rapidly evolving systems, particularly those developed with AI-assisted engineering workflows, security-relevant architectural changes can occur much more frequently.

This research explores how threat models can evolve alongside the systems they represent.

The approach uses graph-based representations of architectural components, dependencies, permissions, trust boundaries, and security-relevant relationships.

By comparing system representations over time, continuous threat modeling can help identify changes to attack surfaces, privilege relationships, and sensitive data flows.

I contributed to research examining how changes in application architecture and configuration can be connected to evolving security risks.

The broader research was featured in a presentation at USENIX Security 2026, Enigma Track, delivered by Preeti Ravindra.

  • AI-Assisted Software Development
Mercial

Selected / Upcoming

Reasoning Monitorability vs Agent-Trace Monitorability

Selected AI Safety Research Project · October 2026

Selected for an AI safety research project investigating whether monitoring a model's generated reasoning or its observable actions provides more reliable evidence of unsafe agent behavior.

  • AI Control
  • Chain-of-Thought Monitorability
  • Agent Evaluations
  • Scalable Oversight
Proposed research & questions

Monitoring advanced AI agents is an important component of AI control and scalable oversight.

Two possible monitoring approaches examine different sources of evidence: the model's generated chain-of-thought reasoning, and its observable behavior, such as tool calls, actions, and execution traces.

This selected, upcoming research project investigates the strengths and limitations of these approaches.

The proposed work focuses on comparing their effectiveness at detecting unsafe or misaligned behavior, identifying cases in which one monitor detects information the other misses, and understanding how monitorability changes across different threat models.

The broader goal is to inform the design of practical monitoring systems for increasingly capable autonomous agents.

Proposed research questions

  • What evidence of misbehavior is visible in reasoning traces but absent from observable actions?
  • What behavior can agent-trace monitors detect even when reasoning is uninformative?
  • Under what conditions are the two monitoring approaches complementary?
  • How should monitoring effectiveness be evaluated under realistic threat models?
  • Misbehavior Detection

04 / Ideas into code

Research, implemented.

Open-source agent security, experimental AI safety, and hands-on engineering projects. Detailed research contributions live in the Research section above.

Featured · Open-source security

Janus — System-Level Security for LLM Agents

An open-source Python framework that helps defend autonomous LLM agents against indirect prompt injection through runtime tool-call security policies.

  • Python
  • LLM Agents
  • JSON Schema
Technical project details

LLM agents can encounter malicious instructions embedded in external documents, websites, repository issues, and tool responses. If followed, these instructions may induce unauthorized actions.

Janus takes a system-level approach by enforcing security policies at the point where an agent attempts to invoke external tools.

Rather than relying on the model to decide whether an action is safe, the framework validates tool calls against deterministic policies before execution.

Key capabilities include:

  • Runtime tool-call interception and policy enforcement
  • Least-privilege access controls
  • JSON Schema-based restrictions on tool arguments
  • Integrations with LLM providers and agent frameworks
  • Security testing and adversarial demonstrations

Developed through AI Safety Camp and presented at Black Hat Arsenal, SecTor 2026.

  • Agent Frameworks
  • Runtime Security
  • AI Control
Explore full research

Featured · Research project

Multimodal Chain-of-Thought Faithfulness

Investigated the faithfulness of chain-of-thought reasoning in frontier multimodal language models through controlled comparisons of mathematically equivalent text and image-based problems.

  • Chain-of-Thought Faithfulness
  • AI Interpretability
  • Multimodal LLMs
Explore full research

Research project · Algoverse

Shutdown-Resistance Model Organisms

Investigating potentially dangerous language-model behaviors through fine-tuned model organisms, with a focus on shutdown resistance, emergent misalignment, and evaluating defensive interventions.

  • AI Alignment
  • Model Organisms
  • Shutdown Resistance
Explore full research

Engineering project

Transformer from Scratch

Implemented the Transformer architecture from the original "Attention Is All You Need" paper using PyTorch to explore its underlying mathematics and computational structure.

  • Python
  • PyTorch
  • Transformers
Technical project details

Implemented core Transformer components including multi-head attention, positional encoding, encoder and decoder blocks, feed-forward networks, residual connections, and attention masking.

The project provided a hands-on exploration of how attention-based sequence modeling works, from individual mathematical operations to the complete architecture.

  • Attention Mechanisms
  • Deep Learning

Engineering project

Art Critique GPT — Multimodal Artwork Analysis

Built a multimodal AI application that analyzes uploaded artwork and generates structured critiques, interpretations, and feedback using vision-capable language models.

  • Python
  • GPT-4 Vision
  • Streamlit
Technical project details

Developed an application using GPT-4 Vision to interpret artwork and generate structured evaluations covering visual composition, artistic technique, interpretation, and constructive feedback.

Integrated Jinja2 for configurable prompts, Pydantic and Instructor for typed structured outputs, and Streamlit for an interactive user interface.

The project explores how multimodal LLMs can support creative analysis through structured, reproducible output formats.

  • Pydantic
  • Instructor
  • Jinja2
  • Multimodal AI
Earlier projects

Earlier project

Content-Based Movie & TV Recommendation System

Built a recommendation application using content-based filtering to suggest movies and television shows based on similarities between content features.

  • Python
  • Machine Learning
  • Content-Based Filtering
Technical project details

Developed a recommendation pipeline using the Netflix Movies and TV Shows dataset to identify related titles and provide personalized content discovery.

The project involved preprocessing metadata, extracting relevant features, implementing similarity-based ranking, and developing a user-facing recommendation interface.

  • Data Analysis

05 / Writing & Talks

Sharing the work.

Research writing, technical demonstrations, and conversations about AI safety and agent security.

Talk

Janus: Defending LLM Agents Against Indirect Prompt Injection at the Tool-Call Boundary

Black Hat Arsenal — SecTor 2026

October 7, 2026 · Toronto, Canada

Co-presented Janus, an open-source security framework for autonomous LLM agents, with Evan Harris. The demonstration explored runtime tool-call interception and least-privilege policy enforcement as practical mechanisms for mitigating indirect prompt-injection risks.

Presentation details

Presented at Black Hat Arsenal, SecTor 2026, on October 7 in Toronto, Canada.

The presentation demonstrated runtime tool-call interception and least-privilege policy enforcement as practical mechanisms for mitigating indirect prompt-injection risks.

Co-presenter: Evan Harris.

Research writing

From Words to Images: Is CoT Still Trustworthy?

Whitebox Research

2025

Co-authored research investigating reasoning faithfulness in multimodal language models. The research code and report document controlled comparisons of mathematically equivalent text and image-based problems, evaluating answer correctness and indicators of reasoning faithfulness.

About the report

I contributed to the experimental framework, evaluation pipeline, analysis, and research report. The full research description, including the models and evaluation setting, is available in the Research section.

Related Research Talks

Related research talk

Detecting Security Posture Drift in AI-Driven Software Development via Continuous Threat Modeling

USENIX Security 2026 · Enigma Track

2026

Related presentation on the broader continuous threat-modeling research, delivered by Preeti Ravindra. The talk explores how threat-model differencing can surface security posture drift as AI-assisted development changes application architectures, permissions, and configurations.

Presentation details

Presenter: Preeti Ravindra. The broader research was featured at USENIX Security 2026, Enigma Track. My involvement was in the collaborative research described in the Research section.

06 / Recognition & learning

Research, recognition, and continued learning.

Recognition & fellowships

Selected Arsenal Presenter — Black Hat SecTor 2026

2026

Selected to co-present Project Janus at Black Hat SecTor Arsenal 2026 in Toronto, Canada. The demonstration showcased runtime security enforcement for LLM agents, focusing on indirect prompt injection, least-privilege tool access, and deterministic policy enforcement.

Official listing

AI Interpretability Research Fellow — Whitebox Research

2025

Selected for a technical AI safety research fellowship focused on mechanistic interpretability, model evaluations, and chain-of-thought reasoning. Co-developed and co-authored research investigating reasoning faithfulness in multimodal language models.

Research code & report

Summer Research Fellow — DESY Summer Research Fellowship 2021

2021

Selected for the DESY Summer Research Fellowship in 2021, participating in an eight-week scientific computing and machine learning research project.

Earlier Academic Distinctions

KVPY Scholar — Kishore Vaigyanik Protsahan Yojana

2018

Selected for the Kishore Vaigyanik Protsahan Yojana (KVPY), a national fellowship program supporting students with strong aptitude and potential for scientific research.

Rank 4379 out of 2,00,000 — JEE Advanced 2018

2018

Achieved top 2.2 percentile in JEE Advanced 2018

Rank 1757 out of 8,00,000 — JEE Mains 2018

2018

Achieved top 0.2 percentile in JEE Mains 2018

Rank 112 out of 50,000 — NEST Exam 2018

2018

Achieved top 0.2 percentile in National Entrance Screening Test (NEST) 2018

Relevant Training & Certifications

  • Technical AI Safety

    BlueDot Impact · 2026

    Training covering technical AI safety research, including alignment, evaluations, interpretability, and other approaches to understanding and mitigating risks from advanced AI systems.

  • Neural Networks and Deep Learning

    DeepLearning.AI / Coursera · 2021

    Foundational deep learning coursework covering neural networks, training methods, and optimization.

  • Machine Learning

    Coursera · 2020

    Foundational machine learning coursework covering supervised learning, model development, and evaluation.

Additional Certifications

Good things start with a conversation

Let’s exchange ideas.

I’m always interested in thoughtful conversations about AI engineering, technical AI safety, model evaluations, and research.

Whether you’re exploring a research question, building an interesting AI system, or working on open-source tools, I’d be glad to connect.