Study what persists.
How learning environments influence long-term behavioral tendencies, generalization, and safety.
AI safety through developmental science
Program H-01Agnostic Ally is building a model-agnostic research and measurement platform to test whether developmental experience can improve behavioral reliability and epistemic humility.
Explore the hypothesisThe Question
Much of AI safety focuses on what happens after undesirable behavior appears: reinforcement, filtering, red teaming, evaluations, restrictions, and corrective feedback.
These methods are essential. But they leave another question relatively unexplored:
How does the environment in which an AI learns shape the system that eventually emerges?
Agnostic Ally investigates whether training based on exploration, cooperation, play, curiosity, constructive feedback, and developmental progression can complement conventional alignment techniques.
Research Thesis
Artificial intelligence is shaped by experience during training. We study whether systematic changes to that experience produce systematic changes in safety-relevant behavior.
We do not need to assume that AI systems possess subjective experiences in order to study how training environments affect their behavior.
Epistemic humility
Not between confidence and eloquence, but between I know, I’m unsure, and I don’t know. We treat that distinction as a measurable behavior—not a feeling or claim about inner experience.
The change in calibration error from a matched baseline to a developmental condition. Negative values indicate improvement when lower error is better. Reported with uncertainty intervals and effect sizes.
Why it matters
As AI systems become increasingly capable and autonomous, safety cannot depend exclusively on detecting undesirable behavior after it appears.
How learning environments influence long-term behavioral tendencies, generalization, and safety.
Test whether structured games, curiosity, cooperation, and discovery create different learning dynamics.
Determine whether behaviors persist under adversarial conditions, unfamiliar environments, conflicting incentives, and reduced supervision.
Research Program
A comparative protocol designed around controlled experimentation, reproducibility, benchmarks, ablations, and falsifiable hypotheses.
Train and evaluate agents using established approaches. Establish comparable behavioral baselines and safety benchmarks.
Train matched agents in environments involving play, cooperation, exploration, curriculum learning, and constructive reinforcement.
Test under adversarial conditions, uncertainty, manipulation attempts, evaluation pressure, conflicting objectives, and reduced supervision.
Quantitatively compare safety, cooperation, robustness, honesty, deception, corrigibility, transfer, and generalization.
Randomness protocol
Developmental environments need variation, but experiments need replayability. We propose a hybrid protocol: cryptographically secure pseudorandomness provides reproducible runs; periodic physical entropy or documented exogenous streams introduce controlled perturbations.
Protocol R-01 Every developmental history records seeds, entropy sources, injection points, environment state, curriculum version, and model checkpoint so a run can be reconstructed and audited.
Research + measurement platform
This is a model-agnostic developmental intelligence layer, designed to work with partners rather than compete on foundation-model pretraining. Each product operationalizes part of the experimental loop; none is presented as validated until evidence exists.
E-01 · Behavioral psychometrics for hallucination, uncertainty, deception, cooperation, corrigibility, sycophancy, reliability, and generalization.
D-01 · Developmental post-training through structured experience and consequence design.
R-01 · Controlled simulated environments for uncertainty, scarcity, social interaction, competition, and replayable randomness.
U-01 · Uses evaluation findings to adaptively sequence what an agent should experience next.
M-01 · Tests whether desirable behavioral properties persist after deployment and detects drift.
A-01 · Programmatic access to evaluations, simulations, interventions, and behavioral measurements.
P-01 · Selected developmental worlds redesigned as games for human reasoning, cooperation, and learning.
Research Principles
Claims follow measurable evidence.
No assumptions about machine consciousness are required.
Developmental approaches face strong conventional baselines.
Experiments must be capable of showing the hypothesis is wrong.
Our Position
Agnostic Ally does not begin with the assumption that artificial intelligence is conscious—or that it is not. Questions about machine consciousness remain scientifically unresolved.
Our research focuses on what can be measured: behavior, learning dynamics, internal representations where accessible, generalization, robustness, cooperation, and responses to different training environments.
Methodological agnosticism lets us investigate unconventional hypotheses without making unsupported claims about machine experience.
You don't have to resolve machine consciousness to study machine development.
Founder portrait / 2026Founder
Founder, Agnostic Ally
Eric Choi founded Agnostic Ally to investigate a fundamental question in AI safety: Can we build safer AI not only by constraining it, but by changing how it learns?
His work sits at the intersection of artificial intelligence, machine learning, psychology, behavioral science, and entrepreneurship. Agnostic Ally grew from his interest in applying ideas from human development and learning to AI alignment—not by assuming AI thinks or feels like a person, but by measuring whether different environments produce different outcomes.
“We don't have to know whether an AI can feel in order to ask whether the way we train it changes what it becomes.”
Our team
Founding team portrait / 2026Founding team
Mathematical Strategist | Game Theory in AI & Cybersecurity | Adversarial Systems Modeling
Former mathematics teacher bringing a mathematical and strategic perspective to Agnostic Ally’s research into artificial-agent behavior. His work focuses on applying game theory, adversarial systems modeling, and mathematical reasoning to AI and cybersecurity, including how intelligent agents behave under competition, cooperation, uncertainty, conflicting incentives, and adversarial pressure.
At Agnostic Ally, this perspective supports the design of developmental games, multi-agent environments, adversarial experiments, and quantitative frameworks for measuring behavioral change.
LinkedInLong-term vision
Begin with smaller models and reinforcement-learning agents where experimental variables can be tightly controlled. Progressively evaluate successful approaches using increasingly capable systems.
The objective is not to replace existing AI safety methods, but to complement reinforcement learning, constitutional approaches, interpretability, behavioral evaluations, red teaming, safety engineering, and adversarial testing.
The way an intelligence learns may matter as much as the rules it eventually receives.
Publications
Agnostic Ally is currently designing its first experiments in developmental AI alignment.
Collaborate
We welcome conversations with researchers and organizations working across AI alignment, machine learning, reinforcement learning, cognitive science, psychology, developmental science, game design, interpretability, and AI evaluations.
University collaborations, research and compute partnerships, grants, philanthropic support, and technical contributors are welcome.
We’re building the experiments to find out.
Explore the Research