Pavel Golikov

Pavel Golikov

AI Researcher | Machine Reasoning, Alignment, & Systems

Pavel Golikov

🚨 I am currently transitioning to industry and actively seeking full-time roles as an AI Researcher / Scientist, with a focus on robust machine reasoning and AI alignment.

I am an AI Researcher at the University of Toronto, working in Prof. Gennady Pekhimenko’s EcoSystem research group, and a member of the Vector Institute. My research focuses on understanding the fundamental limits of algorithmic reasoning in Large Language Models and agentic systems. I design custom agents alongside adversarial evaluations and use mechanistic interpretability to diagnose structural failures in frontier models and agentic systems.

My path to AI research is highly multidisciplinary, blending formal logic, low-level systems engineering, and security analysis. Before my graduate studies, I served as an Intelligence Operator in the Canadian Armed Forces, where I analyzed classified information. This experience ingrained the rigorous, threat-modeling mindset I now apply to AI security and adversarial testing.

Academically, I began with a BSc in Mathematics and Philosophy (formal logic). In my Master’s research, I focused on distributed systems, building full-stack IoT streaming framework using C++, Python, AWS, and Apache Flink. Today, my background in computer systems allows me to approach ML not just mathematically, but with a rigorous engineering lens.

Current Research

  • ArbiGraph - Built an open-source benchmark generator for evaluating context management in tool-assisted language agents. ArbiGraph composes executable natural-language math, GSM-style, and Python-tracing tasks into typed task graphs, making dependency length, distractors, branches, and scalar/list state controllable while preserving exact automatic verification. The framework supports user-defined DAG topologies, executable solvers, dynamic rejection sampling, graph visualization, and released datasets/results for reproducible evaluation. In preliminary Qwen3.5-27B evaluations, isolated tasks remained high accuracy (94.5% math, 96.8% Python, 100.0% GSM), but dependent math accuracy fell to 75.5% on chains and 61.2% on multichains, exposing state-propagation failures hidden by single-task benchmarks. [arXiv] [GitHub]

Selected Publications

  • ArbiGraph: Arbitrarily Scalable Verifiable Task Graphs for Evaluating Context Management - Pavel Golikov, Evgenii Opryshko, Gennady Pekhimenko, and Mark C. Jeffrey. arXiv preprint arXiv:2607.20764, 2026. [arXiv] | [GitHub]

    Brief: Introduced ArbiGraph, a benchmark generator that turns context into typed computational state. It composes executable tasks into user-defined dataflow graphs, supports baseline/forgetting/chain/multichain evaluations, and tests whether agents can retain, update, propagate, and discard relevant context under exact verification.

  • Robust Reasoning Benchmark - Pavel Golikov, Evgenii Opryshko, Gennady Pekhimenko, and Mark C. Jeffrey. arXiv preprint arXiv:2604.08571, 2026. (Under review at NeurIPS 2026) [arXiv] | [DOI] | [Project Page]

    Brief: Introduced RRB to evaluate structural fragility in LLM reasoning. Used mechanistic interpretability to identify “Intra-Query Attention Dilution” in open-weights models and over-refusal in proprietary safety filters (Claude 4.6 Opus). Raised the open problem of the optimal granularity of reasoning - an important question for model reasoning and context management.

  • Fusing Adds and Shifts for Efficient Dot Products - Pavel Golikov, Karthik Ganesan, Gennady Pekhimenko, and Mark C. Jeffrey. IEEE Computer Architecture Letters, 25(1), pp. 33-36, 2025. [DOI]

    Brief: Hardware architecture research proposing a novel algorithmic optimization for dot-product computations.

Master’s Thesis & Systems Infrastructure

  • Flexible IoT Streaming Engine Framework (MSc Thesis, 2022)

    Brief: Engineered a distributed data-streaming framework to automatically partition streaming compute queries between edge devices and the cloud. Built the full stack, including Arduino/C++/Python sensor programming (EMG/ECG data processing), socket networking, and cloud deployment using AWS and Apache Flink.