LLMography in the Age of Loop and Graph Engineering
A working paper extending LLMography from conversation traces to loop- and graph-structured Human–AI decision systems.
Mohammed Bousmah · 2026-08-01 · Working paper
Human–AI decision provenance
LLMography
Reconstruct the decision trajectories formed between humans, LLMs, agents, tools, and autonomous loops — so intelligence can be observed, attributed, and audited.
Founded by Dr. Mohammed Bousmah, PhD
Decision trajectory
01 · Seed trace
A decision begins as a short Human → LLM → Decision path.
Every interaction leaves a trace.
The problem
Modern systems moved from prompts to chains, agents, loops, and multi-agent graphs. Logs show infrastructure. They do not explain how a Human–AI decision emerged.
01
Prompts became chains.
02
Chains became agents.
03
Agents became loops.
04
Loops became decision systems.
Traditional telemetry
Human–AI decision provenance
Request logs, latency, tokens, status codes.
Who asked, what was delegated, what was verified, who decided.
Infrastructure events in time.
Decision events in relation.
What the system did.
How a Human–AI decision emerged.
What is LLMography?
LLMography reconstructs Human–AI decision trajectories so they can be observed, attributed, measured, reproduced, explained, and audited.
Layer 1
Prompts, replies, tool calls, human interventions, and verification events as they occurred.
Layer 2
How observation, revision, feedback, and stopping conditions evolve inside a decision loop.
Layer 3
How humans, agents, models, tools, memory, policy, and orchestration relate across the system.
Signature object
Hover a node to inspect the metadata LLMography recovers: actor, action, time, and reason.
A human frames a decision, an LLM proposes a path, an agent delegates a tool call, verification rejects an unsupported claim, the human revises, and a decision is issued.. Human — Goal framing. Request issued (Need a defensible recommendation). Prompt — Task specification. Instruction recorded. LLM — Draft reasoning. Reply generated. Agent — Orchestration. Delegation. Tool — Evidence lookup. Executed. Observation — Returned evidence. Observed. Verification — Claim check. Rejected (Unsupported conclusion). Memory — Prior context. Recalled. Policy — Oversight rule. Constraint. Human — Intervention. Revision requested (Unsupported conclusion). Decision — Issued outcome. Approved
Research
LLMography begins as a scientific framework. The platform is a research preview derived from that work.
A working paper extending LLMography from conversation traces to loop- and graph-structured Human–AI decision systems.
Mohammed Bousmah · 2026-08-01 · Working paper
Concepts
Concept
The science of reconstructing, measuring, and auditing Human–AI decision trajectories.
Concept
The reconstructed path through which a Human–AI system arrives at a decision.
Concept
The design of iterative observe–act–verify–revise cycles in agentic systems.
Concept
The design of stateful, branching execution graphs for agentic work.
Concept
The record of prompts, replies, tool calls, interventions, and verification events.
Concept
How humans, agents, models, tools, memory, and policy relate across a system.
Evolution
01
A single human instruction produces a model output.
02
Multiple sequential LLM operations are composed into a path.
03
Models select tools and actions rather than only generating text.
04
Systems pursue goals across steps with partial autonomy.
05
Systems iterate, observe, verify, and self-correct.
06
Execution becomes stateful, branching, and structured.
07
The resulting Human–AI decision trajectory becomes observable and auditable.
Research preview
The LLMography Platform is a research preview for reconstructing Human–AI decision trajectories from traces.
Research preview
Coming soon
Decision trajectory
The reconstructed path from goal to issued decision.
Provenance graph
Actors, tools, memory, and verification as a structured graph.
Human interventions
Where a person asked, revised, approved, or stopped the loop.
Verification events
Checks that accepted, rejected, or returned work.
Agent activity
Delegations, tool calls, and orchestration steps.
Loop metrics
Proposed analytical indicators — not certified scores.
Timeline
Ordered events with residual gaps made visible.
Audit summary
What can be reconstructed, and what cannot.
Research network
Receive major LLMography research updates, papers, and platform announcements.
Research network
Share your details and we will follow up when there is meaningful research or platform news.
LLMography is building the scientific and technical foundations for reconstructing how humans and AI systems reach decisions together.