Skip to content
Home
Waldo
Waldo · Why I am building itMay 2026 — Present

Waldo

Give Waldo a responsibility. Stop carrying it in your head.

An agent finishing a task and the task actually being done are two different things.

I’m building Waldo to keep hold of the desired result, coordinate the agents and tools working toward it, bring you in when judgment or permission matters, and preserve what remains until the result is verified or consciously changed.

  • Judgment now
  • Sustainable agency throughout
  • Physical authority later
Waldo product system map connecting a person with agents, accounts, and work tools
The wider product idea: one personal agent coordinating the tools, models, accounts, and specialist agents a person chooses.
RoleCo-Founder & CEO
TimelineMay 2026 — Present
System
SwiftSwiftUICodex App ServerSQLite / GRDBCloudflare Durable ObjectsTypeScriptReact Native

01 · What I learned

Agents got more capable. We inherited the coordination.

The session is a work log. The outcome is the product. When I was building and operating more than 30 production agent instances at Atlan, the difficult part was rarely getting an agent to produce something. It was remembering why each session existed, moving context between tools, catching a waiting decision, and checking whether the result actually solved the original problem.

Suyash felt the same pressure from another direction while running a design studio and training for an Ironman. His work, commitments, routines, and health lived in tools that never understood how those things affected one another. The software could show more information. It could not decide what mattered now, what could wait, or what no longer deserved to be carried.

Delegation has its own cognitive cost: deciding what to hand off, briefing it, supervising it, recovering from failure, and judging whether the risk was worth it. When that cost exceeds the work avoided, the agent has not really reduced the person’s burden.

The person delegated a problem, not a transcript—and should not inherit a second job stitching every result back into life. AI can do more work than ever. It should not leave you with more to carry.

The session

What the agent sees

The prompt, available tools, messages, artifacts, and whether its run finished.

The outcome

What actually changed

Whether the person’s original problem was solved, supported by evidence rather than confidence.

The person

What still matters

The judgment, follow-ups, consequences, capacity, and commitments left after the run.

02 · The product promise

The responsibility is the desired result—not the latest task, run, or failure.

Give Waldo what you need to become true—not a checklist of every step it should take. Waldo should keep hold of that desired result, coordinate the agents, tools, services, and people contributing to it, and return when judgment, permission, or a change of plan belongs to you.

A responsibility survives the latest task, agent run, interface, and failed attempt. Routine progress should not become another feed to supervise; what remains should not disappear merely because one agent stopped.

Work

Make sure the product update reaches customers this week.

Implementation, release, communication, and verification may involve different agents and tools. The responsibility remains the customer-visible result.

Life

Make sure my mother’s appointment is booked and she knows what to bring.

Scheduling, confirmation, preparation, and communication are contributing paths. The responsibility remains the real-world arrangement.

Relationships

Make sure nothing gets dropped after the investor meeting.

Commitments, follow-ups, replies, and decisions can unfold over days. The responsibility persists without living in the person’s working memory.

A failed deployment is evidence about one attempted path. It is not the responsibility, and the failure itself is not an Open Loop. Waldo must still verify whether customers can access the intended update.

An Open Loop is Waldo’s durable record of what remains unresolved relative to the desired result, why it remains unresolved, and where the work should return. The responsibility stays open until evidence supports the result and the person accepts it—or consciously repairs, reopens, defers, transfers, changes, or releases it.

03 · Agent governance

Delegate responsibility without surrendering control.

Running many agents taught me that starting them is not the hardest part. The hard part is deciding what they may see, what they may change, whether they acted once or twice, what actually became true, and what still belongs to the person.

Waldo is being designed to absorb that delegation tax: compose the permitted context, brief specialist agents, supervise bounded work, recover when a path fails, verify what became true, and return only the judgment or permission that belongs to the person.

The missing layer is agent governance. Waldo is being designed as the owner-side layer between a person and every model, specialist agent, tool, connector, service, or future machine acting on their behalf. It should make delegation useful without letting the machinery grant itself authority or decide that the person’s responsibility is closed.

Kennel and the other working foundations let us test parts of this today. End-to-end cross-surface governance is the target architecture, not a capability we claim as shipped. Kennel and other surfaces can propose work; Waldo’s online governed backend will decide what may become canonical or consequential.

The person must remain able to accept, repair, reopen, defer, transfer, change, or release the responsibility. More machine action should expand personal agency, not replace it.

Context

Purpose-bound context

An agent should receive the smallest attributable context required for the current Outcome—not the person’s complete memory.

Authority

Exact authority

Permission must be bounded to an action, resource, purpose, use, and expiry. Memory, past approval, or inferred preference is never current authority.

Execution

Constrained execution

Capabilities, credentials, budgets, cancellation, containment, and revocation must remain governed outside the model.

Truth

Governed truth

Activity is not completion. Provider reports, receipts, evidence, verification, acceptance, and what remains unresolved must stay separate.

04 · Current product and target

Kennel is the first home. Waldo is the relationship.

Today we have three working foundations that we use internally: Kennel on macOS, Waldo on mobile, and the durable backend and agent harness underneath them. Kennel has the strongest bounded acceptance evidence: attributable Codex sessions, conversation history, live processing state, same-task continuation, first-message handling, and archive cleanup.

Kennel is the first home, not the whole vision. It is Waldo’s initial wedge for people already coordinating several agents, giving that work one calm place to land—showing what the agent reports, what evidence supports, what needs judgment, and what remains unresolved without making the transcript the primary unit of value.

The target product is one Waldo carrying responsibilities across work and life. Production integrations, broad provider coverage, automatic artifact verification, and a complete cross-surface responsibility and governance experience are still being built. Today, the evidence is internal and foundation-level rather than proof of the complete integrated experience.

Current product

Three working foundations

Kennel, Waldo mobile, and the harness demonstrate separate parts of the relationship internally.

Target product

One Waldo across work and life

The same user-owned relationship should carry responsibilities across models, tools, services, devices, and contexts.

First wedge

Kennel on the Mac

Start where AI-output overload, review, judgment, and follow-through are already visible and painful.

Kennel on macOS showing attributable agent instances and their current state
Kennel today: a native Mac home for seeing agent work, opening the underlying session, and keeping the person in control.
Read the technical brief for the underlying system design

05 · One relationship

Many agents may work for you. One should always remain on your side.

Your life and your agents should not belong to two different systems. Personal assistants and work orchestrators have evolved as separate products, even though the user is the same person. Calendars, messages, reminders, commitments, and daily administration should not belong to a different identity from the sessions, runtimes, tools, budgets, and policies involved in getting work done.

I don’t believe one model or interface will own our entire digital life. People will use many models, specialist agents, tools, services, and devices. Waldo is being designed to join personal assistance and work orchestration through the same Outcome, authority, evidence, and continuity contracts.

An organization may own some infrastructure. The individual should own the continuing relationship. Models, tools, employers, and surfaces can change; the context a person chooses to share, their permissions, corrections, responsibility history, and unresolved work should remain with them.

Waldo may appear as mobile, a judgment in Kennel, messaging, voice, or eventually a physical form. Those are presences of one user-owned personal agent—not disconnected assistants that make the person rebuild context every time. One agent. Many presences. Still yours.

Context

Composed, not copied

Each agent or tool should receive the smallest attributable view required for the current Outcome—not an indiscriminate memory dump.

Continuity

Across every surface

Work, life context, corrections, and outcomes should stay connected without being trapped in one provider.

Portability

The relationship survives the provider

The person should be able to change models, tools, or employers without abandoning the context and outcome history they own.

06 · The product constitution

More capable agents should mean less life held together in your head.

An agent waiting five minutes is inexpensive. A person reconstructing context across five agents, reviewing unverified changes, and finding the correct terminal is expensive. Infinite machine capacity does not create infinite human attention.

Burnout is not a feature category. It is a product constraint: Waldo should not make people supervise more software, monitor more feeds, or remain permanently available. It should carry routine responsibility quietly and return only when timing, consequence, or authority belongs to the person.

Success means less mental reassembly, fewer silently decaying commitments, a realistic next action when capacity changes, and permission to decide that enough is enough.

After interruption

Less mental reassembly.

Restore the goal, last verified state, unresolved decision, artifacts, and smallest next action.

Before it decays

Keep meaningful commitments alive.

Carry forward what still deserves attention without turning every loose end into an alert.

When capacity changes

Offer an honest next move.

Respect what the person says about their capacity and help reduce, defer, or renegotiate the plan.

At the end of the day

Enough is a valid state.

Reconcile what became true and carry forward only what still deserves the person’s attention.

07 · What I believe

An agent should care about the person behind the task.

ChatGPT or Claude can answer what you ask. I want Waldo to understand why you need it, when it matters, what it affects, and whether it was actually resolved. The current prompt is only one fragment of a person’s priorities, relationships, boundaries, capacity, corrections, and commitments.

Life is already distributed across calendars, messages, files, health systems, models, tools, and other people. Waldo should help carry it forward without making the person rebuild themselves—or become the integration layer—every time the interface changes.

The chatbox made intelligence available. It cannot be the whole interface for asynchronous work, and ordinary people should not have to become natural-language programmers or agent managers to benefit. The next layer is continuity, timing, permission, evidence, and closure: proactive enough to prepare what matters, but never presumptive about consequential action.

Person before prompt

Care about the why

The request is only one fragment of the person’s intent and circumstances.

Action over dashboards

Insight must help

A feed, chart, or score that hands the coordination burden back to the user is not enough.

Agency over lock-in

The layer belongs to you

The person should be able to inspect it, correct it, change providers, and release what no longer matters.

Waldo mascot stepping away from an empty prompt box
The “death of the chatbox” idea: a personal agent should carry context and notice what matters instead of waiting behind an empty prompt.

08 · Principles I won’t trade away

A personal agent is a relationship with clear boundaries.

More execution should never mean less agency. We are building Waldo’s working foundations and target architecture around a human rule: continuity must be inspectable, correction easy, and authority fail closed.

Waldo should learn from what a person says, the corrections they make, and outcomes they verify. Explicit self-knowledge should outrank behavioral inference; activity should never become a hidden personality score.

Human closure

Completion is evidence. Closure belongs to the person.

A green check, stopped process, commit, or final message can describe the run. Only the user can close the real obligation.

Proactivity

Suggest before execute

Low-risk assistance may be proactive; consequential action must stay bounded by visible permission.

Durable responsibility

Interfaces may disappear. Responsibility cannot.

Replaceable models and temporary screens still need an inspectable record of intent, action, evidence, and consequence.

Personal memory

Memory can be corrected and released

The user must be able to inspect, correct, export, delete, and revoke what Waldo carries. Memory must never silently become permission.

09 · The strategic map

Judgment now. Sustainable agency throughout. Physical authority later.

I see three connected pressures, but I do not treat them as three equal markets. AI-output overload is the customer problem we can attack now through Kennel. Burnout and finite human capacity are the constitution for how Waldo should behave. Physical AI is the expansion horizon where the same questions of permission, evidence, interruption, and recovery become more consequential.

The confidence is different too: the overload and burnout problems are already visible; the physical-world tailwind is strong, but Waldo has not yet validated a hardware product or customer wedge there. The wider curve is consumer: capable intelligence is becoming cheap enough to move agents from specialist tools into everyday products.

Swipe or use the arrow keys to compare all four columns.

The three pressures shaping Waldo and Kennel, their strategic role, product fit, and current confidence
PressureStrategic roleWaldo / Kennel fitConfidence
AI-output overloadImmediate customer problemKennel’s current wedgeHigh
Burnout economyProduct constitutionHow Waldo should behaveHigh problem · medium market
Physical worldExpansion horizonBodies for AI pathwayHigh tailwind · low current validation

10 · The interface lesson

Agents exist. I want to make them personal.

Steve Jobs and Steve Wozniak helped turn computers from something hobbyists operated into something ordinary people could make part of their lives. I see agents at the same interface transition: the capability exists, but using it still asks people to think like operators.

A line Jobs wrote about the Macintosh stays with me: “It’s our job to make complex technology easy to use and fun to use.” Waldo is my attempt to do that for agents without hiding intent, consequence, control, or who remains responsible.

Portrait of Steve Jobs seated against a red background in January 1984
Steve Jobs, January 1984. Photograph by Bernard Gotfryd, Library of Congress; no known copyright restrictions.Image source and rights

11 · The expansion horizon

Software earns the right to become physical.

I keep returning to bodies for AI: physical forms people would actually welcome into daily life—a desk object, wearable, home device, vehicle, or small robot. The same Waldo should inhabit each of them, carrying one identity and permission system instead of making every object another disconnected assistant.

The physical-AI tailwind is strong, but this is not a current Waldo hardware program and we have low current customer validation for it. Software comes first because identity, correction, permission, evidence, interruption, revocation, and recovery must work before a personal agent is trusted with sensors, movement, or physical authority.

Health and body data matter to me as foundational, permissioned life context; they are not Waldo’s product category. The form may change. The person it works for should not.

A desk

A calm presence

An object that can speak, listen, and carry context without demanding another screen.

A body

Wearable or home device

New senses and forms for the same user-owned agent, under the same personal policy.

Eventually

Consumer bodies for AI

Physical forms made for ordinary life—not only factories, warehouses, and industrial autonomy.

Waldo mascot centered on a vivid orange field
A familiar character across surfaces: the physical form can change while the agent’s identity, memory, and permissions remain continuous.

12 · Who I’m building with

Waldo is the first company the three of us are building.

Ashish and I became friends at school over a shared obsession with iOS jailbreaking. Years later, I met Suyash in the Computer Center at IIITDM Jabalpur and showed him how to build a website by describing it to an AI coding tool. Waldo is the first company the three of us are building together.

Co-Founder & CEO · AI systems & engineering

Shivansh Fulper

Leads agent architecture, infrastructure, and engineering. Previously built and operated 30+ production agents at Atlan; also worked on Indic language-model data, open-source GovTech, and a from-scratch Qwen3 MoE implementation.

Co-Founder · Product, experience & brand

Suyash Pingale

Leads product, experience, brand, and design. His experience running a design studio while training for an Ironman helped expose how much work and life context still had to be coordinated in a person’s head.

Founding Engineer

Ashish Tembhekar

Spent nine months working as an AI engineer before joining Waldo. He built much of the first app and health-data pipeline and now works across native iOS, Supabase, and agent infrastructure.

13 · Artifacts

See the work, then go deeper.

Start with the work itself: the founders, product, system, company, and site. The outside signals come after.

Founder video · 01:13

Why we started Waldo

Shivansh and Suyash on the problem, the personal-agent thesis, and why this team is building it.

Open founder video

Product video · Earlier foundation

The path from body context to action

An earlier mobile product chapter. It shows where Waldo began; Kennel and the user-owned continuity layer are the current wedge.

Open product video

Technical & vision brief

How Waldo works

The system model, current foundations, permission boundaries, architecture, and longer physical-AI direction.

Read the technical brief

Pitch deck

The company in twelve slides

The problem, wedge, platform, team, and path from personal agents to consumer bodies for AI.

Open the pitch deck

Product site

Meet Waldo

The public product story and the earlier interaction system that led to today’s Kennel-first direction.

Visit heywaldo.in

External signal · Paras Chopra

The delegation tax is the product problem

Paras Chopra frames agent use as learned delegation: discovering what to hand off, briefing it, supervising it, recovering from failure, and absorbing risk. His conclusion sharpens Waldo’s product test—the agent must reduce that cognitive cost behind interfaces ordinary people already know how to use.

Read Paras Chopra’s post

External signal · Andrew Chen

More outcomes, fewer copilots

Andrew Chen describes the shift from AI that assists to agents that act—and the frustration of receiving more work to review. Waldo’s answer is not action alone: it is evidence-backed acceptance, visible human judgment, and continuity the user owns.

Read Andrew Chen’s post

External signal · Y Combinator

Fifty personal agents later, coordination became the problem

YC gave individual employees personal agents, then built QM when managing the fleet became difficult. QM is the organizational answer. Waldo asks the personal question: as agents multiply across work and life, what keeps your context, permissions, judgment, and accepted outcomes coherent—and on your side?

Read YC’s QM notes

External signal · YC RFS

The consumer moment follows the cost curve

YC’s Fall 2026 RFS argues that intelligence is becoming capable and cheap enough for everyday products across how people get things done, learn, stay healthy, and connect. Waldo is being built into that curve as one user-owned agent across work and life.

Read YC’s consumer AI request

Historical reference · Steve Jobs Archive

Make complex technology personal

In his 1999 Macintosh anniversary email, Jobs described Apple’s role as bridging sophisticated technology and ordinary people. That interface lesson shapes how I think about making agents useful beyond today’s hobbyists and operators.

Read Steve in his own words

Many agents may work for you. One should always remain on your side.