DZHANER Back to projects GitHub

LOCAL AI / AGENTS / SYSTEMS

EIDEN

A private local AI platform exploring how a language model can become an engineering system: reasoning locally, using tools, interacting with infrastructure and eventually coordinating multiple specialized agents.

PYTHONOLLAMALLMsAI AGENTSLOCAL AI

CASE STUDY / ARCHITECTURE

EIDEN / Local AI Agent Platform

Local intelligence layer with explicit boundaries between reasoning, tools, memory and execution.

LOCALPRIVATEMODULAR
E
EIDENLOCAL AI AGENT PLATFORMPrivate intelligence layer · reasoning · tools · memory · execution
01
INTERFACE2 components
Web / CLIRequests & commands
Local APIApplication boundary
02
EIDEN CORE3 components
Memory / StateContext across tasks
Tool ManagerControlled capabilities
03
LOCAL RUNTIME3 components
Local ModelsLLMs / embeddings
ToolingAPIs · CLI · files · infra
04
EXECUTION2 components
Controlled ActionsApproved operations
InfrastructureSystems & services
01THE IDEA

Not another chatbot.

EIDEN started from a simple question: what happens when a local language model is treated as the intelligence layer of an engineering system rather than as a conversational interface?

The objective is to build a private AI environment that can reason about tasks, call tools, work with APIs and eventually interact with infrastructure under controlled permissions.

Keeping the model local is a deliberate architectural choice. It gives the system a foundation where data, models and execution remain under the operator's control.

02ARCHITECTURE

Model, orchestration and tools are separate layers.

EIDEN is designed so the model runtime is not tightly coupled to the application or the tools it can use. This makes the system easier to evolve as models, agent frameworks and capabilities change.

ReasoningInterpret and evaluate
Memory / StateContext across tasks
ToolingAPIs · CLI · files · infrastructure
APIsInformation and integrations
CLILocal commands
InfrastructureControlled system interaction
Local ModelLLM / embeddings
03LOCAL EXECUTION

The model runs where the system runs.

Ollama provides the local model runtime. The application can interact with the model without making hosted inference the foundation of the system.

This also makes the architecture useful as a laboratory for testing different local models and agent approaches without redesigning the surrounding system.

  • Local model execution.
  • Python integration layer.
  • Local control over prompts, tools and workflows.
  • No requirement for a hosted LLM API for the core prototype.
04AGENT MODEL

Move from answers to actions.

The important boundary is that model output is not automatically equivalent to permission to execute an operation.

Need Information?Select an allowed tool
Tool CallRetrieve required information
Controlled ExecutionApproved operation
Observe ResultCapture the outcome
ContinueAnother controlled step
ResponseReturn the result
05ENGINEERING DIRECTION

From one agent toward a system of specialized agents.

The longer-term direction is a modular agent architecture where different responsibilities can be separated instead of forcing one model to perform every task.

Infrastructure

Analyze infrastructure state, configuration and operational tasks.

Security

Focus on security analysis, suspicious behavior and defensive checks.

Automation

Turn approved plans into repeatable scripts, API calls and infrastructure workflows.

Coordinator

Break larger tasks into smaller pieces and coordinate specialized capabilities.

06ENGINEERING PROBLEMS

The hard part is control, not conversation.

Tool boundaries

deciding exactly what an agent can access and execute.

State

maintaining useful context across multi-step operations.

Reliability

handling incorrect model assumptions instead of treating generated output as ground truth.

Observability

understanding what the agent decided, which tools it called and what happened as a result.

Model independence

keeping the surrounding architecture flexible enough to change local models.

07STATUS

An evolving engineering platform.

EIDEN is an ongoing prototype rather than a finished product. The value of the project is in building and testing the architecture around local intelligence: models, agents, tools, execution, state and infrastructure.

Future work can add stronger orchestration, persistent memory, controlled infrastructure tools, multiple specialized agents and more explicit approval and audit mechanisms.

08WHY IT MATTERS

AI as an engineering capability.

EIDEN connects two areas that are increasingly converging: infrastructure engineering and AI systems.

Instead of treating AI as a separate feature, the project explores how local intelligence can become another layer of an engineering platform — capable of understanding systems, using tools and assisting with operational work while remaining constrained by explicit technical boundaries.