Layer researchIntelligence and learning
Intelligence & learning
Status: complete (published 2026-08-19). Scope finalized at Batch C kickoff with maintainer POV; see findings.md and sources.md.
Scope inventory (v0)
- Estate: BI and dashboards, notebooks and data science platforms, feature stores, model registries, MLOps
- Agent-era: conversational analytics over metrics layers, LLMOps/AgentOps, eval infrastructure (golden datasets, LLM-as-judge, human review queues, regression gates), trace-to-dataset curation
- Improvement machinery: fine-tuning and distillation pipelines, A/B and canary rollout for agent changes, experiment tracking, classical ML (classifiers, topic models, forecasting) as the deterministic muscle next to LLMs
- Risk: model risk management alignment for regulated environments
Challenged-default candidates
LLM-first analytics vs metrics-layer grounding; buying eval platforms vs building on open tooling. Each track proposes its final list at kickoff.
Files
findings.md and sources.md carry this track's research. The scoping brief and the vendor map were archived on 2026-08-23 (see archive/, decision D038).
Cite this page
Written by Murali Sid, Founder and AI Systems Architect, last updated 18 September 2026. Licensed CC BY-SA 4.0, so quote it freely with attribution.
Murali Sid (2026). Intelligence & learning. Agentic Architecture Skills. https://www.agenticarchitectureskills.com/library/layers/r06-intelligence-and-learningMachine-readable version of this page: /library/layers/r06-intelligence-and-learning.md