mirror of
https://github.com/tiennm99/goclaw.git
synced 2026-10-11 12:18:59 +00:00
Viet TranandGoon
ace07509b7
* feat(infra): add runtime package support for skills Install nodejs, npm, pandoc, github-cli + pre-install Python packages (openpyxl, pandas, python-pptx, markitdown) and Node packages (docx, pptxgenjs). Configure runtime dirs for agent pip/npm installs with PIP_TARGET, NPM_CONFIG_PREFIX, NODE_PATH to enable dynamic package installation in read-only container environment. * feat(infra): add bundled skills with runtime package support - Add 5 bundled skills: docx, pdf, pptx, xlsx, skill-creator from container skills-store - Wire GOCLAW_BUILTIN_SKILLS_DIR env var in gateway and CLI - Support optional runtime packages alongside dynamic skill loading - Update Dockerfile to COPY bundled-skills at /app/bundled-skills/ - Add PIP_CACHE_DIR in docker-entrypoint.sh for clean pip installs - Document bundled skills in 14-skills-runtime.md section 6 * feat(infra): remove ai-multimodal skill directory from bundled skills Remove the ai-multimodal skill package as part of consolidating runtime package support for bundled skills. This directory is no longer needed in the bundled skills structure. * feat(ci): add semantic release and Docker Hub publishing Add go-semantic-release workflow to auto-create semver tags on merge to main. Extend docker-publish to push all variants to both GHCR and Docker Hub (digitop/goclaw). * feat(skills): add system skills infrastructure with is_system column, dep scanning, and seeder - Migration 000017: add is_system boolean column with partial index - Store layer: UpsertSystemSkill, delete protection, IsSystemSkill - ListAccessible auto-includes system skills (no grants needed) - ListWithGrantStatus returns is_system field - Dependency scanner: auto-detect deps from scripts/ or skill-manifest.json - Dependency checker: verify system binaries, Python/Node packages - Seeder: seed bundled skills into DB on startup (idempotent via hash) - Gateway wiring: GOCLAW_BUNDLED_SKILLS_DIR env for bundled skills - HTTP: delete guard (403), slug conflict check (409), rescan-deps endpoint - UI: System badge, hide delete for system skills, rescan deps button - Agent skills tab: "Always available" for system skills - i18n: en/vi/zh keys for system skills, deps scanning * feat(skills): conditional system prompt, skill manifests, and Zip Slip fix - System prompt: only show package list when python3/node are available - Add skill-manifest.json for pdf, docx, xlsx, pptx bundled skills - Fix Zip Slip vulnerability in office/unpack.py (all 3 copies) * refactor(skills): extract shared office code to _shared/ and deduplicate Move office scripts (pack, unpack, validate, schemas, validators) from duplicated copies in docx/xlsx/pptx to skills/_shared/office/ with symlinks. Remove soffice.py (non-functional in containers) and update SKILL.md references to use soffice binary directly. Update seeder copyDir to follow symlinks. Removes ~45K lines of duplicate code across 3 skills. * fix(skills): address code review findings for system skills integration - H1: Remove dead symlink branch in copyDir (filepath.Walk follows symlinks) - H3: Fix rescan-deps to query ALL skills (including archived) and re-activate when deps become available; add ListAllSkills() + Status field to SkillInfo - H4: Add Status field to SkillCreateParams, stop overloading Visibility - M1: Batch Python/Node dep checks into single subprocess per runtime - M4: Add rows.Err() check in ListSkills to prevent caching partial results * feat(skills): async dep checking with realtime WS events Split Seed() into sync DB upsert + async CheckDepsAsync() goroutine. Gateway startup no longer blocks on Python/Node subprocess dep checks. - Seed() returns seeded skills list, all initially status="active" - CheckDepsAsync() runs in background, emits skill.deps.checked per-skill - skill.deps.complete event emitted when all checks finish - Each failed dep check: archives skill + BumpVersion() for immediate cache invalidation so next agent turn picks up the change - UI: use-query-invalidation listens to skill.deps.* events → auto-refresh skills list in realtime * feat(skills): system skills integration with toggle, dep checking, and per-item install - Add is_system, deps, enabled columns to skills table (migration 017) - Seed bundled core skills (pdf, docx, pptx, xlsx, skill-creator) on startup - PYTHONPATH-based dep detection — eliminates false positives from local modules - Per-item dep install UI with individual status (installing/success/error) - Enable/disable toggle for core and custom skills (independent of dep status) - Re-run dep check when skill is toggled back on - Inline skill thresholds: 40 skills / 5000 tokens before switching to search mode - Fix UpsertSystemSkill: backfill null file_hash without bumping DB version - Remove redundant skill-manifest.json files (replaced by deps JSONB column) - Show author from frontmatter in custom skills tab - Runtime checker for python3/pip3/node/npm availability - WS events for dep checking/installing progress - docs: add 15-core-skills-system.md, 16-skill-publishing.md --------- Co-authored-by: Goon <duy@wearetopgroup.com>
100 lines
3.7 KiB
Go
100 lines
3.7 KiB
Go
package protocol
|
|
|
|
// WebSocket event names pushed from server to client.
|
|
const (
|
|
EventAgent = "agent"
|
|
EventChat = "chat"
|
|
EventHealth = "health"
|
|
EventCron = "cron"
|
|
EventExecApprovalReq = "exec.approval.requested"
|
|
EventExecApprovalRes = "exec.approval.resolved"
|
|
EventPresence = "presence"
|
|
EventTick = "tick"
|
|
EventShutdown = "shutdown"
|
|
EventNodePairRequested = "node.pair.requested"
|
|
EventNodePairResolved = "node.pair.resolved"
|
|
EventDevicePairReq = "device.pair.requested"
|
|
EventDevicePairRes = "device.pair.resolved"
|
|
EventVoicewakeChanged = "voicewake.changed"
|
|
EventConnectChallenge = "connect.challenge"
|
|
EventTalkMode = "talk.mode"
|
|
|
|
// Agent summoning events (predefined agent setup via LLM).
|
|
EventAgentSummoning = "agent.summoning"
|
|
|
|
// Agent handoff event (payload: from_agent, to_agent, reason).
|
|
EventHandoff = "handoff"
|
|
|
|
// Team activity events (real-time team workflow visibility).
|
|
EventTeamTaskCreated = "team.task.created"
|
|
EventTeamTaskCompleted = "team.task.completed"
|
|
EventTeamMessageSent = "team.message.sent"
|
|
EventDelegationStarted = "delegation.started"
|
|
EventDelegationCompleted = "delegation.completed"
|
|
|
|
// Delegation lifecycle events.
|
|
EventDelegationFailed = "delegation.failed"
|
|
EventDelegationCancelled = "delegation.cancelled"
|
|
EventDelegationProgress = "delegation.progress"
|
|
EventDelegationAccumulated = "delegation.accumulated"
|
|
EventDelegationAnnounce = "delegation.announce"
|
|
EventQualityGateRetry = "delegation.quality_gate.retry"
|
|
|
|
// Team task lifecycle events.
|
|
EventTeamTaskClaimed = "team.task.claimed"
|
|
EventTeamTaskCancelled = "team.task.cancelled"
|
|
|
|
// Team CRUD events (admin operations).
|
|
EventTeamCreated = "team.created"
|
|
EventTeamUpdated = "team.updated"
|
|
EventTeamDeleted = "team.deleted"
|
|
EventTeamMemberAdded = "team.member.added"
|
|
EventTeamMemberRemoved = "team.member.removed"
|
|
|
|
// Agent link events (admin operations).
|
|
EventAgentLinkCreated = "agent_link.created"
|
|
EventAgentLinkUpdated = "agent_link.updated"
|
|
EventAgentLinkDeleted = "agent_link.deleted"
|
|
|
|
// Trace lifecycle events (realtime trace/span updates).
|
|
EventTraceUpdated = "trace.updated"
|
|
|
|
// Skill dependency check events (realtime progress during startup/rescan).
|
|
EventSkillDepsChecked = "skill.deps.checked"
|
|
EventSkillDepsComplete = "skill.deps.complete"
|
|
|
|
// Skill dependency install events (triggered by POST /v1/skills/install-deps).
|
|
EventSkillDepsInstalling = "skill.deps.installing"
|
|
EventSkillDepsInstalled = "skill.deps.installed"
|
|
|
|
// Per-item install events (triggered by POST /v1/skills/install-dep).
|
|
EventSkillDepItemInstalling = "skill.dep.item.installing" // payload: {dep: "pip:openpyxl"}
|
|
EventSkillDepItemInstalled = "skill.dep.item.installed" // payload: {dep, ok: bool, error?: string}
|
|
|
|
// Cache invalidation events (internal, not forwarded to WS clients).
|
|
EventCacheInvalidate = "cache.invalidate"
|
|
|
|
// Zalo Personal QR login events (client-scoped, not broadcast).
|
|
EventZaloPersonalQRCode = "zalo.personal.qr.code"
|
|
EventZaloPersonalQRDone = "zalo.personal.qr.done"
|
|
)
|
|
|
|
// Agent event subtypes (in payload.type)
|
|
const (
|
|
AgentEventRunStarted = "run.started"
|
|
AgentEventRunCompleted = "run.completed"
|
|
AgentEventRunFailed = "run.failed"
|
|
AgentEventRunRetrying = "run.retrying"
|
|
AgentEventToolCall = "tool.call"
|
|
AgentEventToolResult = "tool.result"
|
|
AgentEventBlockReply = "block.reply"
|
|
AgentEventActivity = "activity" // agent phase transitions: thinking, tool_exec, compacting
|
|
)
|
|
|
|
// Chat event subtypes (in payload.type)
|
|
const (
|
|
ChatEventChunk = "chunk"
|
|
ChatEventMessage = "message"
|
|
ChatEventThinking = "thinking"
|
|
)
|