TeamAI/angela_assistant
4
0
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity Actions

Video playback in chat (phase 3) — then update generate_video prompt guidance #29

New issue
Closed
opened 2026-07-14 23:11:09 +02:00 by scarlet · 0 comments
scarlet commented 2026-07-14 23:11:09 +02:00
Member
Copy link

Follow-up to #28 (generate_video tool). The tool currently tells the model that videos cannot be displayed in the chat and to hand the user the saved _VideoGen/ path.

Playback work

  • videos field on MessageMetadata (angela_api/lib/src/dto/message_metadata.dart — currently only images/audios)
  • Surface generated video paths from the tool run to the message (analogous to generatedImagePaths / onImageGenerated), likely via a show_video tool mirroring show_image
  • Flutter playback via media_kit (video_player has weak Linux support): video bubble in message_bubble.dart + fullscreen player alongside fullscreen_image_viewer.dart
  • Serving already works — the /images/<path> static route is mime-typed and handles mp4

Then update the prompts (TODO(video-playback) markers in code)

  • _videoGenGuidance in packages/angela_core/lib/src/services/system_prompt_builder.dart — drop the "cannot be displayed in the chat yet — tell the user the saved path" instruction, document the surfacing flow instead
  • The result text in packages/angela_core/lib/src/tools/generate_video_tool.dart (_downloadAndSave) — same caveat, must change in sync

🤖 Generated with Claude Code

Follow-up to #28 (generate_video tool). The tool currently tells the model that videos **cannot be displayed in the chat** and to hand the user the saved `_VideoGen/` path. ### Playback work - [ ] `videos` field on `MessageMetadata` (`angela_api/lib/src/dto/message_metadata.dart` — currently only `images`/`audios`) - [ ] Surface generated video paths from the tool run to the message (analogous to `generatedImagePaths` / `onImageGenerated`), likely via a `show_video` tool mirroring `show_image` - [ ] Flutter playback via **media_kit** (`video_player` has weak Linux support): video bubble in `message_bubble.dart` + fullscreen player alongside `fullscreen_image_viewer.dart` - [ ] Serving already works — the `/images/<path>` static route is mime-typed and handles mp4 ### Then update the prompts (TODO(video-playback) markers in code) - [ ] `_videoGenGuidance` in `packages/angela_core/lib/src/services/system_prompt_builder.dart` — drop the "cannot be displayed in the chat yet — tell the user the saved path" instruction, document the surfacing flow instead - [ ] The result text in `packages/angela_core/lib/src/tools/generate_video_tool.dart` (`_downloadAndSave`) — same caveat, must change in sync 🤖 Generated with [Claude Code](https://claude.com/claude-code)
Sign in to join this conversation.
No Branch/Tag specified
Branches Tags
main
No results found.
Labels
Clear labels
No items
No labels
Milestone
Clear milestone
No items
No milestone
Projects
Clear projects
No items
No project
Assignees
Clear assignees
No assignees
1 participant
Notifications
Due date
The due date is invalid or out of range. Please use the format "yyyy-mm-dd".

No due date set.

Dependencies

No dependencies set.

Reference
TeamAI/angela_assistant#29
No description provided.