Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Multimodal UX - Audio Component #1112

Open
wants to merge 29 commits into
base: main
Choose a base branch
from
Open

Multimodal UX - Audio Component #1112

wants to merge 29 commits into from

Conversation

nking-1
Copy link
Collaborator

@nking-1 nking-1 commented Feb 5, 2025

Implements an audio component for the Jupyter widget.

  1. Adds some plumbing for mock data to be passed from the audio() guidance function to the Jupyter widget.
  2. Implements a new audio player component with waveform visualization. Still working on the look and feel, but core functionality, including start, stop, seek, and volume control, are all working.
  3. Sets us up for handing off the current work to the back end team. We'll be working on image and video in the meantime.

nopdive and others added 22 commits November 11, 2024 13:01
Missing import error catch in environment detection.
Moved exceptions catch into one line.
Not yet implemented, but available to call within notebooks.
Primitives were duplicating code.
Audio/image/video now have API primitives to generate from model.
Very basic but enough for rendering.
Also added sample audio/video assets (both creative commons).
This is important as we're using kernel comms (JSON) behind the scenes.
Clean-up of previous commit.
Important for package testing.
Console prints, frontend controls need to be added later.
@nking-1
Copy link
Collaborator Author

nking-1 commented Feb 5, 2025

There are some large formatting changes to existing code from using the "Svelte for VS Code" extension. It seems like that's actually using Prettier under the hood. Sam and I chatted about this and will move forward with using it as our default formatter so hopefully the formatting changes won't happen again.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants