Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Chat history for devs ($1,000) #1327

Open
2 tasks
kodjima33 opened this issue Nov 15, 2024 · 10 comments
Open
2 tasks

Chat history for devs ($1,000) #1327

kodjima33 opened this issue Nov 15, 2024 · 10 comments

Comments

@kodjima33
Copy link
Collaborator

kodjima33 commented Nov 15, 2024

  • as a developer, I want to be able to see chat history (at least with my app)
  • as a developer, I want to see response from llm when I send {notification} request

Explanation 1st part
In my mentor app, sometimes I get spammed with same types of notifications. This happens cuz I don't have access to chat history and don't know what already was said by my app to the user before. I need access to chat history
image

Explanation for 2nd part:
When I'm sending notification to client using "notification" scope, it's very hard to debug if i can't receive the response back to server.
When I'm replying to a client from webhook using "notification" capability, I want to see the response from LLM

I want to know, was the notification sent or not? what was sent?

Without such context, my mentor app is dumb - it doesn't know what it recently said to the user


This is a paid bounty task. Reward is $1,000 in cash. Once completed, link your PR and email [email protected] for reward

@kodjima33 kodjima33 moved this to To do in omi TODO Nov 25, 2024
@kodjima33 kodjima33 changed the title As a developer, when sending notification to client, I want to be able to see the response from LLM As a developer, when sending notification to client, I want to be able to see chat history and the response from LLM Nov 25, 2024
@kodjima33 kodjima33 changed the title As a developer, when sending notification to client, I want to be able to see chat history and the response from LLM Chat history for devs Nov 28, 2024
@kodjima33 kodjima33 changed the title Chat history for devs Chat history for devs ($1,000) Nov 29, 2024
@tiagoefreitas
Copy link

I can work on this because I also need it, is there a process to get started or the first to send a PR gets the bounty?
Is there a deadline?
@kodjima33

@kodjima33
Copy link
Collaborator Author

I can work on this because I also need it, is there a process to get started or the first to send a PR gets the bounty?

Is there a deadline?

@kodjima33

@tiagoefreitas try getting it done by tmrw. Just do a PR. If not we will do it ourselves

@tiagoefreitas
Copy link

@kodjima33 its 1am here (UTC), I will try to do it during the day tomorrow, if that is too long feel free to start it

@tiagoefreitas
Copy link

@kodjima33 is there an admin closer to UTC timezone?

I think the best solution is to add a debug webhook to developer settings that sends the logs and the app can then log it to their preferred system.

A UI inside the Omi app will not be very good for developers but if you think it's useful I can add it.

@tiagoefreitas
Copy link

@kodjima33 can you clarify the difference from chat history and the notification messages from the llm? aren't they the same thing?

you want a UI inside omi app to show both the user transcript and the notifications on the same timeline?
I think providing a webhook to send the notifications to the app has the same effect, because then you can store both the relevant transcript messages that originated the notification, and the notification itself, to a log facility or your database, as the app developer sees fit, and provides a lot more control, because only the app knows exactly what in the transcript triggered the notification, and only that part is relevant to log

I am working on it now

@kodjima33
Copy link
Collaborator Author

Chat history and notifications is same but

This needs to be functionality for omi integration apps

@tiagoefreitas
Copy link

Understood, I have a PR ready just need to test more before pushing.

It adds a new webhook setting to apps and Omi calls that webhook and sends the notification and metada to the plug-in app.

Then the app can store it or log it as the dev prefers.

Does this solve the requirement?

@kodjima33
Copy link
Collaborator Author

@tiagoefreitas can you push rn? will test

if we couldn't test now, @beastoin will do it today

beastoin added a commit that referenced this issue Nov 29, 2024
Issue: #1327

## TODO
- [x] Add user_chat capacity to proactive notification
- [ ] Try with internal logs first
https://us5.datadoghq.com/dashboard/5p3-sb2-q2c/omi-apps-devtool-log?fromUser=false&refresh_mode=sliding&from_ts=1732750755142&to_ts=1732923555142&live=true

## Deploy steps
- [ ] Deploy backend
- [ ] Deploy pusher
- [ ] Deploy plugin
@tiagoefreitas
Copy link

tiagoefreitas commented Nov 30, 2024

here is my PR: #1440

@beastoin beastoin moved this from To do to In progress in omi TODO Dec 2, 2024
@beastoin beastoin moved this from In progress to In review in omi TODO Dec 2, 2024
@beastoin beastoin self-assigned this Dec 2, 2024
@tiagoefreitas
Copy link

@beastoin @kodjima33 I updated the PR with a notifications webhook per app and global developers config, and added an example to the mentor app that logs the notifications.
I am having issues adding an app to my dev backend to test it properly, but it should work.

@beastoin beastoin moved this from In review to Done in omi TODO Dec 9, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
Status: Done
Development

No branches or pull requests

3 participants