Hi everybody, I find a huge part of my job is talking to colleagues and clients and at the end of those phone calls, I have to write a summary of what happened, plus any key points that I need to focus on followup.

I figured it would be an excellent task for a LLM.

It would need intercept the phone call dialogue, and transcribe the dialogue.

Then afterwards I would want to summarize it.

I'm not talking about teams meetings or anything like that, I'm talking a traditional phone call, via a mobile phone to another phone.

I understand that that could be two different pieces of software, and that would be fine, but I am wondering if there is any such tool out there, or a tool in the making?

If you have any leads, I'd love to hear them.

Thank you so much

you are viewing a single comment's thread
view the rest of the comments

[–] Audalin@lemmy.world 15 points 3 months ago (7 children)

Haven't heard of all-in-one solutions, but once you have a recording, whisper.cpp can do the transcription:

https://github.com/ggerganov/whisper.cpp

The underlying Whisper models are MIT.

Then you can use any LLM inference engine, e.g. llama.cpp, and ask the model of your choice to summarise the transcript:

https://github.com/ggerganov/llama.cpp

You can also write a small bash/python script to make the process a bit more automatic.

[–] farsinuce@feddit.dk 1 points 3 months ago* (last edited 3 months ago)

It'd be perfect if you didn't have to record the calls, but instead could use something like Faster-Whisper and saving live transcribed text files instead.

load more comments (6 replies)