GPT‑Live

GPT‑Live

openai.com89 pointsby logickkk141 comments

Discussion summary

The discussion covers GPT‑Live's real-time translation capabilities, concerns about energy use and ethical issues, and the potential for local voice model deployment.

What the discussion says

  • Some users praise the translation quality, while others criticize it as still imperfect.
  • Concerns about energy demands and ethical implications are raised.
  • Interest in running voice models locally is expressed.
With this, human translators have been totally and absolutely a solved problem.
rvz
watched the live translation video very impressive.
zuzululu

Comments

Hacker News

With this, human translators have been totally and absolutely a solved problem with this version of real time translation.

This time is the most natural version that exists and it is a natural as a conversation.

To Downvoters: Why aren't you feeling the AGI?

by rvz

Why aren't you feeling the operating loss? :(

by slekker

“I don’t translate, I interpret” - Ahmed the best interpreter there ever was

by tomasphan

They most definitely did not solve real time translation yet. The French in the video is barely understandable, both the translation and the pronunciation are the quality of an American who hasn't used French since high-school.

by progval

>GPT‑Live can show it’s paying attention with phrases like “mhmm” or “yeah” [...]

Nooooooo!

by moralestapia

watched the live translation video very impressive

Seems like a shift from previous voice models where it sequentially processes voice to text then feeds it to LLM and then back which cant escape the clunky lag

not sure how pipecat stands now, gpt live seems like it takes audio tokens and does inference on it directly

by zuzululu

Any pricing announced yet?

by fnikacevic

Definitely in the right direction in terms of architecture. However those "hmmm" "uh huh" interjected in the demo are pretty awful.

by redox99

I for one am greatly looking forward to the day these kind of voice models can be run locally. It seems like the gap between open-weight and frontier is way larger for voice models than coding/language models.

by JasonSage

Very cool. Not cool bringing Brazil’s loss to Norway again. We're already devastated. No need to keep beating someone on the ground. :(

by HyperL0gi

Does this support more than one user voice? Or, are there plans for this? I did not see that mentioned in the announcement.

by vjulian

(Atty from OpenAI here)

You can choose among 9 voices in the app, all newly refreshed for GPT-Live. If you meant whether it can detect multiple people, it can (like in the livestream), but not always perfect. Would love to hear your feedback once you try it.

by athyuttamre

Absolutely can't wait to try this for language practice. The advanced voice mode is great but ultimately just doesn't work that well and doesn't have the feel of a natural conversation.

by rane

I like this and felt like some of it was much more fluid; but was I alone in feeling like the interjected "uh-huh" or "yeah?" moments felt a little jarring?

Almost felt a bit *uncanny valley* for what "natural" conversation is supposed to be like. If the "uh huh" isn't timed correctly, it'll feel like a zoom call with lag.

by fraywing

I agree. Many times those little interjections don't feel natural. It's impressive, but there's still a lot of room for improvement.

by burntalmonds

Every second of the interaction is uncomfortable to me, but I also have extreme difficulty with video calls with humans. The latency completely breaks my mind.

by AaronAPU

The potential conversational dynamics of people telling each other "quiet!" after they pick up the habit from talking with AI will be interesting. It could lead to people being more assertive and thoughtful, or it could be contentious and rude.

Awesome that they've improved that aspect of voice chat, though.

by observationist

Oh wow, I'd like this. Our current voice interactions with ChatGPT are on a 4o era model; really terrible. oAI has always been pretty cagey on the architecture of their end to end multimodal models. And RL has basically made them worse since launch. (Check the launch videos where the model sings, is more realtime, has accents, etc). I'd love to try a next gen version.

by vessenes

I do not fully understand the complexity behind achieving full-duplex but I hope this sets the bar for Anthropic to follow. Turn-based simplex is yesterday.

by dogscatstrees

Very cool. I thought the agent came in a little to hot at 1:03. I wonder how it decides when to jump in.

by smalltorch

Hoping to use this for natural conversation language learning. Previous iterations of the app kept correcting my words/grammar before it got to the model, causing issues with identifying mistakes in speech

by OsrsNeedsf2P

I was going to post a comment on a related topic (I couldn't find in the announcement if this is English only or not), but would you mind expanding? I was thinking about doing something very similar, and yeah, if the model isn't hearing the mistakes I'm making, that would dramatically decrease it's usefulness.

by MostlyStable

I was hopeful that they avoided the well known sultry voice this go around, but alas. There is little hope for these companies.

The full duplex is awesome, and the feedback that it is getting what you're saying is ok, but in some of the demos was a little overkill.

I'll agree that using the "Golden Girls" was at least more entertaining than the usual pitch.

by altcognito

"I was hopeful that they avoided the well known sultry voice this go around, but alas"

Why do you care? You can select other voices. Why do you need to control others?

What is at the root of your need for domination?

by HardCodedBias

You have always been able to pick between voices of many kinds though? Do you find them all sultry? From the British woman to the 17th century pirate soundalike?

by savanaly

This looks very cool. An AI that can listen and speak and handle tasks without breaking the flow of conversation would solve some big annoyances with current tools.

The concern is though as these get better will people struggle to distinguish these with real human connections?

by raychis

people have been mistaking AI conversations with reality since the very first text-based models came into the public view with ChatGPT. i'm sure with each incremental improvement to outputs like this, though, more people will get convinced of its "humanity"

(see https://www.reddit.com/r/MyBoyfriendIsAI/)

by bstsb

I'm very eager to test this for brainstorming!

One thing I noticed is that we lost vision feature for some reason on the live chat?

This was an extremely useful feature. Not sure if it’s a regional thing or that they just removed that from the current live chat.

I imagine it will be even more useful with this new version.

by HyperL0gi

(Atty from OpenAI here)

GPT-Live does not support video at this point, but we're working hard to introduce it soon. In the meantime, our previous Advanced Voice Mode will continue to be available and supports video.

by athyuttamre

Join the discussion

Write your take first — we'll ask for email only when you're ready to publish.

  • Hacker News
  • With this, human translators have been totally and absolutely a solved problem with this version of real time translation.

    This time is the most natural version that exists and it is a natural as a conversation.

    To Downvoters: Why aren't you feeling the AGI?

    by rvz
  • Why aren't you feeling the operating loss? :(
    by slekker
  • “I don’t translate, I interpret” - Ahmed the best interpreter there ever was
    by tomasphan
  • They most definitely did not solve real time translation yet. The French in the video is barely understandable, both the translation and the pronunciation are the quality of an American who hasn't used French since high-school.
    by progval
  • >GPT‑Live can show it’s paying attention with phrases like “mhmm” or “yeah” [...]

    Nooooooo!

    by moralestapia
  • watched the live translation video very impressive

    Seems like a shift from previous voice models where it sequentially processes voice to text then feeds it to LLM and then back which cant escape the clunky lag

    not sure how pipecat stands now, gpt live seems like it takes audio tokens and does inference on it directly

    by zuzululu
  • Any pricing announced yet?
    by fnikacevic
  • Definitely in the right direction in terms of architecture. However those "hmmm" "uh huh" interjected in the demo are pretty awful.
    by redox99
  • I for one am greatly looking forward to the day these kind of voice models can be run locally. It seems like the gap between open-weight and frontier is way larger for voice models than coding/language models.
    by JasonSage
  • Very cool. Not cool bringing Brazil’s loss to Norway again. We're already devastated. No need to keep beating someone on the ground. :(
    by HyperL0gi
  • Does this support more than one user voice? Or, are there plans for this? I did not see that mentioned in the announcement.
    by vjulian
  • (Atty from OpenAI here)

    You can choose among 9 voices in the app, all newly refreshed for GPT-Live. If you meant whether it can detect multiple people, it can (like in the livestream), but not always perfect. Would love to hear your feedback once you try it.

    by athyuttamre
  • Absolutely can't wait to try this for language practice. The advanced voice mode is great but ultimately just doesn't work that well and doesn't have the feel of a natural conversation.
    by rane
  • I like this and felt like some of it was much more fluid; but was I alone in feeling like the interjected "uh-huh" or "yeah?" moments felt a little jarring?

    Almost felt a bit *uncanny valley* for what "natural" conversation is supposed to be like. If the "uh huh" isn't timed correctly, it'll feel like a zoom call with lag.

    by fraywing
  • I agree. Many times those little interjections don't feel natural. It's impressive, but there's still a lot of room for improvement.
    by burntalmonds
  • Every second of the interaction is uncomfortable to me, but I also have extreme difficulty with video calls with humans. The latency completely breaks my mind.
    by AaronAPU
  • The potential conversational dynamics of people telling each other "quiet!" after they pick up the habit from talking with AI will be interesting. It could lead to people being more assertive and thoughtful, or it could be contentious and rude.

    Awesome that they've improved that aspect of voice chat, though.

    by observationist
  • Oh wow, I'd like this. Our current voice interactions with ChatGPT are on a 4o era model; really terrible. oAI has always been pretty cagey on the architecture of their end to end multimodal models. And RL has basically made them worse since launch. (Check the launch videos where the model sings, is more realtime, has accents, etc). I'd love to try a next gen version.
    by vessenes
  • I do not fully understand the complexity behind achieving full-duplex but I hope this sets the bar for Anthropic to follow. Turn-based simplex is yesterday.
    by dogscatstrees
  • Very cool. I thought the agent came in a little to hot at 1:03. I wonder how it decides when to jump in.
    by smalltorch
  • Hoping to use this for natural conversation language learning. Previous iterations of the app kept correcting my words/grammar before it got to the model, causing issues with identifying mistakes in speech
    by OsrsNeedsf2P
  • I was going to post a comment on a related topic (I couldn't find in the announcement if this is English only or not), but would you mind expanding? I was thinking about doing something very similar, and yeah, if the model isn't hearing the mistakes I'm making, that would dramatically decrease it's usefulness.
    by MostlyStable
  • I was hopeful that they avoided the well known sultry voice this go around, but alas. There is little hope for these companies.

    The full duplex is awesome, and the feedback that it is getting what you're saying is ok, but in some of the demos was a little overkill.

    I'll agree that using the "Golden Girls" was at least more entertaining than the usual pitch.

    by altcognito
  • "I was hopeful that they avoided the well known sultry voice this go around, but alas"

    Why do you care? You can select other voices. Why do you need to control others?

    What is at the root of your need for domination?

    by HardCodedBias
  • You have always been able to pick between voices of many kinds though? Do you find them all sultry? From the British woman to the 17th century pirate soundalike?
    by savanaly
  • This looks very cool. An AI that can listen and speak and handle tasks without breaking the flow of conversation would solve some big annoyances with current tools.

    The concern is though as these get better will people struggle to distinguish these with real human connections?

    by raychis
  • by OtomotO
  • people have been mistaking AI conversations with reality since the very first text-based models came into the public view with ChatGPT. i'm sure with each incremental improvement to outputs like this, though, more people will get convinced of its "humanity"

    (see https://www.reddit.com/r/MyBoyfriendIsAI/)

    by bstsb
  • I'm very eager to test this for brainstorming!

    One thing I noticed is that we lost vision feature for some reason on the live chat?

    This was an extremely useful feature. Not sure if it’s a regional thing or that they just removed that from the current live chat.

    I imagine it will be even more useful with this new version.

    by HyperL0gi
  • (Atty from OpenAI here)

    GPT-Live does not support video at this point, but we're working hard to introduce it soon. In the meantime, our previous Advanced Voice Mode will continue to be available and supports video.

    by athyuttamre

Related stories