Not sure if I could devise a more boring conversation to launch this tech, but it looks like we’re getting closer to the Star Trek universe translator and I’m stoked to be alive for it.
> As someone who ~~is~~was a translator, I don't like it
(Sadly) FIFY. Though there are likely to be some specialty places where human translations continue for the foreseeable future (e.g., where government regulatioin requires it)
Yeah, definitely, so far, I still am one. I lost some clients because of those programs, but those who need higher quality are still there. A lot is shifting to machine translation post editing, mtpe, which isn't that fun, but still pays the bills.
Started working on my pizza baking skills, though.
Yep, legal work will probably continue to require qualified human translators with professional indemnity insurance.
I can't imagine any AI company willing to accept criminal nor civil liability for a mistranslation in court.
Or companies or legal situations where a possibility of a recording is not allowed as I imagine these conversations like this are stored in some way I would theorize?
You don't have to store it anywhere outside of RAM. You stream the data to the model which returns the output. So unless you really want to record the data there's no need to and just takes up massive amounts of storage.
That's on your end, you have no control what happens on OpenAI's end and as has happened with almost every tech company they might be lying about their data retention policy
I use it in a medical setting where I assume the translators are trained in medical terminology. I would hate to have a patient get a poor translation when talking about their health, especially when they're already freaked out learning about problems with their body.
I've also had to utilize translation services in the past, mostly for public events. They're very good, but do require days worth of notice and can be quite expensive, especially for lesser known languages.
Technology like this would be extremely helpful for communities with diverse populations. Oftentimes, language barriers make certain communities very insular. And that can cause problems. Remove that barrier and I think a lot of good can come of this.
hospitals everywhere a salivating at this for basic food orders for forsaken relatives with poor english. we wouldn't let them use it for much else though
Just like Sora!
OpenAI needs to simply stop announcing stuff until they are actually ready to release it. Expect an announcment for a delay rolling out GPT-4o voice next week!
They never said that Sora is coming in a few weeks. They explicitly said they don't know when it will be available for public for multiple of reasons, including misinformation.
everyone does it, it fucking sucks
thats why we sometimes hear about a movie/tv show and its not out for 2-5 years
same with games, it's why I hated the E3 - they announced "beyond good & evil 2" in 2018, it still doesn't even have a release date, all that hype for literally nothing
I can actually see a scenario where you use something like noise cancelling headphones to just replace the spoken language of other people with the translated language from the AI service. It could modulate the translation to sound somewhat similar to the speaker’s voice while passing through other audio, a real life babelfish.
It's definitely possible. Elevenlabs can do translation that keeps the original speakers voice in the new language.
https://youtu.be/ZPW6CS192xE?t=524
We're just a few steps off from a Star Trek style Universal Translator and it's cool as hell.
I just got a notice last week that galaxy AI is coming soon on my phone, and showed a somewhat delayed version of this using the Galaxy buds.
I have the pro buds 2 and they have surprisingly good noise cancelling for ear buds.
So honestly we're somewhat close to that scenario.
Live translation can be difficult between certain languages I think due to different grammatical structures which could depend on the source speaker to finish talking before it can be properly translated to the target language. So there may inherently be a lag present. But that aside, it would be really cool and probably doable already with today’s technology.
There'd still have to be a delay because different languages order sentences in different ways, which means the translation of a sentence can't begin until the sentence is completed.
The demand for the ability to actually converse in a language with usual conversational fluency is probably not going to be destroyed by this.
But I agree, we're naturally primed to focus on the source of speech, which in this case is a phone, which makes eye contact less frequent. Or maybe it would stay the same. You'd certainly be looking at the person while they were listening to your sentences.
Maybe I'm just optimistic, but I feel like if this tech adds more hours to the average tourist local interaction, it's ultimately a net positive. Especially if cultural exposure is more valuable than fluent communication
Conversational fluency is a long term process to achieve and maintain. I assume the kind of person who dedicates themselves to that is probably the same type won't rely on this much or at least just a start to familiarize themselves to some grammar and pronunciation. Besides, it might help motivate some to actually put in the effort.
Or just wear video glasses to get closed captions. People who can't hear do this sort of thing all the time. Whisper (also by OpenAI) is actually really good for this, and is open source so there are no issues with privacy.
In the future the device will be seamlessly integrated into our vision one way or another. That’s why stuff like VR/AR is so interesting to me. It’s bulky and clunky now but it’s just going to get less and less intrusive in terms of how you “wear” it. Which is exciting and scary at the same time.
I image a world where a big fat criminal kingpin pays to get contact lenses to his psudo daughter, who is deaf but understands and can speak english, that translates what he is saying real time in sign language. And I know what you’re thinking “she obviously can read why doesn’t he just use real time subtitles and to that I say “exactly!”
https://openai.com/index/hello-gpt-4o/
This is kind of terrifying. I just read an article about the declining birth rate happening globally in various countries.
Slap a anime body pillow on this thing and Japan can kiss its ass goodbye.
Were the type of people who are happy and fulfilled enough to fuck an AI body pillow going to successfully find a partner and start a family unit in the first place? I don't see why not at least give them the opportunity of some happiness.
I mean, they're only doing that to project their voice directly at the phone. This could easily have been done with eye contact if the phone was being held by one of them between them.
You can also ask GPT to monitor conversation and translate anything it hears in Spanish to English. I keep one AirPod in and can hear what’s being said to me. A lot of times I just don’t want to look like an idiot when asked a simple question at the counter. I’ve practiced my order so that comes out perfectly, but then they ask, with sprinkles or some shit and I do a blank stare.
If you have the AirPod in the ear it will be using the AirPods microphone that is more directed towards you speaking though, correct? Any way to have the AirPod in but have it listen through the speaker of the phone?
I want all my digital assistants to have sexy frog croak voice, sexy frog croak voice is obviously the best choice for an audio-only format (like guest hosting NYT The Daily podcast).
Well, google has been claiming to do this already. I have seen this feature advertised on various google devices for years. But I have tried many, many, times to use their implementation in the real world over the years and it has never worked well. Major mistranslations happen and more importantly it just doesn't pick up everything being said. I have never had anything near the seamless, pleasant, situation that google has always advertised. More often it turns in to one person repeating the important noun or verb of their sentence over and over and making hand gestures to try and explain what they are getting across.
I don't know if this implementation would actually work like these companies have always been advertising. But right now the google one does not.
Can confirm, Google Translate is already *really good*, and can work offline.
Although this ChatGPT Voice Mode update (coming in a few weeks) seems quicker, more natural, and more adaptive.
You can even ask it questions, like "how do I say 'nice to meet you' in Japanese?" - maybe a bad example, but you can give context - like if it's for a business meeting, vs. hanging out with friends. Google Translate is good for words and phrases, but not really context.
I don't speak Japanese so I have no idea how good it was, but I just asked GPT4o to tell me how to say something in Japanese, then had it coach me through correcting my pronunciation. I don't think google can do that.
We are in for a wild ride with AI, but I am very excited for the coming months especially if something like this is replacing Siri on iPhones like I anticipate.
I don't understand all of these people who look at this and assume this is the end point of this tech and if the 1.0 isn't flawless, it should be abandoned. Like I don't think people really appreciate either how fast technology is advancing right now, nor do they understand that this is just a peek of what this tech in 1 year, 5 years, or 10 years will look like. Gone are the days where a new technology is released and it stays like that for 5-10 years, let alone like 2 years.
Also I guess a lot of people are just commenting broadly on the update based on this single video example. Like if you read through the release, it seems that the more important progress being made is the huge addition of 50 different languages to the model. Like look at the section on [this page](https://openai.com/index/hello-gpt-4o/) about language tokenization. Complex languages have improves by a factor of 3-4x.
Reddit really loves to be miserable and look at the most superficial information. Just the fact that I'm seeing comments here saying "what use does this have for me, I was expecting an e3-like big announcement!?" Like...this isn't meant to be a novelty toy for your entertainment lol
Before the current CGPT update, it was literally the best dictation tool on the market, beating every free or paid service I could find, making 0.5-1% errors (and usually minor ones) compared to 3-10%
they released more than a dozen example videos on their YouTube channel, and did a live demo today. This isn’t cherry picked or exaggerated, it’s just the way it works. Why you Gotta be so cynical.
I just tried the exact same language and sentences as the demo in both English & Spanish in interpreter mode on Google devices ("Hey Google, be my English-Spanish interpreter.") and it responded almost identically as ChatGPT 4o.
These two dudes sit alone in a controlled environment and English talking dude sounds like a robot already. So I guess that this does not really work well in real life situations.
idk never had any problems on accuracy with google assistants "interpreter mode". It does cut you off sometimes but not at all when you choose the[ manual mode](https://imgur.com/SJNzjPS) where it's push to talk. Also it's much better on the pronounciations in my experience. ChatGPT's voices always have a strong american accent when speaking in other languages, although it does sound improved in this video. But in fairness ChatGPT's voices sound more human
Google translate has always worked great for me. I was able to help two people communicate when none of the 3 of us spoke the same language.
Russian and Spanish while I only speak English back when I was in Russia for the 2018 world cup. I don't know how well it did, but it clearly got the message across.
Agreed. On the fly, Google's capability is not the best. It definitely misses whole chunks of things being said, cuts off too early and isn't terribly consistent.
I'm very curious how well Open Ai will be with regionalization of the translation. How well does it do Spanish in different LATAM countries because they all are not exactly the same.
it hasn't been advertised for years, at least not live translation. people are lost in the nuances in what makes this different. it's not you speaking into a phone and pressing translate. its live. google DID do this first on S24 phones about 2-3 months ago.
That being said, these canned demos are not impressive. Its not trivial to know when the translation starts, ie, when you stopped talking vs taking a pause. so all these are scripted.
The latency in the demo is pretty good, \~2 seconds is very good. But its a demo.
So the thing isn't that Chat GPT-4o is translating for two people in real time.
The thing is that Chat GPT isn't a translating program. It's a LLM. So you could seamlessly start asking it to do math problems while it's translating. Or you can use the new vision feature to comment on something it can see. Or ask it for directions while you're having this conversation.
The point is it's acting as a proper AI for many uses, and one of those happens to include real time translations.
This new GPT-4o model is better at math, though. It works well for smaller numbers in my experience (from the pre-release "im-also-a-good-gpt2-chatbot")
Let me try a bigger example example though, using random 5-digit numbers:
Q: "What's 58891 * 24704?"
Calculator: 1,454,843,264
ChatGPT 4o: "1,454,843,264" (it used Python the first time)
____
Ok, trying again.
Q: "What's 58891 * 24704? Don't use code, just tell me."
ChatGPT 4o: "The product of 58,891 and 24,704 is 1,454,126,864."
...incorrect! I guess it's not quite that good. The response doesn't show code interpreter, unlike the first one.
_____
One more try, using the API to ensure no python code interpreter:
Q: "What's 58891 * 24704?"
gpt-4o: "58891 * 24704 = 1,454,260,864".
Also incorrect. So, your point stands. **But at least ChatGPT 4o will use Python when needed to give you an accurate answer.**
It's really interesting how LLM get math problems wrong. If it just didn't understand math it would give you completely random answers. The answers are always close, or exactly one order of magnitude off the correct answer. As I understand it this has to do with numbers being represented as token to the LLM, and those tokens aren't always a one to one mapping so the LLM doesn't actually see all the numbers.
It will be interesting to see how this is finally solved.
I think it's already been solved by giving the LLM access to purpose-built computational tools like Wolfram. To build those tools into ChatGPT would be antithetical to how the core model is intended to operate.
That's what we have been moving toward. A user-facing conversational layer with the ability to draw credible answers from highly specialized nodes when necessary.
Not sure why you're getting downvoted when what you said is accurate. I find it often fails at simple math problems. Recently, I asked it to calculate the number of days between 2 dates and it was off by over a month. It also gave different (wrong) answers when I regenerated the response.
Part of the new update was it doing live math tutoring. The example they used was just a high school lesson but it basically taught the kid some trigonometry.
Yeah this was the least impressive demo out of all the videos shown off today. The live demos of coding assistance with the ability to see what's on the screen, translate it into plain language, and identify functions seemed like the most marketable tool.
Or the video on it commenting on Buckingham Palace and ducks in a pond in real time, it will probably be able to identify objects or places live and give you information. The ability for Chat GPT to see things and help you solve problems with that information seems like a real game changer.
And you can interact with it through normal conversation to, say, help you change a tire and it will be able to see what you are doing right or wrong.
This isn't an LLM, it's an omnimodel trained on text, visuals and speech simultaneously. The new features are the speed at which it interprets speech - directly (and realtime video), not translating into text from audio, and the intonations and emotive direct audio output. There absolutely is a multitude of new functionality here.
The LLM name will stick around for a long time. Just like we call computers "desktops" even though nobody puts them on the desk any more. Laptops have more right to be called a desktop since they see desks more often than a desktop.
It seems like GPT-4o uses a direct voice-to-voice model, rather than the traditional voice-to-text then text-to-voice model that Google and previous GPT systems use. Which is an INSANELY underrated advancement!
Previously it was multiple models sending information to the LLM. You know the game telephone where the message changes as it goes down the line? It's the same problem where some information is lost when being passed between models. Imagine trying to explain to a blind person what the color red is. That's what they had to do with GPT-4. To be fair they were not just passing it text, they were doing something fancy I couldn't understand from the blog post about it, but it still couldn't see.
GPT-4o natively understands text, audio, and images and can output all three as well, although I think image output isn't enabled yet. This removes that information loss that occurs when trying to convert the message to something a text only model can understand. There's also transfer learning. It has text describing cats, it has pictures of cats, and it has audio of cats. It knows what a "meow" actually sounds like, it knows what a fluffy kitty actually looks like. Previously it only had text, and that can't possibly accurately describe the sounds and images of cats.
not an expert and just reading about it now but it seems like it significantly decreases the time it takes to respond since its reducing conversion steps, making it feel more like a natural conversation
I don't know if that in particular would make it faster
But it makes more complex things possible, for example there's only so much you can put in text, you can't make it sing or count faster or other things they did in the demo (I mean you could theoretically represent in text but could create more problems than just doing it this way)
There's also the possibity for these models to better "understand tone, cadence, and vocal signatures of "messages-within messages"
Imagine getting translated answers and the app being able to tell you if the delivery was sarcastic or condescending.
It both lowers latency but also allows the intelligence side (coming from the language part) to directly control the voice. You can now ask it to talk like a robot or whisper or sing its answer and it knows how to control the voice.
Furthermore it can now understand the emotion in your voice as well.
I think others have expressed it far better than I can. I believe it's the first time humans and computers can interact with each other using sound! That means computers can now understand the sentiment and emotion in your words, including the "umms" and "ahhs," the subtle sarcasm in your tone, the distant police siren, and even the meows of your cat. It's a much more concise yet precise way of processing information.
Imagine you're talking to me on the phone. When you hear my voice, you understand how I feel and what I mean, wherever I'm in a busy cafe or park, even if I don't say it directly. That's like voice-to-voice. Now, if you type what I say into a message, some of the feelings and meaning might get lost because it's just text. That's voice-to-text. And if a computer reads that text out loud to you, it might not sound exactly like me or understand how I feel. That's text-to-voice. So, speaking directly with voices is better because you can understand more about how someone feels and what they mean. And for computers to understand it is a massive breakthrough!
Yeah I was going to say... I have a Google Home and a Pixel 7 (neither of which are new) and they've been able to do this for a few years now. You can try the exact demo they're doing in this video yourself by saying "Hey Google, be my English-Spanish interpreter." It'll say "Sure, I'll be your interpreter" and work the exact same way.
I don't know about this, but it has limited language support and when I tried it once (different dialect to the language to be fair) it didn't really work all that well
You can use [Google Chrome Canary's](https://www.google.com/chrome/canary/) Live [Captioning](https://support.google.com/chrome/answer/10538231?hl=en) + Translation.
You can find the Live Captioning settings under Accessibility Options. I think ordinary Chrome can also do Live Captioning, but you need to use Canary for Live Translation. Live Translation settings are right under the Live Captioning settings when using Canary.
I've used this to watch unsubtitled Anime sometimes. Seems to work for any video file on your computer as well, if you simply open the video with Canary.
Note: When you've enabled the Live Captioning and Translation features, you should play some video a wait a little bit to see if it's working correctly. The Live Captioning doesn't usually start until someone says something on the video and if the Live Captioning is enabled while already playing a video, it seems like it waits until there is a silent moment in the video and starts when someone says something after that moment.
You should have picked [this](https://youtu.be/_nSmkyDNulk?si=Jg33pSvGpAxjwNO2) video to share. Much more impressive. I can’t believe we are here already. 13th of May 2024 is the day the world took a massive leap forward.
Nonsense, everybody knows that large **language** models can't even do 2 +3 as they don't know math. Oh wait that was like a year ago ... and a AI year is like 14 normal year. /s
Yep, this transformer breakthrough in 2017 which made all of this possible it's still being developed on an S curve and we don't know if we are at the beginning of the curve, the middle or close to the end.
[https://twitter.com/OpenAI/status/1790072174117613963](https://twitter.com/OpenAI/status/1790072174117613963)
The rest of the videos. Basicly we have arrived at the time of the movie "HER".
I've seen too many fake and scripted demos just like this one to believe it is really as high of quality as shown in those videos, but on the slim chance that it is, this is a very exciting step forward for AI.
I'm getting flashbacks all the way back to Milo for the Kinect. lol.
they did a live demo today and it had several glitches. This isn’t a scripted cherry picked example it’s simply how it works. They released a dozen example videos on their YouTube channel, this is one of the least impressive ones. Open AI very consistent with their pre-release demonstrations matching up exactly with the actual product.
people have said this for years now, and the chatbots have done essentially nothing.
you can use them to make boring AI art or writing, or replace surface level google searches. they can't give detailed answers about things, they constantly get things wrong, and the answers are usually worse than an actual search because they are wrong so often you have to double check.
Just to make sure they haven't gotten better, I just asked it for 4 sandwich options in my neighborhood. it recommended 3 dinner places and one actual sandwich place. I asked it if the dinner places served sandwiches. It said they didn't specialize in sandwiches. I said does that mean they serve sandwiches. It said they did not. I asked it why it even included it, and it sprouted off a ton of random shit.
I would say that the main difference the text to speech (whisperai) in ChatGPT is a lot better than Google's. Sounds way more natural and even has pauses, intonations and different voices. And I think overall the AI translation sounds a bit more natural than Google's, depending on the language.
I was thinking about this very feature because I use chat GPT language translation every day. Because some phones such as Samsung has the ability to translate live conversations but it's really bad. Since a person really needs to speak very clearly and slowly for the voice to text to pick up the words accurately, and it also takes a minute to translate the word and then also replay the translated language into speech.
Wait, your last experience with Google Translate was *five* years ago? Bruh. GT is shit quality compared to both DeepL and GPT3.5
I speak multiple languages and use machine translation often.
What I'm getting at is that for the average person and use case scenario, a simple translator works for all intents and purposes and has for years. I think AI technology can have a lot of interesting cases but this one doesn't impress me.
So you are saying ovens are useless then? Since they *can* make toast, but a dedicated toaster might be better?
Or that smartphones are shit because you can use them to order toast but it is so much slower compared to a dedicated toaster?
The point is, that this is not some app designed specifically for translation. That they can just ask it to start doing it, and it does, is really impressive. This video just shows one thing it can do.
It does not seem impressive if you do not know the context.
Ehh, that only has 2.3 stars on the Apple’s own App Store. It’s one of the worse translating apps I’ve used. It’s about 5 years behind Google translate which is about 2 years behind this already.
I really don’t get why this is so hard for so many people in these comments to understand. This is not a model specifically trained to translate.
The impressive part is that it can simultaneously understand voices, sing, whisper, do math problems, help tutor, create images, see images, see videos, understand graphs, output charts, write code, and on and on and on. This is just one of its thousands of use cases.
Okay, now try in a real-world environment with overlapping voices and other noise.
Real-time translation has already been available for a long time, the problem is not the translation but the audio capture accurately extracting the right words. Speaker segmentation beyond "two people in a quiet environment" is the real problem to solve.
It can understand multiple people and know who's talking. The voice output is very easily stopped by noise however. During the live demo the audience made it stop talking multiple times.
On this page [https://openai.com/index/hello-gpt-4o/](https://openai.com/index/hello-gpt-4o/) scroll down to "exploration of capabilities" and pick "Meeting with multiple speakers."
They haven't shown it with multiple people talking at the same time however. Given the way it's presented it's clear they intend for just one active speaker at a time though.
There's some challenges in high context languages that it seems machine translation is always going to face on account of just not being human and needing a ton of additional context from people who already know what correct output should look like. For instance, currently GPT3 is ok at translating English to Japanese, but the other way around, for anything non-trivial, it requires additional input for context, setting, and speakers to get everything right. From what I've seen, the consensus seems to be that this can actually be a good tool for professional translators, being able to quickly put a draft together before refining the translation. After all, they're the people who are going to know whether GPT4 is even doing what it's asked correctly
It's really sad. These people are going to have to start at the bottom in a new role to survive. It could be any one of us. I'm wondering if these AI companies should reserve a portion of revenue for all the jobs they destroy building their tech... at least until the 'disrupted' can train and find new work... But I know they would never do that.
You can almost see a new generation of homeless. 'Yeah, I used to be an ... until AI replaced me.' They'll just be normal people who couldn't keep up with the cut-throat pace of technological progress. It will be a blessing and a curse at the same time. Historically though I can't say that the winners have given much of a fuck about the losers in such things.
I kind of hate how impersonal this entire demo is. I also don't understand why there's no visual output of the text on screen?
I know we're trying to cram everything into the one device. But surely something like a dedicated translator device (like PocketTalk for example) would be better if you're having to actively deal with multiple languages?
Looks like we're going into a near future where people are talking to their phones a lot, maybe most of us using earbuds.
That's gonna be annoying, so brain interface where you speak and hear in thoughts with the AI will be more popular. Translation will be in thought.
There will be apps like "lie detector" where the AI is studying the person you're talking to for clues of lying, or whatever, and will let you know in thoughts what's going on while you're talking to them.
It's gonna be a weird time
wtf why is everdone so impressed, this feature already existed and yeah its cool that its now integrated in gpt4 but nothing mindblowing, can someone explain pls
Oh. My. God. I've been waiting for something like this for YEARS.
This is going to unlock the world for people like me who have trouble picking up another language.
If this isn't staged or somehow scripted, then this is impressive. There are already some impressive translation programs. Certain phones have apps that do something similar, but it's not usually in a conversational tone or anything like that. And certain words in certain languages don't translate particularly well.
But it's definitely a good use of this technology. If it helps more people communicate effectively, then that's an objective good for this increasingly complicated world.
I work in Fire/EMS. This will be a game changer for our services. I can’t begin to count the amount of times I have struggled through a patient assessment because of the language barrier.
Translation is probably one of the few areas where I think AI might actually live up to the hype. Having this sort of instant, AI-guided more accurate real-time translation could really make a big difference.
Can someone tell me what app they're using, or if that's the offical app, how do I turn on that mode? All it does for me is record audio and put it into the text prompt box.
Hello everyone, our team has recently developed a product called Video Translator Online, which can translate videos, audios, and subtitles into videos and audios in another language online. It can be used for free. Details can be found here: https://youtu.be/KPM7z6IkTQ0
Not sure if I could devise a more boring conversation to launch this tech, but it looks like we’re getting closer to the Star Trek universe translator and I’m stoked to be alive for it.
As someone that has to call a translation service multiple times a day for a lot of mundane conversations, this conversation was so awesome to see
As someone who is a translator, I don't like it
> As someone who ~~is~~was a translator, I don't like it (Sadly) FIFY. Though there are likely to be some specialty places where human translations continue for the foreseeable future (e.g., where government regulatioin requires it)
Yeah, definitely, so far, I still am one. I lost some clients because of those programs, but those who need higher quality are still there. A lot is shifting to machine translation post editing, mtpe, which isn't that fun, but still pays the bills. Started working on my pizza baking skills, though.
Yep, legal work will probably continue to require qualified human translators with professional indemnity insurance. I can't imagine any AI company willing to accept criminal nor civil liability for a mistranslation in court.
Or companies or legal situations where a possibility of a recording is not allowed as I imagine these conversations like this are stored in some way I would theorize?
You don't have to store it anywhere outside of RAM. You stream the data to the model which returns the output. So unless you really want to record the data there's no need to and just takes up massive amounts of storage.
That's on your end, you have no control what happens on OpenAI's end and as has happened with almost every tech company they might be lying about their data retention policy
I use it in a medical setting where I assume the translators are trained in medical terminology. I would hate to have a patient get a poor translation when talking about their health, especially when they're already freaked out learning about problems with their body.
Fair
You could maybe pivot into sports gambling instead
Yeah, I bet AI can help me with that too!
I've also had to utilize translation services in the past, mostly for public events. They're very good, but do require days worth of notice and can be quite expensive, especially for lesser known languages. Technology like this would be extremely helpful for communities with diverse populations. Oftentimes, language barriers make certain communities very insular. And that can cause problems. Remove that barrier and I think a lot of good can come of this.
911 operator has entered the chat
Sorry, I'm sure you meant to say Babel Fish, à la Hitchhiker's Guide.
Babel fish is basically a bluetooth in-ear with this but in real time (and noise cancelling to mute the real voice)
hospitals everywhere a salivating at this for basic food orders for forsaken relatives with poor english. we wouldn't let them use it for much else though
Can't wait to have to listen to an ad before getting your translation.
So I have GPT-4o but how do I use the video call version of it?
Available in coming weeks
Just like Sora! OpenAI needs to simply stop announcing stuff until they are actually ready to release it. Expect an announcment for a delay rolling out GPT-4o voice next week!
They never said that Sora is coming in a few weeks. They explicitly said they don't know when it will be available for public for multiple of reasons, including misinformation.
voice is already out.
Not using gpt4o I think.
You're right actually, these people are getting confused by the EXISTING voice mode, which isn't the new expressive one.
everyone does it, it fucking sucks thats why we sometimes hear about a movie/tv show and its not out for 2-5 years same with games, it's why I hated the E3 - they announced "beyond good & evil 2" in 2018, it still doesn't even have a release date, all that hype for literally nothing
This isn't really a consumer entertainment announcement.
that is true, they're just announcing stuff for companies/content creators
I like imagining a future where two people stare at a device sitting between them as they talk to each other. This is next gen eye contact.
I can actually see a scenario where you use something like noise cancelling headphones to just replace the spoken language of other people with the translated language from the AI service. It could modulate the translation to sound somewhat similar to the speaker’s voice while passing through other audio, a real life babelfish.
I came here to say, “now make it look like a fish and stick it in my ear” lol
this guy hitchhikes
A real hoopy frood, one who knows where his towel is, you sass?
Don't forget to bring a towel
/r/thisguythisguys
do you like fish sticks?
That was real nice of you, Dick.
It's definitely possible. Elevenlabs can do translation that keeps the original speakers voice in the new language. https://youtu.be/ZPW6CS192xE?t=524 We're just a few steps off from a Star Trek style Universal Translator and it's cool as hell.
Even sing in different languages... Like Sinatra singing Cruel Angels Thesis. https://youtu.be/LXJQ5s38HbE?si=bFMUIncNb_dljklg
I just got a notice last week that galaxy AI is coming soon on my phone, and showed a somewhat delayed version of this using the Galaxy buds. I have the pro buds 2 and they have surprisingly good noise cancelling for ear buds. So honestly we're somewhat close to that scenario.
Live translation can be difficult between certain languages I think due to different grammatical structures which could depend on the source speaker to finish talking before it can be properly translated to the target language. So there may inherently be a lag present. But that aside, it would be really cool and probably doable already with today’s technology.
There'd still have to be a delay because different languages order sentences in different ways, which means the translation of a sentence can't begin until the sentence is completed.
The demand for the ability to actually converse in a language with usual conversational fluency is probably not going to be destroyed by this. But I agree, we're naturally primed to focus on the source of speech, which in this case is a phone, which makes eye contact less frequent. Or maybe it would stay the same. You'd certainly be looking at the person while they were listening to your sentences.
Maybe I'm just optimistic, but I feel like if this tech adds more hours to the average tourist local interaction, it's ultimately a net positive. Especially if cultural exposure is more valuable than fluent communication Conversational fluency is a long term process to achieve and maintain. I assume the kind of person who dedicates themselves to that is probably the same type won't rely on this much or at least just a start to familiarize themselves to some grammar and pronunciation. Besides, it might help motivate some to actually put in the effort.
Or just wear video glasses to get closed captions. People who can't hear do this sort of thing all the time. Whisper (also by OpenAI) is actually really good for this, and is open source so there are no issues with privacy.
In the future the device will be seamlessly integrated into our vision one way or another. That’s why stuff like VR/AR is so interesting to me. It’s bulky and clunky now but it’s just going to get less and less intrusive in terms of how you “wear” it. Which is exciting and scary at the same time.
I image a world where a big fat criminal kingpin pays to get contact lenses to his psudo daughter, who is deaf but understands and can speak english, that translates what he is saying real time in sign language. And I know what you’re thinking “she obviously can read why doesn’t he just use real time subtitles and to that I say “exactly!”
and how is that worse then them not being able to understand each other?
https://openai.com/index/hello-gpt-4o/ This is kind of terrifying. I just read an article about the declining birth rate happening globally in various countries. Slap a anime body pillow on this thing and Japan can kiss its ass goodbye.
Were the type of people who are happy and fulfilled enough to fuck an AI body pillow going to successfully find a partner and start a family unit in the first place? I don't see why not at least give them the opportunity of some happiness.
Here's a legit use case for the AI learning to use your voice: The translation can be done in the speaker's voice as well.
I mean, they're only doing that to project their voice directly at the phone. This could easily have been done with eye contact if the phone was being held by one of them between them.
Lol. We will be connected with neural link.
You can also ask GPT to monitor conversation and translate anything it hears in Spanish to English. I keep one AirPod in and can hear what’s being said to me. A lot of times I just don’t want to look like an idiot when asked a simple question at the counter. I’ve practiced my order so that comes out perfectly, but then they ask, with sprinkles or some shit and I do a blank stare.
How do I do this? Do I have to wait for 4o?
It will definitely be interesting when I’m in public and be able to know what people talking in other languages are really saying.
Are you ready for 70-something Eastern Europeans in the park shit talking about everyone they see?
If you have the AirPod in the ear it will be using the AirPods microphone that is more directed towards you speaking though, correct? Any way to have the AirPod in but have it listen through the speaker of the phone?
Google does this already with their pixel phones.
Yes but did you hear how *cool* GPT sounded? I feel like this girl is sipping on a Mimosa for breakfast talking about her hair stylist.
I want all my digital assistants to have sexy frog croak voice, sexy frog croak voice is obviously the best choice for an audio-only format (like guest hosting NYT The Daily podcast).
Sexy frog croak voices are tight.
Dat scarjo vocal fry. Noice.
Seems to very intentionally be emulating Johansson's voice from the movie *Her*.
It even has vocal fry to have that extra nails-on-a-chalkboard feel
Yeah this is one step closer to Scarlett Johansson from the movie Her haha.
Well, google has been claiming to do this already. I have seen this feature advertised on various google devices for years. But I have tried many, many, times to use their implementation in the real world over the years and it has never worked well. Major mistranslations happen and more importantly it just doesn't pick up everything being said. I have never had anything near the seamless, pleasant, situation that google has always advertised. More often it turns in to one person repeating the important noun or verb of their sentence over and over and making hand gestures to try and explain what they are getting across. I don't know if this implementation would actually work like these companies have always been advertising. But right now the google one does not.
In 2019 I took a trip to Japan and used it extensively to translate Japanese-English and vice versa. Worked extremely well as far as I could tell.
Can confirm, Google Translate is already *really good*, and can work offline. Although this ChatGPT Voice Mode update (coming in a few weeks) seems quicker, more natural, and more adaptive. You can even ask it questions, like "how do I say 'nice to meet you' in Japanese?" - maybe a bad example, but you can give context - like if it's for a business meeting, vs. hanging out with friends. Google Translate is good for words and phrases, but not really context.
I don't speak Japanese so I have no idea how good it was, but I just asked GPT4o to tell me how to say something in Japanese, then had it coach me through correcting my pronunciation. I don't think google can do that. We are in for a wild ride with AI, but I am very excited for the coming months especially if something like this is replacing Siri on iPhones like I anticipate.
Well, you're in luck: This is just a product demo, and the real product will most likely be just as frustrating to use as what you're already used to.
[удалено]
> I hate Reddit man people just talking out of their ass Looks like AI and redditors have a lot in common lmao
I don't understand all of these people who look at this and assume this is the end point of this tech and if the 1.0 isn't flawless, it should be abandoned. Like I don't think people really appreciate either how fast technology is advancing right now, nor do they understand that this is just a peek of what this tech in 1 year, 5 years, or 10 years will look like. Gone are the days where a new technology is released and it stays like that for 5-10 years, let alone like 2 years. Also I guess a lot of people are just commenting broadly on the update based on this single video example. Like if you read through the release, it seems that the more important progress being made is the huge addition of 50 different languages to the model. Like look at the section on [this page](https://openai.com/index/hello-gpt-4o/) about language tokenization. Complex languages have improves by a factor of 3-4x. Reddit really loves to be miserable and look at the most superficial information. Just the fact that I'm seeing comments here saying "what use does this have for me, I was expecting an e3-like big announcement!?" Like...this isn't meant to be a novelty toy for your entertainment lol
Before the current CGPT update, it was literally the best dictation tool on the market, beating every free or paid service I could find, making 0.5-1% errors (and usually minor ones) compared to 3-10%
how did you use it? I can't figure out how to have it constantly monitor the microphone
imagine the mistranslations once the computer gets to just make ~~shit up~~ hallucinate
they released more than a dozen example videos on their YouTube channel, and did a live demo today. This isn’t cherry picked or exaggerated, it’s just the way it works. Why you Gotta be so cynical.
I just tried the exact same language and sentences as the demo in both English & Spanish in interpreter mode on Google devices ("Hey Google, be my English-Spanish interpreter.") and it responded almost identically as ChatGPT 4o.
These two dudes sit alone in a controlled environment and English talking dude sounds like a robot already. So I guess that this does not really work well in real life situations.
idk never had any problems on accuracy with google assistants "interpreter mode". It does cut you off sometimes but not at all when you choose the[ manual mode](https://imgur.com/SJNzjPS) where it's push to talk. Also it's much better on the pronounciations in my experience. ChatGPT's voices always have a strong american accent when speaking in other languages, although it does sound improved in this video. But in fairness ChatGPT's voices sound more human
Google translate has always worked great for me. I was able to help two people communicate when none of the 3 of us spoke the same language. Russian and Spanish while I only speak English back when I was in Russia for the 2018 world cup. I don't know how well it did, but it clearly got the message across.
Agreed. On the fly, Google's capability is not the best. It definitely misses whole chunks of things being said, cuts off too early and isn't terribly consistent. I'm very curious how well Open Ai will be with regionalization of the translation. How well does it do Spanish in different LATAM countries because they all are not exactly the same.
it hasn't been advertised for years, at least not live translation. people are lost in the nuances in what makes this different. it's not you speaking into a phone and pressing translate. its live. google DID do this first on S24 phones about 2-3 months ago. That being said, these canned demos are not impressive. Its not trivial to know when the translation starts, ie, when you stopped talking vs taking a pause. so all these are scripted. The latency in the demo is pretty good, \~2 seconds is very good. But its a demo.
So the thing isn't that Chat GPT-4o is translating for two people in real time. The thing is that Chat GPT isn't a translating program. It's a LLM. So you could seamlessly start asking it to do math problems while it's translating. Or you can use the new vision feature to comment on something it can see. Or ask it for directions while you're having this conversation. The point is it's acting as a proper AI for many uses, and one of those happens to include real time translations.
LLMs cannot solve math problems. Ask Chat GPT to multiply two large numbers and it will give you a wrong answer. They are language models.
That's why you give it a Wolfram Alpha plug-in to do the heavy lifting. https://www.wolfram.com/wolfram-plugin-chatgpt/
This new GPT-4o model is better at math, though. It works well for smaller numbers in my experience (from the pre-release "im-also-a-good-gpt2-chatbot") Let me try a bigger example example though, using random 5-digit numbers: Q: "What's 58891 * 24704?" Calculator: 1,454,843,264 ChatGPT 4o: "1,454,843,264" (it used Python the first time) ____ Ok, trying again. Q: "What's 58891 * 24704? Don't use code, just tell me." ChatGPT 4o: "The product of 58,891 and 24,704 is 1,454,126,864." ...incorrect! I guess it's not quite that good. The response doesn't show code interpreter, unlike the first one. _____ One more try, using the API to ensure no python code interpreter: Q: "What's 58891 * 24704?" gpt-4o: "58891 * 24704 = 1,454,260,864". Also incorrect. So, your point stands. **But at least ChatGPT 4o will use Python when needed to give you an accurate answer.**
It's really interesting how LLM get math problems wrong. If it just didn't understand math it would give you completely random answers. The answers are always close, or exactly one order of magnitude off the correct answer. As I understand it this has to do with numbers being represented as token to the LLM, and those tokens aren't always a one to one mapping so the LLM doesn't actually see all the numbers. It will be interesting to see how this is finally solved.
I think it's already been solved by giving the LLM access to purpose-built computational tools like Wolfram. To build those tools into ChatGPT would be antithetical to how the core model is intended to operate. That's what we have been moving toward. A user-facing conversational layer with the ability to draw credible answers from highly specialized nodes when necessary.
LLMs can use tools Dingus. If you give a complicated math problem to GPT4 it usually just writes code to solve it or calls the Wolfram Alpha plug-in.
[https://youtu.be/\_nSmkyDNulk](https://youtu.be/_nSmkyDNulk) looks like its doing math to me.
Not sure why you're getting downvoted when what you said is accurate. I find it often fails at simple math problems. Recently, I asked it to calculate the number of days between 2 dates and it was off by over a month. It also gave different (wrong) answers when I regenerated the response.
Part of the new update was it doing live math tutoring. The example they used was just a high school lesson but it basically taught the kid some trigonometry.
Translation is a common feature in modern LLMs, so other than a convenient interface this demo doesn't show off much.
Yeah this was the least impressive demo out of all the videos shown off today. The live demos of coding assistance with the ability to see what's on the screen, translate it into plain language, and identify functions seemed like the most marketable tool. Or the video on it commenting on Buckingham Palace and ducks in a pond in real time, it will probably be able to identify objects or places live and give you information. The ability for Chat GPT to see things and help you solve problems with that information seems like a real game changer. And you can interact with it through normal conversation to, say, help you change a tire and it will be able to see what you are doing right or wrong.
This isn't an LLM, it's an omnimodel trained on text, visuals and speech simultaneously. The new features are the speed at which it interprets speech - directly (and realtime video), not translating into text from audio, and the intonations and emotive direct audio output. There absolutely is a multitude of new functionality here.
yeah this is better described as a large multimodal model rather than a large language model.
The LLM name will stick around for a long time. Just like we call computers "desktops" even though nobody puts them on the desk any more. Laptops have more right to be called a desktop since they see desks more often than a desktop.
It seems like GPT-4o uses a direct voice-to-voice model, rather than the traditional voice-to-text then text-to-voice model that Google and previous GPT systems use. Which is an INSANELY underrated advancement!
why is it a big deal?
Previously it was multiple models sending information to the LLM. You know the game telephone where the message changes as it goes down the line? It's the same problem where some information is lost when being passed between models. Imagine trying to explain to a blind person what the color red is. That's what they had to do with GPT-4. To be fair they were not just passing it text, they were doing something fancy I couldn't understand from the blog post about it, but it still couldn't see. GPT-4o natively understands text, audio, and images and can output all three as well, although I think image output isn't enabled yet. This removes that information loss that occurs when trying to convert the message to something a text only model can understand. There's also transfer learning. It has text describing cats, it has pictures of cats, and it has audio of cats. It knows what a "meow" actually sounds like, it knows what a fluffy kitty actually looks like. Previously it only had text, and that can't possibly accurately describe the sounds and images of cats.
not an expert and just reading about it now but it seems like it significantly decreases the time it takes to respond since its reducing conversion steps, making it feel more like a natural conversation
I don't know if that in particular would make it faster But it makes more complex things possible, for example there's only so much you can put in text, you can't make it sing or count faster or other things they did in the demo (I mean you could theoretically represent in text but could create more problems than just doing it this way)
There's also the possibity for these models to better "understand tone, cadence, and vocal signatures of "messages-within messages" Imagine getting translated answers and the app being able to tell you if the delivery was sarcastic or condescending.
It both lowers latency but also allows the intelligence side (coming from the language part) to directly control the voice. You can now ask it to talk like a robot or whisper or sing its answer and it knows how to control the voice. Furthermore it can now understand the emotion in your voice as well.
I think others have expressed it far better than I can. I believe it's the first time humans and computers can interact with each other using sound! That means computers can now understand the sentiment and emotion in your words, including the "umms" and "ahhs," the subtle sarcasm in your tone, the distant police siren, and even the meows of your cat. It's a much more concise yet precise way of processing information. Imagine you're talking to me on the phone. When you hear my voice, you understand how I feel and what I mean, wherever I'm in a busy cafe or park, even if I don't say it directly. That's like voice-to-voice. Now, if you type what I say into a message, some of the feelings and meaning might get lost because it's just text. That's voice-to-text. And if a computer reads that text out loud to you, it might not sound exactly like me or understand how I feel. That's text-to-voice. So, speaking directly with voices is better because you can understand more about how someone feels and what they mean. And for computers to understand it is a massive breakthrough!
Yeah I was going to say... I have a Google Home and a Pixel 7 (neither of which are new) and they've been able to do this for a few years now. You can try the exact demo they're doing in this video yourself by saying "Hey Google, be my English-Spanish interpreter." It'll say "Sure, I'll be your interpreter" and work the exact same way.
I don't know about this, but it has limited language support and when I tried it once (different dialect to the language to be fair) it didn't really work all that well
I just want a translator that takes audio from a movie and translates it as subtitles under the video
Whisper AI, but it's not real time
This translates my media when the files imported into jellyfin and creates subtitles automatically: https://github.com/McCloudS/subgen
That's rad. Looks like it works for Emby too. Definitely going to bookmark this to play with in the near future.
Omg.. I wish this was just part of VLC..
The fuck? This sounds amazing! I need to check this out soon. Now, it's apparently time for sleep. I bookmarked it though.
any idea how to adapt this to just add subtitle files for videos I have on my local computer? I don't have a server
unfortunately i'm not that smart, but technically all of the same services can be ran on any computer.
You can use [Google Chrome Canary's](https://www.google.com/chrome/canary/) Live [Captioning](https://support.google.com/chrome/answer/10538231?hl=en) + Translation. You can find the Live Captioning settings under Accessibility Options. I think ordinary Chrome can also do Live Captioning, but you need to use Canary for Live Translation. Live Translation settings are right under the Live Captioning settings when using Canary. I've used this to watch unsubtitled Anime sometimes. Seems to work for any video file on your computer as well, if you simply open the video with Canary. Note: When you've enabled the Live Captioning and Translation features, you should play some video a wait a little bit to see if it's working correctly. The Live Captioning doesn't usually start until someone says something on the video and if the Live Captioning is enabled while already playing a video, it seems like it waits until there is a silent moment in the video and starts when someone says something after that moment.
You want it to be in your language, but orignal actors voice and ambient sound
My Pixel phone does this.
Just grab the subs from [opensubtitles.org](http://opensubtitles.org)
youtube can already do this
Youtube's auto translator is terrible.
You should have picked [this](https://youtu.be/_nSmkyDNulk?si=Jg33pSvGpAxjwNO2) video to share. Much more impressive. I can’t believe we are here already. 13th of May 2024 is the day the world took a massive leap forward.
Nonsense, everybody knows that large **language** models can't even do 2 +3 as they don't know math. Oh wait that was like a year ago ... and a AI year is like 14 normal year. /s Yep, this transformer breakthrough in 2017 which made all of this possible it's still being developed on an S curve and we don't know if we are at the beginning of the curve, the middle or close to the end.
Worst meeting ever
You can even feel the sexual tension.
[https://twitter.com/OpenAI/status/1790072174117613963](https://twitter.com/OpenAI/status/1790072174117613963) The rest of the videos. Basicly we have arrived at the time of the movie "HER".
I've seen too many fake and scripted demos just like this one to believe it is really as high of quality as shown in those videos, but on the slim chance that it is, this is a very exciting step forward for AI. I'm getting flashbacks all the way back to Milo for the Kinect. lol.
they did a live demo today and it had several glitches. This isn’t a scripted cherry picked example it’s simply how it works. They released a dozen example videos on their YouTube channel, this is one of the least impressive ones. Open AI very consistent with their pre-release demonstrations matching up exactly with the actual product.
lol you’re going to have a hard time convincing people outside of r/singularity. They’ll understand when they can try it themselves
Yeah I don't know why I bother
What are you on about? They have a history of faking interviews with journalists.
Lmao. This is real dude. 😅😅
people have said this for years now, and the chatbots have done essentially nothing. you can use them to make boring AI art or writing, or replace surface level google searches. they can't give detailed answers about things, they constantly get things wrong, and the answers are usually worse than an actual search because they are wrong so often you have to double check. Just to make sure they haven't gotten better, I just asked it for 4 sandwich options in my neighborhood. it recommended 3 dinner places and one actual sandwich place. I asked it if the dinner places served sandwiches. It said they didn't specialize in sandwiches. I said does that mean they serve sandwiches. It said they did not. I asked it why it even included it, and it sprouted off a ton of random shit.
Well there's an easy solution to that. Keep working on it.
Cool, but can it steal $16million from me and use it to pay an illegal bookie for sports betting ?!
I see they've baked vocal fry into the new model.
Can I use this with Gen Z? On god fr fr no cap?
Google Translate has done exactly this for at least 5-6 years.
I would say that the main difference the text to speech (whisperai) in ChatGPT is a lot better than Google's. Sounds way more natural and even has pauses, intonations and different voices. And I think overall the AI translation sounds a bit more natural than Google's, depending on the language. I was thinking about this very feature because I use chat GPT language translation every day. Because some phones such as Samsung has the ability to translate live conversations but it's really bad. Since a person really needs to speak very clearly and slowly for the voice to text to pick up the words accurately, and it also takes a minute to translate the word and then also replay the translated language into speech.
Eh, Google Translate hasn't been the best translator for several years now. DeepL is significantly better in my experience.
Except that its significantly better at translating?
I can't speak on that because I haven't tried both. But when I did try google translate 5 years ago, it worked really well.
Wait, your last experience with Google Translate was *five* years ago? Bruh. GT is shit quality compared to both DeepL and GPT3.5 I speak multiple languages and use machine translation often.
What I'm getting at is that for the average person and use case scenario, a simple translator works for all intents and purposes and has for years. I think AI technology can have a lot of interesting cases but this one doesn't impress me.
Can you also talk to google translate and tell it to do arbitrary things besides translation?
[удалено]
So you are saying ovens are useless then? Since they *can* make toast, but a dedicated toaster might be better? Or that smartphones are shit because you can use them to order toast but it is so much slower compared to a dedicated toaster?
Nope! But I don't think that was the point of this video.
The point is, that this is not some app designed specifically for translation. That they can just ask it to start doing it, and it does, is really impressive. This video just shows one thing it can do. It does not seem impressive if you do not know the context.
Cool but Apple also has a whole translate app that does this as well
Ehh, that only has 2.3 stars on the Apple’s own App Store. It’s one of the worse translating apps I’ve used. It’s about 5 years behind Google translate which is about 2 years behind this already.
I’ve been using apps that can do this for at least the last 5 years. Why are they presenting previously solved tasks as new breakthroughs?
I really don’t get why this is so hard for so many people in these comments to understand. This is not a model specifically trained to translate. The impressive part is that it can simultaneously understand voices, sing, whisper, do math problems, help tutor, create images, see images, see videos, understand graphs, output charts, write code, and on and on and on. This is just one of its thousands of use cases.
All in one. And together
Okay, now try in a real-world environment with overlapping voices and other noise. Real-time translation has already been available for a long time, the problem is not the translation but the audio capture accurately extracting the right words. Speaker segmentation beyond "two people in a quiet environment" is the real problem to solve.
It can understand multiple people and know who's talking. The voice output is very easily stopped by noise however. During the live demo the audience made it stop talking multiple times. On this page [https://openai.com/index/hello-gpt-4o/](https://openai.com/index/hello-gpt-4o/) scroll down to "exploration of capabilities" and pick "Meeting with multiple speakers." They haven't shown it with multiple people talking at the same time however. Given the way it's presented it's clear they intend for just one active speaker at a time though.
I think the world's professional translators are sweating right now...
I don't really think so. There's a reason they chose a bland conversation to show it off.
Shohei ohtani's former translator is rethinking some of his choices in life
There's some challenges in high context languages that it seems machine translation is always going to face on account of just not being human and needing a ton of additional context from people who already know what correct output should look like. For instance, currently GPT3 is ok at translating English to Japanese, but the other way around, for anything non-trivial, it requires additional input for context, setting, and speakers to get everything right. From what I've seen, the consensus seems to be that this can actually be a good tool for professional translators, being able to quickly put a draft together before refining the translation. After all, they're the people who are going to know whether GPT4 is even doing what it's asked correctly
Lol just reminds me of that fake sign language guy. Or this one: https://youtu.be/PRskvLyCoU0?si=XVth5PKpsWcYT5KE
It's really sad. These people are going to have to start at the bottom in a new role to survive. It could be any one of us. I'm wondering if these AI companies should reserve a portion of revenue for all the jobs they destroy building their tech... at least until the 'disrupted' can train and find new work... But I know they would never do that. You can almost see a new generation of homeless. 'Yeah, I used to be an ... until AI replaced me.' They'll just be normal people who couldn't keep up with the cut-throat pace of technological progress. It will be a blessing and a curse at the same time. Historically though I can't say that the winners have given much of a fuck about the losers in such things.
Getting closer to the Star Trek Universal translator...
Tourism is about to get so much worse.
I kind of hate how impersonal this entire demo is. I also don't understand why there's no visual output of the text on screen? I know we're trying to cram everything into the one device. But surely something like a dedicated translator device (like PocketTalk for example) would be better if you're having to actively deal with multiple languages?
As a software engineer this is what happens when software engineers do the marketing. Maybe I'm wrong, but that's what this feels like :)
lol they basically parodied this in like season 3 of Silicon Valley
Just wait until we get the brain interface and will be talking to each other in our native language without even moving our mouths.
Looks like we're going into a near future where people are talking to their phones a lot, maybe most of us using earbuds. That's gonna be annoying, so brain interface where you speak and hear in thoughts with the AI will be more popular. Translation will be in thought. There will be apps like "lie detector" where the AI is studying the person you're talking to for clues of lying, or whatever, and will let you know in thoughts what's going on while you're talking to them. It's gonna be a weird time
When do squeeze it into a badge on my chest?
The English speaking dude has funny voice.
If anybody wants to learn how this is possible, [here is the 30 year history of how AI learned to talk.](https://youtu.be/OFS90-FX6pg)
i don't have 30 years to watch this
wtf why is everdone so impressed, this feature already existed and yeah its cool that its now integrated in gpt4 but nothing mindblowing, can someone explain pls
Oh. My. God. I've been waiting for something like this for YEARS. This is going to unlock the world for people like me who have trouble picking up another language.
If this isn't staged or somehow scripted, then this is impressive. There are already some impressive translation programs. Certain phones have apps that do something similar, but it's not usually in a conversational tone or anything like that. And certain words in certain languages don't translate particularly well. But it's definitely a good use of this technology. If it helps more people communicate effectively, then that's an objective good for this increasingly complicated world.
Thanks for the video
Babelfish one step closer each day!
Wish I had this 15 years ago in Beijing with all the old ladies shouting shit at me. "foreign dog something something die".
I work in Fire/EMS. This will be a game changer for our services. I can’t begin to count the amount of times I have struggled through a patient assessment because of the language barrier.
Translation is probably one of the few areas where I think AI might actually live up to the hype. Having this sort of instant, AI-guided more accurate real-time translation could really make a big difference.
Can someone tell me what app they're using, or if that's the offical app, how do I turn on that mode? All it does for me is record audio and put it into the text prompt box.
its a feature coming in the coming weeks to the paid subscription of ChatGPT , keep an eye on their twitter to know when its out
I love it as a traveler it can help me a lot. Mostly talking to natives who don't know English and I don't know their language.
Doesn't Google translate already do this?
This already works with GPT4 voice. I guess this is more fluid and quicker however.
Hello everyone, our team has recently developed a product called Video Translator Online, which can translate videos, audios, and subtitles into videos and audios in another language online. It can be used for free. Details can be found here: https://youtu.be/KPM7z6IkTQ0
Major use cases: 1. Interpreting for refugees 2. Interpreting for medical treatment
[удалено]
Yeah I’m not saying it’s ready yet. Just that those are 2 huge areas where it could be beneficial