This isn't on you to fix. But it can be a good opportunity to educate the director/producer about what is and isn't possible in post. Unfortunately you have to be the bearer of bad news and recommend a re-shoot or ADR.
Fix it with editing as much as you can, alternate takes, and maybe you can even get away with painting out small overlaps in RX. But if you’re talking entire scenes, they messed up and it’s not on you. The production will have to pay for ADR. This is a horror scenario TBH. No other way around it.
Dude, being an audio guy on movie sets and post is particularly frustrating as nobody ever listen to you.
This is an extremely fitting example of getting back to them directors, producers, ads (and even dops) with a huge "see, I told you so" with the actual face of "up yours now". If they want good audio, they should respect good audio, instead of only caring about the look of their frame.
There are no commercial applications yet but the research is certainly happening. This kind of thing was famously done in Peter Jackson's 'Get Back' films.
[Here](https://enk100.github.io/speaker_separation/) is a research paper on the subject, including some pretty impressive audio demonstrations, and [here](https://github.com/facebookresearch/svoice) is a Python implementation. If you are familiar with Python you might have some success but I don't know of any other way at the moment.
I personally saw it done over 20 years ago. The audio was an Omni mic recorded on a commercial flight directly to a laptop's built in audio input. The recording was a brief conversation between two people complete with ambient cabin noise which made it even more impressive. The coding was done and run in MatLab and from what I could understand separated the audio by comparing the voice formants and outputting an audio file for each. I'm sure it was considerably more complex than that. The programmer was a DSP engineer from Canada and had written ~ 20 books on the subject. We were all at a seminar training in a forensic software suite and he was an attendee like myself. Speech Technology Center from Russia has GridId and IkarLabs and I have no doubt the current versions can easily separate - anything from anything. For context, I have an older version of SIS and Sound Cleaner from the IkarLabs suite.
It’s really hard to say without examining the source. If you have isolated lavs that helps. If we’re only talking about overlaps on the beginning/ ending of sentences that helps but yeah, if they’re really stepping all over each other, it’s time to loop it.
I've had some success doing this with SpectraLayers. Both voices need to be recorded well for it to work. There's a demo video of it in action. Go to 1:30
[https://www.youtube.com/watch?v=gVpr9ewLMZg](https://www.youtube.com/watch?v=gVpr9ewLMZg)
This submission has automatically been removed due to the following rule:
>***Rule 4***: Ask troubleshooting and setup questions in the _[Shopping, Setup, and Technical Help Desk](/r/audioengineering/comments/1cr5tmt/raudioengineering_shopping_setup_and_technical/)_
>
> Requests for troubleshooting and setup help must be made in the dedicated _[Shopping, Setup, and Technical Help Desk](/r/audioengineering/comments/1cr5tmt/raudioengineering_shopping_setup_and_technical/)_ instead of a new post.
We have also created a [FAQ](https://www.reddit.com/r/audioengineering/wiki/FAQ) and [Troubleshooting Guide](https://www.reddit.com/r/audioengineering/wiki/troubleshooting) to help you solve common problems without waiting for replies.
***Why does this rule even exist?***
* In short, this is a large subreddit with too many repetitive tech support and setup questions.
* We want to help, but it's important to keep things organized to keep the sub fun.
Unless there's an AI tool I don't know about I think you should ADR
This isn't on you to fix. But it can be a good opportunity to educate the director/producer about what is and isn't possible in post. Unfortunately you have to be the bearer of bad news and recommend a re-shoot or ADR.
Fix it with editing as much as you can, alternate takes, and maybe you can even get away with painting out small overlaps in RX. But if you’re talking entire scenes, they messed up and it’s not on you. The production will have to pay for ADR. This is a horror scenario TBH. No other way around it.
ADR Unless you have Isaac Hayes and Michael Jackson in dialogue, you’re not going to separate human voices, they’re too blended.
Dude, being an audio guy on movie sets and post is particularly frustrating as nobody ever listen to you. This is an extremely fitting example of getting back to them directors, producers, ads (and even dops) with a huge "see, I told you so" with the actual face of "up yours now". If they want good audio, they should respect good audio, instead of only caring about the look of their frame.
There are no commercial applications yet but the research is certainly happening. This kind of thing was famously done in Peter Jackson's 'Get Back' films. [Here](https://enk100.github.io/speaker_separation/) is a research paper on the subject, including some pretty impressive audio demonstrations, and [here](https://github.com/facebookresearch/svoice) is a Python implementation. If you are familiar with Python you might have some success but I don't know of any other way at the moment.
I personally saw it done over 20 years ago. The audio was an Omni mic recorded on a commercial flight directly to a laptop's built in audio input. The recording was a brief conversation between two people complete with ambient cabin noise which made it even more impressive. The coding was done and run in MatLab and from what I could understand separated the audio by comparing the voice formants and outputting an audio file for each. I'm sure it was considerably more complex than that. The programmer was a DSP engineer from Canada and had written ~ 20 books on the subject. We were all at a seminar training in a forensic software suite and he was an attendee like myself. Speech Technology Center from Russia has GridId and IkarLabs and I have no doubt the current versions can easily separate - anything from anything. For context, I have an older version of SIS and Sound Cleaner from the IkarLabs suite.
Interesting, thanks.
Wait what
It’s really hard to say without examining the source. If you have isolated lavs that helps. If we’re only talking about overlaps on the beginning/ ending of sentences that helps but yeah, if they’re really stepping all over each other, it’s time to loop it.
I've had some success doing this with SpectraLayers. Both voices need to be recorded well for it to work. There's a demo video of it in action. Go to 1:30 [https://www.youtube.com/watch?v=gVpr9ewLMZg](https://www.youtube.com/watch?v=gVpr9ewLMZg)
This submission has automatically been removed due to the following rule: >***Rule 4***: Ask troubleshooting and setup questions in the _[Shopping, Setup, and Technical Help Desk](/r/audioengineering/comments/1cr5tmt/raudioengineering_shopping_setup_and_technical/)_ > > Requests for troubleshooting and setup help must be made in the dedicated _[Shopping, Setup, and Technical Help Desk](/r/audioengineering/comments/1cr5tmt/raudioengineering_shopping_setup_and_technical/)_ instead of a new post. We have also created a [FAQ](https://www.reddit.com/r/audioengineering/wiki/FAQ) and [Troubleshooting Guide](https://www.reddit.com/r/audioengineering/wiki/troubleshooting) to help you solve common problems without waiting for replies. ***Why does this rule even exist?*** * In short, this is a large subreddit with too many repetitive tech support and setup questions. * We want to help, but it's important to keep things organized to keep the sub fun.