Dvorak wrote:Is a thorough and legit usage of AI, I think.
Restoration should be considered as okay-ish.
As I understand it, John made some demos on tape. Yoko kept it. Then gave it to Paul, George and Ringo.
There were three songs. They were able to extract John's vocals on two of the songs, and completed them - those have been released as "Real love" and "Free as a bird".
They attempted to revive the third song, but the audio quality was poor. There's a hum noise. The piano drowns out John's vocals. It couldn't be cleanly extracted at the time.
Then Peter Jackson did that "Get Back" documentary, taking old session footage, remastering it and then editing it together.
In order to remaster the audio for that, they actually trained up an AI to recognise all four of their voices. This AI was used to cleanly extract and isolate each of their voices, so that the audio could be tidied up and then remixed and remastered.
What the AI is doing is perfectly legit, in my opinion. It is NOT generative. It's NOT using AI to create new vocals from nothing. It's an AI that's trained on their voices to be able to extract just their isolated voices from a messy, noisy mix (I mean, there's going to be a touch of regeneration in there to fill in any gaps but it's NOT generating new audio, it's patching up existing audio).
And, seeing as the AI was created for "Get Back", Peter Jackson gave it to the Beatles so that they could finally complete that third song - "Now and Then" - because the AI could extract John's voice from the tape. Giving them a clean isolated vocal track.
Then Paul and Ringo added their parts. George, of course, is sadly no longer with us. But they had tried to revive the third track before, unsuccessfully, so they also had George's recorded parts from that earlier attempt, and those have been put into this as well. So it does feature parts from all four of them, to legitimately make it a Beatles track.
(It also features an orchestral part composed by George Martin's son. To at least give a nod to "the fifth Beatle", even if they, sadly, had nothing recorded from him to be able to add it, he is included in spirit too, via his son.)
Also cementing its legitimacy as a Beatles track, some audio out-takes - backing vocals - from some of their earlier songs is in the mix too.
Yeah, if you read the papers, they erroneously act like an AI made the whole thing or recreated John's vocals from scratch. Not so. The AI was just used to extract John's vocals from an old poor quality tape - and it's the exact same AI that was used to extract their voices for "Get Back". It's because the AI was developed for that, that they have the trained up AI that knows each of their voices, to re-use it on John's vocals from the tape.
Indeed, the AI is really removing everything else from the audio, leaving John's vocals isolated. So it is legitimately John's voice. The AI just got rid of everything else. It's an "audio repair" AI, not a generative one.
This dude - who does excellent music theory videos and is a massive Beatles (and Radiohead) fan - made a video covering it:
So, yeah, I'm satisfied that this is legit. The AI was just an "audio repair" thing, not generative. And, like, if you think "Get Back" is a legit remaster of that session footage, then you have to consider John's vocals in this legit too, because it's quite literally the same AI they used. It was because it was developed for that documentary that it could be given to the Beatles to let them finally finish that third track (which they had attempted to do before, but mechanical processes just couldn't pull John's vocals out cleanly enough to be used at the time).
"Words ought to be a little wild - for they are assaults of thought on the unthinking."
- John Maynard Keynes