Google's AI Can Quickly Pick Out Voices From a Crowd

Samsung Galaxy S8 Infinity display

Say you are in a crowd of people and a familiar friend calls out to you. A machine may not be able to do that as efficiently.

Tell us in comments below regarding how do you like this newliness. This would be a particularly big convenience for videos recorded in noisy environments that may at times make it hard to hear the speaker. Google's researchers collected 100,000 videos from YouTube, extracted sound segments that each contained the voice of a single speaker and then stitched those segments together into "synthetic cocktail parties" with multiple audio tracks.

According to the blog post, the researchers developed this model by gathering 100,000 videos of "lectures and talks" on YouTube, extracting almost 2,000 hours worth of segments from those videos featuring unobstructed speech, then mixing that audio to create a "synthetic cocktail party" with artificial background noise added.

In the test clip from above, Google has managed to separate the voices of the two stand up comedians from the crowd (and each other) by recognising their faces and generating an audio track for that particular individual's speech.

According to Google, the technique involves combining the auditory and visual signals of an input video to separate the speech.

Junto Capital Management LP Has Lifted Adobe Sys INC (ADBE) Holding
Moreover, State Of Alaska Department Of Revenue has 0.23% invested in Adobe Systems Incorporated (NASDAQ:ADBE) for 53,899 shares. The institutional investor owned 100,000 shares of the software company's stock after selling 10,000 shares during the quarter.

"Intuitively, movements of a person's mouth, for example, should correlate with the sounds produced as that person is speaking, which in turn can help identify which parts of the audio correspond to that person", said researchers Inbar Mosseri and Oran Lang, writing in a blog post. Despite the craziness, the AI generated clean audio track for a single person by isolating their face.

This can be useful if you are trying to communicate in video chat services.

In its Developer Blog, Google writes about the feature that it is "an entirely new way to explore books by starting at the sentence level, rather than the author or topic level". This will boost up the voice of the person you are talking to, even if they are in a crowded room.

Google also believes that this technology can help with automatic closed captioning systems where multiple speakers are overlapping each other. This has proved to be a major challenge in the field of speech recognition, which is among the main applications of neural networks today.

Related:

  • GSA Capital Partners LLP Has $935000 Holding in Applied Materials, Inc. (AMAT)

    Therefore 91% are positive. 24 are the (NASDAQ:AMAT)'s analyst reports since October 19, 2017 according to StockzIntelligence Inc. Putnam Investments Limited Liability Company has invested 0.05% in Pinnacle Foods Inc. (NASDAQ:FB) for 311 shares. (NASDAQ:FB).
    Mourinho Speaks On West Brom Loss

    Mourinho Speaks On West Brom Loss

    He also conceded it was sweet to triumph in a country where some critics claimed his purist principles couldn't flourish. While they did it at a time when the game was still in its infancy, their record around that period was astounding.

    We didn't hand title to Manchester City - Mourinho

    City skipper Vincent Kompany has now won three Premier League titles since joining 10 years ago. I believe in myself. "The mental level, day by day".
  • Two die in separate domestic stabbings in London

    Two die in separate domestic stabbings in London

    A man in his 20s was attacked with a knife in Zenith Close, Colindale, north London, just before 6pm on Sunday. He said there "were loads of police officers" and an ambulance remained outside the house for over an hour.
    Russian and foreign airlines suspend flights over Syria

    Russian and foreign airlines suspend flights over Syria

    It comes as Russian Federation last night vetoed a United States proposal for an investigation into an alleged chemical weapons attack in Syria.
    Multiple departments called to Sun Prairie apartment building fire

    Multiple departments called to Sun Prairie apartment building fire

    Two people were displaced in a small fire in a three-story apartment Saturday afternoon in northwest suburban Palatine. Upon arrival, all occupants were out of the residence, and the fire was in the rear unit of the first floor.
  • Celtic into Scottish Cup final, on course for another treble

    Celtic into Scottish Cup final, on course for another treble

    Rangers man Ross McCrorie was dismissed in the 51st minute, which essentially killed off all hope for them. We can really enjoy this last period of the season, today was a very good performance and a good win.

    Extra Space Storage Inc. (EXR) Analysts See $1.09 EPS

    In other news, VP P Scott Stubbs sold 9,250 shares of the company's stock in a transaction that occurred on Thursday, March 15th. It improved, as 26 investors sold EXR shares while 125 reduced holdings. 69 funds opened positions while 101 raised stakes.

    Taiwan Semiconductor Mfg. (TSM) Upgraded at Zacks Investment Research

    The stock of Taiwan Semiconductor Manufacturing Company Limited (NYSE:TSM) has "Buy" rating given on Tuesday, October 10 by J.P. HSBC raised Taiwan Semiconductor Mfg. from a "hold" rating to a "buy" rating in a research report on Tuesday, January 16th.
  • UN Security Council Refuses to Condemn US Attack on Syria

    The US-led strikes were the biggest global attack on President Bashar al-Assad's regime since the start of Syria's seven-year war. In telephone calls before the Saturday airstrikes, Macron said he had persuaded Trump not to pull out of Syria.
    Sony Xperia XZ2 Premium debuts with super high ISO sensitivity

    Sony Xperia XZ2 Premium debuts with super high ISO sensitivity

    It sports a modern design with 5.8-inch display surrounded by thinner bezels, and supporting a resolution of 3840×2160 pixels. The build quality is the same as the Sony Xperia XZ2 Premium has the same 3D glass on the rear and aluminum frame as the XZ2.
    The Weeknd Breaks Down On Stage At Coachella Because Of Selena Gomez?

    The Weeknd Breaks Down On Stage At Coachella Because Of Selena Gomez?

    One of his fans even took to Twitter and wrote: " The Weeknd crying got me sad like I nearly gave my kidney to Selena (sic)". They walked around the fields together in hugs and later Jeffries was seen resting her head on The Weeknd's shoulder.

Comments

Latest news

Meadow Creek Investment Management LLC Grows Holdings in Fluor Co. (FLR)
Plante Moran Financial Advisors Limited Liability Corporation reported 248 shares. 599,610 were reported by Prudential Financial. It worsened, as 156 investors sold CELG shares while 478 reduced holdings. 67 funds opened positions while 192 raised stakes.

Monsanto (MON) Position Lowered by HM Payson & Co
The basic materials company reported $3.22 earnings per share for the quarter, missing the consensus estimate of $3.31 by ($0.09). It also reduced its holding in Cl A by 325 shares in the quarter, leaving it with 6,285 shares, and cut its stake in Cl A.

Anto, Khloe and Lolu Leaves Big Brother Naija in Final Eviction Show
Some of the viewers who were expecting the duo to make it to the finals, expressed dissatisfaction with her game strategy. They deliberately stirred the waters for trouble.

BB&T Securities LLC Has $673000 Stake in HollyFrontier (HFC)
The company reported ($0.06) earnings per share (EPS) for the quarter, beating analysts' consensus estimates of ($0.07) by $0.01. Gabelli Funds Llc has 0.35% invested in American Electric Power Company, Inc. (NYSE:TISI) for 3.84 million shares.

Jane Street Group LLC Takes Position in Ritchie Bros. Auctioneers (RBA)
Auctioneers from $35.00 to $37.00 and gave the stock an "outperform" rating in a research report on Wednesday, February 28th. The stock has a market capitalization of $4.80 billion and a P/E ratio of 43.46. (NASDAQ:AAPL) rating on Wednesday, July 27.

Manchester City crowned champions as United crash
Vincent Kompany delivered an emotionally charged speech to Manchester City fans and players after the club's title triumph. City will now be looking to break the Premier League points record in their remaining five fixtures.

Former FBI director James Comey makes shocking claims about Trump
He said he thinks it's possible the Russians have something that could compromise Trump. "He is morally unfit to be president". After Clinton's loss, many Democrats blamed Comey, and Clinton herself has said it hurt her election prospects.

Congress President Begins His 3 Day Visit To Uttar Pradesh
Congress sources said in Rae Bareli, Rahul would interact with the locals and party workers, and attend some social events too. It was played in the presence of senior BJP leader and Union HRD minister Prakash Javadekar and Delhi BJP chief Manoj Tiwari.

Analysts' Weekly Ratings Updates for Scripps Networks Interactive (SNI)
AMP Capital Investors Ltd's holdings in Scripps Networks Interactive were worth $2,031,000 at the end of the most recent quarter. The company reported $1.38 earnings per share (EPS) for the quarter, beating the consensus estimate of $1.21 by $0.17.

Moto G6 Plus Geekbench listing reveals key specs
Now, the Moto G6 Plus has been spotted on a benchmark site revealing some specifications of the upcoming smartphone. It will be joined by the Moto G6 and the Moto G6 and Moto G6 Play when Motorola announces its 2018 roster this week.

United Kingdom joins Syria air strikes in response to chemical attack
Asked why she had proceeded without consulting parliament, May cited operational security consideration. Opinion polls suggest most Britons do not support military action.

Electronic Arts (EA) Stock Rating Reaffirmed by William Blair
Following the sale, the senior vice president now owns 4,528 shares of the company's stock, valued at $573,924. The stock of JPMorgan Chase & Co. (NASDAQ:EA) has "Overweight" rating given by KeyBanc Capital Markets.

Rescuers searching for missing Indian family find woman's body
Her wife, Sarah Hart, had a significant amount of Benadryl in her system, as did two of the children, police said. The auto has not been located, and the police said the search would continue for the vehicle and its occupants.

LA Galaxy striker Zlatan Ibrahimovic ready for World Cup comeback
Toronto reached the CONCACAF Champions League final during the week after upstaging seven-time victor America. Ibrahimovic retired from worldwide football after Euro 2016, having won 116 caps for Sweden .

Deadline to register to vote in May primary is Monday, April 16
Nearly half a million people have been advised to "Check the Register" ahead of the May deadline for the upcoming referendum. If held, candidates will contest the 249 seats in the National Assembly for five-year terms.

Other news