Google's AI Can Quickly Pick Out Voices From a Crowd

Google Talk to Books

Say you are in a crowd of people and a familiar friend calls out to you. A machine may not be able to do that as efficiently.

Tell us in comments below regarding how do you like this newliness. This would be a particularly big convenience for videos recorded in noisy environments that may at times make it hard to hear the speaker. Google's researchers collected 100,000 videos from YouTube, extracted sound segments that each contained the voice of a single speaker and then stitched those segments together into "synthetic cocktail parties" with multiple audio tracks.

According to the blog post, the researchers developed this model by gathering 100,000 videos of "lectures and talks" on YouTube, extracting almost 2,000 hours worth of segments from those videos featuring unobstructed speech, then mixing that audio to create a "synthetic cocktail party" with artificial background noise added.

In the test clip from above, Google has managed to separate the voices of the two stand up comedians from the crowd (and each other) by recognising their faces and generating an audio track for that particular individual's speech.

According to Google, the technique involves combining the auditory and visual signals of an input video to separate the speech.

Meadow Creek Investment Management LLC Grows Holdings in Fluor Co. (FLR)
Plante Moran Financial Advisors Limited Liability Corporation reported 248 shares. 599,610 were reported by Prudential Financial. It worsened, as 156 investors sold CELG shares while 478 reduced holdings. 67 funds opened positions while 192 raised stakes.

"Intuitively, movements of a person's mouth, for example, should correlate with the sounds produced as that person is speaking, which in turn can help identify which parts of the audio correspond to that person", said researchers Inbar Mosseri and Oran Lang, writing in a blog post. Despite the craziness, the AI generated clean audio track for a single person by isolating their face.

This can be useful if you are trying to communicate in video chat services.

In its Developer Blog, Google writes about the feature that it is "an entirely new way to explore books by starting at the sentence level, rather than the author or topic level". This will boost up the voice of the person you are talking to, even if they are in a crowded room.

Google also believes that this technology can help with automatic closed captioning systems where multiple speakers are overlapping each other. This has proved to be a major challenge in the field of speech recognition, which is among the main applications of neural networks today.

Related:

  • Jane Street Group LLC Takes Position in Ritchie Bros. Auctioneers (RBA)

    Auctioneers from $35.00 to $37.00 and gave the stock an "outperform" rating in a research report on Wednesday, February 28th. The stock has a market capitalization of $4.80 billion and a P/E ratio of 43.46. (NASDAQ:AAPL) rating on Wednesday, July 27.
    Former FBI director James Comey makes shocking claims about Trump

    Former FBI director James Comey makes shocking claims about Trump

    He said he thinks it's possible the Russians have something that could compromise Trump. "He is morally unfit to be president". After Clinton's loss, many Democrats blamed Comey, and Clinton herself has said it hurt her election prospects.

    First American Bank Buys 5841 Shares of Cisco Systems, Inc. (NASDAQ:CSCO)

    Since December 14, 2017, it had 0 insider buys, and 5 sales for $10.28 million activity. $578,740 worth of Cisco Systems , Inc. It improved, as 12 investors sold NSP shares while 14 reduced holdings. 113 funds opened positions while 249 raised stakes.
  • Junto Capital Management LP Has Lifted Adobe Sys INC (ADBE) Holding

    Moreover, State Of Alaska Department Of Revenue has 0.23% invested in Adobe Systems Incorporated (NASDAQ:ADBE) for 53,899 shares. The institutional investor owned 100,000 shares of the software company's stock after selling 10,000 shares during the quarter.
    Russian and foreign airlines suspend flights over Syria

    Russian and foreign airlines suspend flights over Syria

    It comes as Russian Federation last night vetoed a United States proposal for an investigation into an alleged chemical weapons attack in Syria.
    Mourinho Speaks On West Brom Loss

    Mourinho Speaks On West Brom Loss

    He also conceded it was sweet to triumph in a country where some critics claimed his purist principles couldn't flourish. While they did it at a time when the game was still in its infancy, their record around that period was astounding.
  • Manchester City crowned champions as United crash

    Manchester City crowned champions as United crash

    Vincent Kompany delivered an emotionally charged speech to Manchester City fans and players after the club's title triumph. City will now be looking to break the Premier League points record in their remaining five fixtures.
    We didn't hand title to Manchester City - Mourinho

    We didn't hand title to Manchester City - Mourinho

    City skipper Vincent Kompany has now won three Premier League titles since joining 10 years ago. I believe in myself. "The mental level, day by day".
    Rescuers searching for missing Indian family find woman's body

    Rescuers searching for missing Indian family find woman's body

    Her wife, Sarah Hart, had a significant amount of Benadryl in her system, as did two of the children, police said. The auto has not been located, and the police said the search would continue for the vehicle and its occupants.
  • GSA Capital Partners LLP Has $935000 Holding in Applied Materials, Inc. (AMAT)

    Therefore 91% are positive. 24 are the (NASDAQ:AMAT)'s analyst reports since October 19, 2017 according to StockzIntelligence Inc. Putnam Investments Limited Liability Company has invested 0.05% in Pinnacle Foods Inc. (NASDAQ:FB) for 311 shares. (NASDAQ:FB).
    Celtic into Scottish Cup final, on course for another treble

    Celtic into Scottish Cup final, on course for another treble

    Rangers man Ross McCrorie was dismissed in the 51st minute, which essentially killed off all hope for them. We can really enjoy this last period of the season, today was a very good performance and a good win.

    Extra Space Storage Inc. (EXR) Analysts See $1.09 EPS

    In other news, VP P Scott Stubbs sold 9,250 shares of the company's stock in a transaction that occurred on Thursday, March 15th. It improved, as 26 investors sold EXR shares while 125 reduced holdings. 69 funds opened positions while 101 raised stakes.

Comments

Latest news

Two die in separate domestic stabbings in London
A man in his 20s was attacked with a knife in Zenith Close, Colindale, north London, just before 6pm on Sunday. He said there "were loads of police officers" and an ambulance remained outside the house for over an hour.

Anto, Khloe and Lolu Leaves Big Brother Naija in Final Eviction Show
Some of the viewers who were expecting the duo to make it to the finals, expressed dissatisfaction with her game strategy. They deliberately stirred the waters for trouble.

Congress President Begins His 3 Day Visit To Uttar Pradesh
Congress sources said in Rae Bareli, Rahul would interact with the locals and party workers, and attend some social events too. It was played in the presence of senior BJP leader and Union HRD minister Prakash Javadekar and Delhi BJP chief Manoj Tiwari.

UN Security Council Refuses to Condemn US Attack on Syria
The US-led strikes were the biggest global attack on President Bashar al-Assad's regime since the start of Syria's seven-year war. In telephone calls before the Saturday airstrikes, Macron said he had persuaded Trump not to pull out of Syria.

Analysts' Weekly Ratings Updates for Scripps Networks Interactive (SNI)
AMP Capital Investors Ltd's holdings in Scripps Networks Interactive were worth $2,031,000 at the end of the most recent quarter. The company reported $1.38 earnings per share (EPS) for the quarter, beating the consensus estimate of $1.21 by $0.17.

Taiwan Semiconductor Mfg. (TSM) Upgraded at Zacks Investment Research
The stock of Taiwan Semiconductor Manufacturing Company Limited (NYSE:TSM) has "Buy" rating given on Tuesday, October 10 by J.P. HSBC raised Taiwan Semiconductor Mfg. from a "hold" rating to a "buy" rating in a research report on Tuesday, January 16th.

Whitbread Confirms That Elliott Advisors Holds 5.3% Interest (ALLISS)
That sparked a near 7% jump in Whitbread's share price on Monday to £41.97, the highest the stock has been in almost a year.

Multiple departments called to Sun Prairie apartment building fire
Two people were displaced in a small fire in a three-story apartment Saturday afternoon in northwest suburban Palatine. Upon arrival, all occupants were out of the residence, and the fire was in the rear unit of the first floor.

Moto G6 Plus Geekbench listing reveals key specs
Now, the Moto G6 Plus has been spotted on a benchmark site revealing some specifications of the upcoming smartphone. It will be joined by the Moto G6 and the Moto G6 and Moto G6 Play when Motorola announces its 2018 roster this week.

Sony Xperia XZ2 Premium debuts with super high ISO sensitivity
It sports a modern design with 5.8-inch display surrounded by thinner bezels, and supporting a resolution of 3840×2160 pixels. The build quality is the same as the Sony Xperia XZ2 Premium has the same 3D glass on the rear and aluminum frame as the XZ2.

United Kingdom joins Syria air strikes in response to chemical attack
Asked why she had proceeded without consulting parliament, May cited operational security consideration. Opinion polls suggest most Britons do not support military action.

The Weeknd Breaks Down On Stage At Coachella Because Of Selena Gomez?
One of his fans even took to Twitter and wrote: " The Weeknd crying got me sad like I nearly gave my kidney to Selena (sic)". They walked around the fields together in hugs and later Jeffries was seen resting her head on The Weeknd's shoulder.

Electronic Arts (EA) Stock Rating Reaffirmed by William Blair
Following the sale, the senior vice president now owns 4,528 shares of the company's stock, valued at $573,924. The stock of JPMorgan Chase & Co. (NASDAQ:EA) has "Overweight" rating given by KeyBanc Capital Markets.

LA Galaxy striker Zlatan Ibrahimovic ready for World Cup comeback
Toronto reached the CONCACAF Champions League final during the week after upstaging seven-time victor America. Ibrahimovic retired from worldwide football after Euro 2016, having won 116 caps for Sweden .

Deadline to register to vote in May primary is Monday, April 16
Nearly half a million people have been advised to "Check the Register" ahead of the May deadline for the upcoming referendum. If held, candidates will contest the 249 seats in the National Assembly for five-year terms.

Other news