Audio search engine

An audio search engine is a web-based search engine which crawls the web for audio content. The information can consist of web pages, images, audio files, or another type of document. Various techniques exist for research on these engines.

Audio search from text

Text entered into a search bar by the user is compared to the search engine's database. Matching results are accompanied by a brief description of the audio file and its characteristics such as sample frequency, bit rate, type of file, length, duration, or coding type. The user is given the option of downloading the resulting files.

Audio search from image

The Query by Example(QBE) system is a searching algorithm that uses Content-based image retrieval(CBIR). Keywords are generated from the analysed image. These keywords are used to search for audio files in the database. The results of the search are displayed according to the user preferences regarding to the type of file (wav, mp3, aiff…) or other characteristics.

Above: a sound A waveform
Below: a sound A spectrogram

Audio search from audio

In audio search from audio, the user must play the audio of a song either with a music player, by singing or by humming to the computer microphone. Subsequently, a sound pattern, A, is derived from the audio waveform, and a frequency representation is derived from its Fourier Transform. This pattern will be matched with a pattern, B, corresponding to the waveform and transform of sound files found in the database. All those audio files in the database whose patterns are similar to the pattern search will be displayed as search results

  • Audioburst is an AI-powered audio search platform which was created with the mission of organizing the world's audio content. Using NLP technology and proprietary AI, the Audioburst platform analyzes millions of minutes of live and pre-recorded audio content each day. Everything from podcasts to radio streams and other audio sources are tagged and indexed, creating audio segment “bursts” which are then searchable by keyword, context and topic.
  • Audiosear.ch (Defunct) is a company which develops technology for indexing and retrieving transcribed text from audio recordings. Audio content is indexed and searchable.
  • FluidDATA is a product from BitPlatter which develops technology for indexing and retrieving transcribed text from audio recordings. FluidDATA provides a search engine for millions of podcasts and actively transcribes and indexes all podcasts published in iTunes.
  • VoiceBase is a company which develops technology for converting audio content to time-stamped text with a server-side speech-recognition engine. After the speech recognition process, the audio content is then indexed, and searchable.
  • Matoola is a company which develops technology for searching within audio content by generating transcripts using a speech-recognition engine. The transcripts are then indexed, allowing users to search within the content and jump to the point in the audio they searched for.
  • Everyzing (formerly Podzinger until May, 2007) is a company which develops technology for delivering video content. Everyzing has developed to products which are licensed primarily to large media companies. ezSEO is a white labeled, hosted search engine optimization solution for making audio and video discoverable with major search engines such as Google and Yahoo. ezSEARCH is a universal site search product which combines text, images, audio, and video. Everyzing claims to have spent millions of dollars building speech to text audio search. Everyzing takes the user within the actual content by using speech recognition. This enables online video consumers to jump directly to the point in the video for which they are searching.
  • Picsearch Audio Search has been licensed to search portals since 2006. Picsearch is a search technology provider who powers image, video and audio search for over 100 major search engines around the world.

For smartphones

  • SoundHound (previously known as Midomi) [1][2][3][4] is a software and company (both with the same name), that lets you find results with audio. Its feature are both an audio-based Artificial Intelligence service and services to find songs and details about them by singing / humming or recording them.
  • Shazam is an app for smartphone or Mac best known for its music identification capabilities. It uses a built-in microphone to gather a brief sample of the audio being played. It creates an acoustic fingerprint based on the sample, and compares it against a central database for a match. If it finds a match, it sends information such as the artist, song title, and album back to the user.
  • Doreso identifies a song by humming or singing the melody using a microphone; and by direct input of the name of a song or singer. The app gives information about the song title, its singer and allows you to purchase the song.
  • Munax was a company that released their all-content search engine in its first version in 2005. Their PlayAudioVideo multimedia search engine, created in July 2007, was the first true search engine for multimedia, i.e., providing search on the web for images, video and audio/music in the same search engine, previewing them on the same page. The company Munax is shutdown,[5] the search engine is broken / unmaintained / taken over by criminals [6]

Search results are modified, or suspect, due to the large hosted video being given preferential treatment in search results.

Podcast-specific search engine

  • Listen Notes is a podcast search engine that indexes the meta data (e.g., text description) and some transcripts of all podcasts and all episodes on the Internet.
  • FluidDATA is a podcast search engine that indexes all RSS metadata, Audio metadata, and automatically generates searchable transcripts of all episodes available on the Internet.

Design and algorithms

A spectrogram of the sound of a violin.
The target zone of a song scanned by Shazam.

Audio search has evolved slowly through several basic search formats which exist today and all use keywords. The keywords for each search can be found in the title of the media, any text attached to the media and content linked web pages, also defined by authors and users of video hosted resources.

Some search engines can search recorded speech such as podcasts, though this can be difficult if there is background noise. Around 40 phonemes exist in every language with about 400 in all spoken languages. Rather than applying a text search algorithm after speech-to-text processing is completed, some engines use a phonetic search algorithm to find results within the spoken word. Others work by listening to the entire podcast and creating a text transcription.

Applications as Munax, use several independent ranking algorithms processes, that the inverted index together with hundreds of search parameters to produce the final ranking for each document. Also like Shazam that works by analyzing the captured sound and seeking a match based on an acoustic fingerprint in a database of more than 11 million songs. Shazam identifies songs based on an audio fingerprint based on a time-frequency graph called a spectrogram. Shazam stores a catalogue of audio fingerprints in a database. The user tags a song for 10 seconds and the application creates an audio fingerprint. Once it creates the fingerprint of the audio, Shazam starts the search for matches in the database. If there is a match, it returns the information to the user; otherwise it returns a "song not known" dialogue. Shazam can identify prerecorded music being broadcast from any source, such as a radio, television, cinema or music in a club, provided that the background noise level is not high enough to prevent an acoustic fingerprint being taken, and that the song is present in the software's database.

See also

References

  1. ↑ Soundhound's app for Google Android (note the package name, which contains the former name Midomi): https://play.google.com/store/apps/details?id=com.melodis.midomiMusicIdentifier.freemium and https://play.google.com/store/apps/details?id=com.melodis.midomiMusicIdentifier
  2. ↑ Soundhound's app for Apple iOS: https://itunes.apple.com/us/app/id355554941
  3. ↑ Soundhound's app for Windows phone: https://www.microsoft.com/en-us/store/p/soundhound/9wzdncrfj3m2
  4. ↑ Company's website: https://www.soundhound.com/about
  5. ↑ read error when requesting http://www.munax.com . If an Internet company is not reachable anymore via Internet, you can definitely say: the company is dead.
  6. ↑ https://www.playaudiovideo.com gets reported as an attacking website by mainstream browsers.
This article is issued from Wikipedia. The text is licensed under Creative Commons - Attribution - Sharealike. Additional terms may apply for the media files.