Timo Baumann : Aktivität

poetry generation using ASR and TTS

Thu, 04 Nov 2010 09:38:51 GMT

how about the following: you feed the first verse of your favourite poem/song lyrics into an ASR and have a TTS read back what the ASR understood. It is very likely to rhyme! If you also read back a nice chorus, people will love it. Now, you just need your TTS to do decent singing and you're set:

U: "Ick heff mol in Hamburg een Veermaster sehn"
S: "gegen $l aber hin der hach also eben"
S (canned): "to my hooday, to my hooday"
U: "De masten so scheep as den Schipper sien Been"
S: "hm mach nach $t es in der warm $w"
S (canned): "to my hooday, hooday ho."

By the way, this is how singing works in a soccer stadium and the principle behind Chinese whispers.

aggregated audio duration

Sat, 17 Apr 2010 12:55:31 GMT

I've finally written the one script that was missing from the interwebs and that I have longed to have for so long:

#!/usr/bin/perl
# Copyright (C) 2010 Timo Baumann
# This program is free software; you can redistribute it and/or modify it 
# under the terms of the GNU General Public License as published by the 
# Free Software Foundation; either version 2 of the License, 
# or (at your option) any later version.
# 
# This program is distributed in the hope that it will be useful, 
# but WITHOUT ANY WARRANTY; without even the implied warranty of 
# MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. 
# See the GNU General Public License for more details.
# 
# You should have received a copy of the GNU General Public License 
# along with this program; if not, see <http://www.gnu.org/licenses/>.
use strict;
use warnings;
use Audio::Wav;
use Audio::Wav::Read;

#usage: audio-duration.pl path-or-file1 path-or-file2 ...

my @files;
for my $arg (@ARGV) {
    my $findresult = `find $arg`;
    push @files, grep /.wav$/, split " ", $findresult;
}
#print join " ", @files;
my $duration = 0.0;
my $wav = new Audio::Wav;
for my $file (@files) {
    my $read = $wav->read($file);
    $duration += $read->length_seconds();
}
# convert to something readable
my $readableDuration = "";
if ($duration > 600) {
    my $seconds = int($duration + .5);
    my $minutes = int($duration / 60);
    $seconds -= $minutes * 60;
    my $hours = int($minutes / 60);
    $minutes -= $hours * 60;
    $readableDuration = "(" . ($hours > 0 ? "$hours:" : "") . "$minutes'$seconds") ";
}
print "$duration seconds ", $readableDuration, "in ", ($#files + 1), " wave files.n";

Running this in any directory wil yield the duration of audio (only .wav files) of all the files in this directory. If you supply arguments, it will look into the given directories (or files) and tell you the summed duration.

A must-have for any corpus-linguist dealing with loads of audio files!

Update

Sun, 11 Oct 2009 19:40:57 GMT

I've been back from Stockholm for a while now, gone to Interspeech, SIGdial and YRRSDS and am now back at work in Golm. I'm now again (professionally) centered around two things: Getting our next prototype of an incremental SDS up and running in the next few months and continue to work on my PhD thesis, which I hope to finish some time next year.

Great new Sphinx Extensions

Wed, 01 Jul 2009 09:09:47 GMT

I finally got around to package the pitch tracker and some of our incremental result filtering (which was the reason for me travelling to Boulder, USA) as add-ons for Sphinx. Find them on my website.

Here and there

Wed, 20 May 2009 08:43:05 GMT

I have safely arrived in Stockholm, where I will be visiting researcher at KTH's speech lab for the summer. Also, I will be travelling to NAACL-HLT 2009 in Boulder to present our paper and a smaller workshop in Bielefeld. Also, I will participate in Dialholmia as a student volunteer. Many chances to meet and greet!

Speed-Up Boot under Ubuntu with VMware

Fri, 30 Jan 2009 09:50:02 GMT

I still need Windows for one piece of software that I use occasionally. So, since I've moved to Ubuntu, I've been using VMware for this (as it was the only solution at that time).

My VMware stopped working under Hardy. Luckily, I never needed my Windows-App for half a year. In Intrepid, I was able to just install vmware from their webpage and it restored my windows session from a year ago. Probably a record-breaking uptime for windows...

So, yesterday I played around with bootchart and found out, that the VMware-services took 4 precious seconds of my (and my battery's) lifetime on every boot. Not really worth it, as I'm unlikely to use my Windows-App anytime soon. So, here's what I did:

remove the links in /etc/rc*.d/*vmware

as the first command in /usr/bin/vmplayer add:

gksu -D "Need root priviledges to start vmware services." /etc/init.d/vmware restart

Works like a charm.

Generic Minimum Edit Distance of lists in Perl

Tue, 20 Jan 2009 15:26:23 GMT

The title says it all: I am looking for a generic implementation that tells me the edit distance of two lists. The implementations on CPAN all seem to work on string-data. Which is OK for finding typos but makes WER calculation tedious.

So, I want a generic implementation that takes a comparator-function (as in sort {$a <=> $b} @list) and two lists and outputs the edit distance. Nice to have would be distance-weights and really nifty if the value of the comparator function (not only !=0 but how much lower or higher) was taken into account.

Luckily I don't need it now, so I don't have to write it. But it would be a great finger exercise for a Perl-in-NLP class.

EDIT: The obvious module Text::Levenshtein on CPAN actually *miscalculates* Levenshtein-distance for some input. Luckily I wondered what the 3 bugs in the module were about before I just happily used that code... So I ended up slightly modifying an implementation by Eli Bendersky, which already uses lists internally. So I left out the part about the comparator interface for now and just calculate standard WER, which is all I need right now.

no sound in praat with ubuntu (and USB sound)

Thu, 18 Dec 2008 11:11:04 GMT

If praat (on ubuntu) doesn't want to play any audio, it tells you to consult some Sound-HOWTO (which at least doesn't exist on ubuntu). Unfortunately, http://ubuntuforums.org/archive/index.php/t-64383.html is of little help (and doesn't allow posting anymore as its active phase has expired).

The solution for us was easy: We use an external USB sound card and have deactivated the mainboard sound. For some reason, the sound device is now called "/dev/dsp1" (and "/dev/audio1") and there is no "/dev/dsp" (nor "/dev/audio"). Adding symlinks from "/dev/dsp" to "/dev/dsp1" (and from "/dev/audio" to "/dev/audio1") fixed the problem. Hope this helps.

steps towards German ASR

Thu, 15 May 2008 17:48:19 GMT

Klotz hin Gnubbel

This is what I get with the current acoustic model and a LM that was even trained including the correct sentence (und füge es ein in den Bauch des Elephanten).

Even using only just the correct sentence as a grammar returns und füge es, instead of the complete sentence. The alignment shows, that es is supposedly spans the complete ein in den Bauch des.

I read that the current models are severely overtrained on one speaker, so I tried one of his utterances (de43-01, die Anwendung wird entwickelt) which is correctly understood if I use it as a grammar (effectively resulting in forced alignment) and which results in the beautiful phantasie wird entwickelt if I include this one sentence in the statistical LM as above.

Thus, the bad results are probably due to the bad acoustic model. I've already uploaded the PentoNamingCorpus to Voxforge, thus hopefully, acoustic models will improve eventually. But if bad comes to worse, we'll have to train based on KCoRS and Verbmobil...

sox in Ubuntu Hardy (8.04)

Fri, 25 Apr 2008 20:17:28 GMT

If you just upgraded your Ubuntu to 8.04 and use sox, then you may get the error "sox soxio: Failed reading `some.file': unknown file type `auto'"

In Hardy, all audio formats for sox have been refactored in separate packages libsox-fmt-XYZ. So, either install just the base formats from libsox-fmt-base or get all possible formats with libsox-fmt-all.

SRILM-Makefile for Ubuntu

Tue, 13 Nov 2007 13:42:16 GMT

copy this to common/

schaffe, schaffe

Wed, 10 Oct 2007 09:29:19 GMT

häusle baue

WekaTest

Tue, 11 Sep 2007 10:03:58 GMT

Beispiel zur Weka API