FFmpeg/doc/HOWTO-STREAM

The FFserver streaming HOWTO
----------------------------

Philip Gladstone <philip-ffserver@gladstonefamily.net>
Last updated: July 26, 2002

0. What is this HOWTO about?

This covers only the streaming aspects of ffserver / ffmpeg. All questions about
parameters for ffmpeg, codec questions, etc. are not covered here.

You should also read the ffserver.txt file in this directory. It contains
roughly the same information.

1. What can this do?

When properly configured and running, you can capture video and audio in real
time from a suitable capture card, and stream it out over the Internet to
either Windows Media Player or RealAudio player (with some restrictions).

It can also stream from files, though that is currently broken. Very often, a
web server can be used to serve up the files just as well.

2. What do I need?

I use Linux on a 900MHz Duron with a cheapo Bt848 based TV capture card. I'm
using stock linux 2.4.17 with the stock drivers. [Actually that isn't true,
I needed some special drivers from my motherboard based sound card.]

I understand that FreeBSD systems work just fine as well.

3. How do I make it work?

First, build the kit. It *really* helps to have installed LAME first. Then when
you run the ffserver ./configure, make sure that you have the --enable-mp3lame
flag turned on.

LAME is important as it allows streaming of audio to Windows Media Player. Don't
ask why the other audio types do not work.

As a simple test, just run the following two command lines:

./ffserver -f doc/ffserver.conf &
./ffmpeg http://localhost:8090/feed1.ffm

At this point you should be able to go to your windows machine and fire up
Windows Media Player (WMP). Go to Open URL and enter 

    http://<linuxbox>:8090/test.asf

You should see (after a short delay) video and hear audio. 

WARNING: trying to stream test1.mpg doesn't work with WMP as it tries to
transfer the entire file before starting to play.

4. What happens next?

You should edit the ffserver.conf file to suit your needs (in terms of 
frame rates etc). Then install ffserver and ffmpeg, write a script to start
them up, and off you go.

5. Troubleshooting

* I don't hear any audio, but video is fine

Maybe you didn't install LAME, or get your ./configure statement right. Check
the ffmpeg output to see if a line referring to mp3 is present. If not, then
your configuration was incorrect. If it is, then maybe your wiring is not
setup correctly. Maybe the sound card is not getting data from the right 
input source. Maybe you have a really awful audio interface (like I do)
that only captures in stereo and also requires that one channel be flipped. 
If you are one of these people, then export 'AUDIO_FLIP_LEFT=1' before 
starting ffmpeg.

* The audio and video loose sync after a while.

Yes, they do.

* After a long while, the video update rate goes way down in WMP.

Yes, it does. Who knows why?

* WMP 6.4 behaves differently to WMP 7.

Yes, it does. Any thoughts on this would be gratefully received. These
differences extend to embedding WMP into a web page. [There are two
different object ids that you can use, one of them -- the old one -- cannot
play very well, and the new one works well (both on the same system). However, 
I suspect that the new one is not available unless you have installed WMP 7].

6. What else can it do?

There seems to be a bunch of code that allows you to replay previous
video. I've never tried it, so it probably doesn't work properly. YMMV.
In fact, in order to get some level of stability, ffserver now deletes
all the previously sent video whenever it restarts.

You can fiddle with many of the codec choices and encoding parameters, and
there are a bunch more parameters that you cannot control. Post a message
to the mailing list if there are some 'must have' parameters. Look in the
ffserver.conf for a list of the currently available controls.

It will automatically generate the .ASX or .RAM files that are often used
in browsers. These files are actually redirections to the underlying .ASF
or .RM file. The reason for this is that the browser often fetches the
entire file before starting up the external viewer. The redirection files
are very small and can be transferred quickly. [The stream itself is
often 'infinite' and thus the browser tries to download it and never 
finishes.]

7. Tips

* When you connect to a live stream, most players (WMP, RA etc) want to
buffer a certain number of seconds of material so that they can display the
signal continuously. However, ffserver (by default) starts sending data
in real time. This means that there is a pause of a few seconds while the
buffering is being done by the player. The good news is that this can be
cured by adding a '?buffer=5' to the end of the URL. This says that the
stream should start 5 seconds in the past -- and so the first 5 seconds 
of the stream is sent as fast as the network will allow. It will then
slow down to real time. This noticeably improves the startup experience.

You can also add a 'Preroll 15' statement into the ffserver.conf that will
add the 15 second prebuffering on all requests that do not otherwise
specify a time. In addition, ffserver will skip frames until a key_frame
is found. This further reduces the startup delay by not transferring data
that will be discarded.

* You may want to adjust the MaxBandwidth in the ffserver.conf to limit
the amount of bandwidth consumed by live streams.

8. Why does the ?buffer / Preroll stop working after a time?

It turns out that (on my machine at least) the number of frames successfully
grabbed is marginally less than the number that ought to be grabbed. This
means that the timestamp in the encoded data stream gets behind real time.
This means that if you say 'preroll 10', then when the stream gets 10
or more seconds behind, there is no preroll left.

Fixing this requires a require in the internals in how timestampts are 
handled.

9. Does the ?date= stuff work.

Yes (subject to the caution above). Also note that whenever you start
ffserver, it deletes the ffm file, thus wiping out what you had recorded
before. This behaviour is a temporary fix to various crashes. The aim is
to fix it so that the old data is saved if possible.

The format of the ?date=xxxxxx is fairly flexible. You should use one
of the following formats (the 'T' is literal):

* YYYY-MM-DDTHH:MM:SS     (localtime)
* YYYY-MM-DDTHH:MM:SSZ    (UTC)

You can omit the YYYY-MM-DD, and then it refers to the current day. However 
note that ?date=16:00:00  refers to 4PM on the current day -- this may be
in the future and so unlikely to useful.

You use this by adding the ?date= to the end of the URL for the stream.
For example:   http://localhost:8080/test.asf?date=2002-07-26T23:05:00